00:00:00.001 Started by upstream project "autotest-nightly-lts" build number 2416 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3677 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.155 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.156 The recommended git tool is: git 00:00:00.156 using credential 00000000-0000-0000-0000-000000000002 00:00:00.158 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.200 Fetching changes from the remote Git repository 00:00:00.204 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.233 Using shallow fetch with depth 1 00:00:00.233 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.233 > git --version # timeout=10 00:00:00.263 > git --version # 'git version 2.39.2' 00:00:00.263 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.283 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.283 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:07.015 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:07.025 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:07.037 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:07.037 > git config core.sparsecheckout # timeout=10 00:00:07.050 > git read-tree -mu HEAD # timeout=10 00:00:07.069 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:07.096 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:07.096 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:07.198 [Pipeline] Start of Pipeline 00:00:07.210 [Pipeline] library 00:00:07.212 Loading library shm_lib@master 00:00:07.212 Library shm_lib@master is cached. Copying from home. 00:00:07.229 [Pipeline] node 00:00:07.238 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:07.239 [Pipeline] { 00:00:07.249 [Pipeline] catchError 00:00:07.250 [Pipeline] { 00:00:07.261 [Pipeline] wrap 00:00:07.268 [Pipeline] { 00:00:07.277 [Pipeline] stage 00:00:07.279 [Pipeline] { (Prologue) 00:00:07.488 [Pipeline] sh 00:00:07.769 + logger -p user.info -t JENKINS-CI 00:00:07.784 [Pipeline] echo 00:00:07.786 Node: GP11 00:00:07.795 [Pipeline] sh 00:00:08.088 [Pipeline] setCustomBuildProperty 00:00:08.097 [Pipeline] echo 00:00:08.098 Cleanup processes 00:00:08.103 [Pipeline] sh 00:00:08.378 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:08.378 4111648 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:08.391 [Pipeline] sh 00:00:08.669 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:08.669 ++ grep -v 'sudo pgrep' 00:00:08.669 ++ awk '{print $1}' 00:00:08.669 + sudo kill -9 00:00:08.669 + true 00:00:08.686 [Pipeline] cleanWs 00:00:08.697 [WS-CLEANUP] Deleting project workspace... 00:00:08.698 [WS-CLEANUP] Deferred wipeout is used... 00:00:08.704 [WS-CLEANUP] done 00:00:08.709 [Pipeline] setCustomBuildProperty 00:00:08.726 [Pipeline] sh 00:00:09.004 + sudo git config --global --replace-all safe.directory '*' 00:00:09.109 [Pipeline] httpRequest 00:00:09.486 [Pipeline] echo 00:00:09.488 Sorcerer 10.211.164.20 is alive 00:00:09.500 [Pipeline] retry 00:00:09.503 [Pipeline] { 00:00:09.519 [Pipeline] httpRequest 00:00:09.524 HttpMethod: GET 00:00:09.524 URL: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:09.525 Sending request to url: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:09.546 Response Code: HTTP/1.1 200 OK 00:00:09.547 Success: Status code 200 is in the accepted range: 200,404 00:00:09.547 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:18.436 [Pipeline] } 00:00:18.454 [Pipeline] // retry 00:00:18.462 [Pipeline] sh 00:00:18.744 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:18.760 [Pipeline] httpRequest 00:00:19.146 [Pipeline] echo 00:00:19.148 Sorcerer 10.211.164.20 is alive 00:00:19.156 [Pipeline] retry 00:00:19.158 [Pipeline] { 00:00:19.171 [Pipeline] httpRequest 00:00:19.175 HttpMethod: GET 00:00:19.175 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:19.175 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:19.192 Response Code: HTTP/1.1 200 OK 00:00:19.193 Success: Status code 200 is in the accepted range: 200,404 00:00:19.193 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:08.918 [Pipeline] } 00:01:08.932 [Pipeline] // retry 00:01:08.938 [Pipeline] sh 00:01:09.217 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:11.756 [Pipeline] sh 00:01:12.032 + git -C spdk log --oneline -n5 00:01:12.033 c13c99a5e test: Various fixes for Fedora40 00:01:12.033 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:12.033 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:12.033 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:12.033 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:12.043 [Pipeline] } 00:01:12.058 [Pipeline] // stage 00:01:12.069 [Pipeline] stage 00:01:12.071 [Pipeline] { (Prepare) 00:01:12.092 [Pipeline] writeFile 00:01:12.111 [Pipeline] sh 00:01:12.395 + logger -p user.info -t JENKINS-CI 00:01:12.406 [Pipeline] sh 00:01:12.685 + logger -p user.info -t JENKINS-CI 00:01:12.697 [Pipeline] sh 00:01:12.977 + cat autorun-spdk.conf 00:01:12.977 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:12.977 SPDK_TEST_NVMF=1 00:01:12.977 SPDK_TEST_NVME_CLI=1 00:01:12.977 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:12.977 SPDK_TEST_NVMF_NICS=e810 00:01:12.977 SPDK_RUN_UBSAN=1 00:01:12.977 NET_TYPE=phy 00:01:12.984 RUN_NIGHTLY=1 00:01:12.989 [Pipeline] readFile 00:01:13.014 [Pipeline] withEnv 00:01:13.017 [Pipeline] { 00:01:13.030 [Pipeline] sh 00:01:13.311 + set -ex 00:01:13.311 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:13.311 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:13.311 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:13.311 ++ SPDK_TEST_NVMF=1 00:01:13.311 ++ SPDK_TEST_NVME_CLI=1 00:01:13.311 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:13.311 ++ SPDK_TEST_NVMF_NICS=e810 00:01:13.311 ++ SPDK_RUN_UBSAN=1 00:01:13.311 ++ NET_TYPE=phy 00:01:13.311 ++ RUN_NIGHTLY=1 00:01:13.311 + case $SPDK_TEST_NVMF_NICS in 00:01:13.311 + DRIVERS=ice 00:01:13.311 + [[ tcp == \r\d\m\a ]] 00:01:13.311 + [[ -n ice ]] 00:01:13.311 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:13.311 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:13.311 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:13.311 rmmod: ERROR: Module irdma is not currently loaded 00:01:13.311 rmmod: ERROR: Module i40iw is not currently loaded 00:01:13.311 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:13.311 + true 00:01:13.311 + for D in $DRIVERS 00:01:13.311 + sudo modprobe ice 00:01:13.311 + exit 0 00:01:13.320 [Pipeline] } 00:01:13.336 [Pipeline] // withEnv 00:01:13.341 [Pipeline] } 00:01:13.355 [Pipeline] // stage 00:01:13.366 [Pipeline] catchError 00:01:13.368 [Pipeline] { 00:01:13.383 [Pipeline] timeout 00:01:13.383 Timeout set to expire in 1 hr 0 min 00:01:13.385 [Pipeline] { 00:01:13.399 [Pipeline] stage 00:01:13.401 [Pipeline] { (Tests) 00:01:13.416 [Pipeline] sh 00:01:13.696 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:13.696 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:13.696 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:13.696 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:13.696 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:13.696 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:13.696 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:13.696 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:13.696 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:13.696 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:13.696 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:13.696 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:13.696 + source /etc/os-release 00:01:13.696 ++ NAME='Fedora Linux' 00:01:13.696 ++ VERSION='39 (Cloud Edition)' 00:01:13.696 ++ ID=fedora 00:01:13.696 ++ VERSION_ID=39 00:01:13.696 ++ VERSION_CODENAME= 00:01:13.696 ++ PLATFORM_ID=platform:f39 00:01:13.696 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:13.696 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:13.696 ++ LOGO=fedora-logo-icon 00:01:13.696 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:13.696 ++ HOME_URL=https://fedoraproject.org/ 00:01:13.696 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:13.696 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:13.696 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:13.696 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:13.696 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:13.696 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:13.696 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:13.696 ++ SUPPORT_END=2024-11-12 00:01:13.696 ++ VARIANT='Cloud Edition' 00:01:13.696 ++ VARIANT_ID=cloud 00:01:13.696 + uname -a 00:01:13.696 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:13.696 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:14.626 Hugepages 00:01:14.626 node hugesize free / total 00:01:14.626 node0 1048576kB 0 / 0 00:01:14.626 node0 2048kB 0 / 0 00:01:14.626 node1 1048576kB 0 / 0 00:01:14.626 node1 2048kB 0 / 0 00:01:14.626 00:01:14.626 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:14.626 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:14.626 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:14.626 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:14.627 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:14.627 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:14.627 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:14.627 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:14.627 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:14.627 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:14.627 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:14.627 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:14.885 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:14.885 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:14.885 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:14.885 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:14.885 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:14.885 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:14.885 + rm -f /tmp/spdk-ld-path 00:01:14.885 + source autorun-spdk.conf 00:01:14.885 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:14.885 ++ SPDK_TEST_NVMF=1 00:01:14.885 ++ SPDK_TEST_NVME_CLI=1 00:01:14.885 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:14.885 ++ SPDK_TEST_NVMF_NICS=e810 00:01:14.885 ++ SPDK_RUN_UBSAN=1 00:01:14.885 ++ NET_TYPE=phy 00:01:14.885 ++ RUN_NIGHTLY=1 00:01:14.885 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:14.885 + [[ -n '' ]] 00:01:14.885 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:14.885 + for M in /var/spdk/build-*-manifest.txt 00:01:14.885 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:14.885 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:14.885 + for M in /var/spdk/build-*-manifest.txt 00:01:14.885 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:14.885 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:14.885 + for M in /var/spdk/build-*-manifest.txt 00:01:14.885 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:14.885 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:14.885 ++ uname 00:01:14.885 + [[ Linux == \L\i\n\u\x ]] 00:01:14.885 + sudo dmesg -T 00:01:14.885 + sudo dmesg --clear 00:01:14.885 + dmesg_pid=4112935 00:01:14.885 + [[ Fedora Linux == FreeBSD ]] 00:01:14.885 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:14.885 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:14.885 + sudo dmesg -Tw 00:01:14.885 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:14.885 + [[ -x /usr/src/fio-static/fio ]] 00:01:14.885 + export FIO_BIN=/usr/src/fio-static/fio 00:01:14.885 + FIO_BIN=/usr/src/fio-static/fio 00:01:14.885 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:14.885 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:14.885 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:14.885 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:14.885 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:14.885 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:14.885 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:14.885 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:14.885 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:14.885 Test configuration: 00:01:14.885 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:14.885 SPDK_TEST_NVMF=1 00:01:14.885 SPDK_TEST_NVME_CLI=1 00:01:14.885 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:14.885 SPDK_TEST_NVMF_NICS=e810 00:01:14.885 SPDK_RUN_UBSAN=1 00:01:14.885 NET_TYPE=phy 00:01:14.885 RUN_NIGHTLY=1 02:06:18 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:14.885 02:06:18 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:14.885 02:06:18 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:14.885 02:06:18 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:14.885 02:06:18 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:14.885 02:06:18 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:14.885 02:06:18 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:14.885 02:06:18 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:14.885 02:06:18 -- paths/export.sh@5 -- $ export PATH 00:01:14.885 02:06:18 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:14.885 02:06:18 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:14.885 02:06:18 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:14.885 02:06:18 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732842378.XXXXXX 00:01:14.885 02:06:18 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732842378.U89CTm 00:01:14.885 02:06:18 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:14.885 02:06:18 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:01:14.885 02:06:18 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:01:14.885 02:06:18 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:14.885 02:06:18 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:14.885 02:06:18 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:14.885 02:06:18 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:14.885 02:06:18 -- common/autotest_common.sh@10 -- $ set +x 00:01:14.885 02:06:18 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:01:14.885 02:06:18 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:14.886 02:06:18 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:14.886 02:06:18 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:14.886 02:06:18 -- spdk/autobuild.sh@16 -- $ date -u 00:01:14.886 Fri Nov 29 01:06:18 AM UTC 2024 00:01:14.886 02:06:18 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:14.886 LTS-67-gc13c99a5e 00:01:14.886 02:06:18 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:14.886 02:06:18 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:14.886 02:06:18 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:14.886 02:06:18 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:14.886 02:06:18 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:14.886 02:06:18 -- common/autotest_common.sh@10 -- $ set +x 00:01:14.886 ************************************ 00:01:14.886 START TEST ubsan 00:01:14.886 ************************************ 00:01:14.886 02:06:18 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:14.886 using ubsan 00:01:14.886 00:01:14.886 real 0m0.000s 00:01:14.886 user 0m0.000s 00:01:14.886 sys 0m0.000s 00:01:14.886 02:06:18 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:14.886 02:06:18 -- common/autotest_common.sh@10 -- $ set +x 00:01:14.886 ************************************ 00:01:14.886 END TEST ubsan 00:01:14.886 ************************************ 00:01:15.142 02:06:18 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:01:15.143 02:06:18 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:01:15.143 02:06:18 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:01:15.143 02:06:18 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:01:15.143 02:06:18 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:01:15.143 02:06:18 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:01:15.143 02:06:18 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:01:15.143 02:06:18 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:01:15.143 02:06:18 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:01:15.143 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:01:15.143 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:15.400 Using 'verbs' RDMA provider 00:01:25.628 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:01:35.603 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:01:35.603 Creating mk/config.mk...done. 00:01:35.603 Creating mk/cc.flags.mk...done. 00:01:35.603 Type 'make' to build. 00:01:35.603 02:06:38 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:01:35.603 02:06:38 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:35.603 02:06:38 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:35.603 02:06:38 -- common/autotest_common.sh@10 -- $ set +x 00:01:35.603 ************************************ 00:01:35.603 START TEST make 00:01:35.603 ************************************ 00:01:35.603 02:06:38 -- common/autotest_common.sh@1114 -- $ make -j48 00:01:35.603 make[1]: Nothing to be done for 'all'. 00:01:43.801 The Meson build system 00:01:43.801 Version: 1.5.0 00:01:43.801 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:01:43.801 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:01:43.801 Build type: native build 00:01:43.801 Program cat found: YES (/usr/bin/cat) 00:01:43.801 Project name: DPDK 00:01:43.801 Project version: 23.11.0 00:01:43.801 C compiler for the host machine: cc (gcc 13.3.1 "cc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:43.801 C linker for the host machine: cc ld.bfd 2.40-14 00:01:43.801 Host machine cpu family: x86_64 00:01:43.801 Host machine cpu: x86_64 00:01:43.801 Message: ## Building in Developer Mode ## 00:01:43.801 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:43.801 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:43.801 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:43.801 Program python3 found: YES (/usr/bin/python3) 00:01:43.801 Program cat found: YES (/usr/bin/cat) 00:01:43.801 Compiler for C supports arguments -march=native: YES 00:01:43.801 Checking for size of "void *" : 8 00:01:43.801 Checking for size of "void *" : 8 (cached) 00:01:43.801 Library m found: YES 00:01:43.801 Library numa found: YES 00:01:43.801 Has header "numaif.h" : YES 00:01:43.801 Library fdt found: NO 00:01:43.801 Library execinfo found: NO 00:01:43.801 Has header "execinfo.h" : YES 00:01:43.801 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:43.801 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:43.801 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:43.801 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:43.801 Run-time dependency openssl found: YES 3.1.1 00:01:43.801 Run-time dependency libpcap found: YES 1.10.4 00:01:43.801 Has header "pcap.h" with dependency libpcap: YES 00:01:43.801 Compiler for C supports arguments -Wcast-qual: YES 00:01:43.801 Compiler for C supports arguments -Wdeprecated: YES 00:01:43.801 Compiler for C supports arguments -Wformat: YES 00:01:43.801 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:43.801 Compiler for C supports arguments -Wformat-security: NO 00:01:43.801 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:43.801 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:43.801 Compiler for C supports arguments -Wnested-externs: YES 00:01:43.801 Compiler for C supports arguments -Wold-style-definition: YES 00:01:43.801 Compiler for C supports arguments -Wpointer-arith: YES 00:01:43.801 Compiler for C supports arguments -Wsign-compare: YES 00:01:43.801 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:43.801 Compiler for C supports arguments -Wundef: YES 00:01:43.801 Compiler for C supports arguments -Wwrite-strings: YES 00:01:43.801 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:43.801 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:43.801 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:43.801 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:43.801 Program objdump found: YES (/usr/bin/objdump) 00:01:43.801 Compiler for C supports arguments -mavx512f: YES 00:01:43.801 Checking if "AVX512 checking" compiles: YES 00:01:43.801 Fetching value of define "__SSE4_2__" : 1 00:01:43.802 Fetching value of define "__AES__" : 1 00:01:43.802 Fetching value of define "__AVX__" : 1 00:01:43.802 Fetching value of define "__AVX2__" : (undefined) 00:01:43.802 Fetching value of define "__AVX512BW__" : (undefined) 00:01:43.802 Fetching value of define "__AVX512CD__" : (undefined) 00:01:43.802 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:43.802 Fetching value of define "__AVX512F__" : (undefined) 00:01:43.802 Fetching value of define "__AVX512VL__" : (undefined) 00:01:43.802 Fetching value of define "__PCLMUL__" : 1 00:01:43.802 Fetching value of define "__RDRND__" : 1 00:01:43.802 Fetching value of define "__RDSEED__" : (undefined) 00:01:43.802 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:43.802 Fetching value of define "__znver1__" : (undefined) 00:01:43.802 Fetching value of define "__znver2__" : (undefined) 00:01:43.802 Fetching value of define "__znver3__" : (undefined) 00:01:43.802 Fetching value of define "__znver4__" : (undefined) 00:01:43.802 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:43.802 Message: lib/log: Defining dependency "log" 00:01:43.802 Message: lib/kvargs: Defining dependency "kvargs" 00:01:43.802 Message: lib/telemetry: Defining dependency "telemetry" 00:01:43.802 Checking for function "getentropy" : NO 00:01:43.802 Message: lib/eal: Defining dependency "eal" 00:01:43.802 Message: lib/ring: Defining dependency "ring" 00:01:43.802 Message: lib/rcu: Defining dependency "rcu" 00:01:43.802 Message: lib/mempool: Defining dependency "mempool" 00:01:43.802 Message: lib/mbuf: Defining dependency "mbuf" 00:01:43.802 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:43.802 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:43.802 Compiler for C supports arguments -mpclmul: YES 00:01:43.802 Compiler for C supports arguments -maes: YES 00:01:43.802 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:43.802 Compiler for C supports arguments -mavx512bw: YES 00:01:43.802 Compiler for C supports arguments -mavx512dq: YES 00:01:43.802 Compiler for C supports arguments -mavx512vl: YES 00:01:43.802 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:43.802 Compiler for C supports arguments -mavx2: YES 00:01:43.802 Compiler for C supports arguments -mavx: YES 00:01:43.802 Message: lib/net: Defining dependency "net" 00:01:43.802 Message: lib/meter: Defining dependency "meter" 00:01:43.802 Message: lib/ethdev: Defining dependency "ethdev" 00:01:43.802 Message: lib/pci: Defining dependency "pci" 00:01:43.802 Message: lib/cmdline: Defining dependency "cmdline" 00:01:43.802 Message: lib/hash: Defining dependency "hash" 00:01:43.802 Message: lib/timer: Defining dependency "timer" 00:01:43.802 Message: lib/compressdev: Defining dependency "compressdev" 00:01:43.802 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:43.802 Message: lib/dmadev: Defining dependency "dmadev" 00:01:43.802 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:43.802 Message: lib/power: Defining dependency "power" 00:01:43.802 Message: lib/reorder: Defining dependency "reorder" 00:01:43.802 Message: lib/security: Defining dependency "security" 00:01:43.802 Has header "linux/userfaultfd.h" : YES 00:01:43.802 Has header "linux/vduse.h" : YES 00:01:43.802 Message: lib/vhost: Defining dependency "vhost" 00:01:43.802 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:43.802 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:43.802 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:43.802 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:43.802 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:43.802 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:43.802 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:43.802 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:43.802 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:43.802 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:43.802 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:43.802 Configuring doxy-api-html.conf using configuration 00:01:43.802 Configuring doxy-api-man.conf using configuration 00:01:43.802 Program mandb found: YES (/usr/bin/mandb) 00:01:43.802 Program sphinx-build found: NO 00:01:43.802 Configuring rte_build_config.h using configuration 00:01:43.802 Message: 00:01:43.802 ================= 00:01:43.802 Applications Enabled 00:01:43.802 ================= 00:01:43.802 00:01:43.802 apps: 00:01:43.802 00:01:43.802 00:01:43.802 Message: 00:01:43.802 ================= 00:01:43.802 Libraries Enabled 00:01:43.802 ================= 00:01:43.802 00:01:43.802 libs: 00:01:43.802 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:43.802 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:43.802 cryptodev, dmadev, power, reorder, security, vhost, 00:01:43.802 00:01:43.802 Message: 00:01:43.802 =============== 00:01:43.802 Drivers Enabled 00:01:43.802 =============== 00:01:43.802 00:01:43.802 common: 00:01:43.802 00:01:43.802 bus: 00:01:43.802 pci, vdev, 00:01:43.802 mempool: 00:01:43.802 ring, 00:01:43.802 dma: 00:01:43.802 00:01:43.802 net: 00:01:43.802 00:01:43.802 crypto: 00:01:43.802 00:01:43.802 compress: 00:01:43.802 00:01:43.802 vdpa: 00:01:43.802 00:01:43.802 00:01:43.802 Message: 00:01:43.802 ================= 00:01:43.802 Content Skipped 00:01:43.802 ================= 00:01:43.802 00:01:43.802 apps: 00:01:43.802 dumpcap: explicitly disabled via build config 00:01:43.802 graph: explicitly disabled via build config 00:01:43.802 pdump: explicitly disabled via build config 00:01:43.802 proc-info: explicitly disabled via build config 00:01:43.802 test-acl: explicitly disabled via build config 00:01:43.802 test-bbdev: explicitly disabled via build config 00:01:43.802 test-cmdline: explicitly disabled via build config 00:01:43.802 test-compress-perf: explicitly disabled via build config 00:01:43.802 test-crypto-perf: explicitly disabled via build config 00:01:43.802 test-dma-perf: explicitly disabled via build config 00:01:43.802 test-eventdev: explicitly disabled via build config 00:01:43.802 test-fib: explicitly disabled via build config 00:01:43.802 test-flow-perf: explicitly disabled via build config 00:01:43.802 test-gpudev: explicitly disabled via build config 00:01:43.802 test-mldev: explicitly disabled via build config 00:01:43.802 test-pipeline: explicitly disabled via build config 00:01:43.802 test-pmd: explicitly disabled via build config 00:01:43.802 test-regex: explicitly disabled via build config 00:01:43.802 test-sad: explicitly disabled via build config 00:01:43.802 test-security-perf: explicitly disabled via build config 00:01:43.802 00:01:43.802 libs: 00:01:43.802 metrics: explicitly disabled via build config 00:01:43.802 acl: explicitly disabled via build config 00:01:43.802 bbdev: explicitly disabled via build config 00:01:43.802 bitratestats: explicitly disabled via build config 00:01:43.802 bpf: explicitly disabled via build config 00:01:43.802 cfgfile: explicitly disabled via build config 00:01:43.802 distributor: explicitly disabled via build config 00:01:43.802 efd: explicitly disabled via build config 00:01:43.802 eventdev: explicitly disabled via build config 00:01:43.802 dispatcher: explicitly disabled via build config 00:01:43.802 gpudev: explicitly disabled via build config 00:01:43.802 gro: explicitly disabled via build config 00:01:43.802 gso: explicitly disabled via build config 00:01:43.802 ip_frag: explicitly disabled via build config 00:01:43.802 jobstats: explicitly disabled via build config 00:01:43.802 latencystats: explicitly disabled via build config 00:01:43.802 lpm: explicitly disabled via build config 00:01:43.802 member: explicitly disabled via build config 00:01:43.802 pcapng: explicitly disabled via build config 00:01:43.802 rawdev: explicitly disabled via build config 00:01:43.802 regexdev: explicitly disabled via build config 00:01:43.802 mldev: explicitly disabled via build config 00:01:43.802 rib: explicitly disabled via build config 00:01:43.802 sched: explicitly disabled via build config 00:01:43.802 stack: explicitly disabled via build config 00:01:43.802 ipsec: explicitly disabled via build config 00:01:43.802 pdcp: explicitly disabled via build config 00:01:43.802 fib: explicitly disabled via build config 00:01:43.802 port: explicitly disabled via build config 00:01:43.802 pdump: explicitly disabled via build config 00:01:43.802 table: explicitly disabled via build config 00:01:43.802 pipeline: explicitly disabled via build config 00:01:43.802 graph: explicitly disabled via build config 00:01:43.802 node: explicitly disabled via build config 00:01:43.802 00:01:43.802 drivers: 00:01:43.802 common/cpt: not in enabled drivers build config 00:01:43.802 common/dpaax: not in enabled drivers build config 00:01:43.802 common/iavf: not in enabled drivers build config 00:01:43.802 common/idpf: not in enabled drivers build config 00:01:43.802 common/mvep: not in enabled drivers build config 00:01:43.802 common/octeontx: not in enabled drivers build config 00:01:43.802 bus/auxiliary: not in enabled drivers build config 00:01:43.802 bus/cdx: not in enabled drivers build config 00:01:43.802 bus/dpaa: not in enabled drivers build config 00:01:43.802 bus/fslmc: not in enabled drivers build config 00:01:43.802 bus/ifpga: not in enabled drivers build config 00:01:43.802 bus/platform: not in enabled drivers build config 00:01:43.802 bus/vmbus: not in enabled drivers build config 00:01:43.802 common/cnxk: not in enabled drivers build config 00:01:43.802 common/mlx5: not in enabled drivers build config 00:01:43.802 common/nfp: not in enabled drivers build config 00:01:43.802 common/qat: not in enabled drivers build config 00:01:43.802 common/sfc_efx: not in enabled drivers build config 00:01:43.802 mempool/bucket: not in enabled drivers build config 00:01:43.802 mempool/cnxk: not in enabled drivers build config 00:01:43.802 mempool/dpaa: not in enabled drivers build config 00:01:43.802 mempool/dpaa2: not in enabled drivers build config 00:01:43.802 mempool/octeontx: not in enabled drivers build config 00:01:43.802 mempool/stack: not in enabled drivers build config 00:01:43.802 dma/cnxk: not in enabled drivers build config 00:01:43.802 dma/dpaa: not in enabled drivers build config 00:01:43.802 dma/dpaa2: not in enabled drivers build config 00:01:43.802 dma/hisilicon: not in enabled drivers build config 00:01:43.802 dma/idxd: not in enabled drivers build config 00:01:43.803 dma/ioat: not in enabled drivers build config 00:01:43.803 dma/skeleton: not in enabled drivers build config 00:01:43.803 net/af_packet: not in enabled drivers build config 00:01:43.803 net/af_xdp: not in enabled drivers build config 00:01:43.803 net/ark: not in enabled drivers build config 00:01:43.803 net/atlantic: not in enabled drivers build config 00:01:43.803 net/avp: not in enabled drivers build config 00:01:43.803 net/axgbe: not in enabled drivers build config 00:01:43.803 net/bnx2x: not in enabled drivers build config 00:01:43.803 net/bnxt: not in enabled drivers build config 00:01:43.803 net/bonding: not in enabled drivers build config 00:01:43.803 net/cnxk: not in enabled drivers build config 00:01:43.803 net/cpfl: not in enabled drivers build config 00:01:43.803 net/cxgbe: not in enabled drivers build config 00:01:43.803 net/dpaa: not in enabled drivers build config 00:01:43.803 net/dpaa2: not in enabled drivers build config 00:01:43.803 net/e1000: not in enabled drivers build config 00:01:43.803 net/ena: not in enabled drivers build config 00:01:43.803 net/enetc: not in enabled drivers build config 00:01:43.803 net/enetfec: not in enabled drivers build config 00:01:43.803 net/enic: not in enabled drivers build config 00:01:43.803 net/failsafe: not in enabled drivers build config 00:01:43.803 net/fm10k: not in enabled drivers build config 00:01:43.803 net/gve: not in enabled drivers build config 00:01:43.803 net/hinic: not in enabled drivers build config 00:01:43.803 net/hns3: not in enabled drivers build config 00:01:43.803 net/i40e: not in enabled drivers build config 00:01:43.803 net/iavf: not in enabled drivers build config 00:01:43.803 net/ice: not in enabled drivers build config 00:01:43.803 net/idpf: not in enabled drivers build config 00:01:43.803 net/igc: not in enabled drivers build config 00:01:43.803 net/ionic: not in enabled drivers build config 00:01:43.803 net/ipn3ke: not in enabled drivers build config 00:01:43.803 net/ixgbe: not in enabled drivers build config 00:01:43.803 net/mana: not in enabled drivers build config 00:01:43.803 net/memif: not in enabled drivers build config 00:01:43.803 net/mlx4: not in enabled drivers build config 00:01:43.803 net/mlx5: not in enabled drivers build config 00:01:43.803 net/mvneta: not in enabled drivers build config 00:01:43.803 net/mvpp2: not in enabled drivers build config 00:01:43.803 net/netvsc: not in enabled drivers build config 00:01:43.803 net/nfb: not in enabled drivers build config 00:01:43.803 net/nfp: not in enabled drivers build config 00:01:43.803 net/ngbe: not in enabled drivers build config 00:01:43.803 net/null: not in enabled drivers build config 00:01:43.803 net/octeontx: not in enabled drivers build config 00:01:43.803 net/octeon_ep: not in enabled drivers build config 00:01:43.803 net/pcap: not in enabled drivers build config 00:01:43.803 net/pfe: not in enabled drivers build config 00:01:43.803 net/qede: not in enabled drivers build config 00:01:43.803 net/ring: not in enabled drivers build config 00:01:43.803 net/sfc: not in enabled drivers build config 00:01:43.803 net/softnic: not in enabled drivers build config 00:01:43.803 net/tap: not in enabled drivers build config 00:01:43.803 net/thunderx: not in enabled drivers build config 00:01:43.803 net/txgbe: not in enabled drivers build config 00:01:43.803 net/vdev_netvsc: not in enabled drivers build config 00:01:43.803 net/vhost: not in enabled drivers build config 00:01:43.803 net/virtio: not in enabled drivers build config 00:01:43.803 net/vmxnet3: not in enabled drivers build config 00:01:43.803 raw/*: missing internal dependency, "rawdev" 00:01:43.803 crypto/armv8: not in enabled drivers build config 00:01:43.803 crypto/bcmfs: not in enabled drivers build config 00:01:43.803 crypto/caam_jr: not in enabled drivers build config 00:01:43.803 crypto/ccp: not in enabled drivers build config 00:01:43.803 crypto/cnxk: not in enabled drivers build config 00:01:43.803 crypto/dpaa_sec: not in enabled drivers build config 00:01:43.803 crypto/dpaa2_sec: not in enabled drivers build config 00:01:43.803 crypto/ipsec_mb: not in enabled drivers build config 00:01:43.803 crypto/mlx5: not in enabled drivers build config 00:01:43.803 crypto/mvsam: not in enabled drivers build config 00:01:43.803 crypto/nitrox: not in enabled drivers build config 00:01:43.803 crypto/null: not in enabled drivers build config 00:01:43.803 crypto/octeontx: not in enabled drivers build config 00:01:43.803 crypto/openssl: not in enabled drivers build config 00:01:43.803 crypto/scheduler: not in enabled drivers build config 00:01:43.803 crypto/uadk: not in enabled drivers build config 00:01:43.803 crypto/virtio: not in enabled drivers build config 00:01:43.803 compress/isal: not in enabled drivers build config 00:01:43.803 compress/mlx5: not in enabled drivers build config 00:01:43.803 compress/octeontx: not in enabled drivers build config 00:01:43.803 compress/zlib: not in enabled drivers build config 00:01:43.803 regex/*: missing internal dependency, "regexdev" 00:01:43.803 ml/*: missing internal dependency, "mldev" 00:01:43.803 vdpa/ifc: not in enabled drivers build config 00:01:43.803 vdpa/mlx5: not in enabled drivers build config 00:01:43.803 vdpa/nfp: not in enabled drivers build config 00:01:43.803 vdpa/sfc: not in enabled drivers build config 00:01:43.803 event/*: missing internal dependency, "eventdev" 00:01:43.803 baseband/*: missing internal dependency, "bbdev" 00:01:43.803 gpu/*: missing internal dependency, "gpudev" 00:01:43.803 00:01:43.803 00:01:43.803 Build targets in project: 85 00:01:43.803 00:01:43.803 DPDK 23.11.0 00:01:43.803 00:01:43.803 User defined options 00:01:43.803 buildtype : debug 00:01:43.803 default_library : shared 00:01:43.803 libdir : lib 00:01:43.803 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:43.803 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:01:43.803 c_link_args : 00:01:43.803 cpu_instruction_set: native 00:01:43.803 disable_apps : test-sad,test-acl,test-dma-perf,test-pipeline,test-compress-perf,test-fib,test-flow-perf,test-crypto-perf,test-bbdev,test-eventdev,pdump,test-mldev,test-cmdline,graph,test-security-perf,test-pmd,test,proc-info,test-regex,dumpcap,test-gpudev 00:01:43.803 disable_libs : port,sched,rib,node,ipsec,distributor,gro,eventdev,pdcp,acl,member,latencystats,efd,stack,regexdev,rawdev,bpf,metrics,gpudev,pipeline,pdump,table,fib,dispatcher,mldev,gso,cfgfile,bitratestats,ip_frag,graph,lpm,jobstats,pcapng,bbdev 00:01:43.803 enable_docs : false 00:01:43.803 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:43.803 enable_kmods : false 00:01:43.803 tests : false 00:01:43.803 00:01:43.803 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:44.373 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:01:44.373 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:44.373 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:44.373 [3/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:44.373 [4/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:44.373 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:44.373 [6/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:44.373 [7/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:44.373 [8/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:44.635 [9/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:44.635 [10/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:44.635 [11/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:44.635 [12/265] Linking static target lib/librte_kvargs.a 00:01:44.635 [13/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:44.635 [14/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:44.635 [15/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:44.635 [16/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:44.635 [17/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:44.635 [18/265] Linking static target lib/librte_log.a 00:01:44.635 [19/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:44.635 [20/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:44.635 [21/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:45.205 [22/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.205 [23/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:45.205 [24/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:45.205 [25/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:45.466 [26/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:45.466 [27/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:45.466 [28/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:45.466 [29/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:45.466 [30/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:45.466 [31/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:45.466 [32/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:45.466 [33/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:45.466 [34/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:45.466 [35/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:45.466 [36/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:45.466 [37/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:45.466 [38/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:45.466 [39/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:45.466 [40/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:45.466 [41/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:45.466 [42/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:45.466 [43/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:45.466 [44/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:45.466 [45/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:45.466 [46/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:45.466 [47/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:45.466 [48/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:45.466 [49/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:45.466 [50/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:45.466 [51/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:45.466 [52/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:45.466 [53/265] Linking static target lib/librte_telemetry.a 00:01:45.466 [54/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:45.466 [55/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:45.466 [56/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:45.466 [57/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:45.466 [58/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:45.466 [59/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:45.466 [60/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:45.466 [61/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:45.466 [62/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:45.725 [63/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:45.725 [64/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:45.725 [65/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:45.725 [66/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:45.725 [67/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:45.725 [68/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.725 [69/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:45.725 [70/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:45.725 [71/265] Linking target lib/librte_log.so.24.0 00:01:45.725 [72/265] Linking static target lib/librte_pci.a 00:01:45.725 [73/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:45.725 [74/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:45.725 [75/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:45.986 [76/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:45.986 [77/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:45.986 [78/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:45.986 [79/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:45.986 [80/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:45.986 [81/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:45.986 [82/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:45.986 [83/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:45.986 [84/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:45.986 [85/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:45.986 [86/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:45.986 [87/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:46.245 [88/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:46.245 [89/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:46.245 [90/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:46.245 [91/265] Linking target lib/librte_kvargs.so.24.0 00:01:46.245 [92/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:46.245 [93/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.245 [94/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:46.245 [95/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:46.245 [96/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:46.245 [97/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:46.245 [98/265] Linking static target lib/librte_eal.a 00:01:46.245 [99/265] Linking static target lib/librte_ring.a 00:01:46.508 [100/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:46.508 [101/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:46.508 [102/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:46.508 [103/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:46.508 [104/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:46.508 [105/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:46.508 [106/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:46.508 [107/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:46.508 [108/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:46.508 [109/265] Linking static target lib/librte_meter.a 00:01:46.508 [110/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:46.508 [111/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:46.508 [112/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:46.508 [113/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:46.508 [114/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:46.508 [115/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.508 [116/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:46.508 [117/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:46.508 [118/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:46.508 [119/265] Linking static target lib/librte_mempool.a 00:01:46.508 [120/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:46.508 [121/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:46.767 [122/265] Linking static target lib/librte_rcu.a 00:01:46.767 [123/265] Linking target lib/librte_telemetry.so.24.0 00:01:46.767 [124/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:46.767 [125/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:46.767 [126/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:46.767 [127/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:46.767 [128/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:46.767 [129/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:46.767 [130/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:46.767 [131/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:46.767 [132/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:46.767 [133/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:46.767 [134/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:47.028 [135/265] Linking static target lib/librte_cmdline.a 00:01:47.028 [136/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:47.028 [137/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:47.028 [138/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:47.028 [139/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.028 [140/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:47.028 [141/265] Linking static target lib/librte_net.a 00:01:47.028 [142/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:47.028 [143/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:47.028 [144/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.028 [145/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:47.028 [146/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:47.028 [147/265] Linking static target lib/librte_timer.a 00:01:47.288 [148/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:47.288 [149/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:47.288 [150/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:47.288 [151/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.288 [152/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:47.288 [153/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:47.288 [154/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:47.288 [155/265] Linking static target lib/librte_dmadev.a 00:01:47.547 [156/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.547 [157/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:47.547 [158/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:47.547 [159/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:47.547 [160/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:47.547 [161/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:47.547 [162/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.547 [163/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:47.547 [164/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:47.547 [165/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:47.547 [166/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.547 [167/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:47.547 [168/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:47.805 [169/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:47.805 [170/265] Linking static target lib/librte_power.a 00:01:47.805 [171/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:47.805 [172/265] Linking static target lib/librte_compressdev.a 00:01:47.805 [173/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:47.805 [174/265] Linking static target lib/librte_hash.a 00:01:47.805 [175/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:47.805 [176/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:47.805 [177/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:47.805 [178/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.805 [179/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:47.805 [180/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:47.805 [181/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:47.805 [182/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.064 [183/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:48.064 [184/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:48.064 [185/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:48.064 [186/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:48.064 [187/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:48.064 [188/265] Linking static target lib/librte_mbuf.a 00:01:48.064 [189/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:48.064 [190/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:48.064 [191/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:48.064 [192/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:48.064 [193/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:48.064 [194/265] Linking static target lib/librte_reorder.a 00:01:48.064 [195/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:48.064 [196/265] Linking static target lib/librte_security.a 00:01:48.064 [197/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.064 [198/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:48.064 [199/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:48.322 [200/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:48.322 [201/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.322 [202/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:48.322 [203/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:48.322 [204/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.322 [205/265] Linking static target drivers/librte_bus_vdev.a 00:01:48.322 [206/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:48.322 [207/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:48.322 [208/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:48.322 [209/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:48.322 [210/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:48.322 [211/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:48.323 [212/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:48.323 [213/265] Linking static target drivers/librte_mempool_ring.a 00:01:48.323 [214/265] Linking static target drivers/librte_bus_pci.a 00:01:48.323 [215/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.323 [216/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:48.323 [217/265] Linking static target lib/librte_ethdev.a 00:01:48.581 [218/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.581 [219/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.581 [220/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.839 [221/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.839 [222/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:48.839 [223/265] Linking static target lib/librte_cryptodev.a 00:01:49.773 [224/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.148 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:01:52.520 [226/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.520 [227/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.779 [228/265] Linking target lib/librte_eal.so.24.0 00:01:52.779 [229/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:52.779 [230/265] Linking target lib/librte_meter.so.24.0 00:01:52.779 [231/265] Linking target lib/librte_dmadev.so.24.0 00:01:52.779 [232/265] Linking target lib/librte_timer.so.24.0 00:01:52.779 [233/265] Linking target lib/librte_ring.so.24.0 00:01:52.779 [234/265] Linking target lib/librte_pci.so.24.0 00:01:52.779 [235/265] Linking target drivers/librte_bus_vdev.so.24.0 00:01:53.038 [236/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:53.038 [237/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:53.038 [238/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:53.038 [239/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:53.038 [240/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:53.038 [241/265] Linking target lib/librte_rcu.so.24.0 00:01:53.038 [242/265] Linking target drivers/librte_bus_pci.so.24.0 00:01:53.038 [243/265] Linking target lib/librte_mempool.so.24.0 00:01:53.038 [244/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:53.296 [245/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:53.296 [246/265] Linking target drivers/librte_mempool_ring.so.24.0 00:01:53.296 [247/265] Linking target lib/librte_mbuf.so.24.0 00:01:53.296 [248/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:53.296 [249/265] Linking target lib/librte_reorder.so.24.0 00:01:53.296 [250/265] Linking target lib/librte_net.so.24.0 00:01:53.296 [251/265] Linking target lib/librte_compressdev.so.24.0 00:01:53.296 [252/265] Linking target lib/librte_cryptodev.so.24.0 00:01:53.554 [253/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:53.554 [254/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:53.554 [255/265] Linking target lib/librte_security.so.24.0 00:01:53.554 [256/265] Linking target lib/librte_hash.so.24.0 00:01:53.554 [257/265] Linking target lib/librte_cmdline.so.24.0 00:01:53.554 [258/265] Linking target lib/librte_ethdev.so.24.0 00:01:53.554 [259/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:53.554 [260/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:53.813 [261/265] Linking target lib/librte_power.so.24.0 00:01:57.100 [262/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:01:57.100 [263/265] Linking static target lib/librte_vhost.a 00:01:58.033 [264/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.033 [265/265] Linking target lib/librte_vhost.so.24.0 00:01:58.033 INFO: autodetecting backend as ninja 00:01:58.033 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 48 00:01:58.964 CC lib/log/log.o 00:01:58.964 CC lib/log/log_flags.o 00:01:58.964 CC lib/log/log_deprecated.o 00:01:58.964 CC lib/ut_mock/mock.o 00:01:58.964 CC lib/ut/ut.o 00:01:58.964 LIB libspdk_ut_mock.a 00:01:58.964 LIB libspdk_log.a 00:01:58.964 LIB libspdk_ut.a 00:01:58.964 SO libspdk_ut_mock.so.5.0 00:01:58.964 SO libspdk_ut.so.1.0 00:01:58.964 SO libspdk_log.so.6.1 00:01:58.965 SYMLINK libspdk_ut_mock.so 00:01:58.965 SYMLINK libspdk_ut.so 00:01:58.965 SYMLINK libspdk_log.so 00:01:59.222 CC lib/ioat/ioat.o 00:01:59.222 CXX lib/trace_parser/trace.o 00:01:59.222 CC lib/dma/dma.o 00:01:59.222 CC lib/util/base64.o 00:01:59.222 CC lib/util/bit_array.o 00:01:59.222 CC lib/util/cpuset.o 00:01:59.222 CC lib/util/crc16.o 00:01:59.222 CC lib/util/crc32.o 00:01:59.222 CC lib/util/crc32c.o 00:01:59.222 CC lib/util/crc32_ieee.o 00:01:59.222 CC lib/util/crc64.o 00:01:59.222 CC lib/util/dif.o 00:01:59.222 CC lib/util/fd.o 00:01:59.222 CC lib/util/file.o 00:01:59.222 CC lib/util/hexlify.o 00:01:59.222 CC lib/util/iov.o 00:01:59.222 CC lib/util/math.o 00:01:59.222 CC lib/util/pipe.o 00:01:59.222 CC lib/util/strerror_tls.o 00:01:59.222 CC lib/util/string.o 00:01:59.222 CC lib/util/uuid.o 00:01:59.222 CC lib/util/fd_group.o 00:01:59.222 CC lib/util/xor.o 00:01:59.222 CC lib/util/zipf.o 00:01:59.222 CC lib/vfio_user/host/vfio_user_pci.o 00:01:59.222 CC lib/vfio_user/host/vfio_user.o 00:01:59.222 LIB libspdk_dma.a 00:01:59.480 SO libspdk_dma.so.3.0 00:01:59.480 SYMLINK libspdk_dma.so 00:01:59.480 LIB libspdk_ioat.a 00:01:59.480 SO libspdk_ioat.so.6.0 00:01:59.480 SYMLINK libspdk_ioat.so 00:01:59.480 LIB libspdk_vfio_user.a 00:01:59.480 SO libspdk_vfio_user.so.4.0 00:01:59.738 SYMLINK libspdk_vfio_user.so 00:01:59.738 LIB libspdk_util.a 00:01:59.738 SO libspdk_util.so.8.0 00:01:59.738 SYMLINK libspdk_util.so 00:01:59.994 CC lib/json/json_parse.o 00:01:59.994 CC lib/vmd/vmd.o 00:01:59.994 CC lib/rdma/common.o 00:01:59.994 CC lib/idxd/idxd.o 00:01:59.994 CC lib/json/json_util.o 00:01:59.994 CC lib/env_dpdk/env.o 00:01:59.994 CC lib/conf/conf.o 00:01:59.994 CC lib/rdma/rdma_verbs.o 00:01:59.994 CC lib/vmd/led.o 00:01:59.994 CC lib/idxd/idxd_user.o 00:01:59.994 CC lib/json/json_write.o 00:01:59.994 CC lib/env_dpdk/memory.o 00:01:59.994 CC lib/idxd/idxd_kernel.o 00:01:59.994 CC lib/env_dpdk/pci.o 00:01:59.994 CC lib/env_dpdk/init.o 00:01:59.994 CC lib/env_dpdk/threads.o 00:01:59.994 CC lib/env_dpdk/pci_ioat.o 00:01:59.995 CC lib/env_dpdk/pci_virtio.o 00:01:59.995 CC lib/env_dpdk/pci_vmd.o 00:01:59.995 CC lib/env_dpdk/pci_idxd.o 00:01:59.995 CC lib/env_dpdk/pci_event.o 00:01:59.995 CC lib/env_dpdk/sigbus_handler.o 00:01:59.995 CC lib/env_dpdk/pci_dpdk.o 00:01:59.995 CC lib/env_dpdk/pci_dpdk_2207.o 00:01:59.995 CC lib/env_dpdk/pci_dpdk_2211.o 00:01:59.995 LIB libspdk_trace_parser.a 00:02:00.253 SO libspdk_trace_parser.so.4.0 00:02:00.253 LIB libspdk_conf.a 00:02:00.253 SYMLINK libspdk_trace_parser.so 00:02:00.253 SO libspdk_conf.so.5.0 00:02:00.253 SYMLINK libspdk_conf.so 00:02:00.253 LIB libspdk_rdma.a 00:02:00.253 SO libspdk_rdma.so.5.0 00:02:00.253 LIB libspdk_json.a 00:02:00.253 SO libspdk_json.so.5.1 00:02:00.253 SYMLINK libspdk_rdma.so 00:02:00.510 SYMLINK libspdk_json.so 00:02:00.510 CC lib/jsonrpc/jsonrpc_server.o 00:02:00.510 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:02:00.510 CC lib/jsonrpc/jsonrpc_client.o 00:02:00.510 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:02:00.510 LIB libspdk_idxd.a 00:02:00.510 SO libspdk_idxd.so.11.0 00:02:00.510 SYMLINK libspdk_idxd.so 00:02:00.768 LIB libspdk_vmd.a 00:02:00.768 SO libspdk_vmd.so.5.0 00:02:00.768 SYMLINK libspdk_vmd.so 00:02:00.768 LIB libspdk_jsonrpc.a 00:02:00.768 SO libspdk_jsonrpc.so.5.1 00:02:00.768 SYMLINK libspdk_jsonrpc.so 00:02:01.025 CC lib/rpc/rpc.o 00:02:01.025 LIB libspdk_rpc.a 00:02:01.282 SO libspdk_rpc.so.5.0 00:02:01.282 SYMLINK libspdk_rpc.so 00:02:01.282 CC lib/trace/trace.o 00:02:01.282 CC lib/trace/trace_flags.o 00:02:01.282 CC lib/trace/trace_rpc.o 00:02:01.282 CC lib/sock/sock.o 00:02:01.282 CC lib/notify/notify.o 00:02:01.282 CC lib/notify/notify_rpc.o 00:02:01.282 CC lib/sock/sock_rpc.o 00:02:01.538 LIB libspdk_notify.a 00:02:01.538 SO libspdk_notify.so.5.0 00:02:01.538 LIB libspdk_trace.a 00:02:01.538 SYMLINK libspdk_notify.so 00:02:01.538 SO libspdk_trace.so.9.0 00:02:01.538 SYMLINK libspdk_trace.so 00:02:01.796 LIB libspdk_sock.a 00:02:01.796 CC lib/thread/thread.o 00:02:01.796 CC lib/thread/iobuf.o 00:02:01.796 SO libspdk_sock.so.8.0 00:02:01.796 SYMLINK libspdk_sock.so 00:02:01.796 CC lib/nvme/nvme_ctrlr_cmd.o 00:02:01.796 CC lib/nvme/nvme_ctrlr.o 00:02:01.796 CC lib/nvme/nvme_fabric.o 00:02:01.796 CC lib/nvme/nvme_ns_cmd.o 00:02:01.796 CC lib/nvme/nvme_ns.o 00:02:01.796 CC lib/nvme/nvme_pcie_common.o 00:02:01.796 CC lib/nvme/nvme_pcie.o 00:02:01.796 CC lib/nvme/nvme_qpair.o 00:02:01.796 CC lib/nvme/nvme.o 00:02:01.796 CC lib/nvme/nvme_quirks.o 00:02:01.796 CC lib/nvme/nvme_transport.o 00:02:01.796 CC lib/nvme/nvme_discovery.o 00:02:01.796 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:02:01.796 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:02:01.796 CC lib/nvme/nvme_tcp.o 00:02:01.796 CC lib/nvme/nvme_opal.o 00:02:01.796 CC lib/nvme/nvme_io_msg.o 00:02:01.796 CC lib/nvme/nvme_poll_group.o 00:02:01.796 CC lib/nvme/nvme_zns.o 00:02:01.796 CC lib/nvme/nvme_cuse.o 00:02:01.796 CC lib/nvme/nvme_vfio_user.o 00:02:01.796 CC lib/nvme/nvme_rdma.o 00:02:02.053 LIB libspdk_env_dpdk.a 00:02:02.053 SO libspdk_env_dpdk.so.13.0 00:02:02.311 SYMLINK libspdk_env_dpdk.so 00:02:03.243 LIB libspdk_thread.a 00:02:03.243 SO libspdk_thread.so.9.0 00:02:03.500 SYMLINK libspdk_thread.so 00:02:03.500 CC lib/accel/accel.o 00:02:03.500 CC lib/virtio/virtio.o 00:02:03.500 CC lib/accel/accel_rpc.o 00:02:03.500 CC lib/virtio/virtio_vhost_user.o 00:02:03.500 CC lib/accel/accel_sw.o 00:02:03.500 CC lib/init/json_config.o 00:02:03.500 CC lib/blob/blobstore.o 00:02:03.500 CC lib/virtio/virtio_vfio_user.o 00:02:03.500 CC lib/init/subsystem.o 00:02:03.500 CC lib/blob/request.o 00:02:03.500 CC lib/virtio/virtio_pci.o 00:02:03.500 CC lib/init/subsystem_rpc.o 00:02:03.500 CC lib/blob/zeroes.o 00:02:03.500 CC lib/init/rpc.o 00:02:03.500 CC lib/blob/blob_bs_dev.o 00:02:03.759 LIB libspdk_init.a 00:02:03.759 SO libspdk_init.so.4.0 00:02:03.759 SYMLINK libspdk_init.so 00:02:03.759 LIB libspdk_virtio.a 00:02:03.759 SO libspdk_virtio.so.6.0 00:02:04.018 SYMLINK libspdk_virtio.so 00:02:04.018 CC lib/event/app.o 00:02:04.018 CC lib/event/reactor.o 00:02:04.018 CC lib/event/log_rpc.o 00:02:04.018 CC lib/event/app_rpc.o 00:02:04.018 CC lib/event/scheduler_static.o 00:02:04.276 LIB libspdk_nvme.a 00:02:04.276 SO libspdk_nvme.so.12.0 00:02:04.276 LIB libspdk_event.a 00:02:04.276 SO libspdk_event.so.12.0 00:02:04.534 SYMLINK libspdk_event.so 00:02:04.534 SYMLINK libspdk_nvme.so 00:02:04.534 LIB libspdk_accel.a 00:02:04.534 SO libspdk_accel.so.14.0 00:02:04.534 SYMLINK libspdk_accel.so 00:02:04.793 CC lib/bdev/bdev.o 00:02:04.793 CC lib/bdev/bdev_rpc.o 00:02:04.793 CC lib/bdev/bdev_zone.o 00:02:04.793 CC lib/bdev/part.o 00:02:04.793 CC lib/bdev/scsi_nvme.o 00:02:06.167 LIB libspdk_blob.a 00:02:06.424 SO libspdk_blob.so.10.1 00:02:06.424 SYMLINK libspdk_blob.so 00:02:06.424 CC lib/blobfs/blobfs.o 00:02:06.424 CC lib/blobfs/tree.o 00:02:06.424 CC lib/lvol/lvol.o 00:02:07.358 LIB libspdk_bdev.a 00:02:07.358 LIB libspdk_blobfs.a 00:02:07.358 SO libspdk_bdev.so.14.0 00:02:07.358 SO libspdk_blobfs.so.9.0 00:02:07.358 SYMLINK libspdk_blobfs.so 00:02:07.358 LIB libspdk_lvol.a 00:02:07.358 SYMLINK libspdk_bdev.so 00:02:07.358 SO libspdk_lvol.so.9.1 00:02:07.358 SYMLINK libspdk_lvol.so 00:02:07.626 CC lib/nvmf/ctrlr.o 00:02:07.626 CC lib/ublk/ublk.o 00:02:07.626 CC lib/scsi/dev.o 00:02:07.626 CC lib/ublk/ublk_rpc.o 00:02:07.626 CC lib/nbd/nbd.o 00:02:07.626 CC lib/nvmf/ctrlr_discovery.o 00:02:07.626 CC lib/scsi/lun.o 00:02:07.626 CC lib/nbd/nbd_rpc.o 00:02:07.626 CC lib/scsi/port.o 00:02:07.627 CC lib/ftl/ftl_core.o 00:02:07.627 CC lib/scsi/scsi.o 00:02:07.627 CC lib/nvmf/subsystem.o 00:02:07.627 CC lib/nvmf/ctrlr_bdev.o 00:02:07.627 CC lib/scsi/scsi_bdev.o 00:02:07.627 CC lib/nvmf/nvmf.o 00:02:07.627 CC lib/ftl/ftl_init.o 00:02:07.627 CC lib/scsi/scsi_pr.o 00:02:07.627 CC lib/ftl/ftl_layout.o 00:02:07.627 CC lib/scsi/scsi_rpc.o 00:02:07.627 CC lib/nvmf/nvmf_rpc.o 00:02:07.627 CC lib/scsi/task.o 00:02:07.627 CC lib/nvmf/transport.o 00:02:07.627 CC lib/ftl/ftl_debug.o 00:02:07.627 CC lib/ftl/ftl_io.o 00:02:07.627 CC lib/nvmf/tcp.o 00:02:07.627 CC lib/nvmf/rdma.o 00:02:07.627 CC lib/ftl/ftl_l2p.o 00:02:07.627 CC lib/ftl/ftl_sb.o 00:02:07.627 CC lib/ftl/ftl_l2p_flat.o 00:02:07.627 CC lib/ftl/ftl_nv_cache.o 00:02:07.627 CC lib/ftl/ftl_band.o 00:02:07.627 CC lib/ftl/ftl_writer.o 00:02:07.627 CC lib/ftl/ftl_band_ops.o 00:02:07.627 CC lib/ftl/ftl_rq.o 00:02:07.627 CC lib/ftl/ftl_reloc.o 00:02:07.627 CC lib/ftl/ftl_l2p_cache.o 00:02:07.627 CC lib/ftl/ftl_p2l.o 00:02:07.627 CC lib/ftl/mngt/ftl_mngt.o 00:02:07.627 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:02:07.627 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:02:07.627 CC lib/ftl/mngt/ftl_mngt_startup.o 00:02:07.627 CC lib/ftl/mngt/ftl_mngt_md.o 00:02:07.627 CC lib/ftl/mngt/ftl_mngt_misc.o 00:02:07.627 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:02:07.627 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:02:07.627 CC lib/ftl/mngt/ftl_mngt_band.o 00:02:07.627 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:02:07.627 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:02:07.885 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:02:07.885 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:02:07.885 CC lib/ftl/utils/ftl_conf.o 00:02:07.885 CC lib/ftl/utils/ftl_md.o 00:02:07.885 CC lib/ftl/utils/ftl_mempool.o 00:02:07.885 CC lib/ftl/utils/ftl_bitmap.o 00:02:07.885 CC lib/ftl/utils/ftl_property.o 00:02:07.885 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:02:07.885 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:02:07.885 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:02:07.885 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:02:07.885 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:02:07.885 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:02:07.885 CC lib/ftl/upgrade/ftl_sb_v3.o 00:02:07.885 CC lib/ftl/upgrade/ftl_sb_v5.o 00:02:07.885 CC lib/ftl/nvc/ftl_nvc_dev.o 00:02:07.885 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:02:07.885 CC lib/ftl/base/ftl_base_dev.o 00:02:07.885 CC lib/ftl/base/ftl_base_bdev.o 00:02:07.885 CC lib/ftl/ftl_trace.o 00:02:08.453 LIB libspdk_nbd.a 00:02:08.453 SO libspdk_nbd.so.6.0 00:02:08.453 SYMLINK libspdk_nbd.so 00:02:08.453 LIB libspdk_scsi.a 00:02:08.453 SO libspdk_scsi.so.8.0 00:02:08.453 LIB libspdk_ublk.a 00:02:08.453 SO libspdk_ublk.so.2.0 00:02:08.453 SYMLINK libspdk_scsi.so 00:02:08.453 SYMLINK libspdk_ublk.so 00:02:08.711 CC lib/vhost/vhost.o 00:02:08.711 CC lib/iscsi/conn.o 00:02:08.711 CC lib/iscsi/init_grp.o 00:02:08.711 CC lib/vhost/vhost_rpc.o 00:02:08.711 CC lib/vhost/vhost_scsi.o 00:02:08.711 CC lib/iscsi/iscsi.o 00:02:08.711 CC lib/iscsi/md5.o 00:02:08.711 CC lib/vhost/vhost_blk.o 00:02:08.711 CC lib/iscsi/param.o 00:02:08.711 CC lib/vhost/rte_vhost_user.o 00:02:08.711 CC lib/iscsi/portal_grp.o 00:02:08.711 CC lib/iscsi/tgt_node.o 00:02:08.711 CC lib/iscsi/iscsi_subsystem.o 00:02:08.711 CC lib/iscsi/iscsi_rpc.o 00:02:08.711 CC lib/iscsi/task.o 00:02:08.711 LIB libspdk_ftl.a 00:02:08.968 SO libspdk_ftl.so.8.0 00:02:09.225 SYMLINK libspdk_ftl.so 00:02:09.824 LIB libspdk_vhost.a 00:02:09.824 SO libspdk_vhost.so.7.1 00:02:09.824 SYMLINK libspdk_vhost.so 00:02:10.083 LIB libspdk_iscsi.a 00:02:10.083 LIB libspdk_nvmf.a 00:02:10.083 SO libspdk_iscsi.so.7.0 00:02:10.083 SO libspdk_nvmf.so.17.0 00:02:10.083 SYMLINK libspdk_iscsi.so 00:02:10.340 SYMLINK libspdk_nvmf.so 00:02:10.340 CC module/env_dpdk/env_dpdk_rpc.o 00:02:10.340 CC module/sock/posix/posix.o 00:02:10.340 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:02:10.340 CC module/accel/ioat/accel_ioat.o 00:02:10.340 CC module/scheduler/gscheduler/gscheduler.o 00:02:10.340 CC module/accel/iaa/accel_iaa.o 00:02:10.340 CC module/accel/dsa/accel_dsa.o 00:02:10.340 CC module/blob/bdev/blob_bdev.o 00:02:10.340 CC module/accel/ioat/accel_ioat_rpc.o 00:02:10.340 CC module/accel/error/accel_error.o 00:02:10.340 CC module/accel/dsa/accel_dsa_rpc.o 00:02:10.340 CC module/scheduler/dynamic/scheduler_dynamic.o 00:02:10.340 CC module/accel/iaa/accel_iaa_rpc.o 00:02:10.340 CC module/accel/error/accel_error_rpc.o 00:02:10.598 LIB libspdk_env_dpdk_rpc.a 00:02:10.598 SO libspdk_env_dpdk_rpc.so.5.0 00:02:10.598 SYMLINK libspdk_env_dpdk_rpc.so 00:02:10.598 LIB libspdk_scheduler_gscheduler.a 00:02:10.598 LIB libspdk_scheduler_dpdk_governor.a 00:02:10.598 SO libspdk_scheduler_gscheduler.so.3.0 00:02:10.598 SO libspdk_scheduler_dpdk_governor.so.3.0 00:02:10.598 LIB libspdk_accel_error.a 00:02:10.598 LIB libspdk_accel_ioat.a 00:02:10.598 LIB libspdk_scheduler_dynamic.a 00:02:10.598 SO libspdk_accel_error.so.1.0 00:02:10.598 LIB libspdk_accel_iaa.a 00:02:10.598 SYMLINK libspdk_scheduler_gscheduler.so 00:02:10.598 SO libspdk_accel_ioat.so.5.0 00:02:10.598 SYMLINK libspdk_scheduler_dpdk_governor.so 00:02:10.598 SO libspdk_scheduler_dynamic.so.3.0 00:02:10.598 SO libspdk_accel_iaa.so.2.0 00:02:10.598 LIB libspdk_accel_dsa.a 00:02:10.856 SYMLINK libspdk_accel_error.so 00:02:10.856 SYMLINK libspdk_scheduler_dynamic.so 00:02:10.856 SYMLINK libspdk_accel_ioat.so 00:02:10.856 SO libspdk_accel_dsa.so.4.0 00:02:10.856 LIB libspdk_blob_bdev.a 00:02:10.856 SYMLINK libspdk_accel_iaa.so 00:02:10.856 SO libspdk_blob_bdev.so.10.1 00:02:10.856 SYMLINK libspdk_accel_dsa.so 00:02:10.856 SYMLINK libspdk_blob_bdev.so 00:02:10.856 CC module/bdev/null/bdev_null.o 00:02:10.856 CC module/bdev/null/bdev_null_rpc.o 00:02:10.856 CC module/bdev/gpt/gpt.o 00:02:10.856 CC module/bdev/malloc/bdev_malloc.o 00:02:10.856 CC module/bdev/gpt/vbdev_gpt.o 00:02:10.856 CC module/bdev/malloc/bdev_malloc_rpc.o 00:02:10.856 CC module/bdev/zone_block/vbdev_zone_block.o 00:02:10.856 CC module/bdev/raid/bdev_raid.o 00:02:10.856 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:02:10.856 CC module/bdev/raid/bdev_raid_rpc.o 00:02:10.856 CC module/bdev/passthru/vbdev_passthru.o 00:02:10.856 CC module/bdev/delay/vbdev_delay.o 00:02:10.856 CC module/bdev/raid/bdev_raid_sb.o 00:02:10.856 CC module/bdev/delay/vbdev_delay_rpc.o 00:02:10.856 CC module/bdev/ftl/bdev_ftl.o 00:02:10.856 CC module/bdev/raid/raid0.o 00:02:10.856 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:02:10.856 CC module/bdev/split/vbdev_split.o 00:02:10.856 CC module/bdev/iscsi/bdev_iscsi.o 00:02:10.856 CC module/bdev/ftl/bdev_ftl_rpc.o 00:02:10.856 CC module/bdev/raid/raid1.o 00:02:10.856 CC module/bdev/raid/concat.o 00:02:10.856 CC module/bdev/split/vbdev_split_rpc.o 00:02:10.856 CC module/bdev/lvol/vbdev_lvol.o 00:02:10.856 CC module/bdev/aio/bdev_aio.o 00:02:10.856 CC module/bdev/nvme/bdev_nvme.o 00:02:10.856 CC module/bdev/aio/bdev_aio_rpc.o 00:02:10.856 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:02:11.114 CC module/bdev/error/vbdev_error_rpc.o 00:02:11.114 CC module/bdev/error/vbdev_error.o 00:02:11.114 CC module/bdev/nvme/bdev_nvme_rpc.o 00:02:11.114 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:02:11.114 CC module/blobfs/bdev/blobfs_bdev.o 00:02:11.114 CC module/bdev/nvme/nvme_rpc.o 00:02:11.115 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:02:11.115 CC module/bdev/virtio/bdev_virtio_scsi.o 00:02:11.115 CC module/bdev/nvme/bdev_mdns_client.o 00:02:11.115 CC module/bdev/virtio/bdev_virtio_blk.o 00:02:11.115 CC module/bdev/nvme/vbdev_opal.o 00:02:11.115 CC module/bdev/nvme/vbdev_opal_rpc.o 00:02:11.115 CC module/bdev/virtio/bdev_virtio_rpc.o 00:02:11.115 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:02:11.372 LIB libspdk_sock_posix.a 00:02:11.372 LIB libspdk_blobfs_bdev.a 00:02:11.372 SO libspdk_sock_posix.so.5.0 00:02:11.372 SO libspdk_blobfs_bdev.so.5.0 00:02:11.372 LIB libspdk_bdev_aio.a 00:02:11.372 LIB libspdk_bdev_split.a 00:02:11.372 SO libspdk_bdev_aio.so.5.0 00:02:11.372 SO libspdk_bdev_split.so.5.0 00:02:11.372 LIB libspdk_bdev_gpt.a 00:02:11.372 SYMLINK libspdk_blobfs_bdev.so 00:02:11.372 SYMLINK libspdk_sock_posix.so 00:02:11.372 SO libspdk_bdev_gpt.so.5.0 00:02:11.372 LIB libspdk_bdev_null.a 00:02:11.373 SYMLINK libspdk_bdev_aio.so 00:02:11.373 LIB libspdk_bdev_ftl.a 00:02:11.373 SYMLINK libspdk_bdev_split.so 00:02:11.373 LIB libspdk_bdev_zone_block.a 00:02:11.373 LIB libspdk_bdev_error.a 00:02:11.373 SO libspdk_bdev_null.so.5.0 00:02:11.373 SO libspdk_bdev_ftl.so.5.0 00:02:11.373 LIB libspdk_bdev_passthru.a 00:02:11.373 SYMLINK libspdk_bdev_gpt.so 00:02:11.373 SO libspdk_bdev_zone_block.so.5.0 00:02:11.630 SO libspdk_bdev_error.so.5.0 00:02:11.630 SO libspdk_bdev_passthru.so.5.0 00:02:11.630 LIB libspdk_bdev_malloc.a 00:02:11.630 SYMLINK libspdk_bdev_null.so 00:02:11.630 SYMLINK libspdk_bdev_ftl.so 00:02:11.630 SO libspdk_bdev_malloc.so.5.0 00:02:11.630 SYMLINK libspdk_bdev_zone_block.so 00:02:11.630 SYMLINK libspdk_bdev_error.so 00:02:11.630 SYMLINK libspdk_bdev_passthru.so 00:02:11.630 LIB libspdk_bdev_iscsi.a 00:02:11.630 LIB libspdk_bdev_delay.a 00:02:11.630 SYMLINK libspdk_bdev_malloc.so 00:02:11.630 SO libspdk_bdev_iscsi.so.5.0 00:02:11.630 SO libspdk_bdev_delay.so.5.0 00:02:11.630 SYMLINK libspdk_bdev_iscsi.so 00:02:11.630 SYMLINK libspdk_bdev_delay.so 00:02:11.630 LIB libspdk_bdev_lvol.a 00:02:11.630 LIB libspdk_bdev_virtio.a 00:02:11.630 SO libspdk_bdev_lvol.so.5.0 00:02:11.630 SO libspdk_bdev_virtio.so.5.0 00:02:11.887 SYMLINK libspdk_bdev_lvol.so 00:02:11.887 SYMLINK libspdk_bdev_virtio.so 00:02:12.145 LIB libspdk_bdev_raid.a 00:02:12.145 SO libspdk_bdev_raid.so.5.0 00:02:12.145 SYMLINK libspdk_bdev_raid.so 00:02:13.519 LIB libspdk_bdev_nvme.a 00:02:13.519 SO libspdk_bdev_nvme.so.6.0 00:02:13.519 SYMLINK libspdk_bdev_nvme.so 00:02:13.776 CC module/event/subsystems/vmd/vmd.o 00:02:13.776 CC module/event/subsystems/sock/sock.o 00:02:13.776 CC module/event/subsystems/scheduler/scheduler.o 00:02:13.776 CC module/event/subsystems/vmd/vmd_rpc.o 00:02:13.776 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:02:13.776 CC module/event/subsystems/iobuf/iobuf.o 00:02:13.776 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:02:13.776 LIB libspdk_event_sock.a 00:02:13.776 LIB libspdk_event_vhost_blk.a 00:02:13.776 LIB libspdk_event_scheduler.a 00:02:13.776 LIB libspdk_event_vmd.a 00:02:13.776 SO libspdk_event_sock.so.4.0 00:02:13.777 SO libspdk_event_vhost_blk.so.2.0 00:02:13.777 LIB libspdk_event_iobuf.a 00:02:13.777 SO libspdk_event_scheduler.so.3.0 00:02:13.777 SO libspdk_event_vmd.so.5.0 00:02:13.777 SO libspdk_event_iobuf.so.2.0 00:02:14.035 SYMLINK libspdk_event_sock.so 00:02:14.035 SYMLINK libspdk_event_vhost_blk.so 00:02:14.035 SYMLINK libspdk_event_scheduler.so 00:02:14.035 SYMLINK libspdk_event_vmd.so 00:02:14.035 SYMLINK libspdk_event_iobuf.so 00:02:14.035 CC module/event/subsystems/accel/accel.o 00:02:14.293 LIB libspdk_event_accel.a 00:02:14.293 SO libspdk_event_accel.so.5.0 00:02:14.293 SYMLINK libspdk_event_accel.so 00:02:14.293 CC module/event/subsystems/bdev/bdev.o 00:02:14.550 LIB libspdk_event_bdev.a 00:02:14.550 SO libspdk_event_bdev.so.5.0 00:02:14.550 SYMLINK libspdk_event_bdev.so 00:02:14.807 CC module/event/subsystems/nbd/nbd.o 00:02:14.807 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:02:14.807 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:02:14.807 CC module/event/subsystems/scsi/scsi.o 00:02:14.807 CC module/event/subsystems/ublk/ublk.o 00:02:14.807 LIB libspdk_event_nbd.a 00:02:14.807 LIB libspdk_event_ublk.a 00:02:14.807 LIB libspdk_event_scsi.a 00:02:14.807 SO libspdk_event_ublk.so.2.0 00:02:14.807 SO libspdk_event_nbd.so.5.0 00:02:14.807 SO libspdk_event_scsi.so.5.0 00:02:15.064 SYMLINK libspdk_event_ublk.so 00:02:15.064 SYMLINK libspdk_event_nbd.so 00:02:15.064 SYMLINK libspdk_event_scsi.so 00:02:15.064 LIB libspdk_event_nvmf.a 00:02:15.064 SO libspdk_event_nvmf.so.5.0 00:02:15.064 SYMLINK libspdk_event_nvmf.so 00:02:15.064 CC module/event/subsystems/iscsi/iscsi.o 00:02:15.064 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:02:15.320 LIB libspdk_event_vhost_scsi.a 00:02:15.320 LIB libspdk_event_iscsi.a 00:02:15.320 SO libspdk_event_vhost_scsi.so.2.0 00:02:15.320 SO libspdk_event_iscsi.so.5.0 00:02:15.320 SYMLINK libspdk_event_vhost_scsi.so 00:02:15.320 SYMLINK libspdk_event_iscsi.so 00:02:15.320 SO libspdk.so.5.0 00:02:15.320 SYMLINK libspdk.so 00:02:15.582 CC app/trace_record/trace_record.o 00:02:15.582 CC app/spdk_top/spdk_top.o 00:02:15.582 CXX app/trace/trace.o 00:02:15.582 CC app/spdk_nvme_discover/discovery_aer.o 00:02:15.582 CC app/spdk_nvme_perf/perf.o 00:02:15.582 CC app/spdk_lspci/spdk_lspci.o 00:02:15.582 CC app/spdk_nvme_identify/identify.o 00:02:15.582 TEST_HEADER include/spdk/accel.h 00:02:15.582 CC test/rpc_client/rpc_client_test.o 00:02:15.582 TEST_HEADER include/spdk/accel_module.h 00:02:15.582 TEST_HEADER include/spdk/assert.h 00:02:15.582 TEST_HEADER include/spdk/barrier.h 00:02:15.582 TEST_HEADER include/spdk/base64.h 00:02:15.582 TEST_HEADER include/spdk/bdev.h 00:02:15.582 TEST_HEADER include/spdk/bdev_module.h 00:02:15.582 TEST_HEADER include/spdk/bdev_zone.h 00:02:15.582 TEST_HEADER include/spdk/bit_array.h 00:02:15.582 TEST_HEADER include/spdk/bit_pool.h 00:02:15.582 TEST_HEADER include/spdk/blob_bdev.h 00:02:15.582 TEST_HEADER include/spdk/blobfs_bdev.h 00:02:15.582 TEST_HEADER include/spdk/blobfs.h 00:02:15.582 TEST_HEADER include/spdk/blob.h 00:02:15.582 TEST_HEADER include/spdk/conf.h 00:02:15.582 TEST_HEADER include/spdk/config.h 00:02:15.582 CC examples/interrupt_tgt/interrupt_tgt.o 00:02:15.582 TEST_HEADER include/spdk/cpuset.h 00:02:15.582 CC app/spdk_dd/spdk_dd.o 00:02:15.582 TEST_HEADER include/spdk/crc16.h 00:02:15.582 CC app/iscsi_tgt/iscsi_tgt.o 00:02:15.582 TEST_HEADER include/spdk/crc32.h 00:02:15.582 CC app/nvmf_tgt/nvmf_main.o 00:02:15.582 TEST_HEADER include/spdk/crc64.h 00:02:15.582 TEST_HEADER include/spdk/dif.h 00:02:15.582 CC app/vhost/vhost.o 00:02:15.582 TEST_HEADER include/spdk/dma.h 00:02:15.582 CC examples/ioat/verify/verify.o 00:02:15.582 CC examples/nvme/hello_world/hello_world.o 00:02:15.582 CC examples/nvme/nvme_manage/nvme_manage.o 00:02:15.582 CC examples/nvme/cmb_copy/cmb_copy.o 00:02:15.582 CC examples/ioat/perf/perf.o 00:02:15.582 TEST_HEADER include/spdk/endian.h 00:02:15.582 CC examples/vmd/lsvmd/lsvmd.o 00:02:15.582 CC examples/nvme/reconnect/reconnect.o 00:02:15.583 CC examples/sock/hello_world/hello_sock.o 00:02:15.583 CC examples/idxd/perf/perf.o 00:02:15.583 CC examples/nvme/hotplug/hotplug.o 00:02:15.583 CC examples/nvme/abort/abort.o 00:02:15.583 CC examples/accel/perf/accel_perf.o 00:02:15.583 CC examples/util/zipf/zipf.o 00:02:15.583 TEST_HEADER include/spdk/env_dpdk.h 00:02:15.583 CC examples/nvme/arbitration/arbitration.o 00:02:15.583 TEST_HEADER include/spdk/env.h 00:02:15.583 CC examples/vmd/led/led.o 00:02:15.583 CC test/event/event_perf/event_perf.o 00:02:15.583 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:02:15.583 TEST_HEADER include/spdk/event.h 00:02:15.583 CC test/thread/poller_perf/poller_perf.o 00:02:15.583 CC test/nvme/aer/aer.o 00:02:15.583 CC app/fio/nvme/fio_plugin.o 00:02:15.583 TEST_HEADER include/spdk/fd_group.h 00:02:15.583 TEST_HEADER include/spdk/fd.h 00:02:15.583 CC app/spdk_tgt/spdk_tgt.o 00:02:15.583 TEST_HEADER include/spdk/file.h 00:02:15.583 TEST_HEADER include/spdk/ftl.h 00:02:15.583 TEST_HEADER include/spdk/gpt_spec.h 00:02:15.583 TEST_HEADER include/spdk/hexlify.h 00:02:15.583 TEST_HEADER include/spdk/histogram_data.h 00:02:15.583 TEST_HEADER include/spdk/idxd.h 00:02:15.583 TEST_HEADER include/spdk/idxd_spec.h 00:02:15.583 CC examples/blob/cli/blobcli.o 00:02:15.583 TEST_HEADER include/spdk/init.h 00:02:15.583 TEST_HEADER include/spdk/ioat.h 00:02:15.583 CC test/blobfs/mkfs/mkfs.o 00:02:15.583 CC examples/thread/thread/thread_ex.o 00:02:15.845 CC examples/blob/hello_world/hello_blob.o 00:02:15.845 TEST_HEADER include/spdk/ioat_spec.h 00:02:15.845 CC test/accel/dif/dif.o 00:02:15.845 TEST_HEADER include/spdk/iscsi_spec.h 00:02:15.845 CC test/dma/test_dma/test_dma.o 00:02:15.845 TEST_HEADER include/spdk/json.h 00:02:15.845 TEST_HEADER include/spdk/jsonrpc.h 00:02:15.845 CC examples/bdev/bdevperf/bdevperf.o 00:02:15.845 CC examples/bdev/hello_world/hello_bdev.o 00:02:15.845 TEST_HEADER include/spdk/likely.h 00:02:15.845 CC test/bdev/bdevio/bdevio.o 00:02:15.845 CC examples/nvmf/nvmf/nvmf.o 00:02:15.845 TEST_HEADER include/spdk/log.h 00:02:15.845 TEST_HEADER include/spdk/lvol.h 00:02:15.845 CC test/app/bdev_svc/bdev_svc.o 00:02:15.845 TEST_HEADER include/spdk/memory.h 00:02:15.845 CC test/env/mem_callbacks/mem_callbacks.o 00:02:15.845 TEST_HEADER include/spdk/mmio.h 00:02:15.845 TEST_HEADER include/spdk/nbd.h 00:02:15.845 TEST_HEADER include/spdk/notify.h 00:02:15.845 TEST_HEADER include/spdk/nvme.h 00:02:15.845 TEST_HEADER include/spdk/nvme_intel.h 00:02:15.845 TEST_HEADER include/spdk/nvme_ocssd.h 00:02:15.845 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:02:15.845 TEST_HEADER include/spdk/nvme_spec.h 00:02:15.845 CC test/lvol/esnap/esnap.o 00:02:15.845 TEST_HEADER include/spdk/nvme_zns.h 00:02:15.845 TEST_HEADER include/spdk/nvmf_cmd.h 00:02:15.845 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:02:15.845 TEST_HEADER include/spdk/nvmf.h 00:02:15.845 TEST_HEADER include/spdk/nvmf_spec.h 00:02:15.845 TEST_HEADER include/spdk/nvmf_transport.h 00:02:15.845 TEST_HEADER include/spdk/opal.h 00:02:15.845 TEST_HEADER include/spdk/opal_spec.h 00:02:15.845 TEST_HEADER include/spdk/pci_ids.h 00:02:15.845 TEST_HEADER include/spdk/pipe.h 00:02:15.845 TEST_HEADER include/spdk/queue.h 00:02:15.845 TEST_HEADER include/spdk/reduce.h 00:02:15.845 TEST_HEADER include/spdk/rpc.h 00:02:15.845 TEST_HEADER include/spdk/scheduler.h 00:02:15.845 TEST_HEADER include/spdk/scsi.h 00:02:15.845 LINK spdk_lspci 00:02:15.845 TEST_HEADER include/spdk/scsi_spec.h 00:02:15.845 TEST_HEADER include/spdk/sock.h 00:02:15.845 TEST_HEADER include/spdk/stdinc.h 00:02:15.845 TEST_HEADER include/spdk/string.h 00:02:15.845 TEST_HEADER include/spdk/thread.h 00:02:15.845 TEST_HEADER include/spdk/trace.h 00:02:15.845 TEST_HEADER include/spdk/trace_parser.h 00:02:15.845 TEST_HEADER include/spdk/tree.h 00:02:15.845 TEST_HEADER include/spdk/ublk.h 00:02:15.845 TEST_HEADER include/spdk/util.h 00:02:15.845 TEST_HEADER include/spdk/uuid.h 00:02:15.845 TEST_HEADER include/spdk/version.h 00:02:15.845 TEST_HEADER include/spdk/vfio_user_pci.h 00:02:15.845 TEST_HEADER include/spdk/vfio_user_spec.h 00:02:15.845 TEST_HEADER include/spdk/vhost.h 00:02:15.845 TEST_HEADER include/spdk/vmd.h 00:02:15.845 TEST_HEADER include/spdk/xor.h 00:02:15.845 TEST_HEADER include/spdk/zipf.h 00:02:15.845 CXX test/cpp_headers/accel.o 00:02:15.845 LINK lsvmd 00:02:15.845 LINK rpc_client_test 00:02:15.845 LINK spdk_nvme_discover 00:02:15.845 LINK led 00:02:15.845 LINK event_perf 00:02:15.845 LINK poller_perf 00:02:15.845 LINK zipf 00:02:16.107 LINK nvmf_tgt 00:02:16.107 LINK interrupt_tgt 00:02:16.107 LINK cmb_copy 00:02:16.107 LINK pmr_persistence 00:02:16.107 LINK vhost 00:02:16.107 LINK spdk_trace_record 00:02:16.107 LINK iscsi_tgt 00:02:16.107 LINK verify 00:02:16.107 LINK ioat_perf 00:02:16.107 LINK mkfs 00:02:16.107 LINK spdk_tgt 00:02:16.107 LINK hello_world 00:02:16.107 LINK bdev_svc 00:02:16.107 LINK hello_sock 00:02:16.107 LINK hotplug 00:02:16.107 LINK hello_blob 00:02:16.107 LINK thread 00:02:16.107 LINK hello_bdev 00:02:16.107 LINK aer 00:02:16.107 CC test/event/reactor/reactor.o 00:02:16.379 CXX test/cpp_headers/accel_module.o 00:02:16.379 LINK arbitration 00:02:16.379 LINK nvmf 00:02:16.379 LINK idxd_perf 00:02:16.379 LINK spdk_dd 00:02:16.379 LINK reconnect 00:02:16.379 CC test/nvme/reset/reset.o 00:02:16.379 CC test/env/vtophys/vtophys.o 00:02:16.379 LINK spdk_trace 00:02:16.379 CC app/fio/bdev/fio_plugin.o 00:02:16.379 CC test/nvme/sgl/sgl.o 00:02:16.379 CXX test/cpp_headers/assert.o 00:02:16.379 CC test/app/histogram_perf/histogram_perf.o 00:02:16.379 LINK abort 00:02:16.379 CXX test/cpp_headers/barrier.o 00:02:16.379 CC test/app/jsoncat/jsoncat.o 00:02:16.379 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:02:16.379 LINK dif 00:02:16.379 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:02:16.379 CC test/env/memory/memory_ut.o 00:02:16.379 CC test/event/reactor_perf/reactor_perf.o 00:02:16.379 CC test/env/pci/pci_ut.o 00:02:16.379 CXX test/cpp_headers/base64.o 00:02:16.379 LINK test_dma 00:02:16.379 CC test/app/stub/stub.o 00:02:16.379 LINK bdevio 00:02:16.379 CC test/event/app_repeat/app_repeat.o 00:02:16.379 CXX test/cpp_headers/bdev.o 00:02:16.640 LINK accel_perf 00:02:16.640 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:02:16.640 CXX test/cpp_headers/bdev_module.o 00:02:16.640 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:02:16.640 LINK reactor 00:02:16.640 CC test/nvme/e2edp/nvme_dp.o 00:02:16.640 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:02:16.640 CXX test/cpp_headers/bdev_zone.o 00:02:16.640 LINK nvme_manage 00:02:16.640 CC test/nvme/overhead/overhead.o 00:02:16.640 CXX test/cpp_headers/bit_array.o 00:02:16.640 LINK blobcli 00:02:16.641 LINK vtophys 00:02:16.641 LINK histogram_perf 00:02:16.641 CC test/event/scheduler/scheduler.o 00:02:16.641 CC test/nvme/err_injection/err_injection.o 00:02:16.641 LINK spdk_nvme 00:02:16.641 CC test/nvme/startup/startup.o 00:02:16.641 LINK jsoncat 00:02:16.641 LINK reactor_perf 00:02:16.641 CC test/nvme/reserve/reserve.o 00:02:16.641 CC test/nvme/simple_copy/simple_copy.o 00:02:16.641 LINK env_dpdk_post_init 00:02:16.641 CXX test/cpp_headers/bit_pool.o 00:02:16.907 CC test/nvme/connect_stress/connect_stress.o 00:02:16.907 CC test/nvme/boot_partition/boot_partition.o 00:02:16.907 CC test/nvme/compliance/nvme_compliance.o 00:02:16.907 CXX test/cpp_headers/blob_bdev.o 00:02:16.907 CC test/nvme/fused_ordering/fused_ordering.o 00:02:16.907 LINK app_repeat 00:02:16.907 CXX test/cpp_headers/blobfs_bdev.o 00:02:16.907 CXX test/cpp_headers/blobfs.o 00:02:16.907 LINK reset 00:02:16.907 LINK stub 00:02:16.907 CXX test/cpp_headers/blob.o 00:02:16.907 CXX test/cpp_headers/conf.o 00:02:16.907 CXX test/cpp_headers/config.o 00:02:16.907 CC test/nvme/doorbell_aers/doorbell_aers.o 00:02:16.907 LINK sgl 00:02:16.907 CC test/nvme/fdp/fdp.o 00:02:16.907 LINK mem_callbacks 00:02:16.907 CXX test/cpp_headers/cpuset.o 00:02:16.907 CC test/nvme/cuse/cuse.o 00:02:16.907 CXX test/cpp_headers/crc16.o 00:02:16.907 CXX test/cpp_headers/crc32.o 00:02:16.907 CXX test/cpp_headers/crc64.o 00:02:16.907 CXX test/cpp_headers/dif.o 00:02:16.907 CXX test/cpp_headers/dma.o 00:02:16.907 CXX test/cpp_headers/endian.o 00:02:16.907 CXX test/cpp_headers/env_dpdk.o 00:02:16.907 CXX test/cpp_headers/env.o 00:02:16.907 CXX test/cpp_headers/event.o 00:02:17.166 CXX test/cpp_headers/fd_group.o 00:02:17.166 LINK startup 00:02:17.166 CXX test/cpp_headers/fd.o 00:02:17.166 LINK err_injection 00:02:17.166 LINK nvme_dp 00:02:17.166 CXX test/cpp_headers/file.o 00:02:17.166 LINK overhead 00:02:17.166 LINK reserve 00:02:17.166 CXX test/cpp_headers/ftl.o 00:02:17.166 LINK boot_partition 00:02:17.166 LINK scheduler 00:02:17.166 LINK spdk_nvme_perf 00:02:17.166 CXX test/cpp_headers/gpt_spec.o 00:02:17.166 CXX test/cpp_headers/hexlify.o 00:02:17.166 CXX test/cpp_headers/histogram_data.o 00:02:17.166 LINK connect_stress 00:02:17.166 LINK spdk_nvme_identify 00:02:17.166 LINK bdevperf 00:02:17.166 LINK simple_copy 00:02:17.166 CXX test/cpp_headers/idxd.o 00:02:17.166 CXX test/cpp_headers/idxd_spec.o 00:02:17.166 LINK fused_ordering 00:02:17.166 LINK nvme_fuzz 00:02:17.166 LINK spdk_top 00:02:17.166 CXX test/cpp_headers/init.o 00:02:17.166 LINK pci_ut 00:02:17.166 CXX test/cpp_headers/ioat.o 00:02:17.166 CXX test/cpp_headers/ioat_spec.o 00:02:17.166 CXX test/cpp_headers/iscsi_spec.o 00:02:17.166 CXX test/cpp_headers/json.o 00:02:17.166 LINK doorbell_aers 00:02:17.166 CXX test/cpp_headers/jsonrpc.o 00:02:17.166 CXX test/cpp_headers/likely.o 00:02:17.428 CXX test/cpp_headers/log.o 00:02:17.428 CXX test/cpp_headers/lvol.o 00:02:17.428 LINK spdk_bdev 00:02:17.428 CXX test/cpp_headers/memory.o 00:02:17.428 CXX test/cpp_headers/mmio.o 00:02:17.428 LINK vhost_fuzz 00:02:17.428 CXX test/cpp_headers/nbd.o 00:02:17.428 CXX test/cpp_headers/notify.o 00:02:17.428 CXX test/cpp_headers/nvme.o 00:02:17.428 CXX test/cpp_headers/nvme_intel.o 00:02:17.428 CXX test/cpp_headers/nvme_ocssd.o 00:02:17.428 CXX test/cpp_headers/nvme_ocssd_spec.o 00:02:17.428 CXX test/cpp_headers/nvme_spec.o 00:02:17.428 CXX test/cpp_headers/nvme_zns.o 00:02:17.428 LINK nvme_compliance 00:02:17.428 CXX test/cpp_headers/nvmf_cmd.o 00:02:17.428 CXX test/cpp_headers/nvmf_fc_spec.o 00:02:17.428 CXX test/cpp_headers/nvmf.o 00:02:17.428 CXX test/cpp_headers/nvmf_spec.o 00:02:17.428 CXX test/cpp_headers/nvmf_transport.o 00:02:17.428 CXX test/cpp_headers/opal.o 00:02:17.428 CXX test/cpp_headers/opal_spec.o 00:02:17.428 CXX test/cpp_headers/pci_ids.o 00:02:17.428 CXX test/cpp_headers/pipe.o 00:02:17.428 CXX test/cpp_headers/queue.o 00:02:17.428 CXX test/cpp_headers/reduce.o 00:02:17.428 LINK fdp 00:02:17.428 CXX test/cpp_headers/rpc.o 00:02:17.428 CXX test/cpp_headers/scheduler.o 00:02:17.428 CXX test/cpp_headers/scsi.o 00:02:17.428 CXX test/cpp_headers/scsi_spec.o 00:02:17.428 CXX test/cpp_headers/sock.o 00:02:17.428 CXX test/cpp_headers/stdinc.o 00:02:17.687 CXX test/cpp_headers/string.o 00:02:17.687 CXX test/cpp_headers/thread.o 00:02:17.687 CXX test/cpp_headers/trace.o 00:02:17.687 CXX test/cpp_headers/trace_parser.o 00:02:17.687 CXX test/cpp_headers/tree.o 00:02:17.687 CXX test/cpp_headers/ublk.o 00:02:17.687 CXX test/cpp_headers/util.o 00:02:17.687 CXX test/cpp_headers/uuid.o 00:02:17.687 CXX test/cpp_headers/version.o 00:02:17.687 CXX test/cpp_headers/vfio_user_pci.o 00:02:17.687 CXX test/cpp_headers/vfio_user_spec.o 00:02:17.687 CXX test/cpp_headers/vhost.o 00:02:17.687 CXX test/cpp_headers/vmd.o 00:02:17.687 CXX test/cpp_headers/xor.o 00:02:17.687 CXX test/cpp_headers/zipf.o 00:02:17.945 LINK memory_ut 00:02:18.512 LINK cuse 00:02:18.769 LINK iscsi_fuzz 00:02:21.302 LINK esnap 00:02:21.561 00:02:21.561 real 0m46.547s 00:02:21.561 user 9m39.016s 00:02:21.561 sys 2m9.492s 00:02:21.561 02:07:24 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:21.561 02:07:24 -- common/autotest_common.sh@10 -- $ set +x 00:02:21.561 ************************************ 00:02:21.561 END TEST make 00:02:21.561 ************************************ 00:02:21.561 02:07:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:21.561 02:07:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:21.561 02:07:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:21.561 02:07:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:21.561 02:07:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:21.561 02:07:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:21.561 02:07:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:21.561 02:07:25 -- scripts/common.sh@335 -- # IFS=.-: 00:02:21.561 02:07:25 -- scripts/common.sh@335 -- # read -ra ver1 00:02:21.561 02:07:25 -- scripts/common.sh@336 -- # IFS=.-: 00:02:21.561 02:07:25 -- scripts/common.sh@336 -- # read -ra ver2 00:02:21.561 02:07:25 -- scripts/common.sh@337 -- # local 'op=<' 00:02:21.561 02:07:25 -- scripts/common.sh@339 -- # ver1_l=2 00:02:21.561 02:07:25 -- scripts/common.sh@340 -- # ver2_l=1 00:02:21.561 02:07:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:21.561 02:07:25 -- scripts/common.sh@343 -- # case "$op" in 00:02:21.561 02:07:25 -- scripts/common.sh@344 -- # : 1 00:02:21.561 02:07:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:21.561 02:07:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:21.561 02:07:25 -- scripts/common.sh@364 -- # decimal 1 00:02:21.561 02:07:25 -- scripts/common.sh@352 -- # local d=1 00:02:21.561 02:07:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:21.561 02:07:25 -- scripts/common.sh@354 -- # echo 1 00:02:21.561 02:07:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:21.561 02:07:25 -- scripts/common.sh@365 -- # decimal 2 00:02:21.561 02:07:25 -- scripts/common.sh@352 -- # local d=2 00:02:21.561 02:07:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:21.561 02:07:25 -- scripts/common.sh@354 -- # echo 2 00:02:21.561 02:07:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:21.561 02:07:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:21.561 02:07:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:21.561 02:07:25 -- scripts/common.sh@367 -- # return 0 00:02:21.561 02:07:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:21.561 02:07:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:21.561 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:21.561 --rc genhtml_branch_coverage=1 00:02:21.561 --rc genhtml_function_coverage=1 00:02:21.561 --rc genhtml_legend=1 00:02:21.561 --rc geninfo_all_blocks=1 00:02:21.561 --rc geninfo_unexecuted_blocks=1 00:02:21.561 00:02:21.561 ' 00:02:21.561 02:07:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:21.561 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:21.561 --rc genhtml_branch_coverage=1 00:02:21.561 --rc genhtml_function_coverage=1 00:02:21.561 --rc genhtml_legend=1 00:02:21.561 --rc geninfo_all_blocks=1 00:02:21.561 --rc geninfo_unexecuted_blocks=1 00:02:21.561 00:02:21.561 ' 00:02:21.561 02:07:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:21.561 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:21.561 --rc genhtml_branch_coverage=1 00:02:21.561 --rc genhtml_function_coverage=1 00:02:21.561 --rc genhtml_legend=1 00:02:21.561 --rc geninfo_all_blocks=1 00:02:21.561 --rc geninfo_unexecuted_blocks=1 00:02:21.561 00:02:21.561 ' 00:02:21.561 02:07:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:21.561 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:21.561 --rc genhtml_branch_coverage=1 00:02:21.561 --rc genhtml_function_coverage=1 00:02:21.561 --rc genhtml_legend=1 00:02:21.561 --rc geninfo_all_blocks=1 00:02:21.561 --rc geninfo_unexecuted_blocks=1 00:02:21.561 00:02:21.561 ' 00:02:21.561 02:07:25 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:02:21.561 02:07:25 -- nvmf/common.sh@7 -- # uname -s 00:02:21.561 02:07:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:21.561 02:07:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:21.561 02:07:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:21.561 02:07:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:21.561 02:07:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:21.561 02:07:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:21.561 02:07:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:21.561 02:07:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:21.561 02:07:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:21.561 02:07:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:21.561 02:07:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:02:21.561 02:07:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:02:21.561 02:07:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:21.561 02:07:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:21.561 02:07:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:21.561 02:07:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:02:21.561 02:07:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:21.561 02:07:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:21.561 02:07:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:21.561 02:07:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:21.561 02:07:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:21.561 02:07:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:21.561 02:07:25 -- paths/export.sh@5 -- # export PATH 00:02:21.561 02:07:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:21.561 02:07:25 -- nvmf/common.sh@46 -- # : 0 00:02:21.561 02:07:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:02:21.561 02:07:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:02:21.561 02:07:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:02:21.562 02:07:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:21.562 02:07:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:21.562 02:07:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:02:21.562 02:07:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:02:21.562 02:07:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:02:21.562 02:07:25 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:21.562 02:07:25 -- spdk/autotest.sh@32 -- # uname -s 00:02:21.562 02:07:25 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:21.562 02:07:25 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:21.562 02:07:25 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:21.562 02:07:25 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:21.562 02:07:25 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:21.562 02:07:25 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:21.562 02:07:25 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:21.562 02:07:25 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:21.562 02:07:25 -- spdk/autotest.sh@48 -- # udevadm_pid=4155246 00:02:21.562 02:07:25 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:21.562 02:07:25 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:21.562 02:07:25 -- spdk/autotest.sh@54 -- # echo 4155248 00:02:21.562 02:07:25 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:21.562 02:07:25 -- spdk/autotest.sh@56 -- # echo 4155249 00:02:21.562 02:07:25 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:21.562 02:07:25 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:02:21.562 02:07:25 -- spdk/autotest.sh@60 -- # echo 4155250 00:02:21.562 02:07:25 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:21.562 02:07:25 -- spdk/autotest.sh@62 -- # echo 4155251 00:02:21.562 02:07:25 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:21.562 02:07:25 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:21.562 02:07:25 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:02:21.562 02:07:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:02:21.562 02:07:25 -- common/autotest_common.sh@10 -- # set +x 00:02:21.562 02:07:25 -- spdk/autotest.sh@70 -- # create_test_list 00:02:21.562 02:07:25 -- common/autotest_common.sh@746 -- # xtrace_disable 00:02:21.562 02:07:25 -- common/autotest_common.sh@10 -- # set +x 00:02:21.562 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:02:21.562 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:02:21.562 02:07:25 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:02:21.562 02:07:25 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:21.562 02:07:25 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:21.562 02:07:25 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:02:21.562 02:07:25 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:21.562 02:07:25 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:02:21.562 02:07:25 -- common/autotest_common.sh@1450 -- # uname 00:02:21.562 02:07:25 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:02:21.562 02:07:25 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:02:21.562 02:07:25 -- common/autotest_common.sh@1470 -- # uname 00:02:21.562 02:07:25 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:02:21.562 02:07:25 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:02:21.562 02:07:25 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:02:21.820 lcov: LCOV version 1.15 00:02:21.820 02:07:25 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:02:25.108 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:25.108 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:25.108 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:25.109 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:25.109 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:25.109 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:02:57.189 02:07:57 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:02:57.189 02:07:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:02:57.189 02:07:57 -- common/autotest_common.sh@10 -- # set +x 00:02:57.189 02:07:57 -- spdk/autotest.sh@89 -- # rm -f 00:02:57.189 02:07:57 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:57.189 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:02:57.189 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:02:57.189 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:02:57.189 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:02:57.189 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:02:57.189 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:02:57.189 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:02:57.189 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:02:57.189 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:02:57.189 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:02:57.189 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:02:57.189 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:02:57.189 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:02:57.189 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:02:57.189 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:02:57.189 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:02:57.189 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:02:57.189 02:07:58 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:02:57.189 02:07:58 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:02:57.189 02:07:58 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:02:57.189 02:07:58 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:02:57.189 02:07:58 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:02:57.189 02:07:58 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:02:57.189 02:07:58 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:02:57.189 02:07:58 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:57.189 02:07:58 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:02:57.189 02:07:58 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:02:57.189 02:07:58 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:02:57.189 02:07:58 -- spdk/autotest.sh@108 -- # grep -v p 00:02:57.189 02:07:58 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:02:57.189 02:07:58 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:02:57.189 02:07:58 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:02:57.189 02:07:58 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:02:57.189 02:07:58 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:02:57.189 No valid GPT data, bailing 00:02:57.189 02:07:58 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:02:57.189 02:07:58 -- scripts/common.sh@393 -- # pt= 00:02:57.189 02:07:58 -- scripts/common.sh@394 -- # return 1 00:02:57.189 02:07:58 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:02:57.189 1+0 records in 00:02:57.189 1+0 records out 00:02:57.189 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00173961 s, 603 MB/s 00:02:57.189 02:07:58 -- spdk/autotest.sh@116 -- # sync 00:02:57.189 02:07:58 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:02:57.189 02:07:58 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:02:57.189 02:07:58 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:02:57.189 02:08:00 -- spdk/autotest.sh@122 -- # uname -s 00:02:57.189 02:08:00 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:02:57.189 02:08:00 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:02:57.189 02:08:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:57.189 02:08:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:57.189 02:08:00 -- common/autotest_common.sh@10 -- # set +x 00:02:57.189 ************************************ 00:02:57.189 START TEST setup.sh 00:02:57.189 ************************************ 00:02:57.189 02:08:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:02:57.189 * Looking for test storage... 00:02:57.189 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:57.189 02:08:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:57.189 02:08:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:57.189 02:08:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:57.189 02:08:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:57.189 02:08:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:57.189 02:08:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:57.189 02:08:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:57.189 02:08:00 -- scripts/common.sh@335 -- # IFS=.-: 00:02:57.189 02:08:00 -- scripts/common.sh@335 -- # read -ra ver1 00:02:57.189 02:08:00 -- scripts/common.sh@336 -- # IFS=.-: 00:02:57.189 02:08:00 -- scripts/common.sh@336 -- # read -ra ver2 00:02:57.189 02:08:00 -- scripts/common.sh@337 -- # local 'op=<' 00:02:57.189 02:08:00 -- scripts/common.sh@339 -- # ver1_l=2 00:02:57.190 02:08:00 -- scripts/common.sh@340 -- # ver2_l=1 00:02:57.190 02:08:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:57.190 02:08:00 -- scripts/common.sh@343 -- # case "$op" in 00:02:57.190 02:08:00 -- scripts/common.sh@344 -- # : 1 00:02:57.190 02:08:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:57.190 02:08:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:57.190 02:08:00 -- scripts/common.sh@364 -- # decimal 1 00:02:57.190 02:08:00 -- scripts/common.sh@352 -- # local d=1 00:02:57.190 02:08:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:57.190 02:08:00 -- scripts/common.sh@354 -- # echo 1 00:02:57.190 02:08:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:57.190 02:08:00 -- scripts/common.sh@365 -- # decimal 2 00:02:57.190 02:08:00 -- scripts/common.sh@352 -- # local d=2 00:02:57.190 02:08:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:57.190 02:08:00 -- scripts/common.sh@354 -- # echo 2 00:02:57.190 02:08:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:57.190 02:08:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:57.190 02:08:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:57.190 02:08:00 -- scripts/common.sh@367 -- # return 0 00:02:57.190 02:08:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:57.190 02:08:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:57.190 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:57.190 --rc genhtml_branch_coverage=1 00:02:57.190 --rc genhtml_function_coverage=1 00:02:57.190 --rc genhtml_legend=1 00:02:57.190 --rc geninfo_all_blocks=1 00:02:57.190 --rc geninfo_unexecuted_blocks=1 00:02:57.190 00:02:57.190 ' 00:02:57.190 02:08:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:57.190 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:57.190 --rc genhtml_branch_coverage=1 00:02:57.190 --rc genhtml_function_coverage=1 00:02:57.190 --rc genhtml_legend=1 00:02:57.190 --rc geninfo_all_blocks=1 00:02:57.190 --rc geninfo_unexecuted_blocks=1 00:02:57.190 00:02:57.190 ' 00:02:57.190 02:08:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:57.190 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:57.190 --rc genhtml_branch_coverage=1 00:02:57.190 --rc genhtml_function_coverage=1 00:02:57.190 --rc genhtml_legend=1 00:02:57.190 --rc geninfo_all_blocks=1 00:02:57.190 --rc geninfo_unexecuted_blocks=1 00:02:57.190 00:02:57.190 ' 00:02:57.190 02:08:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:57.190 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:57.190 --rc genhtml_branch_coverage=1 00:02:57.190 --rc genhtml_function_coverage=1 00:02:57.190 --rc genhtml_legend=1 00:02:57.190 --rc geninfo_all_blocks=1 00:02:57.190 --rc geninfo_unexecuted_blocks=1 00:02:57.190 00:02:57.190 ' 00:02:57.190 02:08:00 -- setup/test-setup.sh@10 -- # uname -s 00:02:57.190 02:08:00 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:02:57.190 02:08:00 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:02:57.190 02:08:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:57.190 02:08:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:57.190 02:08:00 -- common/autotest_common.sh@10 -- # set +x 00:02:57.190 ************************************ 00:02:57.190 START TEST acl 00:02:57.190 ************************************ 00:02:57.190 02:08:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:02:57.190 * Looking for test storage... 00:02:57.190 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:57.190 02:08:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:57.190 02:08:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:57.190 02:08:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:57.448 02:08:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:57.448 02:08:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:57.448 02:08:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:57.448 02:08:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:57.448 02:08:00 -- scripts/common.sh@335 -- # IFS=.-: 00:02:57.448 02:08:00 -- scripts/common.sh@335 -- # read -ra ver1 00:02:57.448 02:08:00 -- scripts/common.sh@336 -- # IFS=.-: 00:02:57.448 02:08:00 -- scripts/common.sh@336 -- # read -ra ver2 00:02:57.448 02:08:00 -- scripts/common.sh@337 -- # local 'op=<' 00:02:57.448 02:08:00 -- scripts/common.sh@339 -- # ver1_l=2 00:02:57.448 02:08:00 -- scripts/common.sh@340 -- # ver2_l=1 00:02:57.448 02:08:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:57.448 02:08:00 -- scripts/common.sh@343 -- # case "$op" in 00:02:57.448 02:08:00 -- scripts/common.sh@344 -- # : 1 00:02:57.448 02:08:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:57.448 02:08:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:57.448 02:08:00 -- scripts/common.sh@364 -- # decimal 1 00:02:57.448 02:08:00 -- scripts/common.sh@352 -- # local d=1 00:02:57.448 02:08:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:57.448 02:08:00 -- scripts/common.sh@354 -- # echo 1 00:02:57.448 02:08:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:57.448 02:08:00 -- scripts/common.sh@365 -- # decimal 2 00:02:57.448 02:08:00 -- scripts/common.sh@352 -- # local d=2 00:02:57.448 02:08:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:57.448 02:08:00 -- scripts/common.sh@354 -- # echo 2 00:02:57.448 02:08:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:57.448 02:08:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:57.448 02:08:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:57.448 02:08:00 -- scripts/common.sh@367 -- # return 0 00:02:57.448 02:08:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:57.448 02:08:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:57.448 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:57.448 --rc genhtml_branch_coverage=1 00:02:57.448 --rc genhtml_function_coverage=1 00:02:57.448 --rc genhtml_legend=1 00:02:57.448 --rc geninfo_all_blocks=1 00:02:57.448 --rc geninfo_unexecuted_blocks=1 00:02:57.448 00:02:57.448 ' 00:02:57.448 02:08:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:57.448 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:57.448 --rc genhtml_branch_coverage=1 00:02:57.448 --rc genhtml_function_coverage=1 00:02:57.448 --rc genhtml_legend=1 00:02:57.448 --rc geninfo_all_blocks=1 00:02:57.448 --rc geninfo_unexecuted_blocks=1 00:02:57.448 00:02:57.448 ' 00:02:57.448 02:08:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:57.448 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:57.448 --rc genhtml_branch_coverage=1 00:02:57.448 --rc genhtml_function_coverage=1 00:02:57.448 --rc genhtml_legend=1 00:02:57.448 --rc geninfo_all_blocks=1 00:02:57.448 --rc geninfo_unexecuted_blocks=1 00:02:57.448 00:02:57.448 ' 00:02:57.448 02:08:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:57.448 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:57.448 --rc genhtml_branch_coverage=1 00:02:57.448 --rc genhtml_function_coverage=1 00:02:57.448 --rc genhtml_legend=1 00:02:57.448 --rc geninfo_all_blocks=1 00:02:57.448 --rc geninfo_unexecuted_blocks=1 00:02:57.448 00:02:57.448 ' 00:02:57.448 02:08:00 -- setup/acl.sh@10 -- # get_zoned_devs 00:02:57.448 02:08:00 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:02:57.448 02:08:00 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:02:57.448 02:08:00 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:02:57.448 02:08:00 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:02:57.448 02:08:00 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:02:57.448 02:08:00 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:02:57.448 02:08:00 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:57.448 02:08:00 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:02:57.448 02:08:00 -- setup/acl.sh@12 -- # devs=() 00:02:57.448 02:08:00 -- setup/acl.sh@12 -- # declare -a devs 00:02:57.448 02:08:00 -- setup/acl.sh@13 -- # drivers=() 00:02:57.448 02:08:00 -- setup/acl.sh@13 -- # declare -A drivers 00:02:57.448 02:08:00 -- setup/acl.sh@51 -- # setup reset 00:02:57.448 02:08:00 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:57.448 02:08:00 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:58.822 02:08:02 -- setup/acl.sh@52 -- # collect_setup_devs 00:02:58.822 02:08:02 -- setup/acl.sh@16 -- # local dev driver 00:02:58.822 02:08:02 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:58.822 02:08:02 -- setup/acl.sh@15 -- # setup output status 00:02:58.822 02:08:02 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:58.822 02:08:02 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:02:59.757 Hugepages 00:02:59.757 node hugesize free / total 00:02:59.757 02:08:03 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:59.757 02:08:03 -- setup/acl.sh@19 -- # continue 00:02:59.757 02:08:03 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.757 02:08:03 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:59.757 02:08:03 -- setup/acl.sh@19 -- # continue 00:02:59.757 02:08:03 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.757 02:08:03 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:59.757 02:08:03 -- setup/acl.sh@19 -- # continue 00:02:59.757 02:08:03 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.757 00:02:59.757 Type BDF Vendor Device NUMA Driver Device Block devices 00:02:59.757 02:08:03 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:59.757 02:08:03 -- setup/acl.sh@19 -- # continue 00:02:59.757 02:08:03 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.757 02:08:03 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:02:59.757 02:08:03 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:59.757 02:08:03 -- setup/acl.sh@20 -- # continue 00:02:59.757 02:08:03 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.757 02:08:03 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:02:59.757 02:08:03 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:59.757 02:08:03 -- setup/acl.sh@20 -- # continue 00:02:59.757 02:08:03 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.757 02:08:03 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:02:59.757 02:08:03 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:59.757 02:08:03 -- setup/acl.sh@20 -- # continue 00:02:59.757 02:08:03 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.757 02:08:03 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:02:59.757 02:08:03 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:59.757 02:08:03 -- setup/acl.sh@20 -- # continue 00:02:59.757 02:08:03 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.757 02:08:03 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:02:59.757 02:08:03 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:59.757 02:08:03 -- setup/acl.sh@20 -- # continue 00:02:59.757 02:08:03 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.757 02:08:03 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:02:59.757 02:08:03 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:59.757 02:08:03 -- setup/acl.sh@20 -- # continue 00:02:59.757 02:08:03 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.757 02:08:03 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:02:59.757 02:08:03 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:59.757 02:08:03 -- setup/acl.sh@20 -- # continue 00:02:59.757 02:08:03 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.757 02:08:03 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:02:59.757 02:08:03 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:59.757 02:08:03 -- setup/acl.sh@20 -- # continue 00:02:59.757 02:08:03 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.757 02:08:03 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:02:59.757 02:08:03 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:59.757 02:08:03 -- setup/acl.sh@20 -- # continue 00:02:59.757 02:08:03 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.757 02:08:03 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:02:59.757 02:08:03 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:59.757 02:08:03 -- setup/acl.sh@20 -- # continue 00:02:59.757 02:08:03 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.015 02:08:03 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:03:00.015 02:08:03 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:00.015 02:08:03 -- setup/acl.sh@20 -- # continue 00:03:00.015 02:08:03 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.015 02:08:03 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:03:00.015 02:08:03 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:00.015 02:08:03 -- setup/acl.sh@20 -- # continue 00:03:00.015 02:08:03 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.015 02:08:03 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:03:00.015 02:08:03 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:00.015 02:08:03 -- setup/acl.sh@20 -- # continue 00:03:00.015 02:08:03 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.015 02:08:03 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:03:00.015 02:08:03 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:00.015 02:08:03 -- setup/acl.sh@20 -- # continue 00:03:00.015 02:08:03 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.015 02:08:03 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:03:00.015 02:08:03 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:00.015 02:08:03 -- setup/acl.sh@20 -- # continue 00:03:00.015 02:08:03 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.015 02:08:03 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:03:00.015 02:08:03 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:00.015 02:08:03 -- setup/acl.sh@20 -- # continue 00:03:00.015 02:08:03 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.015 02:08:03 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:03:00.015 02:08:03 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:03:00.015 02:08:03 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:00.015 02:08:03 -- setup/acl.sh@22 -- # devs+=("$dev") 00:03:00.015 02:08:03 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:03:00.015 02:08:03 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.015 02:08:03 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:03:00.015 02:08:03 -- setup/acl.sh@54 -- # run_test denied denied 00:03:00.015 02:08:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:00.015 02:08:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:00.015 02:08:03 -- common/autotest_common.sh@10 -- # set +x 00:03:00.015 ************************************ 00:03:00.015 START TEST denied 00:03:00.015 ************************************ 00:03:00.015 02:08:03 -- common/autotest_common.sh@1114 -- # denied 00:03:00.015 02:08:03 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:03:00.015 02:08:03 -- setup/acl.sh@38 -- # setup output config 00:03:00.015 02:08:03 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:03:00.015 02:08:03 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:00.015 02:08:03 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:01.392 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:03:01.392 02:08:05 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:03:01.392 02:08:05 -- setup/acl.sh@28 -- # local dev driver 00:03:01.392 02:08:05 -- setup/acl.sh@30 -- # for dev in "$@" 00:03:01.392 02:08:05 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:03:01.392 02:08:05 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:03:01.392 02:08:05 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:03:01.392 02:08:05 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:03:01.392 02:08:05 -- setup/acl.sh@41 -- # setup reset 00:03:01.392 02:08:05 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:01.392 02:08:05 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:03.924 00:03:03.924 real 0m3.935s 00:03:03.924 user 0m1.110s 00:03:03.924 sys 0m1.957s 00:03:03.924 02:08:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:03.924 02:08:07 -- common/autotest_common.sh@10 -- # set +x 00:03:03.924 ************************************ 00:03:03.924 END TEST denied 00:03:03.924 ************************************ 00:03:03.924 02:08:07 -- setup/acl.sh@55 -- # run_test allowed allowed 00:03:03.924 02:08:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:03.924 02:08:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:03.924 02:08:07 -- common/autotest_common.sh@10 -- # set +x 00:03:03.924 ************************************ 00:03:03.924 START TEST allowed 00:03:03.924 ************************************ 00:03:03.924 02:08:07 -- common/autotest_common.sh@1114 -- # allowed 00:03:03.924 02:08:07 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:03:03.924 02:08:07 -- setup/acl.sh@45 -- # setup output config 00:03:03.924 02:08:07 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:03:03.924 02:08:07 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:03.924 02:08:07 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:06.505 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:06.505 02:08:09 -- setup/acl.sh@47 -- # verify 00:03:06.505 02:08:09 -- setup/acl.sh@28 -- # local dev driver 00:03:06.505 02:08:09 -- setup/acl.sh@48 -- # setup reset 00:03:06.505 02:08:09 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:06.505 02:08:09 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:07.881 00:03:07.881 real 0m4.057s 00:03:07.881 user 0m1.119s 00:03:07.881 sys 0m1.833s 00:03:07.881 02:08:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:07.881 02:08:11 -- common/autotest_common.sh@10 -- # set +x 00:03:07.881 ************************************ 00:03:07.881 END TEST allowed 00:03:07.881 ************************************ 00:03:07.881 00:03:07.881 real 0m10.769s 00:03:07.881 user 0m3.321s 00:03:07.881 sys 0m5.568s 00:03:07.881 02:08:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:07.881 02:08:11 -- common/autotest_common.sh@10 -- # set +x 00:03:07.881 ************************************ 00:03:07.881 END TEST acl 00:03:07.881 ************************************ 00:03:08.141 02:08:11 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:08.141 02:08:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:08.141 02:08:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:08.141 02:08:11 -- common/autotest_common.sh@10 -- # set +x 00:03:08.141 ************************************ 00:03:08.141 START TEST hugepages 00:03:08.141 ************************************ 00:03:08.141 02:08:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:08.141 * Looking for test storage... 00:03:08.141 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:08.141 02:08:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:08.141 02:08:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:08.141 02:08:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:08.141 02:08:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:08.141 02:08:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:08.141 02:08:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:08.141 02:08:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:08.141 02:08:11 -- scripts/common.sh@335 -- # IFS=.-: 00:03:08.141 02:08:11 -- scripts/common.sh@335 -- # read -ra ver1 00:03:08.141 02:08:11 -- scripts/common.sh@336 -- # IFS=.-: 00:03:08.141 02:08:11 -- scripts/common.sh@336 -- # read -ra ver2 00:03:08.141 02:08:11 -- scripts/common.sh@337 -- # local 'op=<' 00:03:08.141 02:08:11 -- scripts/common.sh@339 -- # ver1_l=2 00:03:08.141 02:08:11 -- scripts/common.sh@340 -- # ver2_l=1 00:03:08.141 02:08:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:08.141 02:08:11 -- scripts/common.sh@343 -- # case "$op" in 00:03:08.141 02:08:11 -- scripts/common.sh@344 -- # : 1 00:03:08.141 02:08:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:08.141 02:08:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:08.141 02:08:11 -- scripts/common.sh@364 -- # decimal 1 00:03:08.141 02:08:11 -- scripts/common.sh@352 -- # local d=1 00:03:08.141 02:08:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:08.141 02:08:11 -- scripts/common.sh@354 -- # echo 1 00:03:08.141 02:08:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:08.141 02:08:11 -- scripts/common.sh@365 -- # decimal 2 00:03:08.141 02:08:11 -- scripts/common.sh@352 -- # local d=2 00:03:08.141 02:08:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:08.141 02:08:11 -- scripts/common.sh@354 -- # echo 2 00:03:08.141 02:08:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:08.141 02:08:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:08.141 02:08:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:08.141 02:08:11 -- scripts/common.sh@367 -- # return 0 00:03:08.141 02:08:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:08.141 02:08:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:08.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.141 --rc genhtml_branch_coverage=1 00:03:08.141 --rc genhtml_function_coverage=1 00:03:08.141 --rc genhtml_legend=1 00:03:08.141 --rc geninfo_all_blocks=1 00:03:08.141 --rc geninfo_unexecuted_blocks=1 00:03:08.141 00:03:08.141 ' 00:03:08.141 02:08:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:08.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.141 --rc genhtml_branch_coverage=1 00:03:08.141 --rc genhtml_function_coverage=1 00:03:08.141 --rc genhtml_legend=1 00:03:08.141 --rc geninfo_all_blocks=1 00:03:08.141 --rc geninfo_unexecuted_blocks=1 00:03:08.141 00:03:08.141 ' 00:03:08.141 02:08:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:08.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.141 --rc genhtml_branch_coverage=1 00:03:08.141 --rc genhtml_function_coverage=1 00:03:08.141 --rc genhtml_legend=1 00:03:08.141 --rc geninfo_all_blocks=1 00:03:08.141 --rc geninfo_unexecuted_blocks=1 00:03:08.141 00:03:08.141 ' 00:03:08.141 02:08:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:08.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.141 --rc genhtml_branch_coverage=1 00:03:08.141 --rc genhtml_function_coverage=1 00:03:08.141 --rc genhtml_legend=1 00:03:08.141 --rc geninfo_all_blocks=1 00:03:08.141 --rc geninfo_unexecuted_blocks=1 00:03:08.141 00:03:08.141 ' 00:03:08.141 02:08:11 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:08.141 02:08:11 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:08.141 02:08:11 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:08.141 02:08:11 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:08.141 02:08:11 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:08.141 02:08:11 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:08.141 02:08:11 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:08.141 02:08:11 -- setup/common.sh@18 -- # local node= 00:03:08.141 02:08:11 -- setup/common.sh@19 -- # local var val 00:03:08.141 02:08:11 -- setup/common.sh@20 -- # local mem_f mem 00:03:08.141 02:08:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:08.141 02:08:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:08.141 02:08:11 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:08.141 02:08:11 -- setup/common.sh@28 -- # mapfile -t mem 00:03:08.141 02:08:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:08.141 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.141 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.141 02:08:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43155700 kB' 'MemAvailable: 46914432 kB' 'Buffers: 3740 kB' 'Cached: 10711088 kB' 'SwapCached: 0 kB' 'Active: 7398348 kB' 'Inactive: 3759496 kB' 'Active(anon): 6997316 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446384 kB' 'Mapped: 206812 kB' 'Shmem: 6554300 kB' 'KReclaimable: 183564 kB' 'Slab: 693476 kB' 'SReclaimable: 183564 kB' 'SUnreclaim: 509912 kB' 'KernelStack: 12896 kB' 'PageTables: 8216 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559284 kB' 'Committed_AS: 8099148 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198264 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:08.141 02:08:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.141 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.141 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.141 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.141 02:08:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.141 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.141 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.141 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.141 02:08:11 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.141 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.141 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.141 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.141 02:08:11 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.141 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.141 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.141 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.141 02:08:11 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.141 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.141 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.141 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.141 02:08:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.141 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.142 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.142 02:08:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.143 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.143 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.143 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.143 02:08:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.143 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.143 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.143 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.143 02:08:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.143 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.143 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.143 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.143 02:08:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.143 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.143 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.143 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.143 02:08:11 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.143 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.143 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.143 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.143 02:08:11 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.143 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.143 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.143 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.143 02:08:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.143 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.143 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.143 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.143 02:08:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.143 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.143 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.143 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.143 02:08:11 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.143 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.143 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.143 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.143 02:08:11 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.143 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.143 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.143 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.143 02:08:11 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.143 02:08:11 -- setup/common.sh@32 -- # continue 00:03:08.143 02:08:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.143 02:08:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.143 02:08:11 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:08.143 02:08:11 -- setup/common.sh@33 -- # echo 2048 00:03:08.143 02:08:11 -- setup/common.sh@33 -- # return 0 00:03:08.143 02:08:11 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:08.143 02:08:11 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:08.143 02:08:11 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:08.143 02:08:11 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:08.143 02:08:11 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:08.143 02:08:11 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:08.143 02:08:11 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:08.143 02:08:11 -- setup/hugepages.sh@207 -- # get_nodes 00:03:08.143 02:08:11 -- setup/hugepages.sh@27 -- # local node 00:03:08.143 02:08:11 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:08.143 02:08:11 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:08.143 02:08:11 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:08.143 02:08:11 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:08.143 02:08:11 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:08.143 02:08:11 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:08.143 02:08:11 -- setup/hugepages.sh@208 -- # clear_hp 00:03:08.143 02:08:11 -- setup/hugepages.sh@37 -- # local node hp 00:03:08.143 02:08:11 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:08.143 02:08:11 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:08.143 02:08:11 -- setup/hugepages.sh@41 -- # echo 0 00:03:08.143 02:08:11 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:08.143 02:08:11 -- setup/hugepages.sh@41 -- # echo 0 00:03:08.143 02:08:11 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:08.143 02:08:11 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:08.143 02:08:11 -- setup/hugepages.sh@41 -- # echo 0 00:03:08.143 02:08:11 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:08.143 02:08:11 -- setup/hugepages.sh@41 -- # echo 0 00:03:08.143 02:08:11 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:08.143 02:08:11 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:08.143 02:08:11 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:08.143 02:08:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:08.143 02:08:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:08.143 02:08:11 -- common/autotest_common.sh@10 -- # set +x 00:03:08.143 ************************************ 00:03:08.143 START TEST default_setup 00:03:08.143 ************************************ 00:03:08.143 02:08:11 -- common/autotest_common.sh@1114 -- # default_setup 00:03:08.143 02:08:11 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:08.143 02:08:11 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:08.143 02:08:11 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:08.143 02:08:11 -- setup/hugepages.sh@51 -- # shift 00:03:08.143 02:08:11 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:08.143 02:08:11 -- setup/hugepages.sh@52 -- # local node_ids 00:03:08.143 02:08:11 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:08.143 02:08:11 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:08.143 02:08:11 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:08.143 02:08:11 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:08.143 02:08:11 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:08.143 02:08:11 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:08.143 02:08:11 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:08.143 02:08:11 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:08.143 02:08:11 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:08.143 02:08:11 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:08.143 02:08:11 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:08.143 02:08:11 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:08.143 02:08:11 -- setup/hugepages.sh@73 -- # return 0 00:03:08.143 02:08:11 -- setup/hugepages.sh@137 -- # setup output 00:03:08.143 02:08:11 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:08.143 02:08:11 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:09.517 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:09.517 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:09.517 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:09.517 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:09.517 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:09.517 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:09.517 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:09.517 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:09.517 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:09.517 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:09.517 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:09.517 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:09.517 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:09.517 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:09.517 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:09.517 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:10.451 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:10.711 02:08:14 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:03:10.711 02:08:14 -- setup/hugepages.sh@89 -- # local node 00:03:10.711 02:08:14 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:10.711 02:08:14 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:10.711 02:08:14 -- setup/hugepages.sh@92 -- # local surp 00:03:10.711 02:08:14 -- setup/hugepages.sh@93 -- # local resv 00:03:10.711 02:08:14 -- setup/hugepages.sh@94 -- # local anon 00:03:10.711 02:08:14 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:10.711 02:08:14 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:10.711 02:08:14 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:10.711 02:08:14 -- setup/common.sh@18 -- # local node= 00:03:10.711 02:08:14 -- setup/common.sh@19 -- # local var val 00:03:10.711 02:08:14 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.711 02:08:14 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.711 02:08:14 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:10.711 02:08:14 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:10.711 02:08:14 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.711 02:08:14 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.711 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.711 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.711 02:08:14 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45283232 kB' 'MemAvailable: 49041932 kB' 'Buffers: 3740 kB' 'Cached: 10711180 kB' 'SwapCached: 0 kB' 'Active: 7402008 kB' 'Inactive: 3759496 kB' 'Active(anon): 7000976 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 449828 kB' 'Mapped: 206748 kB' 'Shmem: 6554392 kB' 'KReclaimable: 183500 kB' 'Slab: 693392 kB' 'SReclaimable: 183500 kB' 'SUnreclaim: 509892 kB' 'KernelStack: 12848 kB' 'PageTables: 8468 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8104688 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:10.711 02:08:14 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.711 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.711 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.711 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.711 02:08:14 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.711 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.711 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.711 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.711 02:08:14 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.711 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.711 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.711 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.711 02:08:14 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.712 02:08:14 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.712 02:08:14 -- setup/common.sh@33 -- # echo 0 00:03:10.712 02:08:14 -- setup/common.sh@33 -- # return 0 00:03:10.712 02:08:14 -- setup/hugepages.sh@97 -- # anon=0 00:03:10.712 02:08:14 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:10.712 02:08:14 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:10.712 02:08:14 -- setup/common.sh@18 -- # local node= 00:03:10.712 02:08:14 -- setup/common.sh@19 -- # local var val 00:03:10.712 02:08:14 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.712 02:08:14 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.712 02:08:14 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:10.712 02:08:14 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:10.712 02:08:14 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.712 02:08:14 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.712 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45283824 kB' 'MemAvailable: 49042524 kB' 'Buffers: 3740 kB' 'Cached: 10711180 kB' 'SwapCached: 0 kB' 'Active: 7402036 kB' 'Inactive: 3759496 kB' 'Active(anon): 7001004 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 449888 kB' 'Mapped: 206748 kB' 'Shmem: 6554392 kB' 'KReclaimable: 183500 kB' 'Slab: 693412 kB' 'SReclaimable: 183500 kB' 'SUnreclaim: 509912 kB' 'KernelStack: 12896 kB' 'PageTables: 8232 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8104700 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.713 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.713 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.714 02:08:14 -- setup/common.sh@33 -- # echo 0 00:03:10.714 02:08:14 -- setup/common.sh@33 -- # return 0 00:03:10.714 02:08:14 -- setup/hugepages.sh@99 -- # surp=0 00:03:10.714 02:08:14 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:10.714 02:08:14 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:10.714 02:08:14 -- setup/common.sh@18 -- # local node= 00:03:10.714 02:08:14 -- setup/common.sh@19 -- # local var val 00:03:10.714 02:08:14 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.714 02:08:14 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.714 02:08:14 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:10.714 02:08:14 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:10.714 02:08:14 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.714 02:08:14 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45283920 kB' 'MemAvailable: 49042620 kB' 'Buffers: 3740 kB' 'Cached: 10711196 kB' 'SwapCached: 0 kB' 'Active: 7400644 kB' 'Inactive: 3759496 kB' 'Active(anon): 6999612 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448480 kB' 'Mapped: 206696 kB' 'Shmem: 6554408 kB' 'KReclaimable: 183500 kB' 'Slab: 693404 kB' 'SReclaimable: 183500 kB' 'SUnreclaim: 509904 kB' 'KernelStack: 12896 kB' 'PageTables: 7840 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8104716 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.714 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.714 02:08:14 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.715 02:08:14 -- setup/common.sh@33 -- # echo 0 00:03:10.715 02:08:14 -- setup/common.sh@33 -- # return 0 00:03:10.715 02:08:14 -- setup/hugepages.sh@100 -- # resv=0 00:03:10.715 02:08:14 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:10.715 nr_hugepages=1024 00:03:10.715 02:08:14 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:10.715 resv_hugepages=0 00:03:10.715 02:08:14 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:10.715 surplus_hugepages=0 00:03:10.715 02:08:14 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:10.715 anon_hugepages=0 00:03:10.715 02:08:14 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:10.715 02:08:14 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:10.715 02:08:14 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:10.715 02:08:14 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:10.715 02:08:14 -- setup/common.sh@18 -- # local node= 00:03:10.715 02:08:14 -- setup/common.sh@19 -- # local var val 00:03:10.715 02:08:14 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.715 02:08:14 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.715 02:08:14 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:10.715 02:08:14 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:10.715 02:08:14 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.715 02:08:14 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45284756 kB' 'MemAvailable: 49043456 kB' 'Buffers: 3740 kB' 'Cached: 10711208 kB' 'SwapCached: 0 kB' 'Active: 7400292 kB' 'Inactive: 3759496 kB' 'Active(anon): 6999260 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448152 kB' 'Mapped: 206696 kB' 'Shmem: 6554420 kB' 'KReclaimable: 183500 kB' 'Slab: 693652 kB' 'SReclaimable: 183500 kB' 'SUnreclaim: 510152 kB' 'KernelStack: 12912 kB' 'PageTables: 8144 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8104732 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.715 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.715 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.716 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.716 02:08:14 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.717 02:08:14 -- setup/common.sh@33 -- # echo 1024 00:03:10.717 02:08:14 -- setup/common.sh@33 -- # return 0 00:03:10.717 02:08:14 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:10.717 02:08:14 -- setup/hugepages.sh@112 -- # get_nodes 00:03:10.717 02:08:14 -- setup/hugepages.sh@27 -- # local node 00:03:10.717 02:08:14 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:10.717 02:08:14 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:10.717 02:08:14 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:10.717 02:08:14 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:10.717 02:08:14 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:10.717 02:08:14 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:10.717 02:08:14 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:10.717 02:08:14 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:10.717 02:08:14 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:10.717 02:08:14 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:10.717 02:08:14 -- setup/common.sh@18 -- # local node=0 00:03:10.717 02:08:14 -- setup/common.sh@19 -- # local var val 00:03:10.717 02:08:14 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.717 02:08:14 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.717 02:08:14 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:10.717 02:08:14 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:10.717 02:08:14 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.717 02:08:14 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27036072 kB' 'MemUsed: 5789784 kB' 'SwapCached: 0 kB' 'Active: 2294728 kB' 'Inactive: 151892 kB' 'Active(anon): 2152484 kB' 'Inactive(anon): 0 kB' 'Active(file): 142244 kB' 'Inactive(file): 151892 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2338216 kB' 'Mapped: 75516 kB' 'AnonPages: 111604 kB' 'Shmem: 2044080 kB' 'KernelStack: 6744 kB' 'PageTables: 3888 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 66604 kB' 'Slab: 372788 kB' 'SReclaimable: 66604 kB' 'SUnreclaim: 306184 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.717 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.717 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.718 02:08:14 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.718 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.718 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.718 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.718 02:08:14 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.718 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.718 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.718 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.718 02:08:14 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.718 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.718 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.718 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.718 02:08:14 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.718 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.718 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.718 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.718 02:08:14 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.718 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.718 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.718 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.718 02:08:14 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.718 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.718 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.718 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.718 02:08:14 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.718 02:08:14 -- setup/common.sh@32 -- # continue 00:03:10.718 02:08:14 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.718 02:08:14 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.718 02:08:14 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.718 02:08:14 -- setup/common.sh@33 -- # echo 0 00:03:10.718 02:08:14 -- setup/common.sh@33 -- # return 0 00:03:10.718 02:08:14 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:10.718 02:08:14 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:10.718 02:08:14 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:10.718 02:08:14 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:10.718 02:08:14 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:10.718 node0=1024 expecting 1024 00:03:10.718 02:08:14 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:10.718 00:03:10.718 real 0m2.510s 00:03:10.718 user 0m0.675s 00:03:10.718 sys 0m0.957s 00:03:10.718 02:08:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:10.718 02:08:14 -- common/autotest_common.sh@10 -- # set +x 00:03:10.718 ************************************ 00:03:10.718 END TEST default_setup 00:03:10.718 ************************************ 00:03:10.718 02:08:14 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:03:10.718 02:08:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:10.718 02:08:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:10.718 02:08:14 -- common/autotest_common.sh@10 -- # set +x 00:03:10.718 ************************************ 00:03:10.718 START TEST per_node_1G_alloc 00:03:10.718 ************************************ 00:03:10.718 02:08:14 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:03:10.718 02:08:14 -- setup/hugepages.sh@143 -- # local IFS=, 00:03:10.718 02:08:14 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:03:10.718 02:08:14 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:10.718 02:08:14 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:03:10.718 02:08:14 -- setup/hugepages.sh@51 -- # shift 00:03:10.718 02:08:14 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:03:10.718 02:08:14 -- setup/hugepages.sh@52 -- # local node_ids 00:03:10.718 02:08:14 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:10.718 02:08:14 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:10.718 02:08:14 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:03:10.718 02:08:14 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:03:10.718 02:08:14 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:10.718 02:08:14 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:10.718 02:08:14 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:10.718 02:08:14 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:10.718 02:08:14 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:10.718 02:08:14 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:03:10.718 02:08:14 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:10.718 02:08:14 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:10.718 02:08:14 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:10.718 02:08:14 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:10.718 02:08:14 -- setup/hugepages.sh@73 -- # return 0 00:03:10.718 02:08:14 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:03:10.718 02:08:14 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:03:10.718 02:08:14 -- setup/hugepages.sh@146 -- # setup output 00:03:10.718 02:08:14 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:10.718 02:08:14 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:12.114 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:12.114 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:12.114 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:12.114 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:12.114 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:12.114 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:12.114 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:12.114 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:12.114 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:12.114 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:12.114 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:12.114 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:12.114 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:12.114 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:12.114 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:12.114 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:12.114 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:12.114 02:08:15 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:03:12.114 02:08:15 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:03:12.114 02:08:15 -- setup/hugepages.sh@89 -- # local node 00:03:12.114 02:08:15 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:12.114 02:08:15 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:12.114 02:08:15 -- setup/hugepages.sh@92 -- # local surp 00:03:12.114 02:08:15 -- setup/hugepages.sh@93 -- # local resv 00:03:12.114 02:08:15 -- setup/hugepages.sh@94 -- # local anon 00:03:12.114 02:08:15 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:12.114 02:08:15 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:12.114 02:08:15 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:12.114 02:08:15 -- setup/common.sh@18 -- # local node= 00:03:12.114 02:08:15 -- setup/common.sh@19 -- # local var val 00:03:12.114 02:08:15 -- setup/common.sh@20 -- # local mem_f mem 00:03:12.114 02:08:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:12.114 02:08:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:12.114 02:08:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:12.114 02:08:15 -- setup/common.sh@28 -- # mapfile -t mem 00:03:12.114 02:08:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:12.114 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.114 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.114 02:08:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45261164 kB' 'MemAvailable: 49019864 kB' 'Buffers: 3740 kB' 'Cached: 10711428 kB' 'SwapCached: 0 kB' 'Active: 7400772 kB' 'Inactive: 3759496 kB' 'Active(anon): 6999740 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448348 kB' 'Mapped: 207172 kB' 'Shmem: 6554640 kB' 'KReclaimable: 183500 kB' 'Slab: 693492 kB' 'SReclaimable: 183500 kB' 'SUnreclaim: 509992 kB' 'KernelStack: 12880 kB' 'PageTables: 8008 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8104696 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198536 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:12.114 02:08:15 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.115 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.115 02:08:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.115 02:08:15 -- setup/common.sh@33 -- # echo 0 00:03:12.115 02:08:15 -- setup/common.sh@33 -- # return 0 00:03:12.115 02:08:15 -- setup/hugepages.sh@97 -- # anon=0 00:03:12.115 02:08:15 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:12.116 02:08:15 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:12.116 02:08:15 -- setup/common.sh@18 -- # local node= 00:03:12.116 02:08:15 -- setup/common.sh@19 -- # local var val 00:03:12.116 02:08:15 -- setup/common.sh@20 -- # local mem_f mem 00:03:12.116 02:08:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:12.116 02:08:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:12.116 02:08:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:12.116 02:08:15 -- setup/common.sh@28 -- # mapfile -t mem 00:03:12.116 02:08:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45260684 kB' 'MemAvailable: 49019384 kB' 'Buffers: 3740 kB' 'Cached: 10711432 kB' 'SwapCached: 0 kB' 'Active: 7400876 kB' 'Inactive: 3759496 kB' 'Active(anon): 6999844 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448376 kB' 'Mapped: 207172 kB' 'Shmem: 6554644 kB' 'KReclaimable: 183500 kB' 'Slab: 693548 kB' 'SReclaimable: 183500 kB' 'SUnreclaim: 510048 kB' 'KernelStack: 12880 kB' 'PageTables: 7952 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8104712 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198504 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.116 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.116 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.117 02:08:15 -- setup/common.sh@33 -- # echo 0 00:03:12.117 02:08:15 -- setup/common.sh@33 -- # return 0 00:03:12.117 02:08:15 -- setup/hugepages.sh@99 -- # surp=0 00:03:12.117 02:08:15 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:12.117 02:08:15 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:12.117 02:08:15 -- setup/common.sh@18 -- # local node= 00:03:12.117 02:08:15 -- setup/common.sh@19 -- # local var val 00:03:12.117 02:08:15 -- setup/common.sh@20 -- # local mem_f mem 00:03:12.117 02:08:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:12.117 02:08:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:12.117 02:08:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:12.117 02:08:15 -- setup/common.sh@28 -- # mapfile -t mem 00:03:12.117 02:08:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45260860 kB' 'MemAvailable: 49019560 kB' 'Buffers: 3740 kB' 'Cached: 10711444 kB' 'SwapCached: 0 kB' 'Active: 7400604 kB' 'Inactive: 3759496 kB' 'Active(anon): 6999572 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448172 kB' 'Mapped: 206744 kB' 'Shmem: 6554656 kB' 'KReclaimable: 183500 kB' 'Slab: 693620 kB' 'SReclaimable: 183500 kB' 'SUnreclaim: 510120 kB' 'KernelStack: 12960 kB' 'PageTables: 8188 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8105092 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198488 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.117 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.117 02:08:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.118 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.118 02:08:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.119 02:08:15 -- setup/common.sh@33 -- # echo 0 00:03:12.119 02:08:15 -- setup/common.sh@33 -- # return 0 00:03:12.119 02:08:15 -- setup/hugepages.sh@100 -- # resv=0 00:03:12.119 02:08:15 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:12.119 nr_hugepages=1024 00:03:12.119 02:08:15 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:12.119 resv_hugepages=0 00:03:12.119 02:08:15 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:12.119 surplus_hugepages=0 00:03:12.119 02:08:15 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:12.119 anon_hugepages=0 00:03:12.119 02:08:15 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:12.119 02:08:15 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:12.119 02:08:15 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:12.119 02:08:15 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:12.119 02:08:15 -- setup/common.sh@18 -- # local node= 00:03:12.119 02:08:15 -- setup/common.sh@19 -- # local var val 00:03:12.119 02:08:15 -- setup/common.sh@20 -- # local mem_f mem 00:03:12.119 02:08:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:12.119 02:08:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:12.119 02:08:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:12.119 02:08:15 -- setup/common.sh@28 -- # mapfile -t mem 00:03:12.119 02:08:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.119 02:08:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45260356 kB' 'MemAvailable: 49019056 kB' 'Buffers: 3740 kB' 'Cached: 10711448 kB' 'SwapCached: 0 kB' 'Active: 7400744 kB' 'Inactive: 3759496 kB' 'Active(anon): 6999712 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448312 kB' 'Mapped: 206744 kB' 'Shmem: 6554660 kB' 'KReclaimable: 183500 kB' 'Slab: 693620 kB' 'SReclaimable: 183500 kB' 'SUnreclaim: 510120 kB' 'KernelStack: 12960 kB' 'PageTables: 8188 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8105108 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198488 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.119 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.119 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.120 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.120 02:08:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.120 02:08:15 -- setup/common.sh@33 -- # echo 1024 00:03:12.120 02:08:15 -- setup/common.sh@33 -- # return 0 00:03:12.120 02:08:15 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:12.120 02:08:15 -- setup/hugepages.sh@112 -- # get_nodes 00:03:12.120 02:08:15 -- setup/hugepages.sh@27 -- # local node 00:03:12.120 02:08:15 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:12.120 02:08:15 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:12.120 02:08:15 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:12.120 02:08:15 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:12.120 02:08:15 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:12.120 02:08:15 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:12.120 02:08:15 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:12.120 02:08:15 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:12.120 02:08:15 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:12.120 02:08:15 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:12.120 02:08:15 -- setup/common.sh@18 -- # local node=0 00:03:12.120 02:08:15 -- setup/common.sh@19 -- # local var val 00:03:12.120 02:08:15 -- setup/common.sh@20 -- # local mem_f mem 00:03:12.120 02:08:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:12.120 02:08:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:12.120 02:08:15 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:12.121 02:08:15 -- setup/common.sh@28 -- # mapfile -t mem 00:03:12.121 02:08:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 28070348 kB' 'MemUsed: 4755508 kB' 'SwapCached: 0 kB' 'Active: 2292456 kB' 'Inactive: 151892 kB' 'Active(anon): 2150212 kB' 'Inactive(anon): 0 kB' 'Active(file): 142244 kB' 'Inactive(file): 151892 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2338284 kB' 'Mapped: 75520 kB' 'AnonPages: 109200 kB' 'Shmem: 2044148 kB' 'KernelStack: 6744 kB' 'PageTables: 3744 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 66604 kB' 'Slab: 372812 kB' 'SReclaimable: 66604 kB' 'SUnreclaim: 306208 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.121 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.121 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@33 -- # echo 0 00:03:12.122 02:08:15 -- setup/common.sh@33 -- # return 0 00:03:12.122 02:08:15 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:12.122 02:08:15 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:12.122 02:08:15 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:12.122 02:08:15 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:12.122 02:08:15 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:12.122 02:08:15 -- setup/common.sh@18 -- # local node=1 00:03:12.122 02:08:15 -- setup/common.sh@19 -- # local var val 00:03:12.122 02:08:15 -- setup/common.sh@20 -- # local mem_f mem 00:03:12.122 02:08:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:12.122 02:08:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:12.122 02:08:15 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:12.122 02:08:15 -- setup/common.sh@28 -- # mapfile -t mem 00:03:12.122 02:08:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 17190008 kB' 'MemUsed: 10519800 kB' 'SwapCached: 0 kB' 'Active: 5108312 kB' 'Inactive: 3607604 kB' 'Active(anon): 4849524 kB' 'Inactive(anon): 0 kB' 'Active(file): 258788 kB' 'Inactive(file): 3607604 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8376932 kB' 'Mapped: 131224 kB' 'AnonPages: 339136 kB' 'Shmem: 4510540 kB' 'KernelStack: 6200 kB' 'PageTables: 4392 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 116896 kB' 'Slab: 320808 kB' 'SReclaimable: 116896 kB' 'SUnreclaim: 203912 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.122 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.122 02:08:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.123 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.123 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.123 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.123 02:08:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.123 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.123 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.123 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.123 02:08:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.123 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.123 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.123 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.123 02:08:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.123 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.123 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.123 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.123 02:08:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.123 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.123 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.123 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.123 02:08:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.123 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.123 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.123 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.123 02:08:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.123 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.123 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.123 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.123 02:08:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.123 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.123 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.123 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.123 02:08:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.123 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.123 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.123 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.123 02:08:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.123 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.123 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.123 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.123 02:08:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.123 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.123 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.123 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.123 02:08:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.123 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.123 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.123 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.123 02:08:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.123 02:08:15 -- setup/common.sh@32 -- # continue 00:03:12.123 02:08:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.123 02:08:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.123 02:08:15 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.123 02:08:15 -- setup/common.sh@33 -- # echo 0 00:03:12.123 02:08:15 -- setup/common.sh@33 -- # return 0 00:03:12.123 02:08:15 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:12.123 02:08:15 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:12.123 02:08:15 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:12.123 02:08:15 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:12.123 02:08:15 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:12.123 node0=512 expecting 512 00:03:12.123 02:08:15 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:12.123 02:08:15 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:12.123 02:08:15 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:12.123 02:08:15 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:12.123 node1=512 expecting 512 00:03:12.123 02:08:15 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:12.123 00:03:12.123 real 0m1.386s 00:03:12.123 user 0m0.575s 00:03:12.123 sys 0m0.774s 00:03:12.123 02:08:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:12.123 02:08:15 -- common/autotest_common.sh@10 -- # set +x 00:03:12.123 ************************************ 00:03:12.123 END TEST per_node_1G_alloc 00:03:12.123 ************************************ 00:03:12.123 02:08:15 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:03:12.123 02:08:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:12.123 02:08:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:12.123 02:08:15 -- common/autotest_common.sh@10 -- # set +x 00:03:12.123 ************************************ 00:03:12.123 START TEST even_2G_alloc 00:03:12.123 ************************************ 00:03:12.123 02:08:15 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:03:12.123 02:08:15 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:03:12.123 02:08:15 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:12.123 02:08:15 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:12.123 02:08:15 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:12.123 02:08:15 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:12.123 02:08:15 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:12.123 02:08:15 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:12.123 02:08:15 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:12.123 02:08:15 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:12.123 02:08:15 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:12.123 02:08:15 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:12.123 02:08:15 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:12.123 02:08:15 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:12.123 02:08:15 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:12.123 02:08:15 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:12.123 02:08:15 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:12.123 02:08:15 -- setup/hugepages.sh@83 -- # : 512 00:03:12.123 02:08:15 -- setup/hugepages.sh@84 -- # : 1 00:03:12.123 02:08:15 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:12.123 02:08:15 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:12.123 02:08:15 -- setup/hugepages.sh@83 -- # : 0 00:03:12.123 02:08:15 -- setup/hugepages.sh@84 -- # : 0 00:03:12.123 02:08:15 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:12.123 02:08:15 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:03:12.123 02:08:15 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:03:12.123 02:08:15 -- setup/hugepages.sh@153 -- # setup output 00:03:12.123 02:08:15 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:12.123 02:08:15 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:13.502 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:13.502 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:13.502 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:13.502 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:13.502 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:13.502 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:13.502 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:13.502 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:13.502 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:13.502 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:13.502 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:13.502 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:13.502 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:13.502 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:13.502 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:13.502 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:13.502 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:13.502 02:08:17 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:03:13.502 02:08:17 -- setup/hugepages.sh@89 -- # local node 00:03:13.502 02:08:17 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:13.502 02:08:17 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:13.502 02:08:17 -- setup/hugepages.sh@92 -- # local surp 00:03:13.502 02:08:17 -- setup/hugepages.sh@93 -- # local resv 00:03:13.502 02:08:17 -- setup/hugepages.sh@94 -- # local anon 00:03:13.502 02:08:17 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:13.502 02:08:17 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:13.502 02:08:17 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:13.502 02:08:17 -- setup/common.sh@18 -- # local node= 00:03:13.503 02:08:17 -- setup/common.sh@19 -- # local var val 00:03:13.503 02:08:17 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.503 02:08:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.503 02:08:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:13.503 02:08:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:13.503 02:08:17 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.503 02:08:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45258024 kB' 'MemAvailable: 49016724 kB' 'Buffers: 3740 kB' 'Cached: 10711528 kB' 'SwapCached: 0 kB' 'Active: 7401248 kB' 'Inactive: 3759496 kB' 'Active(anon): 7000216 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448692 kB' 'Mapped: 206724 kB' 'Shmem: 6554740 kB' 'KReclaimable: 183500 kB' 'Slab: 693484 kB' 'SReclaimable: 183500 kB' 'SUnreclaim: 509984 kB' 'KernelStack: 12976 kB' 'PageTables: 8148 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8105164 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198584 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.503 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.503 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.504 02:08:17 -- setup/common.sh@33 -- # echo 0 00:03:13.504 02:08:17 -- setup/common.sh@33 -- # return 0 00:03:13.504 02:08:17 -- setup/hugepages.sh@97 -- # anon=0 00:03:13.504 02:08:17 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:13.504 02:08:17 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:13.504 02:08:17 -- setup/common.sh@18 -- # local node= 00:03:13.504 02:08:17 -- setup/common.sh@19 -- # local var val 00:03:13.504 02:08:17 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.504 02:08:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.504 02:08:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:13.504 02:08:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:13.504 02:08:17 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.504 02:08:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45263496 kB' 'MemAvailable: 49022196 kB' 'Buffers: 3740 kB' 'Cached: 10711532 kB' 'SwapCached: 0 kB' 'Active: 7401580 kB' 'Inactive: 3759496 kB' 'Active(anon): 7000548 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 449056 kB' 'Mapped: 206724 kB' 'Shmem: 6554744 kB' 'KReclaimable: 183500 kB' 'Slab: 693440 kB' 'SReclaimable: 183500 kB' 'SUnreclaim: 509940 kB' 'KernelStack: 12960 kB' 'PageTables: 8084 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8105176 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198552 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.504 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.504 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.505 02:08:17 -- setup/common.sh@33 -- # echo 0 00:03:13.505 02:08:17 -- setup/common.sh@33 -- # return 0 00:03:13.505 02:08:17 -- setup/hugepages.sh@99 -- # surp=0 00:03:13.505 02:08:17 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:13.505 02:08:17 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:13.505 02:08:17 -- setup/common.sh@18 -- # local node= 00:03:13.505 02:08:17 -- setup/common.sh@19 -- # local var val 00:03:13.505 02:08:17 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.505 02:08:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.505 02:08:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:13.505 02:08:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:13.505 02:08:17 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.505 02:08:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45262992 kB' 'MemAvailable: 49021692 kB' 'Buffers: 3740 kB' 'Cached: 10711540 kB' 'SwapCached: 0 kB' 'Active: 7400800 kB' 'Inactive: 3759496 kB' 'Active(anon): 6999768 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448256 kB' 'Mapped: 206708 kB' 'Shmem: 6554752 kB' 'KReclaimable: 183500 kB' 'Slab: 693440 kB' 'SReclaimable: 183500 kB' 'SUnreclaim: 509940 kB' 'KernelStack: 12992 kB' 'PageTables: 8116 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8105192 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198536 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.505 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.505 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.506 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.506 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.507 02:08:17 -- setup/common.sh@33 -- # echo 0 00:03:13.507 02:08:17 -- setup/common.sh@33 -- # return 0 00:03:13.507 02:08:17 -- setup/hugepages.sh@100 -- # resv=0 00:03:13.507 02:08:17 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:13.507 nr_hugepages=1024 00:03:13.507 02:08:17 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:13.507 resv_hugepages=0 00:03:13.507 02:08:17 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:13.507 surplus_hugepages=0 00:03:13.507 02:08:17 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:13.507 anon_hugepages=0 00:03:13.507 02:08:17 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:13.507 02:08:17 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:13.507 02:08:17 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:13.507 02:08:17 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:13.507 02:08:17 -- setup/common.sh@18 -- # local node= 00:03:13.507 02:08:17 -- setup/common.sh@19 -- # local var val 00:03:13.507 02:08:17 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.507 02:08:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.507 02:08:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:13.507 02:08:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:13.507 02:08:17 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.507 02:08:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.507 02:08:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45262744 kB' 'MemAvailable: 49021444 kB' 'Buffers: 3740 kB' 'Cached: 10711556 kB' 'SwapCached: 0 kB' 'Active: 7400960 kB' 'Inactive: 3759496 kB' 'Active(anon): 6999928 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448428 kB' 'Mapped: 206708 kB' 'Shmem: 6554768 kB' 'KReclaimable: 183500 kB' 'Slab: 693476 kB' 'SReclaimable: 183500 kB' 'SUnreclaim: 509976 kB' 'KernelStack: 12992 kB' 'PageTables: 8144 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8105204 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198536 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.507 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.507 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.508 02:08:17 -- setup/common.sh@33 -- # echo 1024 00:03:13.508 02:08:17 -- setup/common.sh@33 -- # return 0 00:03:13.508 02:08:17 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:13.508 02:08:17 -- setup/hugepages.sh@112 -- # get_nodes 00:03:13.508 02:08:17 -- setup/hugepages.sh@27 -- # local node 00:03:13.508 02:08:17 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:13.508 02:08:17 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:13.508 02:08:17 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:13.508 02:08:17 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:13.508 02:08:17 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:13.508 02:08:17 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:13.508 02:08:17 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:13.508 02:08:17 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:13.508 02:08:17 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:13.508 02:08:17 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:13.508 02:08:17 -- setup/common.sh@18 -- # local node=0 00:03:13.508 02:08:17 -- setup/common.sh@19 -- # local var val 00:03:13.508 02:08:17 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.508 02:08:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.508 02:08:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:13.508 02:08:17 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:13.508 02:08:17 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.508 02:08:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 28070580 kB' 'MemUsed: 4755276 kB' 'SwapCached: 0 kB' 'Active: 2292696 kB' 'Inactive: 151892 kB' 'Active(anon): 2150452 kB' 'Inactive(anon): 0 kB' 'Active(file): 142244 kB' 'Inactive(file): 151892 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2338364 kB' 'Mapped: 75524 kB' 'AnonPages: 109408 kB' 'Shmem: 2044228 kB' 'KernelStack: 6744 kB' 'PageTables: 3796 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 66604 kB' 'Slab: 372700 kB' 'SReclaimable: 66604 kB' 'SUnreclaim: 306096 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.508 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.508 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@33 -- # echo 0 00:03:13.509 02:08:17 -- setup/common.sh@33 -- # return 0 00:03:13.509 02:08:17 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:13.509 02:08:17 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:13.509 02:08:17 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:13.509 02:08:17 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:13.509 02:08:17 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:13.509 02:08:17 -- setup/common.sh@18 -- # local node=1 00:03:13.509 02:08:17 -- setup/common.sh@19 -- # local var val 00:03:13.509 02:08:17 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.509 02:08:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.509 02:08:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:13.509 02:08:17 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:13.509 02:08:17 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.509 02:08:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 17192164 kB' 'MemUsed: 10517644 kB' 'SwapCached: 0 kB' 'Active: 5108232 kB' 'Inactive: 3607604 kB' 'Active(anon): 4849444 kB' 'Inactive(anon): 0 kB' 'Active(file): 258788 kB' 'Inactive(file): 3607604 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8376948 kB' 'Mapped: 131184 kB' 'AnonPages: 338976 kB' 'Shmem: 4510556 kB' 'KernelStack: 6232 kB' 'PageTables: 4300 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 116896 kB' 'Slab: 320776 kB' 'SReclaimable: 116896 kB' 'SUnreclaim: 203880 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.509 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.509 02:08:17 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # continue 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.510 02:08:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.510 02:08:17 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.510 02:08:17 -- setup/common.sh@33 -- # echo 0 00:03:13.510 02:08:17 -- setup/common.sh@33 -- # return 0 00:03:13.510 02:08:17 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:13.510 02:08:17 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:13.510 02:08:17 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:13.510 02:08:17 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:13.510 02:08:17 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:13.510 node0=512 expecting 512 00:03:13.510 02:08:17 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:13.510 02:08:17 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:13.510 02:08:17 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:13.510 02:08:17 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:13.510 node1=512 expecting 512 00:03:13.510 02:08:17 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:13.510 00:03:13.510 real 0m1.455s 00:03:13.510 user 0m0.601s 00:03:13.510 sys 0m0.818s 00:03:13.510 02:08:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:13.510 02:08:17 -- common/autotest_common.sh@10 -- # set +x 00:03:13.510 ************************************ 00:03:13.510 END TEST even_2G_alloc 00:03:13.510 ************************************ 00:03:13.769 02:08:17 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:03:13.769 02:08:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:13.769 02:08:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:13.769 02:08:17 -- common/autotest_common.sh@10 -- # set +x 00:03:13.769 ************************************ 00:03:13.769 START TEST odd_alloc 00:03:13.769 ************************************ 00:03:13.769 02:08:17 -- common/autotest_common.sh@1114 -- # odd_alloc 00:03:13.769 02:08:17 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:03:13.769 02:08:17 -- setup/hugepages.sh@49 -- # local size=2098176 00:03:13.769 02:08:17 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:13.769 02:08:17 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:13.769 02:08:17 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:03:13.769 02:08:17 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:13.769 02:08:17 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:13.769 02:08:17 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:13.769 02:08:17 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:03:13.769 02:08:17 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:13.769 02:08:17 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:13.769 02:08:17 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:13.769 02:08:17 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:13.769 02:08:17 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:13.769 02:08:17 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:13.769 02:08:17 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:13.769 02:08:17 -- setup/hugepages.sh@83 -- # : 513 00:03:13.769 02:08:17 -- setup/hugepages.sh@84 -- # : 1 00:03:13.769 02:08:17 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:13.769 02:08:17 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:03:13.769 02:08:17 -- setup/hugepages.sh@83 -- # : 0 00:03:13.769 02:08:17 -- setup/hugepages.sh@84 -- # : 0 00:03:13.769 02:08:17 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:13.769 02:08:17 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:03:13.769 02:08:17 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:03:13.769 02:08:17 -- setup/hugepages.sh@160 -- # setup output 00:03:13.769 02:08:17 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:13.769 02:08:17 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:14.699 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:14.699 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:14.699 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:14.699 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:14.699 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:14.700 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:14.700 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:14.700 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:14.700 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:14.700 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:14.700 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:14.700 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:14.700 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:14.700 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:14.700 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:14.700 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:14.700 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:14.963 02:08:18 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:03:14.963 02:08:18 -- setup/hugepages.sh@89 -- # local node 00:03:14.963 02:08:18 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:14.963 02:08:18 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:14.963 02:08:18 -- setup/hugepages.sh@92 -- # local surp 00:03:14.963 02:08:18 -- setup/hugepages.sh@93 -- # local resv 00:03:14.963 02:08:18 -- setup/hugepages.sh@94 -- # local anon 00:03:14.963 02:08:18 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:14.963 02:08:18 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:14.963 02:08:18 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:14.963 02:08:18 -- setup/common.sh@18 -- # local node= 00:03:14.963 02:08:18 -- setup/common.sh@19 -- # local var val 00:03:14.963 02:08:18 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.963 02:08:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.963 02:08:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.963 02:08:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.963 02:08:18 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.963 02:08:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.963 02:08:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45265548 kB' 'MemAvailable: 49024248 kB' 'Buffers: 3740 kB' 'Cached: 10711620 kB' 'SwapCached: 0 kB' 'Active: 7399384 kB' 'Inactive: 3759496 kB' 'Active(anon): 6998352 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446648 kB' 'Mapped: 205712 kB' 'Shmem: 6554832 kB' 'KReclaimable: 183500 kB' 'Slab: 693628 kB' 'SReclaimable: 183500 kB' 'SUnreclaim: 510128 kB' 'KernelStack: 12944 kB' 'PageTables: 7816 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 8090044 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198648 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.963 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.963 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.964 02:08:18 -- setup/common.sh@33 -- # echo 0 00:03:14.964 02:08:18 -- setup/common.sh@33 -- # return 0 00:03:14.964 02:08:18 -- setup/hugepages.sh@97 -- # anon=0 00:03:14.964 02:08:18 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:14.964 02:08:18 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:14.964 02:08:18 -- setup/common.sh@18 -- # local node= 00:03:14.964 02:08:18 -- setup/common.sh@19 -- # local var val 00:03:14.964 02:08:18 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.964 02:08:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.964 02:08:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.964 02:08:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.964 02:08:18 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.964 02:08:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45278436 kB' 'MemAvailable: 49037136 kB' 'Buffers: 3740 kB' 'Cached: 10711624 kB' 'SwapCached: 0 kB' 'Active: 7399496 kB' 'Inactive: 3759496 kB' 'Active(anon): 6998464 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446808 kB' 'Mapped: 205712 kB' 'Shmem: 6554836 kB' 'KReclaimable: 183500 kB' 'Slab: 693616 kB' 'SReclaimable: 183500 kB' 'SUnreclaim: 510116 kB' 'KernelStack: 12896 kB' 'PageTables: 7668 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 8090056 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198616 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.964 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.964 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.965 02:08:18 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.965 02:08:18 -- setup/common.sh@33 -- # echo 0 00:03:14.965 02:08:18 -- setup/common.sh@33 -- # return 0 00:03:14.965 02:08:18 -- setup/hugepages.sh@99 -- # surp=0 00:03:14.965 02:08:18 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:14.965 02:08:18 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:14.965 02:08:18 -- setup/common.sh@18 -- # local node= 00:03:14.965 02:08:18 -- setup/common.sh@19 -- # local var val 00:03:14.965 02:08:18 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.965 02:08:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.965 02:08:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.965 02:08:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.965 02:08:18 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.965 02:08:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.965 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45278688 kB' 'MemAvailable: 49037388 kB' 'Buffers: 3740 kB' 'Cached: 10711628 kB' 'SwapCached: 0 kB' 'Active: 7398772 kB' 'Inactive: 3759496 kB' 'Active(anon): 6997740 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446072 kB' 'Mapped: 205660 kB' 'Shmem: 6554840 kB' 'KReclaimable: 183500 kB' 'Slab: 693676 kB' 'SReclaimable: 183500 kB' 'SUnreclaim: 510176 kB' 'KernelStack: 12944 kB' 'PageTables: 7816 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 8090072 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198616 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.966 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.966 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.967 02:08:18 -- setup/common.sh@33 -- # echo 0 00:03:14.967 02:08:18 -- setup/common.sh@33 -- # return 0 00:03:14.967 02:08:18 -- setup/hugepages.sh@100 -- # resv=0 00:03:14.967 02:08:18 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:03:14.967 nr_hugepages=1025 00:03:14.967 02:08:18 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:14.967 resv_hugepages=0 00:03:14.967 02:08:18 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:14.967 surplus_hugepages=0 00:03:14.967 02:08:18 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:14.967 anon_hugepages=0 00:03:14.967 02:08:18 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:14.967 02:08:18 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:03:14.967 02:08:18 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:14.967 02:08:18 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:14.967 02:08:18 -- setup/common.sh@18 -- # local node= 00:03:14.967 02:08:18 -- setup/common.sh@19 -- # local var val 00:03:14.967 02:08:18 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.967 02:08:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.967 02:08:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.967 02:08:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.967 02:08:18 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.967 02:08:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.967 02:08:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45278688 kB' 'MemAvailable: 49037388 kB' 'Buffers: 3740 kB' 'Cached: 10711648 kB' 'SwapCached: 0 kB' 'Active: 7399924 kB' 'Inactive: 3759496 kB' 'Active(anon): 6998892 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447256 kB' 'Mapped: 205660 kB' 'Shmem: 6554860 kB' 'KReclaimable: 183500 kB' 'Slab: 693676 kB' 'SReclaimable: 183500 kB' 'SUnreclaim: 510176 kB' 'KernelStack: 13008 kB' 'PageTables: 8024 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 8092620 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198632 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.967 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.967 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.968 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.968 02:08:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.968 02:08:18 -- setup/common.sh@33 -- # echo 1025 00:03:14.968 02:08:18 -- setup/common.sh@33 -- # return 0 00:03:14.968 02:08:18 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:14.968 02:08:18 -- setup/hugepages.sh@112 -- # get_nodes 00:03:14.968 02:08:18 -- setup/hugepages.sh@27 -- # local node 00:03:14.968 02:08:18 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:14.968 02:08:18 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:14.968 02:08:18 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:14.968 02:08:18 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:03:14.968 02:08:18 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:14.968 02:08:18 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:14.968 02:08:18 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:14.968 02:08:18 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:14.968 02:08:18 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:14.968 02:08:18 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:14.968 02:08:18 -- setup/common.sh@18 -- # local node=0 00:03:14.969 02:08:18 -- setup/common.sh@19 -- # local var val 00:03:14.969 02:08:18 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.969 02:08:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.969 02:08:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:14.969 02:08:18 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:14.969 02:08:18 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.969 02:08:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 28092500 kB' 'MemUsed: 4733356 kB' 'SwapCached: 0 kB' 'Active: 2290984 kB' 'Inactive: 151892 kB' 'Active(anon): 2148740 kB' 'Inactive(anon): 0 kB' 'Active(file): 142244 kB' 'Inactive(file): 151892 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2338392 kB' 'Mapped: 75136 kB' 'AnonPages: 107672 kB' 'Shmem: 2044256 kB' 'KernelStack: 6936 kB' 'PageTables: 3924 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 66604 kB' 'Slab: 372744 kB' 'SReclaimable: 66604 kB' 'SUnreclaim: 306140 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.969 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.969 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.970 02:08:18 -- setup/common.sh@33 -- # echo 0 00:03:14.970 02:08:18 -- setup/common.sh@33 -- # return 0 00:03:14.970 02:08:18 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:14.970 02:08:18 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:14.970 02:08:18 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:14.970 02:08:18 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:14.970 02:08:18 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:14.970 02:08:18 -- setup/common.sh@18 -- # local node=1 00:03:14.970 02:08:18 -- setup/common.sh@19 -- # local var val 00:03:14.970 02:08:18 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.970 02:08:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.970 02:08:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:14.970 02:08:18 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:14.970 02:08:18 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.970 02:08:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.970 02:08:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 17184072 kB' 'MemUsed: 10525736 kB' 'SwapCached: 0 kB' 'Active: 5108684 kB' 'Inactive: 3607604 kB' 'Active(anon): 4849896 kB' 'Inactive(anon): 0 kB' 'Active(file): 258788 kB' 'Inactive(file): 3607604 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8377024 kB' 'Mapped: 130528 kB' 'AnonPages: 339320 kB' 'Shmem: 4510632 kB' 'KernelStack: 6216 kB' 'PageTables: 4288 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 116896 kB' 'Slab: 320932 kB' 'SReclaimable: 116896 kB' 'SUnreclaim: 204036 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.970 02:08:18 -- setup/common.sh@32 -- # continue 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.970 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # continue 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # continue 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # continue 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # continue 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # continue 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # continue 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # continue 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # continue 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # continue 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # continue 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # continue 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # continue 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # continue 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # continue 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # continue 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # continue 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # continue 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.229 02:08:18 -- setup/common.sh@32 -- # continue 00:03:15.229 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.230 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.230 02:08:18 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.230 02:08:18 -- setup/common.sh@32 -- # continue 00:03:15.230 02:08:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.230 02:08:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.230 02:08:18 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.230 02:08:18 -- setup/common.sh@33 -- # echo 0 00:03:15.230 02:08:18 -- setup/common.sh@33 -- # return 0 00:03:15.230 02:08:18 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:15.230 02:08:18 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:15.230 02:08:18 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:15.230 02:08:18 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:15.230 02:08:18 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:03:15.230 node0=512 expecting 513 00:03:15.230 02:08:18 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:15.230 02:08:18 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:15.230 02:08:18 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:15.230 02:08:18 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:03:15.230 node1=513 expecting 512 00:03:15.230 02:08:18 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:03:15.230 00:03:15.230 real 0m1.461s 00:03:15.230 user 0m0.600s 00:03:15.230 sys 0m0.825s 00:03:15.230 02:08:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:15.230 02:08:18 -- common/autotest_common.sh@10 -- # set +x 00:03:15.230 ************************************ 00:03:15.230 END TEST odd_alloc 00:03:15.230 ************************************ 00:03:15.230 02:08:18 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:03:15.230 02:08:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:15.230 02:08:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:15.230 02:08:18 -- common/autotest_common.sh@10 -- # set +x 00:03:15.230 ************************************ 00:03:15.230 START TEST custom_alloc 00:03:15.230 ************************************ 00:03:15.230 02:08:18 -- common/autotest_common.sh@1114 -- # custom_alloc 00:03:15.230 02:08:18 -- setup/hugepages.sh@167 -- # local IFS=, 00:03:15.230 02:08:18 -- setup/hugepages.sh@169 -- # local node 00:03:15.230 02:08:18 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:03:15.230 02:08:18 -- setup/hugepages.sh@170 -- # local nodes_hp 00:03:15.230 02:08:18 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:03:15.230 02:08:18 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:03:15.230 02:08:18 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:15.230 02:08:18 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:15.230 02:08:18 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:15.230 02:08:18 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:15.230 02:08:18 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:15.230 02:08:18 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:15.230 02:08:18 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:15.230 02:08:18 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:15.230 02:08:18 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:15.230 02:08:18 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:15.230 02:08:18 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:15.230 02:08:18 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:15.230 02:08:18 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:15.230 02:08:18 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:15.230 02:08:18 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:15.230 02:08:18 -- setup/hugepages.sh@83 -- # : 256 00:03:15.230 02:08:18 -- setup/hugepages.sh@84 -- # : 1 00:03:15.230 02:08:18 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:15.230 02:08:18 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:15.230 02:08:18 -- setup/hugepages.sh@83 -- # : 0 00:03:15.230 02:08:18 -- setup/hugepages.sh@84 -- # : 0 00:03:15.230 02:08:18 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:15.230 02:08:18 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:03:15.230 02:08:18 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:03:15.230 02:08:18 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:03:15.230 02:08:18 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:15.230 02:08:18 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:15.230 02:08:18 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:15.230 02:08:18 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:15.230 02:08:18 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:15.230 02:08:18 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:15.230 02:08:18 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:15.230 02:08:18 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:15.230 02:08:18 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:15.230 02:08:18 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:15.230 02:08:18 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:15.230 02:08:18 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:15.230 02:08:18 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:03:15.230 02:08:18 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:15.230 02:08:18 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:15.230 02:08:18 -- setup/hugepages.sh@78 -- # return 0 00:03:15.230 02:08:18 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:03:15.230 02:08:18 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:15.230 02:08:18 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:15.230 02:08:18 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:15.230 02:08:18 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:15.230 02:08:18 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:15.230 02:08:18 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:15.230 02:08:18 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:03:15.230 02:08:18 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:15.230 02:08:18 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:15.230 02:08:18 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:15.230 02:08:18 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:15.230 02:08:18 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:15.230 02:08:18 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:15.230 02:08:18 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:15.230 02:08:18 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:03:15.230 02:08:18 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:15.230 02:08:18 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:15.230 02:08:18 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:15.230 02:08:18 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:03:15.230 02:08:18 -- setup/hugepages.sh@78 -- # return 0 00:03:15.230 02:08:18 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:03:15.230 02:08:18 -- setup/hugepages.sh@187 -- # setup output 00:03:15.230 02:08:18 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:15.230 02:08:18 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:16.607 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:16.607 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:16.607 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:16.607 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:16.607 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:16.607 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:16.607 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:16.607 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:16.607 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:16.607 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:16.607 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:16.607 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:16.607 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:16.607 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:16.607 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:16.607 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:16.607 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:16.607 02:08:20 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:03:16.607 02:08:20 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:03:16.607 02:08:20 -- setup/hugepages.sh@89 -- # local node 00:03:16.607 02:08:20 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:16.607 02:08:20 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:16.607 02:08:20 -- setup/hugepages.sh@92 -- # local surp 00:03:16.607 02:08:20 -- setup/hugepages.sh@93 -- # local resv 00:03:16.607 02:08:20 -- setup/hugepages.sh@94 -- # local anon 00:03:16.607 02:08:20 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:16.607 02:08:20 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:16.607 02:08:20 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:16.607 02:08:20 -- setup/common.sh@18 -- # local node= 00:03:16.607 02:08:20 -- setup/common.sh@19 -- # local var val 00:03:16.607 02:08:20 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.607 02:08:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.607 02:08:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.607 02:08:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.607 02:08:20 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.607 02:08:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.607 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.607 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.607 02:08:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44235964 kB' 'MemAvailable: 47994664 kB' 'Buffers: 3740 kB' 'Cached: 10711716 kB' 'SwapCached: 0 kB' 'Active: 7400500 kB' 'Inactive: 3759496 kB' 'Active(anon): 6999468 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447972 kB' 'Mapped: 206032 kB' 'Shmem: 6554928 kB' 'KReclaimable: 183500 kB' 'Slab: 693404 kB' 'SReclaimable: 183500 kB' 'SUnreclaim: 509904 kB' 'KernelStack: 12960 kB' 'PageTables: 7848 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 8090748 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198568 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:16.607 02:08:20 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.607 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.607 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.607 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.607 02:08:20 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.607 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.607 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.607 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.607 02:08:20 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.607 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.607 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.607 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.607 02:08:20 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.607 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.607 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.607 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.607 02:08:20 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.607 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.607 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.607 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.607 02:08:20 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.607 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.607 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.607 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.607 02:08:20 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.607 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.607 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.607 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.607 02:08:20 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.607 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.607 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.607 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.607 02:08:20 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.607 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.607 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.608 02:08:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.608 02:08:20 -- setup/common.sh@33 -- # echo 0 00:03:16.608 02:08:20 -- setup/common.sh@33 -- # return 0 00:03:16.608 02:08:20 -- setup/hugepages.sh@97 -- # anon=0 00:03:16.608 02:08:20 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:16.608 02:08:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:16.608 02:08:20 -- setup/common.sh@18 -- # local node= 00:03:16.608 02:08:20 -- setup/common.sh@19 -- # local var val 00:03:16.608 02:08:20 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.608 02:08:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.608 02:08:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.608 02:08:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.608 02:08:20 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.608 02:08:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.608 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44238408 kB' 'MemAvailable: 47997108 kB' 'Buffers: 3740 kB' 'Cached: 10711720 kB' 'SwapCached: 0 kB' 'Active: 7404236 kB' 'Inactive: 3759496 kB' 'Active(anon): 7003204 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 451876 kB' 'Mapped: 206116 kB' 'Shmem: 6554932 kB' 'KReclaimable: 183500 kB' 'Slab: 693440 kB' 'SReclaimable: 183500 kB' 'SUnreclaim: 509940 kB' 'KernelStack: 12912 kB' 'PageTables: 7664 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 8094012 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198520 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.609 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.609 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.610 02:08:20 -- setup/common.sh@33 -- # echo 0 00:03:16.610 02:08:20 -- setup/common.sh@33 -- # return 0 00:03:16.610 02:08:20 -- setup/hugepages.sh@99 -- # surp=0 00:03:16.610 02:08:20 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:16.610 02:08:20 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:16.610 02:08:20 -- setup/common.sh@18 -- # local node= 00:03:16.610 02:08:20 -- setup/common.sh@19 -- # local var val 00:03:16.610 02:08:20 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.610 02:08:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.610 02:08:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.610 02:08:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.610 02:08:20 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.610 02:08:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44238268 kB' 'MemAvailable: 47996968 kB' 'Buffers: 3740 kB' 'Cached: 10711732 kB' 'SwapCached: 0 kB' 'Active: 7406360 kB' 'Inactive: 3759496 kB' 'Active(anon): 7005328 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 454080 kB' 'Mapped: 206472 kB' 'Shmem: 6554944 kB' 'KReclaimable: 183500 kB' 'Slab: 693524 kB' 'SReclaimable: 183500 kB' 'SUnreclaim: 510024 kB' 'KernelStack: 12960 kB' 'PageTables: 7848 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 8096416 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198524 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.610 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.610 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.611 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.611 02:08:20 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.611 02:08:20 -- setup/common.sh@33 -- # echo 0 00:03:16.611 02:08:20 -- setup/common.sh@33 -- # return 0 00:03:16.611 02:08:20 -- setup/hugepages.sh@100 -- # resv=0 00:03:16.611 02:08:20 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:03:16.611 nr_hugepages=1536 00:03:16.611 02:08:20 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:16.611 resv_hugepages=0 00:03:16.611 02:08:20 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:16.611 surplus_hugepages=0 00:03:16.611 02:08:20 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:16.611 anon_hugepages=0 00:03:16.611 02:08:20 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:16.611 02:08:20 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:03:16.611 02:08:20 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:16.611 02:08:20 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:16.611 02:08:20 -- setup/common.sh@18 -- # local node= 00:03:16.611 02:08:20 -- setup/common.sh@19 -- # local var val 00:03:16.611 02:08:20 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.611 02:08:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.611 02:08:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.611 02:08:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.612 02:08:20 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.612 02:08:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44238268 kB' 'MemAvailable: 47996968 kB' 'Buffers: 3740 kB' 'Cached: 10711732 kB' 'SwapCached: 0 kB' 'Active: 7400616 kB' 'Inactive: 3759496 kB' 'Active(anon): 6999584 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448296 kB' 'Mapped: 206124 kB' 'Shmem: 6554944 kB' 'KReclaimable: 183500 kB' 'Slab: 693524 kB' 'SReclaimable: 183500 kB' 'SUnreclaim: 510024 kB' 'KernelStack: 12960 kB' 'PageTables: 7848 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 8090312 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198520 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.612 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.612 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.613 02:08:20 -- setup/common.sh@33 -- # echo 1536 00:03:16.613 02:08:20 -- setup/common.sh@33 -- # return 0 00:03:16.613 02:08:20 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:16.613 02:08:20 -- setup/hugepages.sh@112 -- # get_nodes 00:03:16.613 02:08:20 -- setup/hugepages.sh@27 -- # local node 00:03:16.613 02:08:20 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:16.613 02:08:20 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:16.613 02:08:20 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:16.613 02:08:20 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:16.613 02:08:20 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:16.613 02:08:20 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:16.613 02:08:20 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:16.613 02:08:20 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:16.613 02:08:20 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:16.613 02:08:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:16.613 02:08:20 -- setup/common.sh@18 -- # local node=0 00:03:16.613 02:08:20 -- setup/common.sh@19 -- # local var val 00:03:16.613 02:08:20 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.613 02:08:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.613 02:08:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:16.613 02:08:20 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:16.613 02:08:20 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.613 02:08:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 28100280 kB' 'MemUsed: 4725576 kB' 'SwapCached: 0 kB' 'Active: 2291464 kB' 'Inactive: 151892 kB' 'Active(anon): 2149220 kB' 'Inactive(anon): 0 kB' 'Active(file): 142244 kB' 'Inactive(file): 151892 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2338400 kB' 'Mapped: 75144 kB' 'AnonPages: 108360 kB' 'Shmem: 2044264 kB' 'KernelStack: 6712 kB' 'PageTables: 3528 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 66604 kB' 'Slab: 372792 kB' 'SReclaimable: 66604 kB' 'SUnreclaim: 306188 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.613 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.613 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@33 -- # echo 0 00:03:16.614 02:08:20 -- setup/common.sh@33 -- # return 0 00:03:16.614 02:08:20 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:16.614 02:08:20 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:16.614 02:08:20 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:16.614 02:08:20 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:16.614 02:08:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:16.614 02:08:20 -- setup/common.sh@18 -- # local node=1 00:03:16.614 02:08:20 -- setup/common.sh@19 -- # local var val 00:03:16.614 02:08:20 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.614 02:08:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.614 02:08:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:16.614 02:08:20 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:16.614 02:08:20 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.614 02:08:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 16138180 kB' 'MemUsed: 11571628 kB' 'SwapCached: 0 kB' 'Active: 5109264 kB' 'Inactive: 3607604 kB' 'Active(anon): 4850476 kB' 'Inactive(anon): 0 kB' 'Active(file): 258788 kB' 'Inactive(file): 3607604 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8377100 kB' 'Mapped: 130524 kB' 'AnonPages: 340040 kB' 'Shmem: 4510708 kB' 'KernelStack: 6264 kB' 'PageTables: 4344 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 116896 kB' 'Slab: 320724 kB' 'SReclaimable: 116896 kB' 'SUnreclaim: 203828 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.614 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.614 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # continue 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.615 02:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.615 02:08:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.615 02:08:20 -- setup/common.sh@33 -- # echo 0 00:03:16.615 02:08:20 -- setup/common.sh@33 -- # return 0 00:03:16.615 02:08:20 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:16.615 02:08:20 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:16.615 02:08:20 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:16.615 02:08:20 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:16.615 02:08:20 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:16.615 node0=512 expecting 512 00:03:16.615 02:08:20 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:16.615 02:08:20 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:16.615 02:08:20 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:16.615 02:08:20 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:03:16.615 node1=1024 expecting 1024 00:03:16.615 02:08:20 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:03:16.615 00:03:16.615 real 0m1.504s 00:03:16.615 user 0m0.638s 00:03:16.615 sys 0m0.833s 00:03:16.615 02:08:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:16.615 02:08:20 -- common/autotest_common.sh@10 -- # set +x 00:03:16.615 ************************************ 00:03:16.615 END TEST custom_alloc 00:03:16.615 ************************************ 00:03:16.615 02:08:20 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:03:16.615 02:08:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:16.615 02:08:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:16.615 02:08:20 -- common/autotest_common.sh@10 -- # set +x 00:03:16.615 ************************************ 00:03:16.615 START TEST no_shrink_alloc 00:03:16.615 ************************************ 00:03:16.615 02:08:20 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:03:16.615 02:08:20 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:03:16.615 02:08:20 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:16.615 02:08:20 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:16.615 02:08:20 -- setup/hugepages.sh@51 -- # shift 00:03:16.615 02:08:20 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:16.615 02:08:20 -- setup/hugepages.sh@52 -- # local node_ids 00:03:16.615 02:08:20 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:16.615 02:08:20 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:16.615 02:08:20 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:16.615 02:08:20 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:16.615 02:08:20 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:16.615 02:08:20 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:16.615 02:08:20 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:16.615 02:08:20 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:16.615 02:08:20 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:16.615 02:08:20 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:16.615 02:08:20 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:16.615 02:08:20 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:16.615 02:08:20 -- setup/hugepages.sh@73 -- # return 0 00:03:16.615 02:08:20 -- setup/hugepages.sh@198 -- # setup output 00:03:16.615 02:08:20 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:16.615 02:08:20 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:17.993 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:17.993 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:17.993 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:17.993 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:17.993 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:17.993 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:17.993 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:17.993 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:17.993 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:17.993 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:17.993 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:17.993 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:17.993 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:17.993 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:17.993 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:17.993 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:17.993 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:17.993 02:08:21 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:03:17.993 02:08:21 -- setup/hugepages.sh@89 -- # local node 00:03:17.993 02:08:21 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:17.993 02:08:21 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:17.993 02:08:21 -- setup/hugepages.sh@92 -- # local surp 00:03:17.993 02:08:21 -- setup/hugepages.sh@93 -- # local resv 00:03:17.993 02:08:21 -- setup/hugepages.sh@94 -- # local anon 00:03:17.993 02:08:21 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:17.993 02:08:21 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:17.993 02:08:21 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:17.993 02:08:21 -- setup/common.sh@18 -- # local node= 00:03:17.993 02:08:21 -- setup/common.sh@19 -- # local var val 00:03:17.993 02:08:21 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.993 02:08:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.993 02:08:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.994 02:08:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.994 02:08:21 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.994 02:08:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45298676 kB' 'MemAvailable: 49057376 kB' 'Buffers: 3740 kB' 'Cached: 10711812 kB' 'SwapCached: 0 kB' 'Active: 7397744 kB' 'Inactive: 3759496 kB' 'Active(anon): 6996712 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 444920 kB' 'Mapped: 204700 kB' 'Shmem: 6555024 kB' 'KReclaimable: 183500 kB' 'Slab: 693416 kB' 'SReclaimable: 183500 kB' 'SUnreclaim: 509916 kB' 'KernelStack: 12880 kB' 'PageTables: 7604 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8056116 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198536 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.994 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.994 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.995 02:08:21 -- setup/common.sh@33 -- # echo 0 00:03:17.995 02:08:21 -- setup/common.sh@33 -- # return 0 00:03:17.995 02:08:21 -- setup/hugepages.sh@97 -- # anon=0 00:03:17.995 02:08:21 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:17.995 02:08:21 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:17.995 02:08:21 -- setup/common.sh@18 -- # local node= 00:03:17.995 02:08:21 -- setup/common.sh@19 -- # local var val 00:03:17.995 02:08:21 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.995 02:08:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.995 02:08:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.995 02:08:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.995 02:08:21 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.995 02:08:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45301288 kB' 'MemAvailable: 49059972 kB' 'Buffers: 3740 kB' 'Cached: 10711812 kB' 'SwapCached: 0 kB' 'Active: 7398116 kB' 'Inactive: 3759496 kB' 'Active(anon): 6997084 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 445292 kB' 'Mapped: 204700 kB' 'Shmem: 6555024 kB' 'KReclaimable: 183468 kB' 'Slab: 693400 kB' 'SReclaimable: 183468 kB' 'SUnreclaim: 509932 kB' 'KernelStack: 12896 kB' 'PageTables: 7708 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8056128 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198504 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.995 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.995 02:08:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.996 02:08:21 -- setup/common.sh@33 -- # echo 0 00:03:17.996 02:08:21 -- setup/common.sh@33 -- # return 0 00:03:17.996 02:08:21 -- setup/hugepages.sh@99 -- # surp=0 00:03:17.996 02:08:21 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:17.996 02:08:21 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:17.996 02:08:21 -- setup/common.sh@18 -- # local node= 00:03:17.996 02:08:21 -- setup/common.sh@19 -- # local var val 00:03:17.996 02:08:21 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.996 02:08:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.996 02:08:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.996 02:08:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.996 02:08:21 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.996 02:08:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45300968 kB' 'MemAvailable: 49059652 kB' 'Buffers: 3740 kB' 'Cached: 10711816 kB' 'SwapCached: 0 kB' 'Active: 7398244 kB' 'Inactive: 3759496 kB' 'Active(anon): 6997212 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 445436 kB' 'Mapped: 204668 kB' 'Shmem: 6555028 kB' 'KReclaimable: 183468 kB' 'Slab: 693392 kB' 'SReclaimable: 183468 kB' 'SUnreclaim: 509924 kB' 'KernelStack: 12896 kB' 'PageTables: 7700 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8056144 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198504 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.996 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.996 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.997 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.997 02:08:21 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.997 02:08:21 -- setup/common.sh@33 -- # echo 0 00:03:17.997 02:08:21 -- setup/common.sh@33 -- # return 0 00:03:17.997 02:08:21 -- setup/hugepages.sh@100 -- # resv=0 00:03:17.998 02:08:21 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:17.998 nr_hugepages=1024 00:03:17.998 02:08:21 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:17.998 resv_hugepages=0 00:03:17.998 02:08:21 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:17.998 surplus_hugepages=0 00:03:17.998 02:08:21 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:17.998 anon_hugepages=0 00:03:17.998 02:08:21 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:17.998 02:08:21 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:17.998 02:08:21 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:17.998 02:08:21 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:17.998 02:08:21 -- setup/common.sh@18 -- # local node= 00:03:17.998 02:08:21 -- setup/common.sh@19 -- # local var val 00:03:17.998 02:08:21 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.998 02:08:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.998 02:08:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.998 02:08:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.998 02:08:21 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.998 02:08:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.998 02:08:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45301412 kB' 'MemAvailable: 49060096 kB' 'Buffers: 3740 kB' 'Cached: 10711852 kB' 'SwapCached: 0 kB' 'Active: 7397312 kB' 'Inactive: 3759496 kB' 'Active(anon): 6996280 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 444388 kB' 'Mapped: 204588 kB' 'Shmem: 6555064 kB' 'KReclaimable: 183468 kB' 'Slab: 693376 kB' 'SReclaimable: 183468 kB' 'SUnreclaim: 509908 kB' 'KernelStack: 12880 kB' 'PageTables: 7648 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8056160 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198504 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.998 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.998 02:08:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.999 02:08:21 -- setup/common.sh@33 -- # echo 1024 00:03:17.999 02:08:21 -- setup/common.sh@33 -- # return 0 00:03:17.999 02:08:21 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:17.999 02:08:21 -- setup/hugepages.sh@112 -- # get_nodes 00:03:17.999 02:08:21 -- setup/hugepages.sh@27 -- # local node 00:03:17.999 02:08:21 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:17.999 02:08:21 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:17.999 02:08:21 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:17.999 02:08:21 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:17.999 02:08:21 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:17.999 02:08:21 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:17.999 02:08:21 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:17.999 02:08:21 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:17.999 02:08:21 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:17.999 02:08:21 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:17.999 02:08:21 -- setup/common.sh@18 -- # local node=0 00:03:17.999 02:08:21 -- setup/common.sh@19 -- # local var val 00:03:17.999 02:08:21 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.999 02:08:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.999 02:08:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:17.999 02:08:21 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:17.999 02:08:21 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.999 02:08:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27046056 kB' 'MemUsed: 5779800 kB' 'SwapCached: 0 kB' 'Active: 2290332 kB' 'Inactive: 151892 kB' 'Active(anon): 2148088 kB' 'Inactive(anon): 0 kB' 'Active(file): 142244 kB' 'Inactive(file): 151892 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2338408 kB' 'Mapped: 74276 kB' 'AnonPages: 106984 kB' 'Shmem: 2044272 kB' 'KernelStack: 6712 kB' 'PageTables: 3468 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 66604 kB' 'Slab: 372728 kB' 'SReclaimable: 66604 kB' 'SUnreclaim: 306124 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.999 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.999 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # continue 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.000 02:08:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.000 02:08:21 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.000 02:08:21 -- setup/common.sh@33 -- # echo 0 00:03:18.000 02:08:21 -- setup/common.sh@33 -- # return 0 00:03:18.000 02:08:21 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:18.000 02:08:21 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:18.000 02:08:21 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:18.000 02:08:21 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:18.000 02:08:21 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:18.000 node0=1024 expecting 1024 00:03:18.000 02:08:21 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:18.000 02:08:21 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:03:18.000 02:08:21 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:03:18.000 02:08:21 -- setup/hugepages.sh@202 -- # setup output 00:03:18.000 02:08:21 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:18.000 02:08:21 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:19.379 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:19.379 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:19.379 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:19.379 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:19.379 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:19.379 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:19.379 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:19.379 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:19.379 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:19.379 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:19.379 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:19.379 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:19.379 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:19.379 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:19.379 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:19.379 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:19.379 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:19.379 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:19.379 02:08:22 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:19.379 02:08:22 -- setup/hugepages.sh@89 -- # local node 00:03:19.379 02:08:22 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:19.379 02:08:22 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:19.379 02:08:22 -- setup/hugepages.sh@92 -- # local surp 00:03:19.379 02:08:23 -- setup/hugepages.sh@93 -- # local resv 00:03:19.379 02:08:23 -- setup/hugepages.sh@94 -- # local anon 00:03:19.379 02:08:23 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:19.379 02:08:23 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:19.379 02:08:23 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:19.379 02:08:23 -- setup/common.sh@18 -- # local node= 00:03:19.379 02:08:23 -- setup/common.sh@19 -- # local var val 00:03:19.379 02:08:23 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.379 02:08:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.379 02:08:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.379 02:08:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.379 02:08:23 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.379 02:08:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.379 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.379 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45289640 kB' 'MemAvailable: 49048324 kB' 'Buffers: 3740 kB' 'Cached: 10711884 kB' 'SwapCached: 0 kB' 'Active: 7397756 kB' 'Inactive: 3759496 kB' 'Active(anon): 6996724 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 444892 kB' 'Mapped: 204616 kB' 'Shmem: 6555096 kB' 'KReclaimable: 183468 kB' 'Slab: 693196 kB' 'SReclaimable: 183468 kB' 'SUnreclaim: 509728 kB' 'KernelStack: 12896 kB' 'PageTables: 7756 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8056188 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.380 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.380 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.381 02:08:23 -- setup/common.sh@33 -- # echo 0 00:03:19.381 02:08:23 -- setup/common.sh@33 -- # return 0 00:03:19.381 02:08:23 -- setup/hugepages.sh@97 -- # anon=0 00:03:19.381 02:08:23 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:19.381 02:08:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:19.381 02:08:23 -- setup/common.sh@18 -- # local node= 00:03:19.381 02:08:23 -- setup/common.sh@19 -- # local var val 00:03:19.381 02:08:23 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.381 02:08:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.381 02:08:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.381 02:08:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.381 02:08:23 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.381 02:08:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45290512 kB' 'MemAvailable: 49049196 kB' 'Buffers: 3740 kB' 'Cached: 10711884 kB' 'SwapCached: 0 kB' 'Active: 7398624 kB' 'Inactive: 3759496 kB' 'Active(anon): 6997592 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 445740 kB' 'Mapped: 204692 kB' 'Shmem: 6555096 kB' 'KReclaimable: 183468 kB' 'Slab: 693264 kB' 'SReclaimable: 183468 kB' 'SUnreclaim: 509796 kB' 'KernelStack: 12880 kB' 'PageTables: 7712 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8056200 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.381 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.381 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.382 02:08:23 -- setup/common.sh@33 -- # echo 0 00:03:19.382 02:08:23 -- setup/common.sh@33 -- # return 0 00:03:19.382 02:08:23 -- setup/hugepages.sh@99 -- # surp=0 00:03:19.382 02:08:23 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:19.382 02:08:23 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:19.382 02:08:23 -- setup/common.sh@18 -- # local node= 00:03:19.382 02:08:23 -- setup/common.sh@19 -- # local var val 00:03:19.382 02:08:23 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.382 02:08:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.382 02:08:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.382 02:08:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.382 02:08:23 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.382 02:08:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.382 02:08:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45291516 kB' 'MemAvailable: 49050200 kB' 'Buffers: 3740 kB' 'Cached: 10711900 kB' 'SwapCached: 0 kB' 'Active: 7397752 kB' 'Inactive: 3759496 kB' 'Active(anon): 6996720 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 444804 kB' 'Mapped: 204596 kB' 'Shmem: 6555112 kB' 'KReclaimable: 183468 kB' 'Slab: 693248 kB' 'SReclaimable: 183468 kB' 'SUnreclaim: 509780 kB' 'KernelStack: 12880 kB' 'PageTables: 7624 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8056216 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.382 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.382 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.644 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.644 02:08:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.644 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.644 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.644 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.644 02:08:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.644 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.644 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.644 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.644 02:08:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.644 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.644 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.644 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.644 02:08:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.644 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.645 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.645 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.646 02:08:23 -- setup/common.sh@33 -- # echo 0 00:03:19.646 02:08:23 -- setup/common.sh@33 -- # return 0 00:03:19.646 02:08:23 -- setup/hugepages.sh@100 -- # resv=0 00:03:19.646 02:08:23 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:19.646 nr_hugepages=1024 00:03:19.646 02:08:23 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:19.646 resv_hugepages=0 00:03:19.646 02:08:23 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:19.646 surplus_hugepages=0 00:03:19.646 02:08:23 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:19.646 anon_hugepages=0 00:03:19.646 02:08:23 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:19.646 02:08:23 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:19.646 02:08:23 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:19.646 02:08:23 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:19.646 02:08:23 -- setup/common.sh@18 -- # local node= 00:03:19.646 02:08:23 -- setup/common.sh@19 -- # local var val 00:03:19.646 02:08:23 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.646 02:08:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.646 02:08:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.646 02:08:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.646 02:08:23 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.646 02:08:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45293592 kB' 'MemAvailable: 49052276 kB' 'Buffers: 3740 kB' 'Cached: 10711912 kB' 'SwapCached: 0 kB' 'Active: 7398020 kB' 'Inactive: 3759496 kB' 'Active(anon): 6996988 kB' 'Inactive(anon): 0 kB' 'Active(file): 401032 kB' 'Inactive(file): 3759496 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 445092 kB' 'Mapped: 204596 kB' 'Shmem: 6555124 kB' 'KReclaimable: 183468 kB' 'Slab: 693248 kB' 'SReclaimable: 183468 kB' 'SUnreclaim: 509780 kB' 'KernelStack: 12928 kB' 'PageTables: 7780 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8059880 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1893980 kB' 'DirectMap2M: 15851520 kB' 'DirectMap1G: 52428800 kB' 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.646 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.646 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.647 02:08:23 -- setup/common.sh@33 -- # echo 1024 00:03:19.647 02:08:23 -- setup/common.sh@33 -- # return 0 00:03:19.647 02:08:23 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:19.647 02:08:23 -- setup/hugepages.sh@112 -- # get_nodes 00:03:19.647 02:08:23 -- setup/hugepages.sh@27 -- # local node 00:03:19.647 02:08:23 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:19.647 02:08:23 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:19.647 02:08:23 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:19.647 02:08:23 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:19.647 02:08:23 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:19.647 02:08:23 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:19.647 02:08:23 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:19.647 02:08:23 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:19.647 02:08:23 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:19.647 02:08:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:19.647 02:08:23 -- setup/common.sh@18 -- # local node=0 00:03:19.647 02:08:23 -- setup/common.sh@19 -- # local var val 00:03:19.647 02:08:23 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.647 02:08:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.647 02:08:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:19.647 02:08:23 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:19.647 02:08:23 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.647 02:08:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27032208 kB' 'MemUsed: 5793648 kB' 'SwapCached: 0 kB' 'Active: 2290916 kB' 'Inactive: 151892 kB' 'Active(anon): 2148672 kB' 'Inactive(anon): 0 kB' 'Active(file): 142244 kB' 'Inactive(file): 151892 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2338408 kB' 'Mapped: 74280 kB' 'AnonPages: 107636 kB' 'Shmem: 2044272 kB' 'KernelStack: 6728 kB' 'PageTables: 3564 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 66604 kB' 'Slab: 372672 kB' 'SReclaimable: 66604 kB' 'SUnreclaim: 306068 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.647 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.647 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # continue 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 02:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 02:08:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.648 02:08:23 -- setup/common.sh@33 -- # echo 0 00:03:19.648 02:08:23 -- setup/common.sh@33 -- # return 0 00:03:19.648 02:08:23 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:19.648 02:08:23 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:19.648 02:08:23 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:19.648 02:08:23 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:19.648 02:08:23 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:19.648 node0=1024 expecting 1024 00:03:19.648 02:08:23 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:19.648 00:03:19.648 real 0m2.922s 00:03:19.648 user 0m1.194s 00:03:19.648 sys 0m1.654s 00:03:19.648 02:08:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:19.648 02:08:23 -- common/autotest_common.sh@10 -- # set +x 00:03:19.648 ************************************ 00:03:19.648 END TEST no_shrink_alloc 00:03:19.648 ************************************ 00:03:19.648 02:08:23 -- setup/hugepages.sh@217 -- # clear_hp 00:03:19.648 02:08:23 -- setup/hugepages.sh@37 -- # local node hp 00:03:19.648 02:08:23 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:19.648 02:08:23 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:19.648 02:08:23 -- setup/hugepages.sh@41 -- # echo 0 00:03:19.648 02:08:23 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:19.648 02:08:23 -- setup/hugepages.sh@41 -- # echo 0 00:03:19.648 02:08:23 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:19.648 02:08:23 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:19.648 02:08:23 -- setup/hugepages.sh@41 -- # echo 0 00:03:19.648 02:08:23 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:19.648 02:08:23 -- setup/hugepages.sh@41 -- # echo 0 00:03:19.648 02:08:23 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:19.648 02:08:23 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:19.648 00:03:19.648 real 0m11.575s 00:03:19.648 user 0m4.474s 00:03:19.648 sys 0m6.038s 00:03:19.648 02:08:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:19.648 02:08:23 -- common/autotest_common.sh@10 -- # set +x 00:03:19.648 ************************************ 00:03:19.648 END TEST hugepages 00:03:19.648 ************************************ 00:03:19.648 02:08:23 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:19.648 02:08:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:19.648 02:08:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:19.648 02:08:23 -- common/autotest_common.sh@10 -- # set +x 00:03:19.648 ************************************ 00:03:19.648 START TEST driver 00:03:19.648 ************************************ 00:03:19.648 02:08:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:19.648 * Looking for test storage... 00:03:19.648 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:19.648 02:08:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:19.648 02:08:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:19.648 02:08:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:19.649 02:08:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:19.649 02:08:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:19.649 02:08:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:19.649 02:08:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:19.649 02:08:23 -- scripts/common.sh@335 -- # IFS=.-: 00:03:19.649 02:08:23 -- scripts/common.sh@335 -- # read -ra ver1 00:03:19.649 02:08:23 -- scripts/common.sh@336 -- # IFS=.-: 00:03:19.649 02:08:23 -- scripts/common.sh@336 -- # read -ra ver2 00:03:19.649 02:08:23 -- scripts/common.sh@337 -- # local 'op=<' 00:03:19.649 02:08:23 -- scripts/common.sh@339 -- # ver1_l=2 00:03:19.649 02:08:23 -- scripts/common.sh@340 -- # ver2_l=1 00:03:19.649 02:08:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:19.649 02:08:23 -- scripts/common.sh@343 -- # case "$op" in 00:03:19.649 02:08:23 -- scripts/common.sh@344 -- # : 1 00:03:19.649 02:08:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:19.649 02:08:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:19.649 02:08:23 -- scripts/common.sh@364 -- # decimal 1 00:03:19.649 02:08:23 -- scripts/common.sh@352 -- # local d=1 00:03:19.649 02:08:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:19.649 02:08:23 -- scripts/common.sh@354 -- # echo 1 00:03:19.649 02:08:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:19.649 02:08:23 -- scripts/common.sh@365 -- # decimal 2 00:03:19.649 02:08:23 -- scripts/common.sh@352 -- # local d=2 00:03:19.649 02:08:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:19.649 02:08:23 -- scripts/common.sh@354 -- # echo 2 00:03:19.649 02:08:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:19.649 02:08:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:19.649 02:08:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:19.649 02:08:23 -- scripts/common.sh@367 -- # return 0 00:03:19.649 02:08:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:19.649 02:08:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:19.649 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:19.649 --rc genhtml_branch_coverage=1 00:03:19.649 --rc genhtml_function_coverage=1 00:03:19.649 --rc genhtml_legend=1 00:03:19.649 --rc geninfo_all_blocks=1 00:03:19.649 --rc geninfo_unexecuted_blocks=1 00:03:19.649 00:03:19.649 ' 00:03:19.649 02:08:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:19.649 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:19.649 --rc genhtml_branch_coverage=1 00:03:19.649 --rc genhtml_function_coverage=1 00:03:19.649 --rc genhtml_legend=1 00:03:19.649 --rc geninfo_all_blocks=1 00:03:19.649 --rc geninfo_unexecuted_blocks=1 00:03:19.649 00:03:19.649 ' 00:03:19.649 02:08:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:19.649 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:19.649 --rc genhtml_branch_coverage=1 00:03:19.649 --rc genhtml_function_coverage=1 00:03:19.649 --rc genhtml_legend=1 00:03:19.649 --rc geninfo_all_blocks=1 00:03:19.649 --rc geninfo_unexecuted_blocks=1 00:03:19.649 00:03:19.649 ' 00:03:19.649 02:08:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:19.649 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:19.649 --rc genhtml_branch_coverage=1 00:03:19.649 --rc genhtml_function_coverage=1 00:03:19.649 --rc genhtml_legend=1 00:03:19.649 --rc geninfo_all_blocks=1 00:03:19.649 --rc geninfo_unexecuted_blocks=1 00:03:19.649 00:03:19.649 ' 00:03:19.649 02:08:23 -- setup/driver.sh@68 -- # setup reset 00:03:19.649 02:08:23 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:19.649 02:08:23 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:22.181 02:08:25 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:22.181 02:08:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:22.181 02:08:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:22.181 02:08:25 -- common/autotest_common.sh@10 -- # set +x 00:03:22.181 ************************************ 00:03:22.181 START TEST guess_driver 00:03:22.181 ************************************ 00:03:22.181 02:08:25 -- common/autotest_common.sh@1114 -- # guess_driver 00:03:22.181 02:08:25 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:22.181 02:08:25 -- setup/driver.sh@47 -- # local fail=0 00:03:22.181 02:08:25 -- setup/driver.sh@49 -- # pick_driver 00:03:22.181 02:08:25 -- setup/driver.sh@36 -- # vfio 00:03:22.181 02:08:25 -- setup/driver.sh@21 -- # local iommu_grups 00:03:22.181 02:08:25 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:22.181 02:08:25 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:22.181 02:08:25 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:22.181 02:08:25 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:22.181 02:08:25 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:03:22.181 02:08:25 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:22.181 02:08:25 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:22.181 02:08:25 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:22.181 02:08:25 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:22.181 02:08:25 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:22.181 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:22.181 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:22.181 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:22.181 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:22.181 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:22.181 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:22.181 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:22.181 02:08:25 -- setup/driver.sh@30 -- # return 0 00:03:22.181 02:08:25 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:22.181 02:08:25 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:22.181 02:08:25 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:22.181 02:08:25 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:22.181 Looking for driver=vfio-pci 00:03:22.181 02:08:25 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:22.181 02:08:25 -- setup/driver.sh@45 -- # setup output config 00:03:22.182 02:08:25 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:22.182 02:08:25 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:23.567 02:08:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.567 02:08:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.567 02:08:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.567 02:08:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.567 02:08:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.567 02:08:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.567 02:08:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.567 02:08:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.567 02:08:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.567 02:08:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.567 02:08:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.567 02:08:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.567 02:08:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.567 02:08:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.567 02:08:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.567 02:08:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.567 02:08:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.567 02:08:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.567 02:08:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.567 02:08:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.567 02:08:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.567 02:08:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.567 02:08:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.567 02:08:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.567 02:08:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.567 02:08:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.567 02:08:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.567 02:08:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.567 02:08:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.567 02:08:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.567 02:08:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.567 02:08:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.567 02:08:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.567 02:08:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.567 02:08:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.568 02:08:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.568 02:08:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.568 02:08:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.568 02:08:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.568 02:08:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.568 02:08:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.568 02:08:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.568 02:08:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.568 02:08:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.568 02:08:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.826 02:08:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.826 02:08:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.826 02:08:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:24.393 02:08:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:24.393 02:08:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:24.393 02:08:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:24.651 02:08:28 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:24.651 02:08:28 -- setup/driver.sh@65 -- # setup reset 00:03:24.651 02:08:28 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:24.651 02:08:28 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:27.183 00:03:27.183 real 0m4.870s 00:03:27.183 user 0m1.120s 00:03:27.183 sys 0m1.986s 00:03:27.183 02:08:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:27.183 02:08:30 -- common/autotest_common.sh@10 -- # set +x 00:03:27.183 ************************************ 00:03:27.183 END TEST guess_driver 00:03:27.183 ************************************ 00:03:27.183 00:03:27.183 real 0m7.508s 00:03:27.183 user 0m1.744s 00:03:27.183 sys 0m3.086s 00:03:27.183 02:08:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:27.183 02:08:30 -- common/autotest_common.sh@10 -- # set +x 00:03:27.183 ************************************ 00:03:27.183 END TEST driver 00:03:27.183 ************************************ 00:03:27.183 02:08:30 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:27.183 02:08:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:27.183 02:08:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:27.183 02:08:30 -- common/autotest_common.sh@10 -- # set +x 00:03:27.183 ************************************ 00:03:27.183 START TEST devices 00:03:27.183 ************************************ 00:03:27.183 02:08:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:27.183 * Looking for test storage... 00:03:27.183 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:27.183 02:08:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:27.183 02:08:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:27.183 02:08:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:27.183 02:08:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:27.183 02:08:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:27.183 02:08:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:27.183 02:08:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:27.183 02:08:30 -- scripts/common.sh@335 -- # IFS=.-: 00:03:27.183 02:08:30 -- scripts/common.sh@335 -- # read -ra ver1 00:03:27.183 02:08:30 -- scripts/common.sh@336 -- # IFS=.-: 00:03:27.183 02:08:30 -- scripts/common.sh@336 -- # read -ra ver2 00:03:27.183 02:08:30 -- scripts/common.sh@337 -- # local 'op=<' 00:03:27.183 02:08:30 -- scripts/common.sh@339 -- # ver1_l=2 00:03:27.183 02:08:30 -- scripts/common.sh@340 -- # ver2_l=1 00:03:27.183 02:08:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:27.183 02:08:30 -- scripts/common.sh@343 -- # case "$op" in 00:03:27.183 02:08:30 -- scripts/common.sh@344 -- # : 1 00:03:27.183 02:08:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:27.183 02:08:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:27.183 02:08:30 -- scripts/common.sh@364 -- # decimal 1 00:03:27.183 02:08:30 -- scripts/common.sh@352 -- # local d=1 00:03:27.183 02:08:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:27.183 02:08:30 -- scripts/common.sh@354 -- # echo 1 00:03:27.183 02:08:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:27.183 02:08:30 -- scripts/common.sh@365 -- # decimal 2 00:03:27.183 02:08:30 -- scripts/common.sh@352 -- # local d=2 00:03:27.183 02:08:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:27.183 02:08:30 -- scripts/common.sh@354 -- # echo 2 00:03:27.183 02:08:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:27.183 02:08:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:27.183 02:08:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:27.183 02:08:30 -- scripts/common.sh@367 -- # return 0 00:03:27.183 02:08:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:27.183 02:08:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:27.183 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:27.183 --rc genhtml_branch_coverage=1 00:03:27.183 --rc genhtml_function_coverage=1 00:03:27.183 --rc genhtml_legend=1 00:03:27.183 --rc geninfo_all_blocks=1 00:03:27.183 --rc geninfo_unexecuted_blocks=1 00:03:27.183 00:03:27.183 ' 00:03:27.183 02:08:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:27.183 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:27.183 --rc genhtml_branch_coverage=1 00:03:27.183 --rc genhtml_function_coverage=1 00:03:27.183 --rc genhtml_legend=1 00:03:27.183 --rc geninfo_all_blocks=1 00:03:27.183 --rc geninfo_unexecuted_blocks=1 00:03:27.183 00:03:27.183 ' 00:03:27.183 02:08:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:27.183 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:27.183 --rc genhtml_branch_coverage=1 00:03:27.183 --rc genhtml_function_coverage=1 00:03:27.183 --rc genhtml_legend=1 00:03:27.183 --rc geninfo_all_blocks=1 00:03:27.183 --rc geninfo_unexecuted_blocks=1 00:03:27.183 00:03:27.183 ' 00:03:27.183 02:08:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:27.183 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:27.183 --rc genhtml_branch_coverage=1 00:03:27.183 --rc genhtml_function_coverage=1 00:03:27.183 --rc genhtml_legend=1 00:03:27.183 --rc geninfo_all_blocks=1 00:03:27.183 --rc geninfo_unexecuted_blocks=1 00:03:27.183 00:03:27.183 ' 00:03:27.183 02:08:30 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:27.183 02:08:30 -- setup/devices.sh@192 -- # setup reset 00:03:27.183 02:08:30 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:27.183 02:08:30 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:29.083 02:08:32 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:29.083 02:08:32 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:29.083 02:08:32 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:29.083 02:08:32 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:29.083 02:08:32 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:29.083 02:08:32 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:29.083 02:08:32 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:29.083 02:08:32 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:29.083 02:08:32 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:29.083 02:08:32 -- setup/devices.sh@196 -- # blocks=() 00:03:29.083 02:08:32 -- setup/devices.sh@196 -- # declare -a blocks 00:03:29.083 02:08:32 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:29.083 02:08:32 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:29.083 02:08:32 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:29.083 02:08:32 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:29.083 02:08:32 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:29.083 02:08:32 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:29.083 02:08:32 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:03:29.083 02:08:32 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:29.083 02:08:32 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:29.083 02:08:32 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:03:29.083 02:08:32 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:29.083 No valid GPT data, bailing 00:03:29.083 02:08:32 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:29.083 02:08:32 -- scripts/common.sh@393 -- # pt= 00:03:29.083 02:08:32 -- scripts/common.sh@394 -- # return 1 00:03:29.083 02:08:32 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:29.083 02:08:32 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:29.083 02:08:32 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:29.083 02:08:32 -- setup/common.sh@80 -- # echo 1000204886016 00:03:29.083 02:08:32 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:03:29.083 02:08:32 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:29.084 02:08:32 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:03:29.084 02:08:32 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:29.084 02:08:32 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:29.084 02:08:32 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:29.084 02:08:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:29.084 02:08:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:29.084 02:08:32 -- common/autotest_common.sh@10 -- # set +x 00:03:29.084 ************************************ 00:03:29.084 START TEST nvme_mount 00:03:29.084 ************************************ 00:03:29.084 02:08:32 -- common/autotest_common.sh@1114 -- # nvme_mount 00:03:29.084 02:08:32 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:29.084 02:08:32 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:29.084 02:08:32 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:29.084 02:08:32 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:29.084 02:08:32 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:29.084 02:08:32 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:29.084 02:08:32 -- setup/common.sh@40 -- # local part_no=1 00:03:29.084 02:08:32 -- setup/common.sh@41 -- # local size=1073741824 00:03:29.084 02:08:32 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:29.084 02:08:32 -- setup/common.sh@44 -- # parts=() 00:03:29.084 02:08:32 -- setup/common.sh@44 -- # local parts 00:03:29.084 02:08:32 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:29.084 02:08:32 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:29.084 02:08:32 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:29.084 02:08:32 -- setup/common.sh@46 -- # (( part++ )) 00:03:29.084 02:08:32 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:29.084 02:08:32 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:29.084 02:08:32 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:29.084 02:08:32 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:30.018 Creating new GPT entries in memory. 00:03:30.018 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:30.018 other utilities. 00:03:30.018 02:08:33 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:30.018 02:08:33 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:30.018 02:08:33 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:30.018 02:08:33 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:30.018 02:08:33 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:30.952 Creating new GPT entries in memory. 00:03:30.952 The operation has completed successfully. 00:03:30.952 02:08:34 -- setup/common.sh@57 -- # (( part++ )) 00:03:30.952 02:08:34 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:30.952 02:08:34 -- setup/common.sh@62 -- # wait 4175181 00:03:30.952 02:08:34 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:30.952 02:08:34 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:30.952 02:08:34 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:30.952 02:08:34 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:30.952 02:08:34 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:30.952 02:08:34 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:30.952 02:08:34 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:30.952 02:08:34 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:30.952 02:08:34 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:30.952 02:08:34 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:30.952 02:08:34 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:30.952 02:08:34 -- setup/devices.sh@53 -- # local found=0 00:03:30.952 02:08:34 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:30.952 02:08:34 -- setup/devices.sh@56 -- # : 00:03:30.952 02:08:34 -- setup/devices.sh@59 -- # local pci status 00:03:30.952 02:08:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:30.952 02:08:34 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:30.952 02:08:34 -- setup/devices.sh@47 -- # setup output config 00:03:30.952 02:08:34 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:30.952 02:08:34 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:32.333 02:08:35 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:32.333 02:08:35 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:32.333 02:08:35 -- setup/devices.sh@63 -- # found=1 00:03:32.333 02:08:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:32.333 02:08:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:32.333 02:08:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:32.333 02:08:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:32.333 02:08:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:32.333 02:08:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:32.333 02:08:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:32.333 02:08:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:32.333 02:08:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:32.333 02:08:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:32.333 02:08:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:32.333 02:08:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:32.333 02:08:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:32.333 02:08:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:32.333 02:08:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:32.333 02:08:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:32.333 02:08:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:32.333 02:08:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:32.333 02:08:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:32.333 02:08:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:32.333 02:08:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:32.333 02:08:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:32.333 02:08:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:32.333 02:08:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:32.333 02:08:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:32.333 02:08:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:32.333 02:08:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:32.333 02:08:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:32.333 02:08:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:32.333 02:08:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:32.333 02:08:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:32.333 02:08:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:32.333 02:08:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:32.333 02:08:35 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:32.333 02:08:35 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:32.333 02:08:35 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:32.333 02:08:35 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:32.333 02:08:35 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:32.333 02:08:35 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:32.333 02:08:35 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:32.333 02:08:35 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:32.333 02:08:35 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:32.333 02:08:35 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:32.333 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:32.333 02:08:35 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:32.333 02:08:35 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:32.591 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:32.591 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:32.591 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:32.591 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:32.591 02:08:36 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:32.591 02:08:36 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:32.591 02:08:36 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:32.591 02:08:36 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:32.591 02:08:36 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:32.591 02:08:36 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:32.591 02:08:36 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:32.591 02:08:36 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:32.591 02:08:36 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:32.591 02:08:36 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:32.591 02:08:36 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:32.591 02:08:36 -- setup/devices.sh@53 -- # local found=0 00:03:32.591 02:08:36 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:32.591 02:08:36 -- setup/devices.sh@56 -- # : 00:03:32.591 02:08:36 -- setup/devices.sh@59 -- # local pci status 00:03:32.591 02:08:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:32.591 02:08:36 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:32.591 02:08:36 -- setup/devices.sh@47 -- # setup output config 00:03:32.591 02:08:36 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:32.591 02:08:36 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:33.578 02:08:37 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.578 02:08:37 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:33.578 02:08:37 -- setup/devices.sh@63 -- # found=1 00:03:33.578 02:08:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.836 02:08:37 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.836 02:08:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.836 02:08:37 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.836 02:08:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.836 02:08:37 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.836 02:08:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.836 02:08:37 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.836 02:08:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.836 02:08:37 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.836 02:08:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.836 02:08:37 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.836 02:08:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.836 02:08:37 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.836 02:08:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.836 02:08:37 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.836 02:08:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.836 02:08:37 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.836 02:08:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.836 02:08:37 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.836 02:08:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.836 02:08:37 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.836 02:08:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.836 02:08:37 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.836 02:08:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.836 02:08:37 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.836 02:08:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.836 02:08:37 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.836 02:08:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.836 02:08:37 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.836 02:08:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.836 02:08:37 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.836 02:08:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.836 02:08:37 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:33.836 02:08:37 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:33.836 02:08:37 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:33.836 02:08:37 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:33.836 02:08:37 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:33.836 02:08:37 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:33.836 02:08:37 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:03:33.836 02:08:37 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:33.836 02:08:37 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:33.836 02:08:37 -- setup/devices.sh@50 -- # local mount_point= 00:03:33.836 02:08:37 -- setup/devices.sh@51 -- # local test_file= 00:03:33.836 02:08:37 -- setup/devices.sh@53 -- # local found=0 00:03:33.836 02:08:37 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:33.836 02:08:37 -- setup/devices.sh@59 -- # local pci status 00:03:33.836 02:08:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.836 02:08:37 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:33.836 02:08:37 -- setup/devices.sh@47 -- # setup output config 00:03:33.836 02:08:37 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:33.836 02:08:37 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:35.211 02:08:38 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.211 02:08:38 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:35.211 02:08:38 -- setup/devices.sh@63 -- # found=1 00:03:35.211 02:08:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.211 02:08:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.211 02:08:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.211 02:08:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.211 02:08:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.211 02:08:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.211 02:08:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.211 02:08:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.211 02:08:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.211 02:08:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.211 02:08:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.211 02:08:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.211 02:08:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.211 02:08:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.211 02:08:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.211 02:08:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.211 02:08:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.211 02:08:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.211 02:08:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.211 02:08:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.211 02:08:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.211 02:08:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.211 02:08:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.211 02:08:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.211 02:08:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.211 02:08:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.211 02:08:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.211 02:08:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.211 02:08:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.211 02:08:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.211 02:08:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.211 02:08:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.211 02:08:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.211 02:08:38 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:35.211 02:08:38 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:35.211 02:08:38 -- setup/devices.sh@68 -- # return 0 00:03:35.211 02:08:38 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:35.211 02:08:38 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:35.211 02:08:38 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:35.211 02:08:38 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:35.211 02:08:38 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:35.211 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:35.211 00:03:35.211 real 0m6.468s 00:03:35.211 user 0m1.541s 00:03:35.211 sys 0m2.548s 00:03:35.211 02:08:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:35.211 02:08:38 -- common/autotest_common.sh@10 -- # set +x 00:03:35.211 ************************************ 00:03:35.211 END TEST nvme_mount 00:03:35.211 ************************************ 00:03:35.470 02:08:38 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:35.470 02:08:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:35.470 02:08:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:35.470 02:08:38 -- common/autotest_common.sh@10 -- # set +x 00:03:35.470 ************************************ 00:03:35.470 START TEST dm_mount 00:03:35.470 ************************************ 00:03:35.470 02:08:38 -- common/autotest_common.sh@1114 -- # dm_mount 00:03:35.470 02:08:38 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:35.470 02:08:38 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:35.470 02:08:38 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:35.470 02:08:38 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:35.470 02:08:38 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:35.470 02:08:38 -- setup/common.sh@40 -- # local part_no=2 00:03:35.470 02:08:38 -- setup/common.sh@41 -- # local size=1073741824 00:03:35.470 02:08:38 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:35.470 02:08:38 -- setup/common.sh@44 -- # parts=() 00:03:35.470 02:08:38 -- setup/common.sh@44 -- # local parts 00:03:35.470 02:08:38 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:35.470 02:08:38 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:35.470 02:08:38 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:35.470 02:08:38 -- setup/common.sh@46 -- # (( part++ )) 00:03:35.470 02:08:38 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:35.470 02:08:38 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:35.470 02:08:38 -- setup/common.sh@46 -- # (( part++ )) 00:03:35.470 02:08:38 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:35.470 02:08:38 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:35.470 02:08:38 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:35.470 02:08:38 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:36.407 Creating new GPT entries in memory. 00:03:36.407 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:36.407 other utilities. 00:03:36.407 02:08:39 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:36.407 02:08:39 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:36.407 02:08:39 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:36.407 02:08:39 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:36.407 02:08:39 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:37.343 Creating new GPT entries in memory. 00:03:37.343 The operation has completed successfully. 00:03:37.343 02:08:40 -- setup/common.sh@57 -- # (( part++ )) 00:03:37.343 02:08:40 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:37.343 02:08:40 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:37.343 02:08:40 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:37.343 02:08:40 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:38.280 The operation has completed successfully. 00:03:38.280 02:08:41 -- setup/common.sh@57 -- # (( part++ )) 00:03:38.280 02:08:41 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:38.280 02:08:41 -- setup/common.sh@62 -- # wait 4177644 00:03:38.538 02:08:42 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:38.538 02:08:42 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:38.538 02:08:42 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:38.538 02:08:42 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:38.538 02:08:42 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:38.538 02:08:42 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:38.538 02:08:42 -- setup/devices.sh@161 -- # break 00:03:38.538 02:08:42 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:38.538 02:08:42 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:38.538 02:08:42 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:03:38.538 02:08:42 -- setup/devices.sh@166 -- # dm=dm-0 00:03:38.538 02:08:42 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:03:38.538 02:08:42 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:03:38.538 02:08:42 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:38.538 02:08:42 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:03:38.538 02:08:42 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:38.538 02:08:42 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:38.538 02:08:42 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:38.538 02:08:42 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:38.538 02:08:42 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:38.538 02:08:42 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:38.538 02:08:42 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:38.538 02:08:42 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:38.538 02:08:42 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:38.538 02:08:42 -- setup/devices.sh@53 -- # local found=0 00:03:38.538 02:08:42 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:38.538 02:08:42 -- setup/devices.sh@56 -- # : 00:03:38.538 02:08:42 -- setup/devices.sh@59 -- # local pci status 00:03:38.538 02:08:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.538 02:08:42 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:38.538 02:08:42 -- setup/devices.sh@47 -- # setup output config 00:03:38.538 02:08:42 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:38.538 02:08:42 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:39.912 02:08:43 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.912 02:08:43 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:39.912 02:08:43 -- setup/devices.sh@63 -- # found=1 00:03:39.912 02:08:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.912 02:08:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.912 02:08:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.912 02:08:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.912 02:08:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.912 02:08:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.912 02:08:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.912 02:08:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.912 02:08:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.912 02:08:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.912 02:08:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.912 02:08:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.912 02:08:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.912 02:08:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.912 02:08:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.912 02:08:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.912 02:08:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.912 02:08:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.912 02:08:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.913 02:08:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.913 02:08:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.913 02:08:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.913 02:08:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.913 02:08:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.913 02:08:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.913 02:08:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.913 02:08:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.913 02:08:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.913 02:08:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.913 02:08:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.913 02:08:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.913 02:08:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.913 02:08:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.913 02:08:43 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:39.913 02:08:43 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:39.913 02:08:43 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:39.913 02:08:43 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:39.913 02:08:43 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:39.913 02:08:43 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:39.913 02:08:43 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:03:39.913 02:08:43 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:39.913 02:08:43 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:03:39.913 02:08:43 -- setup/devices.sh@50 -- # local mount_point= 00:03:39.913 02:08:43 -- setup/devices.sh@51 -- # local test_file= 00:03:39.913 02:08:43 -- setup/devices.sh@53 -- # local found=0 00:03:39.913 02:08:43 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:39.913 02:08:43 -- setup/devices.sh@59 -- # local pci status 00:03:39.913 02:08:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.913 02:08:43 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:39.913 02:08:43 -- setup/devices.sh@47 -- # setup output config 00:03:39.913 02:08:43 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:39.913 02:08:43 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:40.848 02:08:44 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.848 02:08:44 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:03:40.848 02:08:44 -- setup/devices.sh@63 -- # found=1 00:03:40.848 02:08:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.848 02:08:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.848 02:08:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.848 02:08:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.848 02:08:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.848 02:08:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.848 02:08:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.848 02:08:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.848 02:08:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.848 02:08:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.848 02:08:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.848 02:08:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.848 02:08:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.848 02:08:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.848 02:08:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.848 02:08:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.848 02:08:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.848 02:08:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.848 02:08:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.848 02:08:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.848 02:08:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.848 02:08:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.848 02:08:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.848 02:08:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.848 02:08:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.848 02:08:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.848 02:08:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.848 02:08:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.848 02:08:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.848 02:08:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.848 02:08:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.848 02:08:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.848 02:08:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:41.107 02:08:44 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:41.107 02:08:44 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:41.107 02:08:44 -- setup/devices.sh@68 -- # return 0 00:03:41.107 02:08:44 -- setup/devices.sh@187 -- # cleanup_dm 00:03:41.107 02:08:44 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:41.107 02:08:44 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:41.107 02:08:44 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:41.107 02:08:44 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:41.107 02:08:44 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:41.107 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:41.107 02:08:44 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:41.107 02:08:44 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:41.107 00:03:41.107 real 0m5.796s 00:03:41.107 user 0m0.956s 00:03:41.107 sys 0m1.698s 00:03:41.107 02:08:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:41.107 02:08:44 -- common/autotest_common.sh@10 -- # set +x 00:03:41.107 ************************************ 00:03:41.107 END TEST dm_mount 00:03:41.107 ************************************ 00:03:41.107 02:08:44 -- setup/devices.sh@1 -- # cleanup 00:03:41.107 02:08:44 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:41.107 02:08:44 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:41.107 02:08:44 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:41.107 02:08:44 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:41.107 02:08:44 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:41.107 02:08:44 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:41.366 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:41.366 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:41.366 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:41.366 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:41.366 02:08:44 -- setup/devices.sh@12 -- # cleanup_dm 00:03:41.366 02:08:44 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:41.366 02:08:44 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:41.366 02:08:44 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:41.366 02:08:44 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:41.366 02:08:44 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:41.366 02:08:44 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:41.366 00:03:41.366 real 0m14.286s 00:03:41.366 user 0m3.232s 00:03:41.366 sys 0m5.306s 00:03:41.366 02:08:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:41.366 02:08:45 -- common/autotest_common.sh@10 -- # set +x 00:03:41.366 ************************************ 00:03:41.366 END TEST devices 00:03:41.366 ************************************ 00:03:41.366 00:03:41.366 real 0m44.383s 00:03:41.366 user 0m12.915s 00:03:41.366 sys 0m20.123s 00:03:41.366 02:08:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:41.366 02:08:45 -- common/autotest_common.sh@10 -- # set +x 00:03:41.366 ************************************ 00:03:41.366 END TEST setup.sh 00:03:41.366 ************************************ 00:03:41.624 02:08:45 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:42.556 Hugepages 00:03:42.556 node hugesize free / total 00:03:42.556 node0 1048576kB 0 / 0 00:03:42.556 node0 2048kB 2048 / 2048 00:03:42.556 node1 1048576kB 0 / 0 00:03:42.556 node1 2048kB 0 / 0 00:03:42.556 00:03:42.556 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:42.556 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:03:42.556 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:03:42.556 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:03:42.556 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:03:42.556 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:03:42.556 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:03:42.556 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:03:42.556 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:03:42.556 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:03:42.556 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:03:42.557 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:03:42.557 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:03:42.557 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:03:42.557 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:03:42.557 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:03:42.557 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:03:42.557 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:03:42.557 02:08:46 -- spdk/autotest.sh@128 -- # uname -s 00:03:42.557 02:08:46 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:03:42.557 02:08:46 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:03:42.557 02:08:46 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:43.931 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:43.932 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:43.932 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:43.932 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:43.932 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:43.932 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:43.932 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:43.932 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:43.932 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:43.932 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:43.932 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:43.932 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:43.932 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:43.932 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:43.932 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:43.932 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:44.867 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:45.124 02:08:48 -- common/autotest_common.sh@1527 -- # sleep 1 00:03:46.058 02:08:49 -- common/autotest_common.sh@1528 -- # bdfs=() 00:03:46.058 02:08:49 -- common/autotest_common.sh@1528 -- # local bdfs 00:03:46.058 02:08:49 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:03:46.058 02:08:49 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:03:46.058 02:08:49 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:46.058 02:08:49 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:46.058 02:08:49 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:46.058 02:08:49 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:46.058 02:08:49 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:46.058 02:08:49 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:46.058 02:08:49 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:46.058 02:08:49 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:47.433 Waiting for block devices as requested 00:03:47.433 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:03:47.433 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:47.433 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:47.691 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:47.691 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:47.691 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:47.691 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:47.949 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:47.949 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:47.949 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:47.949 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:48.207 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:48.207 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:48.207 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:48.207 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:48.466 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:48.466 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:48.466 02:08:52 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:03:48.466 02:08:52 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:03:48.466 02:08:52 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:03:48.466 02:08:52 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:03:48.466 02:08:52 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:48.466 02:08:52 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:03:48.466 02:08:52 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:48.466 02:08:52 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:03:48.466 02:08:52 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:03:48.466 02:08:52 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:03:48.466 02:08:52 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:03:48.466 02:08:52 -- common/autotest_common.sh@1540 -- # grep oacs 00:03:48.466 02:08:52 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:03:48.466 02:08:52 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:03:48.466 02:08:52 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:03:48.466 02:08:52 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:03:48.724 02:08:52 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:03:48.724 02:08:52 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:03:48.724 02:08:52 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:03:48.724 02:08:52 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:03:48.724 02:08:52 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:03:48.724 02:08:52 -- common/autotest_common.sh@1552 -- # continue 00:03:48.724 02:08:52 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:03:48.724 02:08:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:48.724 02:08:52 -- common/autotest_common.sh@10 -- # set +x 00:03:48.724 02:08:52 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:03:48.724 02:08:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:48.724 02:08:52 -- common/autotest_common.sh@10 -- # set +x 00:03:48.724 02:08:52 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:49.660 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:49.918 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:49.918 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:49.918 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:49.918 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:49.918 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:49.918 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:49.918 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:49.918 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:49.918 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:49.918 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:49.918 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:49.918 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:49.918 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:49.918 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:49.918 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:50.852 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:50.852 02:08:54 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:03:50.852 02:08:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:50.852 02:08:54 -- common/autotest_common.sh@10 -- # set +x 00:03:50.852 02:08:54 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:03:50.852 02:08:54 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:03:50.852 02:08:54 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:03:50.852 02:08:54 -- common/autotest_common.sh@1572 -- # bdfs=() 00:03:50.852 02:08:54 -- common/autotest_common.sh@1572 -- # local bdfs 00:03:50.852 02:08:54 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:03:50.852 02:08:54 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:50.852 02:08:54 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:50.853 02:08:54 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:50.853 02:08:54 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:50.853 02:08:54 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:51.111 02:08:54 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:51.111 02:08:54 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:51.111 02:08:54 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:03:51.111 02:08:54 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:03:51.111 02:08:54 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:03:51.111 02:08:54 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:03:51.111 02:08:54 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:03:51.111 02:08:54 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:03:51.111 02:08:54 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:03:51.111 02:08:54 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=4183067 00:03:51.111 02:08:54 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:03:51.111 02:08:54 -- common/autotest_common.sh@1593 -- # waitforlisten 4183067 00:03:51.111 02:08:54 -- common/autotest_common.sh@829 -- # '[' -z 4183067 ']' 00:03:51.111 02:08:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:51.111 02:08:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:51.111 02:08:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:51.111 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:51.111 02:08:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:51.111 02:08:54 -- common/autotest_common.sh@10 -- # set +x 00:03:51.111 [2024-11-29 02:08:54.645152] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:51.111 [2024-11-29 02:08:54.645236] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4183067 ] 00:03:51.111 EAL: No free 2048 kB hugepages reported on node 1 00:03:51.111 [2024-11-29 02:08:54.708377] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:51.369 [2024-11-29 02:08:54.822334] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:51.369 [2024-11-29 02:08:54.822515] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:51.941 02:08:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:51.941 02:08:55 -- common/autotest_common.sh@862 -- # return 0 00:03:51.941 02:08:55 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:03:51.941 02:08:55 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:03:51.941 02:08:55 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:03:55.224 nvme0n1 00:03:55.224 02:08:58 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:03:55.482 [2024-11-29 02:08:58.913758] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:03:55.482 [2024-11-29 02:08:58.913806] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:03:55.482 request: 00:03:55.482 { 00:03:55.482 "nvme_ctrlr_name": "nvme0", 00:03:55.482 "password": "test", 00:03:55.482 "method": "bdev_nvme_opal_revert", 00:03:55.482 "req_id": 1 00:03:55.482 } 00:03:55.482 Got JSON-RPC error response 00:03:55.482 response: 00:03:55.482 { 00:03:55.482 "code": -32603, 00:03:55.482 "message": "Internal error" 00:03:55.482 } 00:03:55.482 02:08:58 -- common/autotest_common.sh@1599 -- # true 00:03:55.482 02:08:58 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:03:55.482 02:08:58 -- common/autotest_common.sh@1603 -- # killprocess 4183067 00:03:55.482 02:08:58 -- common/autotest_common.sh@936 -- # '[' -z 4183067 ']' 00:03:55.482 02:08:58 -- common/autotest_common.sh@940 -- # kill -0 4183067 00:03:55.482 02:08:58 -- common/autotest_common.sh@941 -- # uname 00:03:55.482 02:08:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:03:55.482 02:08:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4183067 00:03:55.482 02:08:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:03:55.482 02:08:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:03:55.482 02:08:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4183067' 00:03:55.482 killing process with pid 4183067 00:03:55.482 02:08:58 -- common/autotest_common.sh@955 -- # kill 4183067 00:03:55.482 02:08:58 -- common/autotest_common.sh@960 -- # wait 4183067 00:03:57.382 02:09:00 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:03:57.382 02:09:00 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:03:57.382 02:09:00 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:03:57.382 02:09:00 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:03:57.382 02:09:00 -- spdk/autotest.sh@160 -- # timing_enter lib 00:03:57.382 02:09:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:57.382 02:09:00 -- common/autotest_common.sh@10 -- # set +x 00:03:57.382 02:09:00 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:03:57.382 02:09:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:57.382 02:09:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:57.382 02:09:00 -- common/autotest_common.sh@10 -- # set +x 00:03:57.382 ************************************ 00:03:57.382 START TEST env 00:03:57.382 ************************************ 00:03:57.382 02:09:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:03:57.382 * Looking for test storage... 00:03:57.382 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:03:57.382 02:09:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:57.382 02:09:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:57.382 02:09:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:57.382 02:09:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:57.382 02:09:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:57.382 02:09:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:57.382 02:09:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:57.382 02:09:00 -- scripts/common.sh@335 -- # IFS=.-: 00:03:57.382 02:09:00 -- scripts/common.sh@335 -- # read -ra ver1 00:03:57.382 02:09:00 -- scripts/common.sh@336 -- # IFS=.-: 00:03:57.382 02:09:00 -- scripts/common.sh@336 -- # read -ra ver2 00:03:57.382 02:09:00 -- scripts/common.sh@337 -- # local 'op=<' 00:03:57.382 02:09:00 -- scripts/common.sh@339 -- # ver1_l=2 00:03:57.382 02:09:00 -- scripts/common.sh@340 -- # ver2_l=1 00:03:57.382 02:09:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:57.382 02:09:00 -- scripts/common.sh@343 -- # case "$op" in 00:03:57.382 02:09:00 -- scripts/common.sh@344 -- # : 1 00:03:57.382 02:09:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:57.382 02:09:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:57.382 02:09:00 -- scripts/common.sh@364 -- # decimal 1 00:03:57.382 02:09:00 -- scripts/common.sh@352 -- # local d=1 00:03:57.382 02:09:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:57.382 02:09:00 -- scripts/common.sh@354 -- # echo 1 00:03:57.382 02:09:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:57.382 02:09:00 -- scripts/common.sh@365 -- # decimal 2 00:03:57.382 02:09:00 -- scripts/common.sh@352 -- # local d=2 00:03:57.382 02:09:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:57.382 02:09:00 -- scripts/common.sh@354 -- # echo 2 00:03:57.382 02:09:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:57.382 02:09:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:57.382 02:09:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:57.382 02:09:00 -- scripts/common.sh@367 -- # return 0 00:03:57.382 02:09:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:57.382 02:09:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:57.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:57.382 --rc genhtml_branch_coverage=1 00:03:57.382 --rc genhtml_function_coverage=1 00:03:57.382 --rc genhtml_legend=1 00:03:57.382 --rc geninfo_all_blocks=1 00:03:57.382 --rc geninfo_unexecuted_blocks=1 00:03:57.382 00:03:57.382 ' 00:03:57.382 02:09:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:57.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:57.382 --rc genhtml_branch_coverage=1 00:03:57.382 --rc genhtml_function_coverage=1 00:03:57.382 --rc genhtml_legend=1 00:03:57.382 --rc geninfo_all_blocks=1 00:03:57.382 --rc geninfo_unexecuted_blocks=1 00:03:57.382 00:03:57.382 ' 00:03:57.382 02:09:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:57.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:57.382 --rc genhtml_branch_coverage=1 00:03:57.382 --rc genhtml_function_coverage=1 00:03:57.382 --rc genhtml_legend=1 00:03:57.382 --rc geninfo_all_blocks=1 00:03:57.382 --rc geninfo_unexecuted_blocks=1 00:03:57.382 00:03:57.382 ' 00:03:57.382 02:09:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:57.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:57.382 --rc genhtml_branch_coverage=1 00:03:57.382 --rc genhtml_function_coverage=1 00:03:57.382 --rc genhtml_legend=1 00:03:57.382 --rc geninfo_all_blocks=1 00:03:57.382 --rc geninfo_unexecuted_blocks=1 00:03:57.382 00:03:57.382 ' 00:03:57.382 02:09:00 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:03:57.382 02:09:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:57.382 02:09:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:57.382 02:09:00 -- common/autotest_common.sh@10 -- # set +x 00:03:57.382 ************************************ 00:03:57.382 START TEST env_memory 00:03:57.382 ************************************ 00:03:57.382 02:09:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:03:57.382 00:03:57.382 00:03:57.382 CUnit - A unit testing framework for C - Version 2.1-3 00:03:57.382 http://cunit.sourceforge.net/ 00:03:57.382 00:03:57.382 00:03:57.383 Suite: memory 00:03:57.383 Test: alloc and free memory map ...[2024-11-29 02:09:00.930707] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:03:57.383 passed 00:03:57.383 Test: mem map translation ...[2024-11-29 02:09:00.951635] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:03:57.383 [2024-11-29 02:09:00.951657] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:03:57.383 [2024-11-29 02:09:00.951715] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:03:57.383 [2024-11-29 02:09:00.951727] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:03:57.383 passed 00:03:57.383 Test: mem map registration ...[2024-11-29 02:09:00.993800] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:03:57.383 [2024-11-29 02:09:00.993820] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:03:57.383 passed 00:03:57.383 Test: mem map adjacent registrations ...passed 00:03:57.383 00:03:57.383 Run Summary: Type Total Ran Passed Failed Inactive 00:03:57.383 suites 1 1 n/a 0 0 00:03:57.383 tests 4 4 4 0 0 00:03:57.383 asserts 152 152 152 0 n/a 00:03:57.383 00:03:57.383 Elapsed time = 0.144 seconds 00:03:57.383 00:03:57.383 real 0m0.152s 00:03:57.383 user 0m0.146s 00:03:57.383 sys 0m0.005s 00:03:57.383 02:09:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:57.383 02:09:01 -- common/autotest_common.sh@10 -- # set +x 00:03:57.383 ************************************ 00:03:57.383 END TEST env_memory 00:03:57.383 ************************************ 00:03:57.642 02:09:01 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:03:57.642 02:09:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:57.642 02:09:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:57.642 02:09:01 -- common/autotest_common.sh@10 -- # set +x 00:03:57.642 ************************************ 00:03:57.642 START TEST env_vtophys 00:03:57.642 ************************************ 00:03:57.642 02:09:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:03:57.642 EAL: lib.eal log level changed from notice to debug 00:03:57.642 EAL: Detected lcore 0 as core 0 on socket 0 00:03:57.642 EAL: Detected lcore 1 as core 1 on socket 0 00:03:57.642 EAL: Detected lcore 2 as core 2 on socket 0 00:03:57.642 EAL: Detected lcore 3 as core 3 on socket 0 00:03:57.642 EAL: Detected lcore 4 as core 4 on socket 0 00:03:57.642 EAL: Detected lcore 5 as core 5 on socket 0 00:03:57.642 EAL: Detected lcore 6 as core 8 on socket 0 00:03:57.642 EAL: Detected lcore 7 as core 9 on socket 0 00:03:57.642 EAL: Detected lcore 8 as core 10 on socket 0 00:03:57.642 EAL: Detected lcore 9 as core 11 on socket 0 00:03:57.642 EAL: Detected lcore 10 as core 12 on socket 0 00:03:57.642 EAL: Detected lcore 11 as core 13 on socket 0 00:03:57.642 EAL: Detected lcore 12 as core 0 on socket 1 00:03:57.642 EAL: Detected lcore 13 as core 1 on socket 1 00:03:57.642 EAL: Detected lcore 14 as core 2 on socket 1 00:03:57.642 EAL: Detected lcore 15 as core 3 on socket 1 00:03:57.642 EAL: Detected lcore 16 as core 4 on socket 1 00:03:57.642 EAL: Detected lcore 17 as core 5 on socket 1 00:03:57.642 EAL: Detected lcore 18 as core 8 on socket 1 00:03:57.642 EAL: Detected lcore 19 as core 9 on socket 1 00:03:57.642 EAL: Detected lcore 20 as core 10 on socket 1 00:03:57.642 EAL: Detected lcore 21 as core 11 on socket 1 00:03:57.642 EAL: Detected lcore 22 as core 12 on socket 1 00:03:57.642 EAL: Detected lcore 23 as core 13 on socket 1 00:03:57.642 EAL: Detected lcore 24 as core 0 on socket 0 00:03:57.642 EAL: Detected lcore 25 as core 1 on socket 0 00:03:57.642 EAL: Detected lcore 26 as core 2 on socket 0 00:03:57.642 EAL: Detected lcore 27 as core 3 on socket 0 00:03:57.642 EAL: Detected lcore 28 as core 4 on socket 0 00:03:57.642 EAL: Detected lcore 29 as core 5 on socket 0 00:03:57.642 EAL: Detected lcore 30 as core 8 on socket 0 00:03:57.642 EAL: Detected lcore 31 as core 9 on socket 0 00:03:57.642 EAL: Detected lcore 32 as core 10 on socket 0 00:03:57.642 EAL: Detected lcore 33 as core 11 on socket 0 00:03:57.642 EAL: Detected lcore 34 as core 12 on socket 0 00:03:57.642 EAL: Detected lcore 35 as core 13 on socket 0 00:03:57.642 EAL: Detected lcore 36 as core 0 on socket 1 00:03:57.642 EAL: Detected lcore 37 as core 1 on socket 1 00:03:57.642 EAL: Detected lcore 38 as core 2 on socket 1 00:03:57.642 EAL: Detected lcore 39 as core 3 on socket 1 00:03:57.642 EAL: Detected lcore 40 as core 4 on socket 1 00:03:57.642 EAL: Detected lcore 41 as core 5 on socket 1 00:03:57.642 EAL: Detected lcore 42 as core 8 on socket 1 00:03:57.642 EAL: Detected lcore 43 as core 9 on socket 1 00:03:57.642 EAL: Detected lcore 44 as core 10 on socket 1 00:03:57.642 EAL: Detected lcore 45 as core 11 on socket 1 00:03:57.642 EAL: Detected lcore 46 as core 12 on socket 1 00:03:57.642 EAL: Detected lcore 47 as core 13 on socket 1 00:03:57.642 EAL: Maximum logical cores by configuration: 128 00:03:57.642 EAL: Detected CPU lcores: 48 00:03:57.642 EAL: Detected NUMA nodes: 2 00:03:57.642 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:03:57.642 EAL: Detected shared linkage of DPDK 00:03:57.642 EAL: No shared files mode enabled, IPC will be disabled 00:03:57.642 EAL: Bus pci wants IOVA as 'DC' 00:03:57.642 EAL: Buses did not request a specific IOVA mode. 00:03:57.642 EAL: IOMMU is available, selecting IOVA as VA mode. 00:03:57.642 EAL: Selected IOVA mode 'VA' 00:03:57.642 EAL: No free 2048 kB hugepages reported on node 1 00:03:57.642 EAL: Probing VFIO support... 00:03:57.642 EAL: IOMMU type 1 (Type 1) is supported 00:03:57.642 EAL: IOMMU type 7 (sPAPR) is not supported 00:03:57.642 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:03:57.642 EAL: VFIO support initialized 00:03:57.642 EAL: Ask a virtual area of 0x2e000 bytes 00:03:57.642 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:03:57.642 EAL: Setting up physically contiguous memory... 00:03:57.642 EAL: Setting maximum number of open files to 524288 00:03:57.642 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:03:57.642 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:03:57.642 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:03:57.642 EAL: Ask a virtual area of 0x61000 bytes 00:03:57.642 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:03:57.642 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:57.642 EAL: Ask a virtual area of 0x400000000 bytes 00:03:57.642 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:03:57.642 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:03:57.642 EAL: Ask a virtual area of 0x61000 bytes 00:03:57.642 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:03:57.642 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:57.642 EAL: Ask a virtual area of 0x400000000 bytes 00:03:57.642 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:03:57.642 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:03:57.642 EAL: Ask a virtual area of 0x61000 bytes 00:03:57.642 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:03:57.642 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:57.642 EAL: Ask a virtual area of 0x400000000 bytes 00:03:57.642 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:03:57.642 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:03:57.643 EAL: Ask a virtual area of 0x61000 bytes 00:03:57.643 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:03:57.643 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:57.643 EAL: Ask a virtual area of 0x400000000 bytes 00:03:57.643 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:03:57.643 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:03:57.643 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:03:57.643 EAL: Ask a virtual area of 0x61000 bytes 00:03:57.643 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:03:57.643 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:57.643 EAL: Ask a virtual area of 0x400000000 bytes 00:03:57.643 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:03:57.643 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:03:57.643 EAL: Ask a virtual area of 0x61000 bytes 00:03:57.643 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:03:57.643 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:57.643 EAL: Ask a virtual area of 0x400000000 bytes 00:03:57.643 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:03:57.643 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:03:57.643 EAL: Ask a virtual area of 0x61000 bytes 00:03:57.643 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:03:57.643 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:57.643 EAL: Ask a virtual area of 0x400000000 bytes 00:03:57.643 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:03:57.643 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:03:57.643 EAL: Ask a virtual area of 0x61000 bytes 00:03:57.643 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:03:57.643 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:57.643 EAL: Ask a virtual area of 0x400000000 bytes 00:03:57.643 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:03:57.643 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:03:57.643 EAL: Hugepages will be freed exactly as allocated. 00:03:57.643 EAL: No shared files mode enabled, IPC is disabled 00:03:57.643 EAL: No shared files mode enabled, IPC is disabled 00:03:57.643 EAL: TSC frequency is ~2700000 KHz 00:03:57.643 EAL: Main lcore 0 is ready (tid=7f039debaa00;cpuset=[0]) 00:03:57.643 EAL: Trying to obtain current memory policy. 00:03:57.643 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:57.643 EAL: Restoring previous memory policy: 0 00:03:57.643 EAL: request: mp_malloc_sync 00:03:57.643 EAL: No shared files mode enabled, IPC is disabled 00:03:57.643 EAL: Heap on socket 0 was expanded by 2MB 00:03:57.643 EAL: No shared files mode enabled, IPC is disabled 00:03:57.643 EAL: No PCI address specified using 'addr=' in: bus=pci 00:03:57.643 EAL: Mem event callback 'spdk:(nil)' registered 00:03:57.643 00:03:57.643 00:03:57.643 CUnit - A unit testing framework for C - Version 2.1-3 00:03:57.643 http://cunit.sourceforge.net/ 00:03:57.643 00:03:57.643 00:03:57.643 Suite: components_suite 00:03:57.643 Test: vtophys_malloc_test ...passed 00:03:57.643 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:03:57.643 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:57.643 EAL: Restoring previous memory policy: 4 00:03:57.643 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.643 EAL: request: mp_malloc_sync 00:03:57.643 EAL: No shared files mode enabled, IPC is disabled 00:03:57.643 EAL: Heap on socket 0 was expanded by 4MB 00:03:57.643 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.643 EAL: request: mp_malloc_sync 00:03:57.643 EAL: No shared files mode enabled, IPC is disabled 00:03:57.643 EAL: Heap on socket 0 was shrunk by 4MB 00:03:57.643 EAL: Trying to obtain current memory policy. 00:03:57.643 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:57.643 EAL: Restoring previous memory policy: 4 00:03:57.643 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.643 EAL: request: mp_malloc_sync 00:03:57.643 EAL: No shared files mode enabled, IPC is disabled 00:03:57.643 EAL: Heap on socket 0 was expanded by 6MB 00:03:57.643 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.643 EAL: request: mp_malloc_sync 00:03:57.643 EAL: No shared files mode enabled, IPC is disabled 00:03:57.643 EAL: Heap on socket 0 was shrunk by 6MB 00:03:57.643 EAL: Trying to obtain current memory policy. 00:03:57.643 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:57.643 EAL: Restoring previous memory policy: 4 00:03:57.643 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.643 EAL: request: mp_malloc_sync 00:03:57.643 EAL: No shared files mode enabled, IPC is disabled 00:03:57.643 EAL: Heap on socket 0 was expanded by 10MB 00:03:57.643 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.643 EAL: request: mp_malloc_sync 00:03:57.643 EAL: No shared files mode enabled, IPC is disabled 00:03:57.643 EAL: Heap on socket 0 was shrunk by 10MB 00:03:57.643 EAL: Trying to obtain current memory policy. 00:03:57.643 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:57.643 EAL: Restoring previous memory policy: 4 00:03:57.643 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.643 EAL: request: mp_malloc_sync 00:03:57.643 EAL: No shared files mode enabled, IPC is disabled 00:03:57.643 EAL: Heap on socket 0 was expanded by 18MB 00:03:57.643 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.643 EAL: request: mp_malloc_sync 00:03:57.643 EAL: No shared files mode enabled, IPC is disabled 00:03:57.643 EAL: Heap on socket 0 was shrunk by 18MB 00:03:57.643 EAL: Trying to obtain current memory policy. 00:03:57.643 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:57.643 EAL: Restoring previous memory policy: 4 00:03:57.643 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.643 EAL: request: mp_malloc_sync 00:03:57.643 EAL: No shared files mode enabled, IPC is disabled 00:03:57.643 EAL: Heap on socket 0 was expanded by 34MB 00:03:57.643 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.643 EAL: request: mp_malloc_sync 00:03:57.643 EAL: No shared files mode enabled, IPC is disabled 00:03:57.643 EAL: Heap on socket 0 was shrunk by 34MB 00:03:57.643 EAL: Trying to obtain current memory policy. 00:03:57.643 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:57.643 EAL: Restoring previous memory policy: 4 00:03:57.643 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.643 EAL: request: mp_malloc_sync 00:03:57.643 EAL: No shared files mode enabled, IPC is disabled 00:03:57.643 EAL: Heap on socket 0 was expanded by 66MB 00:03:57.643 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.643 EAL: request: mp_malloc_sync 00:03:57.643 EAL: No shared files mode enabled, IPC is disabled 00:03:57.643 EAL: Heap on socket 0 was shrunk by 66MB 00:03:57.643 EAL: Trying to obtain current memory policy. 00:03:57.643 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:57.643 EAL: Restoring previous memory policy: 4 00:03:57.643 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.643 EAL: request: mp_malloc_sync 00:03:57.643 EAL: No shared files mode enabled, IPC is disabled 00:03:57.643 EAL: Heap on socket 0 was expanded by 130MB 00:03:57.643 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.643 EAL: request: mp_malloc_sync 00:03:57.643 EAL: No shared files mode enabled, IPC is disabled 00:03:57.643 EAL: Heap on socket 0 was shrunk by 130MB 00:03:57.643 EAL: Trying to obtain current memory policy. 00:03:57.643 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:57.902 EAL: Restoring previous memory policy: 4 00:03:57.902 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.902 EAL: request: mp_malloc_sync 00:03:57.902 EAL: No shared files mode enabled, IPC is disabled 00:03:57.902 EAL: Heap on socket 0 was expanded by 258MB 00:03:57.902 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.902 EAL: request: mp_malloc_sync 00:03:57.902 EAL: No shared files mode enabled, IPC is disabled 00:03:57.902 EAL: Heap on socket 0 was shrunk by 258MB 00:03:57.902 EAL: Trying to obtain current memory policy. 00:03:57.902 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:58.163 EAL: Restoring previous memory policy: 4 00:03:58.163 EAL: Calling mem event callback 'spdk:(nil)' 00:03:58.163 EAL: request: mp_malloc_sync 00:03:58.163 EAL: No shared files mode enabled, IPC is disabled 00:03:58.163 EAL: Heap on socket 0 was expanded by 514MB 00:03:58.163 EAL: Calling mem event callback 'spdk:(nil)' 00:03:58.163 EAL: request: mp_malloc_sync 00:03:58.163 EAL: No shared files mode enabled, IPC is disabled 00:03:58.163 EAL: Heap on socket 0 was shrunk by 514MB 00:03:58.163 EAL: Trying to obtain current memory policy. 00:03:58.163 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:58.728 EAL: Restoring previous memory policy: 4 00:03:58.728 EAL: Calling mem event callback 'spdk:(nil)' 00:03:58.728 EAL: request: mp_malloc_sync 00:03:58.728 EAL: No shared files mode enabled, IPC is disabled 00:03:58.728 EAL: Heap on socket 0 was expanded by 1026MB 00:03:58.728 EAL: Calling mem event callback 'spdk:(nil)' 00:03:58.986 EAL: request: mp_malloc_sync 00:03:58.986 EAL: No shared files mode enabled, IPC is disabled 00:03:58.986 EAL: Heap on socket 0 was shrunk by 1026MB 00:03:58.986 passed 00:03:58.986 00:03:58.986 Run Summary: Type Total Ran Passed Failed Inactive 00:03:58.986 suites 1 1 n/a 0 0 00:03:58.986 tests 2 2 2 0 0 00:03:58.986 asserts 497 497 497 0 n/a 00:03:58.986 00:03:58.986 Elapsed time = 1.326 seconds 00:03:58.986 EAL: Calling mem event callback 'spdk:(nil)' 00:03:58.986 EAL: request: mp_malloc_sync 00:03:58.986 EAL: No shared files mode enabled, IPC is disabled 00:03:58.986 EAL: Heap on socket 0 was shrunk by 2MB 00:03:58.986 EAL: No shared files mode enabled, IPC is disabled 00:03:58.986 EAL: No shared files mode enabled, IPC is disabled 00:03:58.986 EAL: No shared files mode enabled, IPC is disabled 00:03:58.986 00:03:58.986 real 0m1.459s 00:03:58.986 user 0m0.809s 00:03:58.986 sys 0m0.602s 00:03:58.986 02:09:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:58.986 02:09:02 -- common/autotest_common.sh@10 -- # set +x 00:03:58.986 ************************************ 00:03:58.986 END TEST env_vtophys 00:03:58.986 ************************************ 00:03:58.986 02:09:02 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:03:58.986 02:09:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:58.986 02:09:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:58.987 02:09:02 -- common/autotest_common.sh@10 -- # set +x 00:03:58.987 ************************************ 00:03:58.987 START TEST env_pci 00:03:58.987 ************************************ 00:03:58.987 02:09:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:03:58.987 00:03:58.987 00:03:58.987 CUnit - A unit testing framework for C - Version 2.1-3 00:03:58.987 http://cunit.sourceforge.net/ 00:03:58.987 00:03:58.987 00:03:58.987 Suite: pci 00:03:58.987 Test: pci_hook ...[2024-11-29 02:09:02.567547] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 4184226 has claimed it 00:03:58.987 EAL: Cannot find device (10000:00:01.0) 00:03:58.987 EAL: Failed to attach device on primary process 00:03:58.987 passed 00:03:58.987 00:03:58.987 Run Summary: Type Total Ran Passed Failed Inactive 00:03:58.987 suites 1 1 n/a 0 0 00:03:58.987 tests 1 1 1 0 0 00:03:58.987 asserts 25 25 25 0 n/a 00:03:58.987 00:03:58.987 Elapsed time = 0.021 seconds 00:03:58.987 00:03:58.987 real 0m0.034s 00:03:58.987 user 0m0.011s 00:03:58.987 sys 0m0.023s 00:03:58.987 02:09:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:58.987 02:09:02 -- common/autotest_common.sh@10 -- # set +x 00:03:58.987 ************************************ 00:03:58.987 END TEST env_pci 00:03:58.987 ************************************ 00:03:58.987 02:09:02 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:03:58.987 02:09:02 -- env/env.sh@15 -- # uname 00:03:58.987 02:09:02 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:03:58.987 02:09:02 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:03:58.987 02:09:02 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:03:58.987 02:09:02 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:03:58.987 02:09:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:58.987 02:09:02 -- common/autotest_common.sh@10 -- # set +x 00:03:58.987 ************************************ 00:03:58.987 START TEST env_dpdk_post_init 00:03:58.987 ************************************ 00:03:58.987 02:09:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:03:58.987 EAL: Detected CPU lcores: 48 00:03:58.987 EAL: Detected NUMA nodes: 2 00:03:58.987 EAL: Detected shared linkage of DPDK 00:03:58.987 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:03:58.987 EAL: Selected IOVA mode 'VA' 00:03:58.987 EAL: No free 2048 kB hugepages reported on node 1 00:03:58.987 EAL: VFIO support initialized 00:03:58.987 TELEMETRY: No legacy callbacks, legacy socket not created 00:03:59.245 EAL: Using IOMMU type 1 (Type 1) 00:03:59.245 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:03:59.245 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:03:59.245 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:03:59.245 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:03:59.245 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:03:59.245 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:03:59.245 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:03:59.245 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:03:59.245 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:03:59.245 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:03:59.245 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:03:59.245 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:03:59.245 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:03:59.245 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:03:59.245 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:03:59.245 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:04:00.180 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:04:03.507 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:04:03.507 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:04:03.507 Starting DPDK initialization... 00:04:03.507 Starting SPDK post initialization... 00:04:03.507 SPDK NVMe probe 00:04:03.507 Attaching to 0000:88:00.0 00:04:03.507 Attached to 0000:88:00.0 00:04:03.507 Cleaning up... 00:04:03.507 00:04:03.507 real 0m4.392s 00:04:03.507 user 0m3.290s 00:04:03.507 sys 0m0.162s 00:04:03.507 02:09:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:03.507 02:09:07 -- common/autotest_common.sh@10 -- # set +x 00:04:03.507 ************************************ 00:04:03.507 END TEST env_dpdk_post_init 00:04:03.507 ************************************ 00:04:03.507 02:09:07 -- env/env.sh@26 -- # uname 00:04:03.507 02:09:07 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:03.507 02:09:07 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:03.507 02:09:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:03.507 02:09:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:03.507 02:09:07 -- common/autotest_common.sh@10 -- # set +x 00:04:03.507 ************************************ 00:04:03.507 START TEST env_mem_callbacks 00:04:03.507 ************************************ 00:04:03.508 02:09:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:03.508 EAL: Detected CPU lcores: 48 00:04:03.508 EAL: Detected NUMA nodes: 2 00:04:03.508 EAL: Detected shared linkage of DPDK 00:04:03.508 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:03.508 EAL: Selected IOVA mode 'VA' 00:04:03.508 EAL: No free 2048 kB hugepages reported on node 1 00:04:03.508 EAL: VFIO support initialized 00:04:03.508 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:03.508 00:04:03.508 00:04:03.508 CUnit - A unit testing framework for C - Version 2.1-3 00:04:03.508 http://cunit.sourceforge.net/ 00:04:03.508 00:04:03.508 00:04:03.508 Suite: memory 00:04:03.508 Test: test ... 00:04:03.508 register 0x200000200000 2097152 00:04:03.508 malloc 3145728 00:04:03.508 register 0x200000400000 4194304 00:04:03.508 buf 0x200000500000 len 3145728 PASSED 00:04:03.508 malloc 64 00:04:03.508 buf 0x2000004fff40 len 64 PASSED 00:04:03.508 malloc 4194304 00:04:03.508 register 0x200000800000 6291456 00:04:03.508 buf 0x200000a00000 len 4194304 PASSED 00:04:03.508 free 0x200000500000 3145728 00:04:03.508 free 0x2000004fff40 64 00:04:03.508 unregister 0x200000400000 4194304 PASSED 00:04:03.508 free 0x200000a00000 4194304 00:04:03.508 unregister 0x200000800000 6291456 PASSED 00:04:03.508 malloc 8388608 00:04:03.508 register 0x200000400000 10485760 00:04:03.508 buf 0x200000600000 len 8388608 PASSED 00:04:03.508 free 0x200000600000 8388608 00:04:03.508 unregister 0x200000400000 10485760 PASSED 00:04:03.508 passed 00:04:03.508 00:04:03.508 Run Summary: Type Total Ran Passed Failed Inactive 00:04:03.508 suites 1 1 n/a 0 0 00:04:03.508 tests 1 1 1 0 0 00:04:03.508 asserts 15 15 15 0 n/a 00:04:03.508 00:04:03.508 Elapsed time = 0.005 seconds 00:04:03.508 00:04:03.508 real 0m0.049s 00:04:03.508 user 0m0.010s 00:04:03.508 sys 0m0.039s 00:04:03.508 02:09:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:03.508 02:09:07 -- common/autotest_common.sh@10 -- # set +x 00:04:03.508 ************************************ 00:04:03.508 END TEST env_mem_callbacks 00:04:03.508 ************************************ 00:04:03.508 00:04:03.508 real 0m6.344s 00:04:03.508 user 0m4.403s 00:04:03.508 sys 0m0.979s 00:04:03.508 02:09:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:03.508 02:09:07 -- common/autotest_common.sh@10 -- # set +x 00:04:03.508 ************************************ 00:04:03.508 END TEST env 00:04:03.508 ************************************ 00:04:03.508 02:09:07 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:03.508 02:09:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:03.508 02:09:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:03.508 02:09:07 -- common/autotest_common.sh@10 -- # set +x 00:04:03.508 ************************************ 00:04:03.508 START TEST rpc 00:04:03.508 ************************************ 00:04:03.508 02:09:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:03.792 * Looking for test storage... 00:04:03.792 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:03.792 02:09:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:03.792 02:09:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:03.792 02:09:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:03.792 02:09:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:03.792 02:09:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:03.792 02:09:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:03.792 02:09:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:03.792 02:09:07 -- scripts/common.sh@335 -- # IFS=.-: 00:04:03.792 02:09:07 -- scripts/common.sh@335 -- # read -ra ver1 00:04:03.792 02:09:07 -- scripts/common.sh@336 -- # IFS=.-: 00:04:03.792 02:09:07 -- scripts/common.sh@336 -- # read -ra ver2 00:04:03.792 02:09:07 -- scripts/common.sh@337 -- # local 'op=<' 00:04:03.792 02:09:07 -- scripts/common.sh@339 -- # ver1_l=2 00:04:03.792 02:09:07 -- scripts/common.sh@340 -- # ver2_l=1 00:04:03.792 02:09:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:03.792 02:09:07 -- scripts/common.sh@343 -- # case "$op" in 00:04:03.792 02:09:07 -- scripts/common.sh@344 -- # : 1 00:04:03.792 02:09:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:03.792 02:09:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:03.792 02:09:07 -- scripts/common.sh@364 -- # decimal 1 00:04:03.792 02:09:07 -- scripts/common.sh@352 -- # local d=1 00:04:03.792 02:09:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:03.792 02:09:07 -- scripts/common.sh@354 -- # echo 1 00:04:03.792 02:09:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:03.792 02:09:07 -- scripts/common.sh@365 -- # decimal 2 00:04:03.792 02:09:07 -- scripts/common.sh@352 -- # local d=2 00:04:03.792 02:09:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:03.792 02:09:07 -- scripts/common.sh@354 -- # echo 2 00:04:03.792 02:09:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:03.792 02:09:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:03.792 02:09:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:03.792 02:09:07 -- scripts/common.sh@367 -- # return 0 00:04:03.792 02:09:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:03.792 02:09:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:03.792 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:03.792 --rc genhtml_branch_coverage=1 00:04:03.792 --rc genhtml_function_coverage=1 00:04:03.792 --rc genhtml_legend=1 00:04:03.792 --rc geninfo_all_blocks=1 00:04:03.792 --rc geninfo_unexecuted_blocks=1 00:04:03.792 00:04:03.792 ' 00:04:03.792 02:09:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:03.792 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:03.792 --rc genhtml_branch_coverage=1 00:04:03.792 --rc genhtml_function_coverage=1 00:04:03.792 --rc genhtml_legend=1 00:04:03.792 --rc geninfo_all_blocks=1 00:04:03.792 --rc geninfo_unexecuted_blocks=1 00:04:03.792 00:04:03.792 ' 00:04:03.792 02:09:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:03.792 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:03.792 --rc genhtml_branch_coverage=1 00:04:03.792 --rc genhtml_function_coverage=1 00:04:03.792 --rc genhtml_legend=1 00:04:03.792 --rc geninfo_all_blocks=1 00:04:03.792 --rc geninfo_unexecuted_blocks=1 00:04:03.792 00:04:03.792 ' 00:04:03.792 02:09:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:03.792 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:03.792 --rc genhtml_branch_coverage=1 00:04:03.792 --rc genhtml_function_coverage=1 00:04:03.792 --rc genhtml_legend=1 00:04:03.792 --rc geninfo_all_blocks=1 00:04:03.792 --rc geninfo_unexecuted_blocks=1 00:04:03.792 00:04:03.792 ' 00:04:03.792 02:09:07 -- rpc/rpc.sh@65 -- # spdk_pid=4185032 00:04:03.792 02:09:07 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:04:03.792 02:09:07 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:03.792 02:09:07 -- rpc/rpc.sh@67 -- # waitforlisten 4185032 00:04:03.792 02:09:07 -- common/autotest_common.sh@829 -- # '[' -z 4185032 ']' 00:04:03.792 02:09:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:03.792 02:09:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:03.792 02:09:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:03.792 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:03.792 02:09:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:03.792 02:09:07 -- common/autotest_common.sh@10 -- # set +x 00:04:03.792 [2024-11-29 02:09:07.305459] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:03.792 [2024-11-29 02:09:07.305551] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4185032 ] 00:04:03.792 EAL: No free 2048 kB hugepages reported on node 1 00:04:03.792 [2024-11-29 02:09:07.363346] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:04.051 [2024-11-29 02:09:07.473033] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:04.051 [2024-11-29 02:09:07.473187] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:04.051 [2024-11-29 02:09:07.473209] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 4185032' to capture a snapshot of events at runtime. 00:04:04.051 [2024-11-29 02:09:07.473222] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid4185032 for offline analysis/debug. 00:04:04.051 [2024-11-29 02:09:07.473256] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:04.616 02:09:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:04.616 02:09:08 -- common/autotest_common.sh@862 -- # return 0 00:04:04.616 02:09:08 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:04.616 02:09:08 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:04.616 02:09:08 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:04.616 02:09:08 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:04.616 02:09:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:04.616 02:09:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:04.616 02:09:08 -- common/autotest_common.sh@10 -- # set +x 00:04:04.616 ************************************ 00:04:04.616 START TEST rpc_integrity 00:04:04.616 ************************************ 00:04:04.616 02:09:08 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:04.616 02:09:08 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:04.616 02:09:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:04.616 02:09:08 -- common/autotest_common.sh@10 -- # set +x 00:04:04.616 02:09:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:04.616 02:09:08 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:04.616 02:09:08 -- rpc/rpc.sh@13 -- # jq length 00:04:04.875 02:09:08 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:04.875 02:09:08 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:04.875 02:09:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:04.875 02:09:08 -- common/autotest_common.sh@10 -- # set +x 00:04:04.875 02:09:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:04.875 02:09:08 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:04.875 02:09:08 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:04.875 02:09:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:04.875 02:09:08 -- common/autotest_common.sh@10 -- # set +x 00:04:04.875 02:09:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:04.875 02:09:08 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:04.875 { 00:04:04.875 "name": "Malloc0", 00:04:04.875 "aliases": [ 00:04:04.875 "b46555a1-1600-415b-9c63-dff841d24eb4" 00:04:04.875 ], 00:04:04.875 "product_name": "Malloc disk", 00:04:04.875 "block_size": 512, 00:04:04.875 "num_blocks": 16384, 00:04:04.875 "uuid": "b46555a1-1600-415b-9c63-dff841d24eb4", 00:04:04.875 "assigned_rate_limits": { 00:04:04.875 "rw_ios_per_sec": 0, 00:04:04.875 "rw_mbytes_per_sec": 0, 00:04:04.875 "r_mbytes_per_sec": 0, 00:04:04.875 "w_mbytes_per_sec": 0 00:04:04.875 }, 00:04:04.875 "claimed": false, 00:04:04.875 "zoned": false, 00:04:04.875 "supported_io_types": { 00:04:04.875 "read": true, 00:04:04.875 "write": true, 00:04:04.875 "unmap": true, 00:04:04.875 "write_zeroes": true, 00:04:04.875 "flush": true, 00:04:04.875 "reset": true, 00:04:04.875 "compare": false, 00:04:04.875 "compare_and_write": false, 00:04:04.875 "abort": true, 00:04:04.875 "nvme_admin": false, 00:04:04.875 "nvme_io": false 00:04:04.875 }, 00:04:04.875 "memory_domains": [ 00:04:04.875 { 00:04:04.875 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:04.875 "dma_device_type": 2 00:04:04.875 } 00:04:04.875 ], 00:04:04.875 "driver_specific": {} 00:04:04.875 } 00:04:04.875 ]' 00:04:04.875 02:09:08 -- rpc/rpc.sh@17 -- # jq length 00:04:04.875 02:09:08 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:04.875 02:09:08 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:04.875 02:09:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:04.875 02:09:08 -- common/autotest_common.sh@10 -- # set +x 00:04:04.875 [2024-11-29 02:09:08.393572] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:04.875 [2024-11-29 02:09:08.393617] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:04.875 [2024-11-29 02:09:08.393639] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xedbcb0 00:04:04.875 [2024-11-29 02:09:08.393652] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:04.875 [2024-11-29 02:09:08.394962] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:04.875 [2024-11-29 02:09:08.394991] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:04.875 Passthru0 00:04:04.875 02:09:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:04.875 02:09:08 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:04.875 02:09:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:04.875 02:09:08 -- common/autotest_common.sh@10 -- # set +x 00:04:04.875 02:09:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:04.875 02:09:08 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:04.875 { 00:04:04.875 "name": "Malloc0", 00:04:04.875 "aliases": [ 00:04:04.875 "b46555a1-1600-415b-9c63-dff841d24eb4" 00:04:04.875 ], 00:04:04.875 "product_name": "Malloc disk", 00:04:04.875 "block_size": 512, 00:04:04.875 "num_blocks": 16384, 00:04:04.875 "uuid": "b46555a1-1600-415b-9c63-dff841d24eb4", 00:04:04.875 "assigned_rate_limits": { 00:04:04.875 "rw_ios_per_sec": 0, 00:04:04.875 "rw_mbytes_per_sec": 0, 00:04:04.875 "r_mbytes_per_sec": 0, 00:04:04.875 "w_mbytes_per_sec": 0 00:04:04.875 }, 00:04:04.875 "claimed": true, 00:04:04.875 "claim_type": "exclusive_write", 00:04:04.875 "zoned": false, 00:04:04.875 "supported_io_types": { 00:04:04.875 "read": true, 00:04:04.875 "write": true, 00:04:04.875 "unmap": true, 00:04:04.875 "write_zeroes": true, 00:04:04.875 "flush": true, 00:04:04.875 "reset": true, 00:04:04.875 "compare": false, 00:04:04.875 "compare_and_write": false, 00:04:04.875 "abort": true, 00:04:04.875 "nvme_admin": false, 00:04:04.875 "nvme_io": false 00:04:04.875 }, 00:04:04.875 "memory_domains": [ 00:04:04.875 { 00:04:04.875 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:04.875 "dma_device_type": 2 00:04:04.875 } 00:04:04.875 ], 00:04:04.875 "driver_specific": {} 00:04:04.875 }, 00:04:04.875 { 00:04:04.875 "name": "Passthru0", 00:04:04.875 "aliases": [ 00:04:04.875 "33ed687f-d0fa-56b6-85bf-022d907e8678" 00:04:04.875 ], 00:04:04.875 "product_name": "passthru", 00:04:04.875 "block_size": 512, 00:04:04.875 "num_blocks": 16384, 00:04:04.875 "uuid": "33ed687f-d0fa-56b6-85bf-022d907e8678", 00:04:04.875 "assigned_rate_limits": { 00:04:04.875 "rw_ios_per_sec": 0, 00:04:04.875 "rw_mbytes_per_sec": 0, 00:04:04.875 "r_mbytes_per_sec": 0, 00:04:04.875 "w_mbytes_per_sec": 0 00:04:04.875 }, 00:04:04.875 "claimed": false, 00:04:04.875 "zoned": false, 00:04:04.875 "supported_io_types": { 00:04:04.875 "read": true, 00:04:04.875 "write": true, 00:04:04.875 "unmap": true, 00:04:04.875 "write_zeroes": true, 00:04:04.875 "flush": true, 00:04:04.875 "reset": true, 00:04:04.875 "compare": false, 00:04:04.875 "compare_and_write": false, 00:04:04.875 "abort": true, 00:04:04.875 "nvme_admin": false, 00:04:04.875 "nvme_io": false 00:04:04.875 }, 00:04:04.875 "memory_domains": [ 00:04:04.875 { 00:04:04.875 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:04.875 "dma_device_type": 2 00:04:04.875 } 00:04:04.875 ], 00:04:04.875 "driver_specific": { 00:04:04.875 "passthru": { 00:04:04.875 "name": "Passthru0", 00:04:04.875 "base_bdev_name": "Malloc0" 00:04:04.875 } 00:04:04.875 } 00:04:04.875 } 00:04:04.875 ]' 00:04:04.875 02:09:08 -- rpc/rpc.sh@21 -- # jq length 00:04:04.875 02:09:08 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:04.875 02:09:08 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:04.875 02:09:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:04.875 02:09:08 -- common/autotest_common.sh@10 -- # set +x 00:04:04.875 02:09:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:04.875 02:09:08 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:04.875 02:09:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:04.875 02:09:08 -- common/autotest_common.sh@10 -- # set +x 00:04:04.876 02:09:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:04.876 02:09:08 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:04.876 02:09:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:04.876 02:09:08 -- common/autotest_common.sh@10 -- # set +x 00:04:04.876 02:09:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:04.876 02:09:08 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:04.876 02:09:08 -- rpc/rpc.sh@26 -- # jq length 00:04:04.876 02:09:08 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:04.876 00:04:04.876 real 0m0.228s 00:04:04.876 user 0m0.148s 00:04:04.876 sys 0m0.019s 00:04:04.876 02:09:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:04.876 02:09:08 -- common/autotest_common.sh@10 -- # set +x 00:04:04.876 ************************************ 00:04:04.876 END TEST rpc_integrity 00:04:04.876 ************************************ 00:04:04.876 02:09:08 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:04.876 02:09:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:04.876 02:09:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:04.876 02:09:08 -- common/autotest_common.sh@10 -- # set +x 00:04:04.876 ************************************ 00:04:04.876 START TEST rpc_plugins 00:04:04.876 ************************************ 00:04:04.876 02:09:08 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:04:04.876 02:09:08 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:04.876 02:09:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:04.876 02:09:08 -- common/autotest_common.sh@10 -- # set +x 00:04:04.876 02:09:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:04.876 02:09:08 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:04.876 02:09:08 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:04.876 02:09:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:04.876 02:09:08 -- common/autotest_common.sh@10 -- # set +x 00:04:05.134 02:09:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:05.134 02:09:08 -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:05.134 { 00:04:05.134 "name": "Malloc1", 00:04:05.134 "aliases": [ 00:04:05.134 "088452e1-0f04-40bf-82e3-8d16f306463d" 00:04:05.134 ], 00:04:05.134 "product_name": "Malloc disk", 00:04:05.134 "block_size": 4096, 00:04:05.134 "num_blocks": 256, 00:04:05.134 "uuid": "088452e1-0f04-40bf-82e3-8d16f306463d", 00:04:05.134 "assigned_rate_limits": { 00:04:05.134 "rw_ios_per_sec": 0, 00:04:05.134 "rw_mbytes_per_sec": 0, 00:04:05.134 "r_mbytes_per_sec": 0, 00:04:05.134 "w_mbytes_per_sec": 0 00:04:05.134 }, 00:04:05.134 "claimed": false, 00:04:05.134 "zoned": false, 00:04:05.134 "supported_io_types": { 00:04:05.134 "read": true, 00:04:05.134 "write": true, 00:04:05.134 "unmap": true, 00:04:05.134 "write_zeroes": true, 00:04:05.134 "flush": true, 00:04:05.134 "reset": true, 00:04:05.134 "compare": false, 00:04:05.134 "compare_and_write": false, 00:04:05.134 "abort": true, 00:04:05.134 "nvme_admin": false, 00:04:05.134 "nvme_io": false 00:04:05.134 }, 00:04:05.134 "memory_domains": [ 00:04:05.134 { 00:04:05.134 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:05.134 "dma_device_type": 2 00:04:05.134 } 00:04:05.134 ], 00:04:05.134 "driver_specific": {} 00:04:05.134 } 00:04:05.134 ]' 00:04:05.134 02:09:08 -- rpc/rpc.sh@32 -- # jq length 00:04:05.134 02:09:08 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:05.134 02:09:08 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:05.134 02:09:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:05.134 02:09:08 -- common/autotest_common.sh@10 -- # set +x 00:04:05.134 02:09:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:05.134 02:09:08 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:05.134 02:09:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:05.134 02:09:08 -- common/autotest_common.sh@10 -- # set +x 00:04:05.134 02:09:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:05.134 02:09:08 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:05.134 02:09:08 -- rpc/rpc.sh@36 -- # jq length 00:04:05.134 02:09:08 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:05.134 00:04:05.134 real 0m0.115s 00:04:05.134 user 0m0.079s 00:04:05.134 sys 0m0.008s 00:04:05.134 02:09:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:05.134 02:09:08 -- common/autotest_common.sh@10 -- # set +x 00:04:05.134 ************************************ 00:04:05.134 END TEST rpc_plugins 00:04:05.134 ************************************ 00:04:05.134 02:09:08 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:05.134 02:09:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:05.134 02:09:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:05.134 02:09:08 -- common/autotest_common.sh@10 -- # set +x 00:04:05.134 ************************************ 00:04:05.134 START TEST rpc_trace_cmd_test 00:04:05.134 ************************************ 00:04:05.134 02:09:08 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:04:05.134 02:09:08 -- rpc/rpc.sh@40 -- # local info 00:04:05.134 02:09:08 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:05.134 02:09:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:05.134 02:09:08 -- common/autotest_common.sh@10 -- # set +x 00:04:05.134 02:09:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:05.134 02:09:08 -- rpc/rpc.sh@42 -- # info='{ 00:04:05.134 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid4185032", 00:04:05.134 "tpoint_group_mask": "0x8", 00:04:05.134 "iscsi_conn": { 00:04:05.134 "mask": "0x2", 00:04:05.134 "tpoint_mask": "0x0" 00:04:05.134 }, 00:04:05.134 "scsi": { 00:04:05.134 "mask": "0x4", 00:04:05.134 "tpoint_mask": "0x0" 00:04:05.134 }, 00:04:05.134 "bdev": { 00:04:05.134 "mask": "0x8", 00:04:05.134 "tpoint_mask": "0xffffffffffffffff" 00:04:05.134 }, 00:04:05.134 "nvmf_rdma": { 00:04:05.134 "mask": "0x10", 00:04:05.134 "tpoint_mask": "0x0" 00:04:05.134 }, 00:04:05.134 "nvmf_tcp": { 00:04:05.134 "mask": "0x20", 00:04:05.134 "tpoint_mask": "0x0" 00:04:05.134 }, 00:04:05.134 "ftl": { 00:04:05.134 "mask": "0x40", 00:04:05.134 "tpoint_mask": "0x0" 00:04:05.134 }, 00:04:05.134 "blobfs": { 00:04:05.134 "mask": "0x80", 00:04:05.134 "tpoint_mask": "0x0" 00:04:05.134 }, 00:04:05.134 "dsa": { 00:04:05.134 "mask": "0x200", 00:04:05.134 "tpoint_mask": "0x0" 00:04:05.134 }, 00:04:05.134 "thread": { 00:04:05.134 "mask": "0x400", 00:04:05.134 "tpoint_mask": "0x0" 00:04:05.134 }, 00:04:05.134 "nvme_pcie": { 00:04:05.134 "mask": "0x800", 00:04:05.134 "tpoint_mask": "0x0" 00:04:05.134 }, 00:04:05.134 "iaa": { 00:04:05.134 "mask": "0x1000", 00:04:05.134 "tpoint_mask": "0x0" 00:04:05.134 }, 00:04:05.134 "nvme_tcp": { 00:04:05.134 "mask": "0x2000", 00:04:05.134 "tpoint_mask": "0x0" 00:04:05.134 }, 00:04:05.134 "bdev_nvme": { 00:04:05.134 "mask": "0x4000", 00:04:05.134 "tpoint_mask": "0x0" 00:04:05.134 } 00:04:05.134 }' 00:04:05.134 02:09:08 -- rpc/rpc.sh@43 -- # jq length 00:04:05.134 02:09:08 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:04:05.134 02:09:08 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:05.134 02:09:08 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:05.134 02:09:08 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:05.134 02:09:08 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:05.134 02:09:08 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:05.393 02:09:08 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:05.393 02:09:08 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:05.393 02:09:08 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:05.393 00:04:05.393 real 0m0.196s 00:04:05.393 user 0m0.178s 00:04:05.393 sys 0m0.012s 00:04:05.393 02:09:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:05.393 02:09:08 -- common/autotest_common.sh@10 -- # set +x 00:04:05.393 ************************************ 00:04:05.393 END TEST rpc_trace_cmd_test 00:04:05.393 ************************************ 00:04:05.393 02:09:08 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:04:05.393 02:09:08 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:05.393 02:09:08 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:05.393 02:09:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:05.393 02:09:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:05.393 02:09:08 -- common/autotest_common.sh@10 -- # set +x 00:04:05.393 ************************************ 00:04:05.393 START TEST rpc_daemon_integrity 00:04:05.393 ************************************ 00:04:05.393 02:09:08 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:05.393 02:09:08 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:05.393 02:09:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:05.393 02:09:08 -- common/autotest_common.sh@10 -- # set +x 00:04:05.393 02:09:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:05.393 02:09:08 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:05.393 02:09:08 -- rpc/rpc.sh@13 -- # jq length 00:04:05.393 02:09:08 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:05.393 02:09:08 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:05.393 02:09:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:05.393 02:09:08 -- common/autotest_common.sh@10 -- # set +x 00:04:05.393 02:09:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:05.393 02:09:08 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:04:05.393 02:09:08 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:05.393 02:09:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:05.393 02:09:08 -- common/autotest_common.sh@10 -- # set +x 00:04:05.393 02:09:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:05.393 02:09:08 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:05.393 { 00:04:05.393 "name": "Malloc2", 00:04:05.393 "aliases": [ 00:04:05.393 "8209d3ad-62f9-4b0d-a244-95999196430c" 00:04:05.393 ], 00:04:05.393 "product_name": "Malloc disk", 00:04:05.394 "block_size": 512, 00:04:05.394 "num_blocks": 16384, 00:04:05.394 "uuid": "8209d3ad-62f9-4b0d-a244-95999196430c", 00:04:05.394 "assigned_rate_limits": { 00:04:05.394 "rw_ios_per_sec": 0, 00:04:05.394 "rw_mbytes_per_sec": 0, 00:04:05.394 "r_mbytes_per_sec": 0, 00:04:05.394 "w_mbytes_per_sec": 0 00:04:05.394 }, 00:04:05.394 "claimed": false, 00:04:05.394 "zoned": false, 00:04:05.394 "supported_io_types": { 00:04:05.394 "read": true, 00:04:05.394 "write": true, 00:04:05.394 "unmap": true, 00:04:05.394 "write_zeroes": true, 00:04:05.394 "flush": true, 00:04:05.394 "reset": true, 00:04:05.394 "compare": false, 00:04:05.394 "compare_and_write": false, 00:04:05.394 "abort": true, 00:04:05.394 "nvme_admin": false, 00:04:05.394 "nvme_io": false 00:04:05.394 }, 00:04:05.394 "memory_domains": [ 00:04:05.394 { 00:04:05.394 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:05.394 "dma_device_type": 2 00:04:05.394 } 00:04:05.394 ], 00:04:05.394 "driver_specific": {} 00:04:05.394 } 00:04:05.394 ]' 00:04:05.394 02:09:08 -- rpc/rpc.sh@17 -- # jq length 00:04:05.394 02:09:08 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:05.394 02:09:08 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:04:05.394 02:09:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:05.394 02:09:08 -- common/autotest_common.sh@10 -- # set +x 00:04:05.394 [2024-11-29 02:09:08.999286] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:04:05.394 [2024-11-29 02:09:08.999333] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:05.394 [2024-11-29 02:09:08.999356] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xedd590 00:04:05.394 [2024-11-29 02:09:08.999371] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:05.394 [2024-11-29 02:09:09.000734] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:05.394 [2024-11-29 02:09:09.000763] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:05.394 Passthru0 00:04:05.394 02:09:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:05.394 02:09:09 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:05.394 02:09:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:05.394 02:09:09 -- common/autotest_common.sh@10 -- # set +x 00:04:05.394 02:09:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:05.394 02:09:09 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:05.394 { 00:04:05.394 "name": "Malloc2", 00:04:05.394 "aliases": [ 00:04:05.394 "8209d3ad-62f9-4b0d-a244-95999196430c" 00:04:05.394 ], 00:04:05.394 "product_name": "Malloc disk", 00:04:05.394 "block_size": 512, 00:04:05.394 "num_blocks": 16384, 00:04:05.394 "uuid": "8209d3ad-62f9-4b0d-a244-95999196430c", 00:04:05.394 "assigned_rate_limits": { 00:04:05.394 "rw_ios_per_sec": 0, 00:04:05.394 "rw_mbytes_per_sec": 0, 00:04:05.394 "r_mbytes_per_sec": 0, 00:04:05.394 "w_mbytes_per_sec": 0 00:04:05.394 }, 00:04:05.394 "claimed": true, 00:04:05.394 "claim_type": "exclusive_write", 00:04:05.394 "zoned": false, 00:04:05.394 "supported_io_types": { 00:04:05.394 "read": true, 00:04:05.394 "write": true, 00:04:05.394 "unmap": true, 00:04:05.394 "write_zeroes": true, 00:04:05.394 "flush": true, 00:04:05.394 "reset": true, 00:04:05.394 "compare": false, 00:04:05.394 "compare_and_write": false, 00:04:05.394 "abort": true, 00:04:05.394 "nvme_admin": false, 00:04:05.394 "nvme_io": false 00:04:05.394 }, 00:04:05.394 "memory_domains": [ 00:04:05.394 { 00:04:05.394 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:05.394 "dma_device_type": 2 00:04:05.394 } 00:04:05.394 ], 00:04:05.394 "driver_specific": {} 00:04:05.394 }, 00:04:05.394 { 00:04:05.394 "name": "Passthru0", 00:04:05.394 "aliases": [ 00:04:05.394 "388d2a18-cb32-598d-84d5-02818793dcfe" 00:04:05.394 ], 00:04:05.394 "product_name": "passthru", 00:04:05.394 "block_size": 512, 00:04:05.394 "num_blocks": 16384, 00:04:05.394 "uuid": "388d2a18-cb32-598d-84d5-02818793dcfe", 00:04:05.394 "assigned_rate_limits": { 00:04:05.394 "rw_ios_per_sec": 0, 00:04:05.394 "rw_mbytes_per_sec": 0, 00:04:05.394 "r_mbytes_per_sec": 0, 00:04:05.394 "w_mbytes_per_sec": 0 00:04:05.394 }, 00:04:05.394 "claimed": false, 00:04:05.394 "zoned": false, 00:04:05.394 "supported_io_types": { 00:04:05.394 "read": true, 00:04:05.394 "write": true, 00:04:05.394 "unmap": true, 00:04:05.394 "write_zeroes": true, 00:04:05.394 "flush": true, 00:04:05.394 "reset": true, 00:04:05.394 "compare": false, 00:04:05.394 "compare_and_write": false, 00:04:05.394 "abort": true, 00:04:05.394 "nvme_admin": false, 00:04:05.394 "nvme_io": false 00:04:05.394 }, 00:04:05.394 "memory_domains": [ 00:04:05.394 { 00:04:05.394 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:05.394 "dma_device_type": 2 00:04:05.394 } 00:04:05.394 ], 00:04:05.394 "driver_specific": { 00:04:05.394 "passthru": { 00:04:05.394 "name": "Passthru0", 00:04:05.394 "base_bdev_name": "Malloc2" 00:04:05.394 } 00:04:05.394 } 00:04:05.394 } 00:04:05.394 ]' 00:04:05.394 02:09:09 -- rpc/rpc.sh@21 -- # jq length 00:04:05.394 02:09:09 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:05.394 02:09:09 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:05.394 02:09:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:05.394 02:09:09 -- common/autotest_common.sh@10 -- # set +x 00:04:05.394 02:09:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:05.394 02:09:09 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:05.394 02:09:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:05.394 02:09:09 -- common/autotest_common.sh@10 -- # set +x 00:04:05.394 02:09:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:05.394 02:09:09 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:05.394 02:09:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:05.394 02:09:09 -- common/autotest_common.sh@10 -- # set +x 00:04:05.653 02:09:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:05.653 02:09:09 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:05.653 02:09:09 -- rpc/rpc.sh@26 -- # jq length 00:04:05.653 02:09:09 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:05.653 00:04:05.653 real 0m0.219s 00:04:05.653 user 0m0.141s 00:04:05.653 sys 0m0.024s 00:04:05.653 02:09:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:05.653 02:09:09 -- common/autotest_common.sh@10 -- # set +x 00:04:05.653 ************************************ 00:04:05.653 END TEST rpc_daemon_integrity 00:04:05.653 ************************************ 00:04:05.653 02:09:09 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:05.653 02:09:09 -- rpc/rpc.sh@84 -- # killprocess 4185032 00:04:05.653 02:09:09 -- common/autotest_common.sh@936 -- # '[' -z 4185032 ']' 00:04:05.653 02:09:09 -- common/autotest_common.sh@940 -- # kill -0 4185032 00:04:05.653 02:09:09 -- common/autotest_common.sh@941 -- # uname 00:04:05.653 02:09:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:05.653 02:09:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4185032 00:04:05.653 02:09:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:05.653 02:09:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:05.653 02:09:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4185032' 00:04:05.653 killing process with pid 4185032 00:04:05.653 02:09:09 -- common/autotest_common.sh@955 -- # kill 4185032 00:04:05.653 02:09:09 -- common/autotest_common.sh@960 -- # wait 4185032 00:04:06.220 00:04:06.220 real 0m2.479s 00:04:06.220 user 0m3.146s 00:04:06.220 sys 0m0.581s 00:04:06.220 02:09:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:06.220 02:09:09 -- common/autotest_common.sh@10 -- # set +x 00:04:06.220 ************************************ 00:04:06.220 END TEST rpc 00:04:06.220 ************************************ 00:04:06.220 02:09:09 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:06.220 02:09:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:06.220 02:09:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:06.220 02:09:09 -- common/autotest_common.sh@10 -- # set +x 00:04:06.220 ************************************ 00:04:06.220 START TEST rpc_client 00:04:06.220 ************************************ 00:04:06.220 02:09:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:06.220 * Looking for test storage... 00:04:06.220 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:04:06.220 02:09:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:06.220 02:09:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:06.220 02:09:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:06.220 02:09:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:06.220 02:09:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:06.220 02:09:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:06.220 02:09:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:06.220 02:09:09 -- scripts/common.sh@335 -- # IFS=.-: 00:04:06.220 02:09:09 -- scripts/common.sh@335 -- # read -ra ver1 00:04:06.220 02:09:09 -- scripts/common.sh@336 -- # IFS=.-: 00:04:06.220 02:09:09 -- scripts/common.sh@336 -- # read -ra ver2 00:04:06.220 02:09:09 -- scripts/common.sh@337 -- # local 'op=<' 00:04:06.220 02:09:09 -- scripts/common.sh@339 -- # ver1_l=2 00:04:06.220 02:09:09 -- scripts/common.sh@340 -- # ver2_l=1 00:04:06.220 02:09:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:06.220 02:09:09 -- scripts/common.sh@343 -- # case "$op" in 00:04:06.220 02:09:09 -- scripts/common.sh@344 -- # : 1 00:04:06.220 02:09:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:06.220 02:09:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:06.220 02:09:09 -- scripts/common.sh@364 -- # decimal 1 00:04:06.220 02:09:09 -- scripts/common.sh@352 -- # local d=1 00:04:06.220 02:09:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:06.220 02:09:09 -- scripts/common.sh@354 -- # echo 1 00:04:06.220 02:09:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:06.220 02:09:09 -- scripts/common.sh@365 -- # decimal 2 00:04:06.220 02:09:09 -- scripts/common.sh@352 -- # local d=2 00:04:06.220 02:09:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:06.220 02:09:09 -- scripts/common.sh@354 -- # echo 2 00:04:06.220 02:09:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:06.220 02:09:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:06.220 02:09:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:06.220 02:09:09 -- scripts/common.sh@367 -- # return 0 00:04:06.220 02:09:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:06.220 02:09:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:06.220 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:06.220 --rc genhtml_branch_coverage=1 00:04:06.220 --rc genhtml_function_coverage=1 00:04:06.220 --rc genhtml_legend=1 00:04:06.220 --rc geninfo_all_blocks=1 00:04:06.220 --rc geninfo_unexecuted_blocks=1 00:04:06.220 00:04:06.220 ' 00:04:06.220 02:09:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:06.220 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:06.220 --rc genhtml_branch_coverage=1 00:04:06.220 --rc genhtml_function_coverage=1 00:04:06.220 --rc genhtml_legend=1 00:04:06.220 --rc geninfo_all_blocks=1 00:04:06.220 --rc geninfo_unexecuted_blocks=1 00:04:06.220 00:04:06.220 ' 00:04:06.220 02:09:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:06.220 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:06.220 --rc genhtml_branch_coverage=1 00:04:06.220 --rc genhtml_function_coverage=1 00:04:06.220 --rc genhtml_legend=1 00:04:06.220 --rc geninfo_all_blocks=1 00:04:06.220 --rc geninfo_unexecuted_blocks=1 00:04:06.220 00:04:06.220 ' 00:04:06.220 02:09:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:06.220 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:06.220 --rc genhtml_branch_coverage=1 00:04:06.220 --rc genhtml_function_coverage=1 00:04:06.220 --rc genhtml_legend=1 00:04:06.220 --rc geninfo_all_blocks=1 00:04:06.220 --rc geninfo_unexecuted_blocks=1 00:04:06.220 00:04:06.220 ' 00:04:06.220 02:09:09 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:04:06.220 OK 00:04:06.220 02:09:09 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:04:06.220 00:04:06.220 real 0m0.153s 00:04:06.220 user 0m0.103s 00:04:06.220 sys 0m0.058s 00:04:06.220 02:09:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:06.220 02:09:09 -- common/autotest_common.sh@10 -- # set +x 00:04:06.220 ************************************ 00:04:06.220 END TEST rpc_client 00:04:06.220 ************************************ 00:04:06.220 02:09:09 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:06.220 02:09:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:06.220 02:09:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:06.220 02:09:09 -- common/autotest_common.sh@10 -- # set +x 00:04:06.220 ************************************ 00:04:06.220 START TEST json_config 00:04:06.220 ************************************ 00:04:06.220 02:09:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:06.220 02:09:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:06.220 02:09:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:06.220 02:09:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:06.480 02:09:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:06.480 02:09:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:06.480 02:09:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:06.480 02:09:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:06.480 02:09:09 -- scripts/common.sh@335 -- # IFS=.-: 00:04:06.480 02:09:09 -- scripts/common.sh@335 -- # read -ra ver1 00:04:06.480 02:09:09 -- scripts/common.sh@336 -- # IFS=.-: 00:04:06.480 02:09:09 -- scripts/common.sh@336 -- # read -ra ver2 00:04:06.480 02:09:09 -- scripts/common.sh@337 -- # local 'op=<' 00:04:06.480 02:09:09 -- scripts/common.sh@339 -- # ver1_l=2 00:04:06.480 02:09:09 -- scripts/common.sh@340 -- # ver2_l=1 00:04:06.480 02:09:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:06.480 02:09:09 -- scripts/common.sh@343 -- # case "$op" in 00:04:06.480 02:09:09 -- scripts/common.sh@344 -- # : 1 00:04:06.480 02:09:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:06.480 02:09:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:06.480 02:09:09 -- scripts/common.sh@364 -- # decimal 1 00:04:06.480 02:09:09 -- scripts/common.sh@352 -- # local d=1 00:04:06.480 02:09:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:06.480 02:09:09 -- scripts/common.sh@354 -- # echo 1 00:04:06.480 02:09:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:06.480 02:09:09 -- scripts/common.sh@365 -- # decimal 2 00:04:06.480 02:09:09 -- scripts/common.sh@352 -- # local d=2 00:04:06.480 02:09:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:06.480 02:09:09 -- scripts/common.sh@354 -- # echo 2 00:04:06.480 02:09:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:06.480 02:09:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:06.480 02:09:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:06.480 02:09:09 -- scripts/common.sh@367 -- # return 0 00:04:06.480 02:09:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:06.480 02:09:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:06.480 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:06.480 --rc genhtml_branch_coverage=1 00:04:06.480 --rc genhtml_function_coverage=1 00:04:06.480 --rc genhtml_legend=1 00:04:06.480 --rc geninfo_all_blocks=1 00:04:06.480 --rc geninfo_unexecuted_blocks=1 00:04:06.480 00:04:06.480 ' 00:04:06.480 02:09:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:06.480 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:06.480 --rc genhtml_branch_coverage=1 00:04:06.480 --rc genhtml_function_coverage=1 00:04:06.480 --rc genhtml_legend=1 00:04:06.480 --rc geninfo_all_blocks=1 00:04:06.480 --rc geninfo_unexecuted_blocks=1 00:04:06.480 00:04:06.480 ' 00:04:06.480 02:09:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:06.480 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:06.480 --rc genhtml_branch_coverage=1 00:04:06.480 --rc genhtml_function_coverage=1 00:04:06.480 --rc genhtml_legend=1 00:04:06.480 --rc geninfo_all_blocks=1 00:04:06.480 --rc geninfo_unexecuted_blocks=1 00:04:06.480 00:04:06.480 ' 00:04:06.480 02:09:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:06.480 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:06.480 --rc genhtml_branch_coverage=1 00:04:06.480 --rc genhtml_function_coverage=1 00:04:06.480 --rc genhtml_legend=1 00:04:06.480 --rc geninfo_all_blocks=1 00:04:06.480 --rc geninfo_unexecuted_blocks=1 00:04:06.480 00:04:06.480 ' 00:04:06.480 02:09:09 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:06.481 02:09:09 -- nvmf/common.sh@7 -- # uname -s 00:04:06.481 02:09:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:06.481 02:09:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:06.481 02:09:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:06.481 02:09:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:06.481 02:09:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:06.481 02:09:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:06.481 02:09:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:06.481 02:09:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:06.481 02:09:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:06.481 02:09:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:06.481 02:09:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:06.481 02:09:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:06.481 02:09:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:06.481 02:09:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:06.481 02:09:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:06.481 02:09:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:06.481 02:09:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:06.481 02:09:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:06.481 02:09:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:06.481 02:09:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:06.481 02:09:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:06.481 02:09:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:06.481 02:09:09 -- paths/export.sh@5 -- # export PATH 00:04:06.481 02:09:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:06.481 02:09:09 -- nvmf/common.sh@46 -- # : 0 00:04:06.481 02:09:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:06.481 02:09:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:06.481 02:09:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:06.481 02:09:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:06.481 02:09:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:06.481 02:09:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:06.481 02:09:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:06.481 02:09:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:06.481 02:09:09 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:04:06.481 02:09:09 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:04:06.481 02:09:09 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:04:06.481 02:09:09 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:04:06.481 02:09:09 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:04:06.481 02:09:09 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:04:06.481 02:09:09 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:04:06.481 02:09:09 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:04:06.481 02:09:09 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:04:06.481 02:09:09 -- json_config/json_config.sh@32 -- # declare -A app_params 00:04:06.481 02:09:09 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:04:06.481 02:09:09 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:04:06.481 02:09:09 -- json_config/json_config.sh@43 -- # last_event_id=0 00:04:06.481 02:09:09 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:06.481 02:09:09 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:04:06.481 INFO: JSON configuration test init 00:04:06.481 02:09:09 -- json_config/json_config.sh@420 -- # json_config_test_init 00:04:06.481 02:09:09 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:04:06.481 02:09:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:06.481 02:09:09 -- common/autotest_common.sh@10 -- # set +x 00:04:06.481 02:09:09 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:04:06.481 02:09:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:06.481 02:09:09 -- common/autotest_common.sh@10 -- # set +x 00:04:06.481 02:09:09 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:04:06.481 02:09:09 -- json_config/json_config.sh@98 -- # local app=target 00:04:06.481 02:09:09 -- json_config/json_config.sh@99 -- # shift 00:04:06.481 02:09:09 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:06.481 02:09:09 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:06.481 02:09:09 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:06.481 02:09:09 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:06.481 02:09:09 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:06.481 02:09:09 -- json_config/json_config.sh@111 -- # app_pid[$app]=4185901 00:04:06.481 02:09:09 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:04:06.481 02:09:09 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:06.481 Waiting for target to run... 00:04:06.481 02:09:09 -- json_config/json_config.sh@114 -- # waitforlisten 4185901 /var/tmp/spdk_tgt.sock 00:04:06.481 02:09:09 -- common/autotest_common.sh@829 -- # '[' -z 4185901 ']' 00:04:06.481 02:09:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:06.481 02:09:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:06.481 02:09:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:06.481 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:06.481 02:09:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:06.481 02:09:09 -- common/autotest_common.sh@10 -- # set +x 00:04:06.481 [2024-11-29 02:09:10.017761] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:06.481 [2024-11-29 02:09:10.017863] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4185901 ] 00:04:06.481 EAL: No free 2048 kB hugepages reported on node 1 00:04:06.740 [2024-11-29 02:09:10.379065] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:06.998 [2024-11-29 02:09:10.466507] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:06.998 [2024-11-29 02:09:10.466714] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:07.565 02:09:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:07.565 02:09:10 -- common/autotest_common.sh@862 -- # return 0 00:04:07.565 02:09:10 -- json_config/json_config.sh@115 -- # echo '' 00:04:07.565 00:04:07.565 02:09:10 -- json_config/json_config.sh@322 -- # create_accel_config 00:04:07.565 02:09:10 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:04:07.565 02:09:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:07.565 02:09:10 -- common/autotest_common.sh@10 -- # set +x 00:04:07.565 02:09:10 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:04:07.565 02:09:10 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:04:07.565 02:09:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:07.565 02:09:10 -- common/autotest_common.sh@10 -- # set +x 00:04:07.565 02:09:11 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:04:07.565 02:09:11 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:04:07.565 02:09:11 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:04:10.852 02:09:14 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:04:10.852 02:09:14 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:04:10.852 02:09:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:10.852 02:09:14 -- common/autotest_common.sh@10 -- # set +x 00:04:10.852 02:09:14 -- json_config/json_config.sh@48 -- # local ret=0 00:04:10.852 02:09:14 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:04:10.852 02:09:14 -- json_config/json_config.sh@49 -- # local enabled_types 00:04:10.852 02:09:14 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:04:10.852 02:09:14 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:04:10.852 02:09:14 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:04:10.852 02:09:14 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:04:10.852 02:09:14 -- json_config/json_config.sh@51 -- # local get_types 00:04:10.852 02:09:14 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:04:10.852 02:09:14 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:04:10.852 02:09:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:10.852 02:09:14 -- common/autotest_common.sh@10 -- # set +x 00:04:10.852 02:09:14 -- json_config/json_config.sh@58 -- # return 0 00:04:10.852 02:09:14 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:04:10.852 02:09:14 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:04:10.852 02:09:14 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:04:10.852 02:09:14 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:04:10.852 02:09:14 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:04:10.852 02:09:14 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:04:10.852 02:09:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:10.852 02:09:14 -- common/autotest_common.sh@10 -- # set +x 00:04:10.852 02:09:14 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:04:10.852 02:09:14 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:04:10.852 02:09:14 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:04:10.852 02:09:14 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:10.852 02:09:14 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:11.110 MallocForNvmf0 00:04:11.110 02:09:14 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:11.110 02:09:14 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:11.369 MallocForNvmf1 00:04:11.369 02:09:14 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:04:11.369 02:09:14 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:04:11.627 [2024-11-29 02:09:15.190131] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:11.627 02:09:15 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:11.627 02:09:15 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:11.885 02:09:15 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:11.885 02:09:15 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:12.143 02:09:15 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:12.143 02:09:15 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:12.401 02:09:15 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:12.401 02:09:15 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:12.659 [2024-11-29 02:09:16.193523] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:12.659 02:09:16 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:04:12.659 02:09:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:12.659 02:09:16 -- common/autotest_common.sh@10 -- # set +x 00:04:12.659 02:09:16 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:04:12.659 02:09:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:12.659 02:09:16 -- common/autotest_common.sh@10 -- # set +x 00:04:12.659 02:09:16 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:04:12.659 02:09:16 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:12.659 02:09:16 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:12.918 MallocBdevForConfigChangeCheck 00:04:12.918 02:09:16 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:04:12.918 02:09:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:12.918 02:09:16 -- common/autotest_common.sh@10 -- # set +x 00:04:12.918 02:09:16 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:04:12.918 02:09:16 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:13.484 02:09:16 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:04:13.484 INFO: shutting down applications... 00:04:13.484 02:09:16 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:04:13.484 02:09:16 -- json_config/json_config.sh@431 -- # json_config_clear target 00:04:13.484 02:09:16 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:04:13.484 02:09:16 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:04:14.859 Calling clear_iscsi_subsystem 00:04:14.859 Calling clear_nvmf_subsystem 00:04:14.859 Calling clear_nbd_subsystem 00:04:14.859 Calling clear_ublk_subsystem 00:04:14.859 Calling clear_vhost_blk_subsystem 00:04:14.859 Calling clear_vhost_scsi_subsystem 00:04:14.859 Calling clear_scheduler_subsystem 00:04:14.859 Calling clear_bdev_subsystem 00:04:14.859 Calling clear_accel_subsystem 00:04:14.859 Calling clear_vmd_subsystem 00:04:14.859 Calling clear_sock_subsystem 00:04:14.859 Calling clear_iobuf_subsystem 00:04:15.118 02:09:18 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:04:15.118 02:09:18 -- json_config/json_config.sh@396 -- # count=100 00:04:15.118 02:09:18 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:04:15.118 02:09:18 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:15.118 02:09:18 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:04:15.118 02:09:18 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:04:15.376 02:09:18 -- json_config/json_config.sh@398 -- # break 00:04:15.376 02:09:18 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:04:15.376 02:09:18 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:04:15.376 02:09:18 -- json_config/json_config.sh@120 -- # local app=target 00:04:15.376 02:09:18 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:04:15.376 02:09:18 -- json_config/json_config.sh@124 -- # [[ -n 4185901 ]] 00:04:15.376 02:09:18 -- json_config/json_config.sh@127 -- # kill -SIGINT 4185901 00:04:15.376 02:09:18 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:04:15.376 02:09:18 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:15.376 02:09:18 -- json_config/json_config.sh@130 -- # kill -0 4185901 00:04:15.376 02:09:18 -- json_config/json_config.sh@134 -- # sleep 0.5 00:04:15.944 02:09:19 -- json_config/json_config.sh@129 -- # (( i++ )) 00:04:15.944 02:09:19 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:15.944 02:09:19 -- json_config/json_config.sh@130 -- # kill -0 4185901 00:04:15.944 02:09:19 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:04:15.944 02:09:19 -- json_config/json_config.sh@132 -- # break 00:04:15.944 02:09:19 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:04:15.944 02:09:19 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:04:15.944 SPDK target shutdown done 00:04:15.944 02:09:19 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:04:15.944 INFO: relaunching applications... 00:04:15.944 02:09:19 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:15.944 02:09:19 -- json_config/json_config.sh@98 -- # local app=target 00:04:15.944 02:09:19 -- json_config/json_config.sh@99 -- # shift 00:04:15.944 02:09:19 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:15.944 02:09:19 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:15.944 02:09:19 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:15.944 02:09:19 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:15.944 02:09:19 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:15.944 02:09:19 -- json_config/json_config.sh@111 -- # app_pid[$app]=4187244 00:04:15.944 02:09:19 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:15.944 02:09:19 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:15.944 Waiting for target to run... 00:04:15.944 02:09:19 -- json_config/json_config.sh@114 -- # waitforlisten 4187244 /var/tmp/spdk_tgt.sock 00:04:15.944 02:09:19 -- common/autotest_common.sh@829 -- # '[' -z 4187244 ']' 00:04:15.944 02:09:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:15.944 02:09:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:15.944 02:09:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:15.944 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:15.944 02:09:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:15.944 02:09:19 -- common/autotest_common.sh@10 -- # set +x 00:04:15.944 [2024-11-29 02:09:19.474781] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:15.944 [2024-11-29 02:09:19.474870] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4187244 ] 00:04:15.944 EAL: No free 2048 kB hugepages reported on node 1 00:04:16.508 [2024-11-29 02:09:20.008845] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:16.508 [2024-11-29 02:09:20.114574] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:16.508 [2024-11-29 02:09:20.114785] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:19.785 [2024-11-29 02:09:23.151474] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:19.785 [2024-11-29 02:09:23.183934] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:19.785 02:09:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:19.785 02:09:23 -- common/autotest_common.sh@862 -- # return 0 00:04:19.785 02:09:23 -- json_config/json_config.sh@115 -- # echo '' 00:04:19.785 00:04:19.785 02:09:23 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:04:19.785 02:09:23 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:04:19.785 INFO: Checking if target configuration is the same... 00:04:19.785 02:09:23 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:19.785 02:09:23 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:04:19.785 02:09:23 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:19.785 + '[' 2 -ne 2 ']' 00:04:19.785 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:19.785 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:19.785 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:19.785 +++ basename /dev/fd/62 00:04:19.785 ++ mktemp /tmp/62.XXX 00:04:19.785 + tmp_file_1=/tmp/62.5AN 00:04:19.785 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:19.786 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:19.786 + tmp_file_2=/tmp/spdk_tgt_config.json.en3 00:04:19.786 + ret=0 00:04:19.786 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:20.352 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:20.352 + diff -u /tmp/62.5AN /tmp/spdk_tgt_config.json.en3 00:04:20.352 + echo 'INFO: JSON config files are the same' 00:04:20.352 INFO: JSON config files are the same 00:04:20.352 + rm /tmp/62.5AN /tmp/spdk_tgt_config.json.en3 00:04:20.352 + exit 0 00:04:20.352 02:09:23 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:04:20.352 02:09:23 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:04:20.352 INFO: changing configuration and checking if this can be detected... 00:04:20.352 02:09:23 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:20.352 02:09:23 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:20.610 02:09:24 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:20.610 02:09:24 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:04:20.610 02:09:24 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:20.610 + '[' 2 -ne 2 ']' 00:04:20.610 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:20.610 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:20.610 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:20.610 +++ basename /dev/fd/62 00:04:20.610 ++ mktemp /tmp/62.XXX 00:04:20.610 + tmp_file_1=/tmp/62.IWk 00:04:20.610 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:20.610 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:20.610 + tmp_file_2=/tmp/spdk_tgt_config.json.ooD 00:04:20.610 + ret=0 00:04:20.610 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:20.868 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:20.868 + diff -u /tmp/62.IWk /tmp/spdk_tgt_config.json.ooD 00:04:20.868 + ret=1 00:04:20.868 + echo '=== Start of file: /tmp/62.IWk ===' 00:04:20.868 + cat /tmp/62.IWk 00:04:20.868 + echo '=== End of file: /tmp/62.IWk ===' 00:04:20.868 + echo '' 00:04:20.868 + echo '=== Start of file: /tmp/spdk_tgt_config.json.ooD ===' 00:04:20.868 + cat /tmp/spdk_tgt_config.json.ooD 00:04:20.868 + echo '=== End of file: /tmp/spdk_tgt_config.json.ooD ===' 00:04:20.868 + echo '' 00:04:20.868 + rm /tmp/62.IWk /tmp/spdk_tgt_config.json.ooD 00:04:20.868 + exit 1 00:04:20.868 02:09:24 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:04:20.868 INFO: configuration change detected. 00:04:20.868 02:09:24 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:04:20.868 02:09:24 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:04:20.868 02:09:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:20.868 02:09:24 -- common/autotest_common.sh@10 -- # set +x 00:04:20.868 02:09:24 -- json_config/json_config.sh@360 -- # local ret=0 00:04:20.868 02:09:24 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:04:20.868 02:09:24 -- json_config/json_config.sh@370 -- # [[ -n 4187244 ]] 00:04:20.868 02:09:24 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:04:20.868 02:09:24 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:04:20.868 02:09:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:20.868 02:09:24 -- common/autotest_common.sh@10 -- # set +x 00:04:20.868 02:09:24 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:04:20.868 02:09:24 -- json_config/json_config.sh@246 -- # uname -s 00:04:20.868 02:09:24 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:04:20.869 02:09:24 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:04:20.869 02:09:24 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:04:20.869 02:09:24 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:04:20.869 02:09:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:20.869 02:09:24 -- common/autotest_common.sh@10 -- # set +x 00:04:20.869 02:09:24 -- json_config/json_config.sh@376 -- # killprocess 4187244 00:04:20.869 02:09:24 -- common/autotest_common.sh@936 -- # '[' -z 4187244 ']' 00:04:20.869 02:09:24 -- common/autotest_common.sh@940 -- # kill -0 4187244 00:04:20.869 02:09:24 -- common/autotest_common.sh@941 -- # uname 00:04:20.869 02:09:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:20.869 02:09:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4187244 00:04:21.127 02:09:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:21.127 02:09:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:21.127 02:09:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4187244' 00:04:21.127 killing process with pid 4187244 00:04:21.127 02:09:24 -- common/autotest_common.sh@955 -- # kill 4187244 00:04:21.127 02:09:24 -- common/autotest_common.sh@960 -- # wait 4187244 00:04:23.028 02:09:26 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:23.028 02:09:26 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:04:23.028 02:09:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:23.028 02:09:26 -- common/autotest_common.sh@10 -- # set +x 00:04:23.028 02:09:26 -- json_config/json_config.sh@381 -- # return 0 00:04:23.028 02:09:26 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:04:23.028 INFO: Success 00:04:23.028 00:04:23.028 real 0m16.456s 00:04:23.028 user 0m18.994s 00:04:23.028 sys 0m2.186s 00:04:23.028 02:09:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:23.028 02:09:26 -- common/autotest_common.sh@10 -- # set +x 00:04:23.028 ************************************ 00:04:23.028 END TEST json_config 00:04:23.028 ************************************ 00:04:23.028 02:09:26 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:23.028 02:09:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:23.028 02:09:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:23.028 02:09:26 -- common/autotest_common.sh@10 -- # set +x 00:04:23.028 ************************************ 00:04:23.028 START TEST json_config_extra_key 00:04:23.028 ************************************ 00:04:23.028 02:09:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:23.028 02:09:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:23.028 02:09:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:23.028 02:09:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:23.028 02:09:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:23.028 02:09:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:23.028 02:09:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:23.028 02:09:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:23.028 02:09:26 -- scripts/common.sh@335 -- # IFS=.-: 00:04:23.028 02:09:26 -- scripts/common.sh@335 -- # read -ra ver1 00:04:23.028 02:09:26 -- scripts/common.sh@336 -- # IFS=.-: 00:04:23.028 02:09:26 -- scripts/common.sh@336 -- # read -ra ver2 00:04:23.028 02:09:26 -- scripts/common.sh@337 -- # local 'op=<' 00:04:23.028 02:09:26 -- scripts/common.sh@339 -- # ver1_l=2 00:04:23.028 02:09:26 -- scripts/common.sh@340 -- # ver2_l=1 00:04:23.028 02:09:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:23.028 02:09:26 -- scripts/common.sh@343 -- # case "$op" in 00:04:23.028 02:09:26 -- scripts/common.sh@344 -- # : 1 00:04:23.028 02:09:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:23.028 02:09:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:23.028 02:09:26 -- scripts/common.sh@364 -- # decimal 1 00:04:23.028 02:09:26 -- scripts/common.sh@352 -- # local d=1 00:04:23.028 02:09:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:23.028 02:09:26 -- scripts/common.sh@354 -- # echo 1 00:04:23.028 02:09:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:23.028 02:09:26 -- scripts/common.sh@365 -- # decimal 2 00:04:23.028 02:09:26 -- scripts/common.sh@352 -- # local d=2 00:04:23.028 02:09:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:23.028 02:09:26 -- scripts/common.sh@354 -- # echo 2 00:04:23.028 02:09:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:23.029 02:09:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:23.029 02:09:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:23.029 02:09:26 -- scripts/common.sh@367 -- # return 0 00:04:23.029 02:09:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:23.029 02:09:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:23.029 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:23.029 --rc genhtml_branch_coverage=1 00:04:23.029 --rc genhtml_function_coverage=1 00:04:23.029 --rc genhtml_legend=1 00:04:23.029 --rc geninfo_all_blocks=1 00:04:23.029 --rc geninfo_unexecuted_blocks=1 00:04:23.029 00:04:23.029 ' 00:04:23.029 02:09:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:23.029 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:23.029 --rc genhtml_branch_coverage=1 00:04:23.029 --rc genhtml_function_coverage=1 00:04:23.029 --rc genhtml_legend=1 00:04:23.029 --rc geninfo_all_blocks=1 00:04:23.029 --rc geninfo_unexecuted_blocks=1 00:04:23.029 00:04:23.029 ' 00:04:23.029 02:09:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:23.029 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:23.029 --rc genhtml_branch_coverage=1 00:04:23.029 --rc genhtml_function_coverage=1 00:04:23.029 --rc genhtml_legend=1 00:04:23.029 --rc geninfo_all_blocks=1 00:04:23.029 --rc geninfo_unexecuted_blocks=1 00:04:23.029 00:04:23.029 ' 00:04:23.029 02:09:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:23.029 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:23.029 --rc genhtml_branch_coverage=1 00:04:23.029 --rc genhtml_function_coverage=1 00:04:23.029 --rc genhtml_legend=1 00:04:23.029 --rc geninfo_all_blocks=1 00:04:23.029 --rc geninfo_unexecuted_blocks=1 00:04:23.029 00:04:23.029 ' 00:04:23.029 02:09:26 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:23.029 02:09:26 -- nvmf/common.sh@7 -- # uname -s 00:04:23.029 02:09:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:23.029 02:09:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:23.029 02:09:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:23.029 02:09:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:23.029 02:09:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:23.029 02:09:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:23.029 02:09:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:23.029 02:09:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:23.029 02:09:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:23.029 02:09:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:23.029 02:09:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:23.029 02:09:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:23.029 02:09:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:23.029 02:09:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:23.029 02:09:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:23.029 02:09:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:23.029 02:09:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:23.029 02:09:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:23.029 02:09:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:23.029 02:09:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:23.029 02:09:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:23.029 02:09:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:23.029 02:09:26 -- paths/export.sh@5 -- # export PATH 00:04:23.029 02:09:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:23.029 02:09:26 -- nvmf/common.sh@46 -- # : 0 00:04:23.029 02:09:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:23.029 02:09:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:23.029 02:09:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:23.029 02:09:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:23.029 02:09:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:23.029 02:09:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:23.029 02:09:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:23.029 02:09:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:23.029 02:09:26 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:04:23.029 02:09:26 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:04:23.029 02:09:26 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:04:23.029 02:09:26 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:04:23.029 02:09:26 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:04:23.029 02:09:26 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:04:23.029 02:09:26 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:04:23.029 02:09:26 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:04:23.029 02:09:26 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:23.029 02:09:26 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:04:23.029 INFO: launching applications... 00:04:23.029 02:09:26 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:23.029 02:09:26 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:04:23.029 02:09:26 -- json_config/json_config_extra_key.sh@25 -- # shift 00:04:23.029 02:09:26 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:04:23.029 02:09:26 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:04:23.029 02:09:26 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=4188194 00:04:23.029 02:09:26 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:23.029 02:09:26 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:04:23.029 Waiting for target to run... 00:04:23.029 02:09:26 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 4188194 /var/tmp/spdk_tgt.sock 00:04:23.029 02:09:26 -- common/autotest_common.sh@829 -- # '[' -z 4188194 ']' 00:04:23.029 02:09:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:23.029 02:09:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:23.029 02:09:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:23.029 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:23.029 02:09:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:23.029 02:09:26 -- common/autotest_common.sh@10 -- # set +x 00:04:23.029 [2024-11-29 02:09:26.467848] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:23.029 [2024-11-29 02:09:26.467927] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4188194 ] 00:04:23.029 EAL: No free 2048 kB hugepages reported on node 1 00:04:23.288 [2024-11-29 02:09:26.797503] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:23.288 [2024-11-29 02:09:26.884592] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:23.288 [2024-11-29 02:09:26.884793] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:23.856 02:09:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:23.856 02:09:27 -- common/autotest_common.sh@862 -- # return 0 00:04:23.856 02:09:27 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:04:23.856 00:04:23.856 02:09:27 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:04:23.856 INFO: shutting down applications... 00:04:23.856 02:09:27 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:04:23.856 02:09:27 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:04:23.856 02:09:27 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:04:23.856 02:09:27 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 4188194 ]] 00:04:23.856 02:09:27 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 4188194 00:04:23.856 02:09:27 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:04:23.856 02:09:27 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:23.856 02:09:27 -- json_config/json_config_extra_key.sh@50 -- # kill -0 4188194 00:04:23.856 02:09:27 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:24.422 02:09:27 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:24.422 02:09:27 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:24.422 02:09:27 -- json_config/json_config_extra_key.sh@50 -- # kill -0 4188194 00:04:24.422 02:09:27 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:24.990 02:09:28 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:24.990 02:09:28 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:24.990 02:09:28 -- json_config/json_config_extra_key.sh@50 -- # kill -0 4188194 00:04:24.990 02:09:28 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:04:24.990 02:09:28 -- json_config/json_config_extra_key.sh@52 -- # break 00:04:24.990 02:09:28 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:04:24.990 02:09:28 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:04:24.990 SPDK target shutdown done 00:04:24.990 02:09:28 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:04:24.990 Success 00:04:24.990 00:04:24.990 real 0m2.130s 00:04:24.990 user 0m1.629s 00:04:24.990 sys 0m0.460s 00:04:24.990 02:09:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:24.990 02:09:28 -- common/autotest_common.sh@10 -- # set +x 00:04:24.990 ************************************ 00:04:24.990 END TEST json_config_extra_key 00:04:24.990 ************************************ 00:04:24.990 02:09:28 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:24.990 02:09:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:24.990 02:09:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:24.990 02:09:28 -- common/autotest_common.sh@10 -- # set +x 00:04:24.990 ************************************ 00:04:24.990 START TEST alias_rpc 00:04:24.990 ************************************ 00:04:24.990 02:09:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:24.990 * Looking for test storage... 00:04:24.990 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:04:24.990 02:09:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:24.990 02:09:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:24.990 02:09:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:24.990 02:09:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:24.990 02:09:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:24.990 02:09:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:24.990 02:09:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:24.990 02:09:28 -- scripts/common.sh@335 -- # IFS=.-: 00:04:24.990 02:09:28 -- scripts/common.sh@335 -- # read -ra ver1 00:04:24.990 02:09:28 -- scripts/common.sh@336 -- # IFS=.-: 00:04:24.990 02:09:28 -- scripts/common.sh@336 -- # read -ra ver2 00:04:24.990 02:09:28 -- scripts/common.sh@337 -- # local 'op=<' 00:04:24.990 02:09:28 -- scripts/common.sh@339 -- # ver1_l=2 00:04:24.990 02:09:28 -- scripts/common.sh@340 -- # ver2_l=1 00:04:24.990 02:09:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:24.990 02:09:28 -- scripts/common.sh@343 -- # case "$op" in 00:04:24.990 02:09:28 -- scripts/common.sh@344 -- # : 1 00:04:24.990 02:09:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:24.990 02:09:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:24.990 02:09:28 -- scripts/common.sh@364 -- # decimal 1 00:04:24.990 02:09:28 -- scripts/common.sh@352 -- # local d=1 00:04:24.991 02:09:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:24.991 02:09:28 -- scripts/common.sh@354 -- # echo 1 00:04:24.991 02:09:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:24.991 02:09:28 -- scripts/common.sh@365 -- # decimal 2 00:04:24.991 02:09:28 -- scripts/common.sh@352 -- # local d=2 00:04:24.991 02:09:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:24.991 02:09:28 -- scripts/common.sh@354 -- # echo 2 00:04:24.991 02:09:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:24.991 02:09:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:24.991 02:09:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:24.991 02:09:28 -- scripts/common.sh@367 -- # return 0 00:04:24.991 02:09:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:24.991 02:09:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:24.991 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:24.991 --rc genhtml_branch_coverage=1 00:04:24.991 --rc genhtml_function_coverage=1 00:04:24.991 --rc genhtml_legend=1 00:04:24.991 --rc geninfo_all_blocks=1 00:04:24.991 --rc geninfo_unexecuted_blocks=1 00:04:24.991 00:04:24.991 ' 00:04:24.991 02:09:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:24.991 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:24.991 --rc genhtml_branch_coverage=1 00:04:24.991 --rc genhtml_function_coverage=1 00:04:24.991 --rc genhtml_legend=1 00:04:24.991 --rc geninfo_all_blocks=1 00:04:24.991 --rc geninfo_unexecuted_blocks=1 00:04:24.991 00:04:24.991 ' 00:04:24.991 02:09:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:24.991 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:24.991 --rc genhtml_branch_coverage=1 00:04:24.991 --rc genhtml_function_coverage=1 00:04:24.991 --rc genhtml_legend=1 00:04:24.991 --rc geninfo_all_blocks=1 00:04:24.991 --rc geninfo_unexecuted_blocks=1 00:04:24.991 00:04:24.991 ' 00:04:24.991 02:09:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:24.991 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:24.991 --rc genhtml_branch_coverage=1 00:04:24.991 --rc genhtml_function_coverage=1 00:04:24.991 --rc genhtml_legend=1 00:04:24.991 --rc geninfo_all_blocks=1 00:04:24.991 --rc geninfo_unexecuted_blocks=1 00:04:24.991 00:04:24.991 ' 00:04:24.991 02:09:28 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:24.991 02:09:28 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=4188520 00:04:24.991 02:09:28 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:24.991 02:09:28 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 4188520 00:04:24.991 02:09:28 -- common/autotest_common.sh@829 -- # '[' -z 4188520 ']' 00:04:24.991 02:09:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:24.991 02:09:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:24.991 02:09:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:24.991 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:24.991 02:09:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:24.991 02:09:28 -- common/autotest_common.sh@10 -- # set +x 00:04:24.991 [2024-11-29 02:09:28.638009] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:24.991 [2024-11-29 02:09:28.638105] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4188520 ] 00:04:24.991 EAL: No free 2048 kB hugepages reported on node 1 00:04:25.250 [2024-11-29 02:09:28.695846] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:25.250 [2024-11-29 02:09:28.802197] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:25.250 [2024-11-29 02:09:28.802376] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:26.186 02:09:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:26.186 02:09:29 -- common/autotest_common.sh@862 -- # return 0 00:04:26.186 02:09:29 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:04:26.444 02:09:29 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 4188520 00:04:26.444 02:09:29 -- common/autotest_common.sh@936 -- # '[' -z 4188520 ']' 00:04:26.444 02:09:29 -- common/autotest_common.sh@940 -- # kill -0 4188520 00:04:26.444 02:09:29 -- common/autotest_common.sh@941 -- # uname 00:04:26.444 02:09:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:26.444 02:09:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4188520 00:04:26.444 02:09:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:26.444 02:09:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:26.444 02:09:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4188520' 00:04:26.444 killing process with pid 4188520 00:04:26.444 02:09:29 -- common/autotest_common.sh@955 -- # kill 4188520 00:04:26.444 02:09:29 -- common/autotest_common.sh@960 -- # wait 4188520 00:04:27.011 00:04:27.011 real 0m1.932s 00:04:27.011 user 0m2.215s 00:04:27.011 sys 0m0.484s 00:04:27.011 02:09:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:27.011 02:09:30 -- common/autotest_common.sh@10 -- # set +x 00:04:27.011 ************************************ 00:04:27.011 END TEST alias_rpc 00:04:27.011 ************************************ 00:04:27.011 02:09:30 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:04:27.011 02:09:30 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:27.011 02:09:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:27.011 02:09:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:27.011 02:09:30 -- common/autotest_common.sh@10 -- # set +x 00:04:27.011 ************************************ 00:04:27.011 START TEST spdkcli_tcp 00:04:27.011 ************************************ 00:04:27.011 02:09:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:27.011 * Looking for test storage... 00:04:27.011 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:04:27.011 02:09:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:27.011 02:09:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:27.011 02:09:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:27.011 02:09:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:27.011 02:09:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:27.011 02:09:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:27.011 02:09:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:27.011 02:09:30 -- scripts/common.sh@335 -- # IFS=.-: 00:04:27.011 02:09:30 -- scripts/common.sh@335 -- # read -ra ver1 00:04:27.011 02:09:30 -- scripts/common.sh@336 -- # IFS=.-: 00:04:27.011 02:09:30 -- scripts/common.sh@336 -- # read -ra ver2 00:04:27.011 02:09:30 -- scripts/common.sh@337 -- # local 'op=<' 00:04:27.011 02:09:30 -- scripts/common.sh@339 -- # ver1_l=2 00:04:27.011 02:09:30 -- scripts/common.sh@340 -- # ver2_l=1 00:04:27.011 02:09:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:27.011 02:09:30 -- scripts/common.sh@343 -- # case "$op" in 00:04:27.011 02:09:30 -- scripts/common.sh@344 -- # : 1 00:04:27.011 02:09:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:27.011 02:09:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:27.011 02:09:30 -- scripts/common.sh@364 -- # decimal 1 00:04:27.011 02:09:30 -- scripts/common.sh@352 -- # local d=1 00:04:27.011 02:09:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:27.011 02:09:30 -- scripts/common.sh@354 -- # echo 1 00:04:27.011 02:09:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:27.011 02:09:30 -- scripts/common.sh@365 -- # decimal 2 00:04:27.011 02:09:30 -- scripts/common.sh@352 -- # local d=2 00:04:27.011 02:09:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:27.011 02:09:30 -- scripts/common.sh@354 -- # echo 2 00:04:27.011 02:09:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:27.011 02:09:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:27.012 02:09:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:27.012 02:09:30 -- scripts/common.sh@367 -- # return 0 00:04:27.012 02:09:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:27.012 02:09:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:27.012 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.012 --rc genhtml_branch_coverage=1 00:04:27.012 --rc genhtml_function_coverage=1 00:04:27.012 --rc genhtml_legend=1 00:04:27.012 --rc geninfo_all_blocks=1 00:04:27.012 --rc geninfo_unexecuted_blocks=1 00:04:27.012 00:04:27.012 ' 00:04:27.012 02:09:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:27.012 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.012 --rc genhtml_branch_coverage=1 00:04:27.012 --rc genhtml_function_coverage=1 00:04:27.012 --rc genhtml_legend=1 00:04:27.012 --rc geninfo_all_blocks=1 00:04:27.012 --rc geninfo_unexecuted_blocks=1 00:04:27.012 00:04:27.012 ' 00:04:27.012 02:09:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:27.012 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.012 --rc genhtml_branch_coverage=1 00:04:27.012 --rc genhtml_function_coverage=1 00:04:27.012 --rc genhtml_legend=1 00:04:27.012 --rc geninfo_all_blocks=1 00:04:27.012 --rc geninfo_unexecuted_blocks=1 00:04:27.012 00:04:27.012 ' 00:04:27.012 02:09:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:27.012 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.012 --rc genhtml_branch_coverage=1 00:04:27.012 --rc genhtml_function_coverage=1 00:04:27.012 --rc genhtml_legend=1 00:04:27.012 --rc geninfo_all_blocks=1 00:04:27.012 --rc geninfo_unexecuted_blocks=1 00:04:27.012 00:04:27.012 ' 00:04:27.012 02:09:30 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:04:27.012 02:09:30 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:04:27.012 02:09:30 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:04:27.012 02:09:30 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:04:27.012 02:09:30 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:04:27.012 02:09:30 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:04:27.012 02:09:30 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:04:27.012 02:09:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:27.012 02:09:30 -- common/autotest_common.sh@10 -- # set +x 00:04:27.012 02:09:30 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=4188853 00:04:27.012 02:09:30 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:04:27.012 02:09:30 -- spdkcli/tcp.sh@27 -- # waitforlisten 4188853 00:04:27.012 02:09:30 -- common/autotest_common.sh@829 -- # '[' -z 4188853 ']' 00:04:27.012 02:09:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:27.012 02:09:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:27.012 02:09:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:27.012 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:27.012 02:09:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:27.012 02:09:30 -- common/autotest_common.sh@10 -- # set +x 00:04:27.012 [2024-11-29 02:09:30.603073] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:27.012 [2024-11-29 02:09:30.603159] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4188853 ] 00:04:27.012 EAL: No free 2048 kB hugepages reported on node 1 00:04:27.012 [2024-11-29 02:09:30.662020] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:27.270 [2024-11-29 02:09:30.776258] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:27.270 [2024-11-29 02:09:30.776489] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:27.270 [2024-11-29 02:09:30.776490] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:28.205 02:09:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:28.205 02:09:31 -- common/autotest_common.sh@862 -- # return 0 00:04:28.205 02:09:31 -- spdkcli/tcp.sh@31 -- # socat_pid=4188994 00:04:28.205 02:09:31 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:28.205 02:09:31 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:28.205 [ 00:04:28.205 "bdev_malloc_delete", 00:04:28.205 "bdev_malloc_create", 00:04:28.205 "bdev_null_resize", 00:04:28.205 "bdev_null_delete", 00:04:28.205 "bdev_null_create", 00:04:28.205 "bdev_nvme_cuse_unregister", 00:04:28.205 "bdev_nvme_cuse_register", 00:04:28.205 "bdev_opal_new_user", 00:04:28.205 "bdev_opal_set_lock_state", 00:04:28.205 "bdev_opal_delete", 00:04:28.205 "bdev_opal_get_info", 00:04:28.205 "bdev_opal_create", 00:04:28.205 "bdev_nvme_opal_revert", 00:04:28.205 "bdev_nvme_opal_init", 00:04:28.205 "bdev_nvme_send_cmd", 00:04:28.205 "bdev_nvme_get_path_iostat", 00:04:28.205 "bdev_nvme_get_mdns_discovery_info", 00:04:28.205 "bdev_nvme_stop_mdns_discovery", 00:04:28.205 "bdev_nvme_start_mdns_discovery", 00:04:28.205 "bdev_nvme_set_multipath_policy", 00:04:28.205 "bdev_nvme_set_preferred_path", 00:04:28.205 "bdev_nvme_get_io_paths", 00:04:28.205 "bdev_nvme_remove_error_injection", 00:04:28.205 "bdev_nvme_add_error_injection", 00:04:28.205 "bdev_nvme_get_discovery_info", 00:04:28.205 "bdev_nvme_stop_discovery", 00:04:28.205 "bdev_nvme_start_discovery", 00:04:28.205 "bdev_nvme_get_controller_health_info", 00:04:28.205 "bdev_nvme_disable_controller", 00:04:28.205 "bdev_nvme_enable_controller", 00:04:28.205 "bdev_nvme_reset_controller", 00:04:28.205 "bdev_nvme_get_transport_statistics", 00:04:28.205 "bdev_nvme_apply_firmware", 00:04:28.205 "bdev_nvme_detach_controller", 00:04:28.205 "bdev_nvme_get_controllers", 00:04:28.205 "bdev_nvme_attach_controller", 00:04:28.205 "bdev_nvme_set_hotplug", 00:04:28.205 "bdev_nvme_set_options", 00:04:28.205 "bdev_passthru_delete", 00:04:28.205 "bdev_passthru_create", 00:04:28.205 "bdev_lvol_grow_lvstore", 00:04:28.205 "bdev_lvol_get_lvols", 00:04:28.205 "bdev_lvol_get_lvstores", 00:04:28.205 "bdev_lvol_delete", 00:04:28.205 "bdev_lvol_set_read_only", 00:04:28.205 "bdev_lvol_resize", 00:04:28.205 "bdev_lvol_decouple_parent", 00:04:28.205 "bdev_lvol_inflate", 00:04:28.205 "bdev_lvol_rename", 00:04:28.205 "bdev_lvol_clone_bdev", 00:04:28.205 "bdev_lvol_clone", 00:04:28.205 "bdev_lvol_snapshot", 00:04:28.205 "bdev_lvol_create", 00:04:28.205 "bdev_lvol_delete_lvstore", 00:04:28.205 "bdev_lvol_rename_lvstore", 00:04:28.205 "bdev_lvol_create_lvstore", 00:04:28.205 "bdev_raid_set_options", 00:04:28.205 "bdev_raid_remove_base_bdev", 00:04:28.205 "bdev_raid_add_base_bdev", 00:04:28.205 "bdev_raid_delete", 00:04:28.205 "bdev_raid_create", 00:04:28.205 "bdev_raid_get_bdevs", 00:04:28.205 "bdev_error_inject_error", 00:04:28.205 "bdev_error_delete", 00:04:28.205 "bdev_error_create", 00:04:28.205 "bdev_split_delete", 00:04:28.205 "bdev_split_create", 00:04:28.205 "bdev_delay_delete", 00:04:28.205 "bdev_delay_create", 00:04:28.205 "bdev_delay_update_latency", 00:04:28.205 "bdev_zone_block_delete", 00:04:28.205 "bdev_zone_block_create", 00:04:28.205 "blobfs_create", 00:04:28.205 "blobfs_detect", 00:04:28.205 "blobfs_set_cache_size", 00:04:28.205 "bdev_aio_delete", 00:04:28.205 "bdev_aio_rescan", 00:04:28.205 "bdev_aio_create", 00:04:28.205 "bdev_ftl_set_property", 00:04:28.205 "bdev_ftl_get_properties", 00:04:28.205 "bdev_ftl_get_stats", 00:04:28.205 "bdev_ftl_unmap", 00:04:28.205 "bdev_ftl_unload", 00:04:28.205 "bdev_ftl_delete", 00:04:28.205 "bdev_ftl_load", 00:04:28.205 "bdev_ftl_create", 00:04:28.205 "bdev_virtio_attach_controller", 00:04:28.205 "bdev_virtio_scsi_get_devices", 00:04:28.205 "bdev_virtio_detach_controller", 00:04:28.205 "bdev_virtio_blk_set_hotplug", 00:04:28.205 "bdev_iscsi_delete", 00:04:28.205 "bdev_iscsi_create", 00:04:28.205 "bdev_iscsi_set_options", 00:04:28.205 "accel_error_inject_error", 00:04:28.205 "ioat_scan_accel_module", 00:04:28.205 "dsa_scan_accel_module", 00:04:28.205 "iaa_scan_accel_module", 00:04:28.205 "iscsi_set_options", 00:04:28.205 "iscsi_get_auth_groups", 00:04:28.205 "iscsi_auth_group_remove_secret", 00:04:28.205 "iscsi_auth_group_add_secret", 00:04:28.205 "iscsi_delete_auth_group", 00:04:28.205 "iscsi_create_auth_group", 00:04:28.205 "iscsi_set_discovery_auth", 00:04:28.205 "iscsi_get_options", 00:04:28.205 "iscsi_target_node_request_logout", 00:04:28.205 "iscsi_target_node_set_redirect", 00:04:28.205 "iscsi_target_node_set_auth", 00:04:28.205 "iscsi_target_node_add_lun", 00:04:28.205 "iscsi_get_connections", 00:04:28.205 "iscsi_portal_group_set_auth", 00:04:28.205 "iscsi_start_portal_group", 00:04:28.205 "iscsi_delete_portal_group", 00:04:28.205 "iscsi_create_portal_group", 00:04:28.205 "iscsi_get_portal_groups", 00:04:28.205 "iscsi_delete_target_node", 00:04:28.205 "iscsi_target_node_remove_pg_ig_maps", 00:04:28.205 "iscsi_target_node_add_pg_ig_maps", 00:04:28.205 "iscsi_create_target_node", 00:04:28.205 "iscsi_get_target_nodes", 00:04:28.205 "iscsi_delete_initiator_group", 00:04:28.205 "iscsi_initiator_group_remove_initiators", 00:04:28.205 "iscsi_initiator_group_add_initiators", 00:04:28.205 "iscsi_create_initiator_group", 00:04:28.205 "iscsi_get_initiator_groups", 00:04:28.205 "nvmf_set_crdt", 00:04:28.205 "nvmf_set_config", 00:04:28.205 "nvmf_set_max_subsystems", 00:04:28.205 "nvmf_subsystem_get_listeners", 00:04:28.205 "nvmf_subsystem_get_qpairs", 00:04:28.205 "nvmf_subsystem_get_controllers", 00:04:28.205 "nvmf_get_stats", 00:04:28.205 "nvmf_get_transports", 00:04:28.205 "nvmf_create_transport", 00:04:28.205 "nvmf_get_targets", 00:04:28.205 "nvmf_delete_target", 00:04:28.206 "nvmf_create_target", 00:04:28.206 "nvmf_subsystem_allow_any_host", 00:04:28.206 "nvmf_subsystem_remove_host", 00:04:28.206 "nvmf_subsystem_add_host", 00:04:28.206 "nvmf_subsystem_remove_ns", 00:04:28.206 "nvmf_subsystem_add_ns", 00:04:28.206 "nvmf_subsystem_listener_set_ana_state", 00:04:28.206 "nvmf_discovery_get_referrals", 00:04:28.206 "nvmf_discovery_remove_referral", 00:04:28.206 "nvmf_discovery_add_referral", 00:04:28.206 "nvmf_subsystem_remove_listener", 00:04:28.206 "nvmf_subsystem_add_listener", 00:04:28.206 "nvmf_delete_subsystem", 00:04:28.206 "nvmf_create_subsystem", 00:04:28.206 "nvmf_get_subsystems", 00:04:28.206 "env_dpdk_get_mem_stats", 00:04:28.206 "nbd_get_disks", 00:04:28.206 "nbd_stop_disk", 00:04:28.206 "nbd_start_disk", 00:04:28.206 "ublk_recover_disk", 00:04:28.206 "ublk_get_disks", 00:04:28.206 "ublk_stop_disk", 00:04:28.206 "ublk_start_disk", 00:04:28.206 "ublk_destroy_target", 00:04:28.206 "ublk_create_target", 00:04:28.206 "virtio_blk_create_transport", 00:04:28.206 "virtio_blk_get_transports", 00:04:28.206 "vhost_controller_set_coalescing", 00:04:28.206 "vhost_get_controllers", 00:04:28.206 "vhost_delete_controller", 00:04:28.206 "vhost_create_blk_controller", 00:04:28.206 "vhost_scsi_controller_remove_target", 00:04:28.206 "vhost_scsi_controller_add_target", 00:04:28.206 "vhost_start_scsi_controller", 00:04:28.206 "vhost_create_scsi_controller", 00:04:28.206 "thread_set_cpumask", 00:04:28.206 "framework_get_scheduler", 00:04:28.206 "framework_set_scheduler", 00:04:28.206 "framework_get_reactors", 00:04:28.206 "thread_get_io_channels", 00:04:28.206 "thread_get_pollers", 00:04:28.206 "thread_get_stats", 00:04:28.206 "framework_monitor_context_switch", 00:04:28.206 "spdk_kill_instance", 00:04:28.206 "log_enable_timestamps", 00:04:28.206 "log_get_flags", 00:04:28.206 "log_clear_flag", 00:04:28.206 "log_set_flag", 00:04:28.206 "log_get_level", 00:04:28.206 "log_set_level", 00:04:28.206 "log_get_print_level", 00:04:28.206 "log_set_print_level", 00:04:28.206 "framework_enable_cpumask_locks", 00:04:28.206 "framework_disable_cpumask_locks", 00:04:28.206 "framework_wait_init", 00:04:28.206 "framework_start_init", 00:04:28.206 "scsi_get_devices", 00:04:28.206 "bdev_get_histogram", 00:04:28.206 "bdev_enable_histogram", 00:04:28.206 "bdev_set_qos_limit", 00:04:28.206 "bdev_set_qd_sampling_period", 00:04:28.206 "bdev_get_bdevs", 00:04:28.206 "bdev_reset_iostat", 00:04:28.206 "bdev_get_iostat", 00:04:28.206 "bdev_examine", 00:04:28.206 "bdev_wait_for_examine", 00:04:28.206 "bdev_set_options", 00:04:28.206 "notify_get_notifications", 00:04:28.206 "notify_get_types", 00:04:28.206 "accel_get_stats", 00:04:28.206 "accel_set_options", 00:04:28.206 "accel_set_driver", 00:04:28.206 "accel_crypto_key_destroy", 00:04:28.206 "accel_crypto_keys_get", 00:04:28.206 "accel_crypto_key_create", 00:04:28.206 "accel_assign_opc", 00:04:28.206 "accel_get_module_info", 00:04:28.206 "accel_get_opc_assignments", 00:04:28.206 "vmd_rescan", 00:04:28.206 "vmd_remove_device", 00:04:28.206 "vmd_enable", 00:04:28.206 "sock_set_default_impl", 00:04:28.206 "sock_impl_set_options", 00:04:28.206 "sock_impl_get_options", 00:04:28.206 "iobuf_get_stats", 00:04:28.206 "iobuf_set_options", 00:04:28.206 "framework_get_pci_devices", 00:04:28.206 "framework_get_config", 00:04:28.206 "framework_get_subsystems", 00:04:28.206 "trace_get_info", 00:04:28.206 "trace_get_tpoint_group_mask", 00:04:28.206 "trace_disable_tpoint_group", 00:04:28.206 "trace_enable_tpoint_group", 00:04:28.206 "trace_clear_tpoint_mask", 00:04:28.206 "trace_set_tpoint_mask", 00:04:28.206 "spdk_get_version", 00:04:28.206 "rpc_get_methods" 00:04:28.206 ] 00:04:28.206 02:09:31 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:28.206 02:09:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:28.206 02:09:31 -- common/autotest_common.sh@10 -- # set +x 00:04:28.206 02:09:31 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:28.206 02:09:31 -- spdkcli/tcp.sh@38 -- # killprocess 4188853 00:04:28.206 02:09:31 -- common/autotest_common.sh@936 -- # '[' -z 4188853 ']' 00:04:28.206 02:09:31 -- common/autotest_common.sh@940 -- # kill -0 4188853 00:04:28.206 02:09:31 -- common/autotest_common.sh@941 -- # uname 00:04:28.206 02:09:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:28.206 02:09:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4188853 00:04:28.206 02:09:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:28.206 02:09:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:28.206 02:09:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4188853' 00:04:28.206 killing process with pid 4188853 00:04:28.206 02:09:31 -- common/autotest_common.sh@955 -- # kill 4188853 00:04:28.206 02:09:31 -- common/autotest_common.sh@960 -- # wait 4188853 00:04:28.773 00:04:28.773 real 0m1.928s 00:04:28.773 user 0m3.652s 00:04:28.773 sys 0m0.483s 00:04:28.773 02:09:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:28.773 02:09:32 -- common/autotest_common.sh@10 -- # set +x 00:04:28.773 ************************************ 00:04:28.773 END TEST spdkcli_tcp 00:04:28.773 ************************************ 00:04:28.773 02:09:32 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:28.773 02:09:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:28.773 02:09:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:28.773 02:09:32 -- common/autotest_common.sh@10 -- # set +x 00:04:28.773 ************************************ 00:04:28.773 START TEST dpdk_mem_utility 00:04:28.773 ************************************ 00:04:28.773 02:09:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:28.773 * Looking for test storage... 00:04:28.773 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:04:28.773 02:09:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:28.773 02:09:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:28.773 02:09:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:29.032 02:09:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:29.032 02:09:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:29.032 02:09:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:29.032 02:09:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:29.032 02:09:32 -- scripts/common.sh@335 -- # IFS=.-: 00:04:29.032 02:09:32 -- scripts/common.sh@335 -- # read -ra ver1 00:04:29.032 02:09:32 -- scripts/common.sh@336 -- # IFS=.-: 00:04:29.032 02:09:32 -- scripts/common.sh@336 -- # read -ra ver2 00:04:29.032 02:09:32 -- scripts/common.sh@337 -- # local 'op=<' 00:04:29.032 02:09:32 -- scripts/common.sh@339 -- # ver1_l=2 00:04:29.032 02:09:32 -- scripts/common.sh@340 -- # ver2_l=1 00:04:29.032 02:09:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:29.032 02:09:32 -- scripts/common.sh@343 -- # case "$op" in 00:04:29.032 02:09:32 -- scripts/common.sh@344 -- # : 1 00:04:29.032 02:09:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:29.032 02:09:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:29.032 02:09:32 -- scripts/common.sh@364 -- # decimal 1 00:04:29.032 02:09:32 -- scripts/common.sh@352 -- # local d=1 00:04:29.032 02:09:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:29.032 02:09:32 -- scripts/common.sh@354 -- # echo 1 00:04:29.032 02:09:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:29.032 02:09:32 -- scripts/common.sh@365 -- # decimal 2 00:04:29.032 02:09:32 -- scripts/common.sh@352 -- # local d=2 00:04:29.032 02:09:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:29.032 02:09:32 -- scripts/common.sh@354 -- # echo 2 00:04:29.032 02:09:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:29.032 02:09:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:29.032 02:09:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:29.032 02:09:32 -- scripts/common.sh@367 -- # return 0 00:04:29.032 02:09:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:29.032 02:09:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:29.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:29.032 --rc genhtml_branch_coverage=1 00:04:29.032 --rc genhtml_function_coverage=1 00:04:29.032 --rc genhtml_legend=1 00:04:29.032 --rc geninfo_all_blocks=1 00:04:29.032 --rc geninfo_unexecuted_blocks=1 00:04:29.032 00:04:29.032 ' 00:04:29.032 02:09:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:29.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:29.032 --rc genhtml_branch_coverage=1 00:04:29.032 --rc genhtml_function_coverage=1 00:04:29.032 --rc genhtml_legend=1 00:04:29.032 --rc geninfo_all_blocks=1 00:04:29.032 --rc geninfo_unexecuted_blocks=1 00:04:29.032 00:04:29.032 ' 00:04:29.032 02:09:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:29.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:29.032 --rc genhtml_branch_coverage=1 00:04:29.032 --rc genhtml_function_coverage=1 00:04:29.032 --rc genhtml_legend=1 00:04:29.032 --rc geninfo_all_blocks=1 00:04:29.032 --rc geninfo_unexecuted_blocks=1 00:04:29.032 00:04:29.032 ' 00:04:29.032 02:09:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:29.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:29.032 --rc genhtml_branch_coverage=1 00:04:29.032 --rc genhtml_function_coverage=1 00:04:29.032 --rc genhtml_legend=1 00:04:29.032 --rc geninfo_all_blocks=1 00:04:29.032 --rc geninfo_unexecuted_blocks=1 00:04:29.032 00:04:29.032 ' 00:04:29.032 02:09:32 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:29.032 02:09:32 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=4189080 00:04:29.032 02:09:32 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:29.032 02:09:32 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 4189080 00:04:29.032 02:09:32 -- common/autotest_common.sh@829 -- # '[' -z 4189080 ']' 00:04:29.032 02:09:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:29.032 02:09:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:29.032 02:09:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:29.033 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:29.033 02:09:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:29.033 02:09:32 -- common/autotest_common.sh@10 -- # set +x 00:04:29.033 [2024-11-29 02:09:32.555123] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:29.033 [2024-11-29 02:09:32.555202] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4189080 ] 00:04:29.033 EAL: No free 2048 kB hugepages reported on node 1 00:04:29.033 [2024-11-29 02:09:32.617192] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:29.291 [2024-11-29 02:09:32.729133] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:29.291 [2024-11-29 02:09:32.729311] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:29.858 02:09:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:29.858 02:09:33 -- common/autotest_common.sh@862 -- # return 0 00:04:29.858 02:09:33 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:29.858 02:09:33 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:29.858 02:09:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:29.858 02:09:33 -- common/autotest_common.sh@10 -- # set +x 00:04:29.858 { 00:04:29.858 "filename": "/tmp/spdk_mem_dump.txt" 00:04:29.858 } 00:04:29.858 02:09:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:29.858 02:09:33 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:30.117 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:30.117 1 heaps totaling size 814.000000 MiB 00:04:30.117 size: 814.000000 MiB heap id: 0 00:04:30.117 end heaps---------- 00:04:30.117 8 mempools totaling size 598.116089 MiB 00:04:30.117 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:30.117 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:30.117 size: 84.521057 MiB name: bdev_io_4189080 00:04:30.117 size: 51.011292 MiB name: evtpool_4189080 00:04:30.117 size: 50.003479 MiB name: msgpool_4189080 00:04:30.117 size: 21.763794 MiB name: PDU_Pool 00:04:30.117 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:30.117 size: 0.026123 MiB name: Session_Pool 00:04:30.117 end mempools------- 00:04:30.117 6 memzones totaling size 4.142822 MiB 00:04:30.117 size: 1.000366 MiB name: RG_ring_0_4189080 00:04:30.117 size: 1.000366 MiB name: RG_ring_1_4189080 00:04:30.117 size: 1.000366 MiB name: RG_ring_4_4189080 00:04:30.117 size: 1.000366 MiB name: RG_ring_5_4189080 00:04:30.117 size: 0.125366 MiB name: RG_ring_2_4189080 00:04:30.117 size: 0.015991 MiB name: RG_ring_3_4189080 00:04:30.117 end memzones------- 00:04:30.117 02:09:33 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:30.117 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:30.117 list of free elements. size: 12.519348 MiB 00:04:30.117 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:30.117 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:30.117 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:30.117 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:30.117 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:30.117 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:30.117 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:30.117 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:30.117 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:30.117 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:30.117 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:30.117 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:30.117 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:30.117 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:30.117 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:30.117 list of standard malloc elements. size: 199.218079 MiB 00:04:30.117 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:30.117 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:30.117 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:30.117 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:30.117 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:30.117 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:30.117 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:30.117 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:30.117 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:30.117 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:30.117 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:30.117 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:30.117 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:30.117 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:30.117 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:30.117 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:30.117 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:30.117 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:30.117 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:30.117 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:30.117 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:30.117 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:30.117 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:30.117 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:30.117 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:30.117 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:30.117 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:30.117 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:30.117 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:30.117 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:30.117 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:30.117 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:30.117 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:30.117 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:30.117 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:30.117 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:30.117 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:30.117 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:30.117 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:30.117 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:30.117 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:30.117 list of memzone associated elements. size: 602.262573 MiB 00:04:30.117 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:30.117 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:30.117 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:30.117 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:30.117 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:30.117 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_4189080_0 00:04:30.117 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:30.117 associated memzone info: size: 48.002930 MiB name: MP_evtpool_4189080_0 00:04:30.117 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:30.117 associated memzone info: size: 48.002930 MiB name: MP_msgpool_4189080_0 00:04:30.117 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:30.118 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:30.118 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:30.118 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:30.118 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:30.118 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_4189080 00:04:30.118 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:30.118 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_4189080 00:04:30.118 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:30.118 associated memzone info: size: 1.007996 MiB name: MP_evtpool_4189080 00:04:30.118 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:30.118 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:30.118 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:30.118 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:30.118 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:30.118 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:30.118 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:30.118 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:30.118 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:30.118 associated memzone info: size: 1.000366 MiB name: RG_ring_0_4189080 00:04:30.118 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:30.118 associated memzone info: size: 1.000366 MiB name: RG_ring_1_4189080 00:04:30.118 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:30.118 associated memzone info: size: 1.000366 MiB name: RG_ring_4_4189080 00:04:30.118 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:30.118 associated memzone info: size: 1.000366 MiB name: RG_ring_5_4189080 00:04:30.118 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:30.118 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_4189080 00:04:30.118 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:30.118 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:30.118 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:30.118 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:30.118 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:30.118 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:30.118 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:30.118 associated memzone info: size: 0.125366 MiB name: RG_ring_2_4189080 00:04:30.118 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:30.118 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:30.118 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:30.118 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:30.118 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:30.118 associated memzone info: size: 0.015991 MiB name: RG_ring_3_4189080 00:04:30.118 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:30.118 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:30.118 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:30.118 associated memzone info: size: 0.000183 MiB name: MP_msgpool_4189080 00:04:30.118 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:30.118 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_4189080 00:04:30.118 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:30.118 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:30.118 02:09:33 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:30.118 02:09:33 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 4189080 00:04:30.118 02:09:33 -- common/autotest_common.sh@936 -- # '[' -z 4189080 ']' 00:04:30.118 02:09:33 -- common/autotest_common.sh@940 -- # kill -0 4189080 00:04:30.118 02:09:33 -- common/autotest_common.sh@941 -- # uname 00:04:30.118 02:09:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:30.118 02:09:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4189080 00:04:30.118 02:09:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:30.118 02:09:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:30.118 02:09:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4189080' 00:04:30.118 killing process with pid 4189080 00:04:30.118 02:09:33 -- common/autotest_common.sh@955 -- # kill 4189080 00:04:30.118 02:09:33 -- common/autotest_common.sh@960 -- # wait 4189080 00:04:30.721 00:04:30.721 real 0m1.754s 00:04:30.721 user 0m1.900s 00:04:30.721 sys 0m0.478s 00:04:30.721 02:09:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:30.721 02:09:34 -- common/autotest_common.sh@10 -- # set +x 00:04:30.721 ************************************ 00:04:30.721 END TEST dpdk_mem_utility 00:04:30.721 ************************************ 00:04:30.721 02:09:34 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:30.721 02:09:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:30.721 02:09:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.721 02:09:34 -- common/autotest_common.sh@10 -- # set +x 00:04:30.721 ************************************ 00:04:30.721 START TEST event 00:04:30.721 ************************************ 00:04:30.721 02:09:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:30.721 * Looking for test storage... 00:04:30.721 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:30.721 02:09:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:30.721 02:09:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:30.721 02:09:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:30.721 02:09:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:30.721 02:09:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:30.721 02:09:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:30.721 02:09:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:30.721 02:09:34 -- scripts/common.sh@335 -- # IFS=.-: 00:04:30.721 02:09:34 -- scripts/common.sh@335 -- # read -ra ver1 00:04:30.721 02:09:34 -- scripts/common.sh@336 -- # IFS=.-: 00:04:30.721 02:09:34 -- scripts/common.sh@336 -- # read -ra ver2 00:04:30.721 02:09:34 -- scripts/common.sh@337 -- # local 'op=<' 00:04:30.721 02:09:34 -- scripts/common.sh@339 -- # ver1_l=2 00:04:30.721 02:09:34 -- scripts/common.sh@340 -- # ver2_l=1 00:04:30.721 02:09:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:30.721 02:09:34 -- scripts/common.sh@343 -- # case "$op" in 00:04:30.721 02:09:34 -- scripts/common.sh@344 -- # : 1 00:04:30.721 02:09:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:30.722 02:09:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:30.722 02:09:34 -- scripts/common.sh@364 -- # decimal 1 00:04:30.722 02:09:34 -- scripts/common.sh@352 -- # local d=1 00:04:30.722 02:09:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:30.722 02:09:34 -- scripts/common.sh@354 -- # echo 1 00:04:30.722 02:09:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:30.722 02:09:34 -- scripts/common.sh@365 -- # decimal 2 00:04:30.722 02:09:34 -- scripts/common.sh@352 -- # local d=2 00:04:30.722 02:09:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:30.722 02:09:34 -- scripts/common.sh@354 -- # echo 2 00:04:30.722 02:09:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:30.722 02:09:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:30.722 02:09:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:30.722 02:09:34 -- scripts/common.sh@367 -- # return 0 00:04:30.722 02:09:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:30.722 02:09:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:30.722 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.722 --rc genhtml_branch_coverage=1 00:04:30.722 --rc genhtml_function_coverage=1 00:04:30.722 --rc genhtml_legend=1 00:04:30.722 --rc geninfo_all_blocks=1 00:04:30.722 --rc geninfo_unexecuted_blocks=1 00:04:30.722 00:04:30.722 ' 00:04:30.722 02:09:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:30.722 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.722 --rc genhtml_branch_coverage=1 00:04:30.722 --rc genhtml_function_coverage=1 00:04:30.722 --rc genhtml_legend=1 00:04:30.722 --rc geninfo_all_blocks=1 00:04:30.722 --rc geninfo_unexecuted_blocks=1 00:04:30.722 00:04:30.722 ' 00:04:30.722 02:09:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:30.722 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.722 --rc genhtml_branch_coverage=1 00:04:30.722 --rc genhtml_function_coverage=1 00:04:30.722 --rc genhtml_legend=1 00:04:30.722 --rc geninfo_all_blocks=1 00:04:30.722 --rc geninfo_unexecuted_blocks=1 00:04:30.722 00:04:30.722 ' 00:04:30.722 02:09:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:30.722 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.722 --rc genhtml_branch_coverage=1 00:04:30.722 --rc genhtml_function_coverage=1 00:04:30.722 --rc genhtml_legend=1 00:04:30.722 --rc geninfo_all_blocks=1 00:04:30.722 --rc geninfo_unexecuted_blocks=1 00:04:30.722 00:04:30.722 ' 00:04:30.722 02:09:34 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:04:30.722 02:09:34 -- bdev/nbd_common.sh@6 -- # set -e 00:04:30.722 02:09:34 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:30.722 02:09:34 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:04:30.722 02:09:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.722 02:09:34 -- common/autotest_common.sh@10 -- # set +x 00:04:30.722 ************************************ 00:04:30.722 START TEST event_perf 00:04:30.722 ************************************ 00:04:30.722 02:09:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:30.722 Running I/O for 1 seconds...[2024-11-29 02:09:34.308873] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:30.722 [2024-11-29 02:09:34.308955] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4189404 ] 00:04:30.722 EAL: No free 2048 kB hugepages reported on node 1 00:04:30.722 [2024-11-29 02:09:34.369922] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:31.008 [2024-11-29 02:09:34.489349] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:31.008 [2024-11-29 02:09:34.489458] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:31.008 [2024-11-29 02:09:34.489461] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:31.008 [2024-11-29 02:09:34.489430] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:31.942 Running I/O for 1 seconds... 00:04:31.942 lcore 0: 230089 00:04:31.942 lcore 1: 230087 00:04:31.942 lcore 2: 230088 00:04:31.942 lcore 3: 230089 00:04:31.942 done. 00:04:31.942 00:04:31.942 real 0m1.317s 00:04:31.942 user 0m4.230s 00:04:31.942 sys 0m0.082s 00:04:31.942 02:09:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:31.942 02:09:35 -- common/autotest_common.sh@10 -- # set +x 00:04:31.942 ************************************ 00:04:31.942 END TEST event_perf 00:04:31.942 ************************************ 00:04:32.201 02:09:35 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:32.201 02:09:35 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:32.201 02:09:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:32.201 02:09:35 -- common/autotest_common.sh@10 -- # set +x 00:04:32.201 ************************************ 00:04:32.201 START TEST event_reactor 00:04:32.201 ************************************ 00:04:32.201 02:09:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:32.201 [2024-11-29 02:09:35.657795] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:32.201 [2024-11-29 02:09:35.657886] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4189566 ] 00:04:32.201 EAL: No free 2048 kB hugepages reported on node 1 00:04:32.201 [2024-11-29 02:09:35.723091] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:32.201 [2024-11-29 02:09:35.837162] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:33.575 test_start 00:04:33.575 oneshot 00:04:33.575 tick 100 00:04:33.575 tick 100 00:04:33.575 tick 250 00:04:33.575 tick 100 00:04:33.575 tick 100 00:04:33.575 tick 100 00:04:33.575 tick 250 00:04:33.575 tick 500 00:04:33.575 tick 100 00:04:33.575 tick 100 00:04:33.575 tick 250 00:04:33.575 tick 100 00:04:33.575 tick 100 00:04:33.575 test_end 00:04:33.575 00:04:33.575 real 0m1.317s 00:04:33.575 user 0m1.223s 00:04:33.575 sys 0m0.088s 00:04:33.575 02:09:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:33.575 02:09:36 -- common/autotest_common.sh@10 -- # set +x 00:04:33.575 ************************************ 00:04:33.575 END TEST event_reactor 00:04:33.575 ************************************ 00:04:33.575 02:09:36 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:33.575 02:09:36 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:33.575 02:09:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:33.575 02:09:36 -- common/autotest_common.sh@10 -- # set +x 00:04:33.575 ************************************ 00:04:33.575 START TEST event_reactor_perf 00:04:33.575 ************************************ 00:04:33.575 02:09:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:33.575 [2024-11-29 02:09:37.000311] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:33.575 [2024-11-29 02:09:37.000408] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4189747 ] 00:04:33.575 EAL: No free 2048 kB hugepages reported on node 1 00:04:33.575 [2024-11-29 02:09:37.061952] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:33.575 [2024-11-29 02:09:37.177988] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:34.947 test_start 00:04:34.947 test_end 00:04:34.947 Performance: 351798 events per second 00:04:34.947 00:04:34.947 real 0m1.316s 00:04:34.947 user 0m1.227s 00:04:34.947 sys 0m0.083s 00:04:34.947 02:09:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:34.947 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:34.947 ************************************ 00:04:34.947 END TEST event_reactor_perf 00:04:34.947 ************************************ 00:04:34.947 02:09:38 -- event/event.sh@49 -- # uname -s 00:04:34.947 02:09:38 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:34.947 02:09:38 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:34.947 02:09:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:34.947 02:09:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:34.947 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:34.947 ************************************ 00:04:34.947 START TEST event_scheduler 00:04:34.947 ************************************ 00:04:34.947 02:09:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:34.947 * Looking for test storage... 00:04:34.947 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:04:34.947 02:09:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:34.947 02:09:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:34.947 02:09:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:34.947 02:09:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:34.947 02:09:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:34.947 02:09:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:34.947 02:09:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:34.948 02:09:38 -- scripts/common.sh@335 -- # IFS=.-: 00:04:34.948 02:09:38 -- scripts/common.sh@335 -- # read -ra ver1 00:04:34.948 02:09:38 -- scripts/common.sh@336 -- # IFS=.-: 00:04:34.948 02:09:38 -- scripts/common.sh@336 -- # read -ra ver2 00:04:34.948 02:09:38 -- scripts/common.sh@337 -- # local 'op=<' 00:04:34.948 02:09:38 -- scripts/common.sh@339 -- # ver1_l=2 00:04:34.948 02:09:38 -- scripts/common.sh@340 -- # ver2_l=1 00:04:34.948 02:09:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:34.948 02:09:38 -- scripts/common.sh@343 -- # case "$op" in 00:04:34.948 02:09:38 -- scripts/common.sh@344 -- # : 1 00:04:34.948 02:09:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:34.948 02:09:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:34.948 02:09:38 -- scripts/common.sh@364 -- # decimal 1 00:04:34.948 02:09:38 -- scripts/common.sh@352 -- # local d=1 00:04:34.948 02:09:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:34.948 02:09:38 -- scripts/common.sh@354 -- # echo 1 00:04:34.948 02:09:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:34.948 02:09:38 -- scripts/common.sh@365 -- # decimal 2 00:04:34.948 02:09:38 -- scripts/common.sh@352 -- # local d=2 00:04:34.948 02:09:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:34.948 02:09:38 -- scripts/common.sh@354 -- # echo 2 00:04:34.948 02:09:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:34.948 02:09:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:34.948 02:09:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:34.948 02:09:38 -- scripts/common.sh@367 -- # return 0 00:04:34.948 02:09:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:34.948 02:09:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:34.948 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.948 --rc genhtml_branch_coverage=1 00:04:34.948 --rc genhtml_function_coverage=1 00:04:34.948 --rc genhtml_legend=1 00:04:34.948 --rc geninfo_all_blocks=1 00:04:34.948 --rc geninfo_unexecuted_blocks=1 00:04:34.948 00:04:34.948 ' 00:04:34.948 02:09:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:34.948 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.948 --rc genhtml_branch_coverage=1 00:04:34.948 --rc genhtml_function_coverage=1 00:04:34.948 --rc genhtml_legend=1 00:04:34.948 --rc geninfo_all_blocks=1 00:04:34.948 --rc geninfo_unexecuted_blocks=1 00:04:34.948 00:04:34.948 ' 00:04:34.948 02:09:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:34.948 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.948 --rc genhtml_branch_coverage=1 00:04:34.948 --rc genhtml_function_coverage=1 00:04:34.948 --rc genhtml_legend=1 00:04:34.948 --rc geninfo_all_blocks=1 00:04:34.948 --rc geninfo_unexecuted_blocks=1 00:04:34.948 00:04:34.948 ' 00:04:34.948 02:09:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:34.948 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.948 --rc genhtml_branch_coverage=1 00:04:34.948 --rc genhtml_function_coverage=1 00:04:34.948 --rc genhtml_legend=1 00:04:34.948 --rc geninfo_all_blocks=1 00:04:34.948 --rc geninfo_unexecuted_blocks=1 00:04:34.948 00:04:34.948 ' 00:04:34.948 02:09:38 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:34.948 02:09:38 -- scheduler/scheduler.sh@35 -- # scheduler_pid=4190044 00:04:34.948 02:09:38 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:34.948 02:09:38 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:34.948 02:09:38 -- scheduler/scheduler.sh@37 -- # waitforlisten 4190044 00:04:34.948 02:09:38 -- common/autotest_common.sh@829 -- # '[' -z 4190044 ']' 00:04:34.948 02:09:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:34.948 02:09:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:34.948 02:09:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:34.948 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:34.948 02:09:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:34.948 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:34.948 [2024-11-29 02:09:38.510125] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:34.948 [2024-11-29 02:09:38.510206] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4190044 ] 00:04:34.948 EAL: No free 2048 kB hugepages reported on node 1 00:04:34.948 [2024-11-29 02:09:38.567204] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:35.205 [2024-11-29 02:09:38.671302] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:35.205 [2024-11-29 02:09:38.671364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:35.205 [2024-11-29 02:09:38.671430] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:35.206 [2024-11-29 02:09:38.671434] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:35.206 02:09:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:35.206 02:09:38 -- common/autotest_common.sh@862 -- # return 0 00:04:35.206 02:09:38 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:35.206 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:35.206 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:35.206 POWER: Env isn't set yet! 00:04:35.206 POWER: Attempting to initialise ACPI cpufreq power management... 00:04:35.206 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:04:35.206 POWER: Cannot get available frequencies of lcore 0 00:04:35.206 POWER: Attempting to initialise PSTAT power management... 00:04:35.206 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:04:35.206 POWER: Initialized successfully for lcore 0 power management 00:04:35.206 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:04:35.206 POWER: Initialized successfully for lcore 1 power management 00:04:35.206 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:04:35.206 POWER: Initialized successfully for lcore 2 power management 00:04:35.206 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:04:35.206 POWER: Initialized successfully for lcore 3 power management 00:04:35.206 [2024-11-29 02:09:38.758604] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:04:35.206 [2024-11-29 02:09:38.758622] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:04:35.206 [2024-11-29 02:09:38.758632] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:04:35.206 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:35.206 02:09:38 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:35.206 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:35.206 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:35.206 [2024-11-29 02:09:38.863877] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:35.206 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:35.206 02:09:38 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:35.206 02:09:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:35.206 02:09:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:35.206 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:35.206 ************************************ 00:04:35.206 START TEST scheduler_create_thread 00:04:35.206 ************************************ 00:04:35.206 02:09:38 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:04:35.206 02:09:38 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:35.206 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:35.206 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:35.206 2 00:04:35.206 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:35.206 02:09:38 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:35.206 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:35.206 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:35.463 3 00:04:35.463 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:35.463 02:09:38 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:35.463 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:35.463 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:35.463 4 00:04:35.463 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:35.463 02:09:38 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:35.463 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:35.463 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:35.463 5 00:04:35.463 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:35.463 02:09:38 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:35.463 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:35.463 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:35.463 6 00:04:35.463 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:35.463 02:09:38 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:35.463 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:35.463 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:35.463 7 00:04:35.463 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:35.463 02:09:38 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:35.463 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:35.463 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:35.463 8 00:04:35.463 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:35.463 02:09:38 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:35.463 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:35.463 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:35.463 9 00:04:35.463 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:35.463 02:09:38 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:35.463 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:35.463 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:35.463 10 00:04:35.463 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:35.463 02:09:38 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:35.463 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:35.463 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:35.463 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:35.463 02:09:38 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:35.463 02:09:38 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:35.463 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:35.463 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:35.463 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:35.463 02:09:38 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:35.463 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:35.463 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:36.027 02:09:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:36.027 02:09:39 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:36.027 02:09:39 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:36.027 02:09:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:36.027 02:09:39 -- common/autotest_common.sh@10 -- # set +x 00:04:36.960 02:09:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:36.960 00:04:36.960 real 0m1.755s 00:04:36.960 user 0m0.010s 00:04:36.960 sys 0m0.003s 00:04:36.960 02:09:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:36.960 02:09:40 -- common/autotest_common.sh@10 -- # set +x 00:04:36.960 ************************************ 00:04:36.960 END TEST scheduler_create_thread 00:04:36.960 ************************************ 00:04:37.217 02:09:40 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:04:37.217 02:09:40 -- scheduler/scheduler.sh@46 -- # killprocess 4190044 00:04:37.217 02:09:40 -- common/autotest_common.sh@936 -- # '[' -z 4190044 ']' 00:04:37.217 02:09:40 -- common/autotest_common.sh@940 -- # kill -0 4190044 00:04:37.217 02:09:40 -- common/autotest_common.sh@941 -- # uname 00:04:37.217 02:09:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:37.217 02:09:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4190044 00:04:37.217 02:09:40 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:04:37.217 02:09:40 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:04:37.217 02:09:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4190044' 00:04:37.217 killing process with pid 4190044 00:04:37.217 02:09:40 -- common/autotest_common.sh@955 -- # kill 4190044 00:04:37.217 02:09:40 -- common/autotest_common.sh@960 -- # wait 4190044 00:04:37.475 [2024-11-29 02:09:41.104125] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:04:37.733 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:37.733 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:04:37.733 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:04:37.733 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:04:37.733 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:04:37.733 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:04:37.733 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:04:37.733 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:04:37.733 00:04:37.734 real 0m3.033s 00:04:37.734 user 0m3.897s 00:04:37.734 sys 0m0.338s 00:04:37.734 02:09:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:37.734 02:09:41 -- common/autotest_common.sh@10 -- # set +x 00:04:37.734 ************************************ 00:04:37.734 END TEST event_scheduler 00:04:37.734 ************************************ 00:04:37.734 02:09:41 -- event/event.sh@51 -- # modprobe -n nbd 00:04:37.734 02:09:41 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:04:37.734 02:09:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:37.734 02:09:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:37.734 02:09:41 -- common/autotest_common.sh@10 -- # set +x 00:04:37.734 ************************************ 00:04:37.734 START TEST app_repeat 00:04:37.734 ************************************ 00:04:37.734 02:09:41 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:04:37.734 02:09:41 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:37.734 02:09:41 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:37.734 02:09:41 -- event/event.sh@13 -- # local nbd_list 00:04:37.734 02:09:41 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:37.734 02:09:41 -- event/event.sh@14 -- # local bdev_list 00:04:37.734 02:09:41 -- event/event.sh@15 -- # local repeat_times=4 00:04:37.734 02:09:41 -- event/event.sh@17 -- # modprobe nbd 00:04:37.734 02:09:41 -- event/event.sh@19 -- # repeat_pid=4190371 00:04:37.734 02:09:41 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:04:37.734 02:09:41 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:04:37.734 02:09:41 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 4190371' 00:04:37.734 Process app_repeat pid: 4190371 00:04:37.734 02:09:41 -- event/event.sh@23 -- # for i in {0..2} 00:04:37.734 02:09:41 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:04:37.734 spdk_app_start Round 0 00:04:37.734 02:09:41 -- event/event.sh@25 -- # waitforlisten 4190371 /var/tmp/spdk-nbd.sock 00:04:37.734 02:09:41 -- common/autotest_common.sh@829 -- # '[' -z 4190371 ']' 00:04:37.734 02:09:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:37.734 02:09:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:37.734 02:09:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:37.734 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:37.734 02:09:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:37.734 02:09:41 -- common/autotest_common.sh@10 -- # set +x 00:04:37.993 [2024-11-29 02:09:41.424567] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:37.993 [2024-11-29 02:09:41.424639] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4190371 ] 00:04:37.993 EAL: No free 2048 kB hugepages reported on node 1 00:04:37.993 [2024-11-29 02:09:41.489027] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:37.993 [2024-11-29 02:09:41.605846] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:37.993 [2024-11-29 02:09:41.605852] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:38.927 02:09:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:38.927 02:09:42 -- common/autotest_common.sh@862 -- # return 0 00:04:38.927 02:09:42 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:39.185 Malloc0 00:04:39.185 02:09:42 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:39.444 Malloc1 00:04:39.444 02:09:42 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:39.444 02:09:42 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:39.444 02:09:42 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:39.444 02:09:42 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:39.444 02:09:42 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:39.444 02:09:42 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:39.444 02:09:42 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:39.444 02:09:42 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:39.444 02:09:42 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:39.444 02:09:42 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:39.444 02:09:42 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:39.444 02:09:42 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:39.444 02:09:42 -- bdev/nbd_common.sh@12 -- # local i 00:04:39.444 02:09:42 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:39.444 02:09:42 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:39.444 02:09:42 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:39.702 /dev/nbd0 00:04:39.702 02:09:43 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:39.702 02:09:43 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:39.702 02:09:43 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:39.702 02:09:43 -- common/autotest_common.sh@867 -- # local i 00:04:39.702 02:09:43 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:39.702 02:09:43 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:39.702 02:09:43 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:39.702 02:09:43 -- common/autotest_common.sh@871 -- # break 00:04:39.702 02:09:43 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:39.702 02:09:43 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:39.702 02:09:43 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:39.702 1+0 records in 00:04:39.702 1+0 records out 00:04:39.702 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000237149 s, 17.3 MB/s 00:04:39.702 02:09:43 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:39.702 02:09:43 -- common/autotest_common.sh@884 -- # size=4096 00:04:39.702 02:09:43 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:39.702 02:09:43 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:39.702 02:09:43 -- common/autotest_common.sh@887 -- # return 0 00:04:39.702 02:09:43 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:39.702 02:09:43 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:39.702 02:09:43 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:39.960 /dev/nbd1 00:04:39.960 02:09:43 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:39.960 02:09:43 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:39.960 02:09:43 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:39.960 02:09:43 -- common/autotest_common.sh@867 -- # local i 00:04:39.960 02:09:43 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:39.960 02:09:43 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:39.960 02:09:43 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:39.961 02:09:43 -- common/autotest_common.sh@871 -- # break 00:04:39.961 02:09:43 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:39.961 02:09:43 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:39.961 02:09:43 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:39.961 1+0 records in 00:04:39.961 1+0 records out 00:04:39.961 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000195416 s, 21.0 MB/s 00:04:39.961 02:09:43 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:39.961 02:09:43 -- common/autotest_common.sh@884 -- # size=4096 00:04:39.961 02:09:43 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:39.961 02:09:43 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:39.961 02:09:43 -- common/autotest_common.sh@887 -- # return 0 00:04:39.961 02:09:43 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:39.961 02:09:43 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:39.961 02:09:43 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:39.961 02:09:43 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:39.961 02:09:43 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:40.219 02:09:43 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:40.219 { 00:04:40.219 "nbd_device": "/dev/nbd0", 00:04:40.219 "bdev_name": "Malloc0" 00:04:40.219 }, 00:04:40.219 { 00:04:40.219 "nbd_device": "/dev/nbd1", 00:04:40.219 "bdev_name": "Malloc1" 00:04:40.219 } 00:04:40.219 ]' 00:04:40.219 02:09:43 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:40.219 { 00:04:40.219 "nbd_device": "/dev/nbd0", 00:04:40.219 "bdev_name": "Malloc0" 00:04:40.219 }, 00:04:40.219 { 00:04:40.219 "nbd_device": "/dev/nbd1", 00:04:40.219 "bdev_name": "Malloc1" 00:04:40.219 } 00:04:40.219 ]' 00:04:40.219 02:09:43 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:40.219 02:09:43 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:40.219 /dev/nbd1' 00:04:40.219 02:09:43 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:40.219 /dev/nbd1' 00:04:40.219 02:09:43 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:40.219 02:09:43 -- bdev/nbd_common.sh@65 -- # count=2 00:04:40.219 02:09:43 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:40.219 02:09:43 -- bdev/nbd_common.sh@95 -- # count=2 00:04:40.219 02:09:43 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:40.219 02:09:43 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:40.219 02:09:43 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:40.219 02:09:43 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:40.219 02:09:43 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:40.219 02:09:43 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:40.219 02:09:43 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:40.219 02:09:43 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:40.219 256+0 records in 00:04:40.219 256+0 records out 00:04:40.219 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00507971 s, 206 MB/s 00:04:40.219 02:09:43 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:40.219 02:09:43 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:40.219 256+0 records in 00:04:40.219 256+0 records out 00:04:40.219 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022518 s, 46.6 MB/s 00:04:40.220 02:09:43 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:40.220 02:09:43 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:40.220 256+0 records in 00:04:40.220 256+0 records out 00:04:40.220 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244171 s, 42.9 MB/s 00:04:40.220 02:09:43 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:40.220 02:09:43 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:40.220 02:09:43 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:40.220 02:09:43 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:40.220 02:09:43 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:40.220 02:09:43 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:40.220 02:09:43 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:40.220 02:09:43 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:40.220 02:09:43 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:40.220 02:09:43 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:40.220 02:09:43 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:40.220 02:09:43 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:40.220 02:09:43 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:40.220 02:09:43 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:40.220 02:09:43 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:40.220 02:09:43 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:40.220 02:09:43 -- bdev/nbd_common.sh@51 -- # local i 00:04:40.220 02:09:43 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:40.220 02:09:43 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:40.479 02:09:44 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:40.479 02:09:44 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:40.479 02:09:44 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:40.479 02:09:44 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:40.479 02:09:44 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:40.479 02:09:44 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:40.737 02:09:44 -- bdev/nbd_common.sh@41 -- # break 00:04:40.737 02:09:44 -- bdev/nbd_common.sh@45 -- # return 0 00:04:40.737 02:09:44 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:40.737 02:09:44 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:40.995 02:09:44 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:40.995 02:09:44 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:40.995 02:09:44 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:40.995 02:09:44 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:40.995 02:09:44 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:40.995 02:09:44 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:40.995 02:09:44 -- bdev/nbd_common.sh@41 -- # break 00:04:40.995 02:09:44 -- bdev/nbd_common.sh@45 -- # return 0 00:04:40.995 02:09:44 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:40.995 02:09:44 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:40.995 02:09:44 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:40.995 02:09:44 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:41.253 02:09:44 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:41.253 02:09:44 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:41.253 02:09:44 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:41.253 02:09:44 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:41.253 02:09:44 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:41.253 02:09:44 -- bdev/nbd_common.sh@65 -- # true 00:04:41.253 02:09:44 -- bdev/nbd_common.sh@65 -- # count=0 00:04:41.253 02:09:44 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:41.253 02:09:44 -- bdev/nbd_common.sh@104 -- # count=0 00:04:41.253 02:09:44 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:41.253 02:09:44 -- bdev/nbd_common.sh@109 -- # return 0 00:04:41.253 02:09:44 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:41.517 02:09:45 -- event/event.sh@35 -- # sleep 3 00:04:41.776 [2024-11-29 02:09:45.280364] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:41.776 [2024-11-29 02:09:45.393279] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:41.776 [2024-11-29 02:09:45.393280] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:41.776 [2024-11-29 02:09:45.455007] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:41.776 [2024-11-29 02:09:45.455093] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:45.056 02:09:48 -- event/event.sh@23 -- # for i in {0..2} 00:04:45.056 02:09:48 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:04:45.056 spdk_app_start Round 1 00:04:45.056 02:09:48 -- event/event.sh@25 -- # waitforlisten 4190371 /var/tmp/spdk-nbd.sock 00:04:45.056 02:09:48 -- common/autotest_common.sh@829 -- # '[' -z 4190371 ']' 00:04:45.056 02:09:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:45.056 02:09:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:45.056 02:09:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:45.056 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:45.056 02:09:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:45.056 02:09:48 -- common/autotest_common.sh@10 -- # set +x 00:04:45.056 02:09:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:45.056 02:09:48 -- common/autotest_common.sh@862 -- # return 0 00:04:45.056 02:09:48 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:45.056 Malloc0 00:04:45.056 02:09:48 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:45.314 Malloc1 00:04:45.314 02:09:48 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:45.314 02:09:48 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:45.314 02:09:48 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:45.314 02:09:48 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:45.314 02:09:48 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:45.314 02:09:48 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:45.314 02:09:48 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:45.314 02:09:48 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:45.314 02:09:48 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:45.314 02:09:48 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:45.314 02:09:48 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:45.314 02:09:48 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:45.314 02:09:48 -- bdev/nbd_common.sh@12 -- # local i 00:04:45.314 02:09:48 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:45.314 02:09:48 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:45.314 02:09:48 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:45.573 /dev/nbd0 00:04:45.573 02:09:49 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:45.573 02:09:49 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:45.573 02:09:49 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:45.573 02:09:49 -- common/autotest_common.sh@867 -- # local i 00:04:45.573 02:09:49 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:45.573 02:09:49 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:45.573 02:09:49 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:45.573 02:09:49 -- common/autotest_common.sh@871 -- # break 00:04:45.573 02:09:49 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:45.573 02:09:49 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:45.573 02:09:49 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:45.573 1+0 records in 00:04:45.573 1+0 records out 00:04:45.573 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000182708 s, 22.4 MB/s 00:04:45.573 02:09:49 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:45.573 02:09:49 -- common/autotest_common.sh@884 -- # size=4096 00:04:45.573 02:09:49 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:45.573 02:09:49 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:45.573 02:09:49 -- common/autotest_common.sh@887 -- # return 0 00:04:45.573 02:09:49 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:45.573 02:09:49 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:45.573 02:09:49 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:45.831 /dev/nbd1 00:04:45.831 02:09:49 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:45.831 02:09:49 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:45.831 02:09:49 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:45.831 02:09:49 -- common/autotest_common.sh@867 -- # local i 00:04:45.831 02:09:49 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:45.831 02:09:49 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:45.831 02:09:49 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:45.831 02:09:49 -- common/autotest_common.sh@871 -- # break 00:04:45.831 02:09:49 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:45.831 02:09:49 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:45.831 02:09:49 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:45.831 1+0 records in 00:04:45.831 1+0 records out 00:04:45.831 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000183255 s, 22.4 MB/s 00:04:45.831 02:09:49 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:45.831 02:09:49 -- common/autotest_common.sh@884 -- # size=4096 00:04:45.831 02:09:49 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:45.831 02:09:49 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:45.831 02:09:49 -- common/autotest_common.sh@887 -- # return 0 00:04:45.831 02:09:49 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:45.831 02:09:49 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:45.831 02:09:49 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:45.831 02:09:49 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:45.831 02:09:49 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:46.089 02:09:49 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:46.089 { 00:04:46.089 "nbd_device": "/dev/nbd0", 00:04:46.090 "bdev_name": "Malloc0" 00:04:46.090 }, 00:04:46.090 { 00:04:46.090 "nbd_device": "/dev/nbd1", 00:04:46.090 "bdev_name": "Malloc1" 00:04:46.090 } 00:04:46.090 ]' 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:46.090 { 00:04:46.090 "nbd_device": "/dev/nbd0", 00:04:46.090 "bdev_name": "Malloc0" 00:04:46.090 }, 00:04:46.090 { 00:04:46.090 "nbd_device": "/dev/nbd1", 00:04:46.090 "bdev_name": "Malloc1" 00:04:46.090 } 00:04:46.090 ]' 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:46.090 /dev/nbd1' 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:46.090 /dev/nbd1' 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@65 -- # count=2 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@95 -- # count=2 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:46.090 256+0 records in 00:04:46.090 256+0 records out 00:04:46.090 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00503813 s, 208 MB/s 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:46.090 256+0 records in 00:04:46.090 256+0 records out 00:04:46.090 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229929 s, 45.6 MB/s 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:46.090 256+0 records in 00:04:46.090 256+0 records out 00:04:46.090 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219517 s, 47.8 MB/s 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@51 -- # local i 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:46.090 02:09:49 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:46.348 02:09:49 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:46.348 02:09:49 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:46.348 02:09:49 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:46.348 02:09:49 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:46.348 02:09:49 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:46.348 02:09:49 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:46.348 02:09:49 -- bdev/nbd_common.sh@41 -- # break 00:04:46.348 02:09:49 -- bdev/nbd_common.sh@45 -- # return 0 00:04:46.348 02:09:49 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:46.348 02:09:49 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:46.608 02:09:50 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:46.608 02:09:50 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:46.608 02:09:50 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:46.608 02:09:50 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:46.608 02:09:50 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:46.608 02:09:50 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:46.608 02:09:50 -- bdev/nbd_common.sh@41 -- # break 00:04:46.608 02:09:50 -- bdev/nbd_common.sh@45 -- # return 0 00:04:46.608 02:09:50 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:46.608 02:09:50 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:46.608 02:09:50 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:46.867 02:09:50 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:46.867 02:09:50 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:46.867 02:09:50 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:47.125 02:09:50 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:47.125 02:09:50 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:47.125 02:09:50 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:47.125 02:09:50 -- bdev/nbd_common.sh@65 -- # true 00:04:47.125 02:09:50 -- bdev/nbd_common.sh@65 -- # count=0 00:04:47.125 02:09:50 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:47.125 02:09:50 -- bdev/nbd_common.sh@104 -- # count=0 00:04:47.125 02:09:50 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:47.125 02:09:50 -- bdev/nbd_common.sh@109 -- # return 0 00:04:47.125 02:09:50 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:47.384 02:09:50 -- event/event.sh@35 -- # sleep 3 00:04:47.643 [2024-11-29 02:09:51.152480] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:47.643 [2024-11-29 02:09:51.265283] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:47.643 [2024-11-29 02:09:51.265287] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:47.927 [2024-11-29 02:09:51.327504] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:47.927 [2024-11-29 02:09:51.327568] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:50.453 02:09:53 -- event/event.sh@23 -- # for i in {0..2} 00:04:50.453 02:09:53 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:04:50.453 spdk_app_start Round 2 00:04:50.453 02:09:53 -- event/event.sh@25 -- # waitforlisten 4190371 /var/tmp/spdk-nbd.sock 00:04:50.453 02:09:53 -- common/autotest_common.sh@829 -- # '[' -z 4190371 ']' 00:04:50.453 02:09:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:50.453 02:09:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:50.454 02:09:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:50.454 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:50.454 02:09:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:50.454 02:09:53 -- common/autotest_common.sh@10 -- # set +x 00:04:50.454 02:09:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:50.454 02:09:54 -- common/autotest_common.sh@862 -- # return 0 00:04:50.454 02:09:54 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:50.713 Malloc0 00:04:50.713 02:09:54 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:50.972 Malloc1 00:04:50.972 02:09:54 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:50.972 02:09:54 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:50.972 02:09:54 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:50.972 02:09:54 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:50.972 02:09:54 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:50.972 02:09:54 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:50.972 02:09:54 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:50.972 02:09:54 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:50.972 02:09:54 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:50.972 02:09:54 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:50.972 02:09:54 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:50.972 02:09:54 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:50.972 02:09:54 -- bdev/nbd_common.sh@12 -- # local i 00:04:51.230 02:09:54 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:51.230 02:09:54 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:51.230 02:09:54 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:51.230 /dev/nbd0 00:04:51.230 02:09:54 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:51.230 02:09:54 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:51.230 02:09:54 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:51.230 02:09:54 -- common/autotest_common.sh@867 -- # local i 00:04:51.230 02:09:54 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:51.230 02:09:54 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:51.230 02:09:54 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:51.230 02:09:54 -- common/autotest_common.sh@871 -- # break 00:04:51.230 02:09:54 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:51.230 02:09:54 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:51.230 02:09:54 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:51.488 1+0 records in 00:04:51.488 1+0 records out 00:04:51.488 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000182108 s, 22.5 MB/s 00:04:51.488 02:09:54 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:51.488 02:09:54 -- common/autotest_common.sh@884 -- # size=4096 00:04:51.488 02:09:54 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:51.488 02:09:54 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:51.488 02:09:54 -- common/autotest_common.sh@887 -- # return 0 00:04:51.488 02:09:54 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:51.488 02:09:54 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:51.488 02:09:54 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:51.745 /dev/nbd1 00:04:51.745 02:09:55 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:51.745 02:09:55 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:51.745 02:09:55 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:51.745 02:09:55 -- common/autotest_common.sh@867 -- # local i 00:04:51.745 02:09:55 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:51.745 02:09:55 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:51.745 02:09:55 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:51.745 02:09:55 -- common/autotest_common.sh@871 -- # break 00:04:51.745 02:09:55 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:51.745 02:09:55 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:51.745 02:09:55 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:51.745 1+0 records in 00:04:51.745 1+0 records out 00:04:51.745 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000193024 s, 21.2 MB/s 00:04:51.745 02:09:55 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:51.745 02:09:55 -- common/autotest_common.sh@884 -- # size=4096 00:04:51.745 02:09:55 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:51.745 02:09:55 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:51.745 02:09:55 -- common/autotest_common.sh@887 -- # return 0 00:04:51.745 02:09:55 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:51.745 02:09:55 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:51.745 02:09:55 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:51.745 02:09:55 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:51.745 02:09:55 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:52.003 { 00:04:52.003 "nbd_device": "/dev/nbd0", 00:04:52.003 "bdev_name": "Malloc0" 00:04:52.003 }, 00:04:52.003 { 00:04:52.003 "nbd_device": "/dev/nbd1", 00:04:52.003 "bdev_name": "Malloc1" 00:04:52.003 } 00:04:52.003 ]' 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:52.003 { 00:04:52.003 "nbd_device": "/dev/nbd0", 00:04:52.003 "bdev_name": "Malloc0" 00:04:52.003 }, 00:04:52.003 { 00:04:52.003 "nbd_device": "/dev/nbd1", 00:04:52.003 "bdev_name": "Malloc1" 00:04:52.003 } 00:04:52.003 ]' 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:52.003 /dev/nbd1' 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:52.003 /dev/nbd1' 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@65 -- # count=2 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@95 -- # count=2 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:52.003 256+0 records in 00:04:52.003 256+0 records out 00:04:52.003 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00527908 s, 199 MB/s 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:52.003 256+0 records in 00:04:52.003 256+0 records out 00:04:52.003 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201652 s, 52.0 MB/s 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:52.003 256+0 records in 00:04:52.003 256+0 records out 00:04:52.003 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243313 s, 43.1 MB/s 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@51 -- # local i 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:52.003 02:09:55 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:52.260 02:09:55 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:52.260 02:09:55 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:52.260 02:09:55 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:52.260 02:09:55 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:52.260 02:09:55 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:52.260 02:09:55 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:52.260 02:09:55 -- bdev/nbd_common.sh@41 -- # break 00:04:52.260 02:09:55 -- bdev/nbd_common.sh@45 -- # return 0 00:04:52.260 02:09:55 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:52.260 02:09:55 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:52.518 02:09:56 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:52.518 02:09:56 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:52.518 02:09:56 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:52.518 02:09:56 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:52.518 02:09:56 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:52.518 02:09:56 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:52.518 02:09:56 -- bdev/nbd_common.sh@41 -- # break 00:04:52.518 02:09:56 -- bdev/nbd_common.sh@45 -- # return 0 00:04:52.518 02:09:56 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:52.518 02:09:56 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:52.518 02:09:56 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:52.777 02:09:56 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:52.777 02:09:56 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:52.777 02:09:56 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:52.777 02:09:56 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:52.777 02:09:56 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:52.777 02:09:56 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:52.777 02:09:56 -- bdev/nbd_common.sh@65 -- # true 00:04:52.777 02:09:56 -- bdev/nbd_common.sh@65 -- # count=0 00:04:52.777 02:09:56 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:52.777 02:09:56 -- bdev/nbd_common.sh@104 -- # count=0 00:04:52.777 02:09:56 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:52.777 02:09:56 -- bdev/nbd_common.sh@109 -- # return 0 00:04:52.777 02:09:56 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:53.036 02:09:56 -- event/event.sh@35 -- # sleep 3 00:04:53.602 [2024-11-29 02:09:56.980923] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:53.602 [2024-11-29 02:09:57.094150] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:53.602 [2024-11-29 02:09:57.094154] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:53.602 [2024-11-29 02:09:57.154292] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:53.602 [2024-11-29 02:09:57.154341] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:56.129 02:09:59 -- event/event.sh@38 -- # waitforlisten 4190371 /var/tmp/spdk-nbd.sock 00:04:56.129 02:09:59 -- common/autotest_common.sh@829 -- # '[' -z 4190371 ']' 00:04:56.129 02:09:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:56.129 02:09:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:56.129 02:09:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:56.129 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:56.129 02:09:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:56.129 02:09:59 -- common/autotest_common.sh@10 -- # set +x 00:04:56.387 02:09:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:56.387 02:09:59 -- common/autotest_common.sh@862 -- # return 0 00:04:56.387 02:09:59 -- event/event.sh@39 -- # killprocess 4190371 00:04:56.387 02:09:59 -- common/autotest_common.sh@936 -- # '[' -z 4190371 ']' 00:04:56.387 02:09:59 -- common/autotest_common.sh@940 -- # kill -0 4190371 00:04:56.387 02:09:59 -- common/autotest_common.sh@941 -- # uname 00:04:56.387 02:09:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:56.387 02:09:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4190371 00:04:56.387 02:09:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:56.387 02:09:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:56.387 02:09:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4190371' 00:04:56.387 killing process with pid 4190371 00:04:56.387 02:09:59 -- common/autotest_common.sh@955 -- # kill 4190371 00:04:56.387 02:09:59 -- common/autotest_common.sh@960 -- # wait 4190371 00:04:56.646 spdk_app_start is called in Round 0. 00:04:56.646 Shutdown signal received, stop current app iteration 00:04:56.646 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:04:56.646 spdk_app_start is called in Round 1. 00:04:56.646 Shutdown signal received, stop current app iteration 00:04:56.646 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:04:56.646 spdk_app_start is called in Round 2. 00:04:56.646 Shutdown signal received, stop current app iteration 00:04:56.646 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:04:56.646 spdk_app_start is called in Round 3. 00:04:56.646 Shutdown signal received, stop current app iteration 00:04:56.646 02:10:00 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:04:56.646 02:10:00 -- event/event.sh@42 -- # return 0 00:04:56.646 00:04:56.646 real 0m18.842s 00:04:56.646 user 0m41.097s 00:04:56.646 sys 0m3.053s 00:04:56.646 02:10:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:56.646 02:10:00 -- common/autotest_common.sh@10 -- # set +x 00:04:56.646 ************************************ 00:04:56.646 END TEST app_repeat 00:04:56.646 ************************************ 00:04:56.646 02:10:00 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:04:56.646 02:10:00 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:04:56.646 02:10:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:56.646 02:10:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:56.646 02:10:00 -- common/autotest_common.sh@10 -- # set +x 00:04:56.646 ************************************ 00:04:56.646 START TEST cpu_locks 00:04:56.646 ************************************ 00:04:56.646 02:10:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:04:56.646 * Looking for test storage... 00:04:56.646 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:56.646 02:10:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:56.646 02:10:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:56.646 02:10:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:56.905 02:10:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:56.905 02:10:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:56.905 02:10:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:56.905 02:10:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:56.905 02:10:00 -- scripts/common.sh@335 -- # IFS=.-: 00:04:56.905 02:10:00 -- scripts/common.sh@335 -- # read -ra ver1 00:04:56.905 02:10:00 -- scripts/common.sh@336 -- # IFS=.-: 00:04:56.905 02:10:00 -- scripts/common.sh@336 -- # read -ra ver2 00:04:56.905 02:10:00 -- scripts/common.sh@337 -- # local 'op=<' 00:04:56.905 02:10:00 -- scripts/common.sh@339 -- # ver1_l=2 00:04:56.905 02:10:00 -- scripts/common.sh@340 -- # ver2_l=1 00:04:56.905 02:10:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:56.905 02:10:00 -- scripts/common.sh@343 -- # case "$op" in 00:04:56.905 02:10:00 -- scripts/common.sh@344 -- # : 1 00:04:56.905 02:10:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:56.905 02:10:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:56.905 02:10:00 -- scripts/common.sh@364 -- # decimal 1 00:04:56.905 02:10:00 -- scripts/common.sh@352 -- # local d=1 00:04:56.905 02:10:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:56.905 02:10:00 -- scripts/common.sh@354 -- # echo 1 00:04:56.905 02:10:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:56.905 02:10:00 -- scripts/common.sh@365 -- # decimal 2 00:04:56.905 02:10:00 -- scripts/common.sh@352 -- # local d=2 00:04:56.905 02:10:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:56.905 02:10:00 -- scripts/common.sh@354 -- # echo 2 00:04:56.905 02:10:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:56.905 02:10:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:56.905 02:10:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:56.905 02:10:00 -- scripts/common.sh@367 -- # return 0 00:04:56.905 02:10:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:56.905 02:10:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:56.905 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:56.905 --rc genhtml_branch_coverage=1 00:04:56.905 --rc genhtml_function_coverage=1 00:04:56.905 --rc genhtml_legend=1 00:04:56.906 --rc geninfo_all_blocks=1 00:04:56.906 --rc geninfo_unexecuted_blocks=1 00:04:56.906 00:04:56.906 ' 00:04:56.906 02:10:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:56.906 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:56.906 --rc genhtml_branch_coverage=1 00:04:56.906 --rc genhtml_function_coverage=1 00:04:56.906 --rc genhtml_legend=1 00:04:56.906 --rc geninfo_all_blocks=1 00:04:56.906 --rc geninfo_unexecuted_blocks=1 00:04:56.906 00:04:56.906 ' 00:04:56.906 02:10:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:56.906 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:56.906 --rc genhtml_branch_coverage=1 00:04:56.906 --rc genhtml_function_coverage=1 00:04:56.906 --rc genhtml_legend=1 00:04:56.906 --rc geninfo_all_blocks=1 00:04:56.906 --rc geninfo_unexecuted_blocks=1 00:04:56.906 00:04:56.906 ' 00:04:56.906 02:10:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:56.906 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:56.906 --rc genhtml_branch_coverage=1 00:04:56.906 --rc genhtml_function_coverage=1 00:04:56.906 --rc genhtml_legend=1 00:04:56.906 --rc geninfo_all_blocks=1 00:04:56.906 --rc geninfo_unexecuted_blocks=1 00:04:56.906 00:04:56.906 ' 00:04:56.906 02:10:00 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:04:56.906 02:10:00 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:04:56.906 02:10:00 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:04:56.906 02:10:00 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:04:56.906 02:10:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:56.906 02:10:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:56.906 02:10:00 -- common/autotest_common.sh@10 -- # set +x 00:04:56.906 ************************************ 00:04:56.906 START TEST default_locks 00:04:56.906 ************************************ 00:04:56.906 02:10:00 -- common/autotest_common.sh@1114 -- # default_locks 00:04:56.906 02:10:00 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=4192925 00:04:56.906 02:10:00 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:56.906 02:10:00 -- event/cpu_locks.sh@47 -- # waitforlisten 4192925 00:04:56.906 02:10:00 -- common/autotest_common.sh@829 -- # '[' -z 4192925 ']' 00:04:56.906 02:10:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:56.906 02:10:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:56.906 02:10:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:56.906 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:56.906 02:10:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:56.906 02:10:00 -- common/autotest_common.sh@10 -- # set +x 00:04:56.906 [2024-11-29 02:10:00.459660] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:56.906 [2024-11-29 02:10:00.459747] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4192925 ] 00:04:56.906 EAL: No free 2048 kB hugepages reported on node 1 00:04:56.906 [2024-11-29 02:10:00.517320] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:57.164 [2024-11-29 02:10:00.637813] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:57.164 [2024-11-29 02:10:00.637995] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:58.098 02:10:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:58.098 02:10:01 -- common/autotest_common.sh@862 -- # return 0 00:04:58.098 02:10:01 -- event/cpu_locks.sh@49 -- # locks_exist 4192925 00:04:58.098 02:10:01 -- event/cpu_locks.sh@22 -- # lslocks -p 4192925 00:04:58.098 02:10:01 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:58.098 lslocks: write error 00:04:58.098 02:10:01 -- event/cpu_locks.sh@50 -- # killprocess 4192925 00:04:58.098 02:10:01 -- common/autotest_common.sh@936 -- # '[' -z 4192925 ']' 00:04:58.098 02:10:01 -- common/autotest_common.sh@940 -- # kill -0 4192925 00:04:58.098 02:10:01 -- common/autotest_common.sh@941 -- # uname 00:04:58.098 02:10:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:58.099 02:10:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4192925 00:04:58.357 02:10:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:58.357 02:10:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:58.357 02:10:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4192925' 00:04:58.357 killing process with pid 4192925 00:04:58.357 02:10:01 -- common/autotest_common.sh@955 -- # kill 4192925 00:04:58.357 02:10:01 -- common/autotest_common.sh@960 -- # wait 4192925 00:04:58.673 02:10:02 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 4192925 00:04:58.673 02:10:02 -- common/autotest_common.sh@650 -- # local es=0 00:04:58.673 02:10:02 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 4192925 00:04:58.673 02:10:02 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:04:58.673 02:10:02 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:58.673 02:10:02 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:04:58.673 02:10:02 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:58.673 02:10:02 -- common/autotest_common.sh@653 -- # waitforlisten 4192925 00:04:58.673 02:10:02 -- common/autotest_common.sh@829 -- # '[' -z 4192925 ']' 00:04:58.673 02:10:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:58.673 02:10:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:58.673 02:10:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:58.673 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:58.673 02:10:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:58.673 02:10:02 -- common/autotest_common.sh@10 -- # set +x 00:04:58.673 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (4192925) - No such process 00:04:58.673 ERROR: process (pid: 4192925) is no longer running 00:04:58.673 02:10:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:58.673 02:10:02 -- common/autotest_common.sh@862 -- # return 1 00:04:58.673 02:10:02 -- common/autotest_common.sh@653 -- # es=1 00:04:58.673 02:10:02 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:58.673 02:10:02 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:58.673 02:10:02 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:58.673 02:10:02 -- event/cpu_locks.sh@54 -- # no_locks 00:04:58.673 02:10:02 -- event/cpu_locks.sh@26 -- # lock_files=() 00:04:58.673 02:10:02 -- event/cpu_locks.sh@26 -- # local lock_files 00:04:58.673 02:10:02 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:04:58.673 00:04:58.673 real 0m1.852s 00:04:58.673 user 0m2.011s 00:04:58.673 sys 0m0.557s 00:04:58.673 02:10:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:58.673 02:10:02 -- common/autotest_common.sh@10 -- # set +x 00:04:58.673 ************************************ 00:04:58.673 END TEST default_locks 00:04:58.673 ************************************ 00:04:58.673 02:10:02 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:04:58.673 02:10:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:58.673 02:10:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:58.673 02:10:02 -- common/autotest_common.sh@10 -- # set +x 00:04:58.673 ************************************ 00:04:58.673 START TEST default_locks_via_rpc 00:04:58.673 ************************************ 00:04:58.673 02:10:02 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:04:58.673 02:10:02 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=4193225 00:04:58.673 02:10:02 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:58.673 02:10:02 -- event/cpu_locks.sh@63 -- # waitforlisten 4193225 00:04:58.673 02:10:02 -- common/autotest_common.sh@829 -- # '[' -z 4193225 ']' 00:04:58.673 02:10:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:58.673 02:10:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:58.673 02:10:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:58.673 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:58.673 02:10:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:58.673 02:10:02 -- common/autotest_common.sh@10 -- # set +x 00:04:58.954 [2024-11-29 02:10:02.340702] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:58.954 [2024-11-29 02:10:02.340783] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4193225 ] 00:04:58.954 EAL: No free 2048 kB hugepages reported on node 1 00:04:58.954 [2024-11-29 02:10:02.397829] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:58.954 [2024-11-29 02:10:02.506117] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:58.954 [2024-11-29 02:10:02.506303] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:59.888 02:10:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:59.888 02:10:03 -- common/autotest_common.sh@862 -- # return 0 00:04:59.888 02:10:03 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:04:59.888 02:10:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:59.888 02:10:03 -- common/autotest_common.sh@10 -- # set +x 00:04:59.888 02:10:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:59.888 02:10:03 -- event/cpu_locks.sh@67 -- # no_locks 00:04:59.888 02:10:03 -- event/cpu_locks.sh@26 -- # lock_files=() 00:04:59.888 02:10:03 -- event/cpu_locks.sh@26 -- # local lock_files 00:04:59.888 02:10:03 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:04:59.888 02:10:03 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:04:59.888 02:10:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:59.888 02:10:03 -- common/autotest_common.sh@10 -- # set +x 00:04:59.888 02:10:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:59.888 02:10:03 -- event/cpu_locks.sh@71 -- # locks_exist 4193225 00:04:59.888 02:10:03 -- event/cpu_locks.sh@22 -- # lslocks -p 4193225 00:04:59.888 02:10:03 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:00.146 02:10:03 -- event/cpu_locks.sh@73 -- # killprocess 4193225 00:05:00.146 02:10:03 -- common/autotest_common.sh@936 -- # '[' -z 4193225 ']' 00:05:00.146 02:10:03 -- common/autotest_common.sh@940 -- # kill -0 4193225 00:05:00.146 02:10:03 -- common/autotest_common.sh@941 -- # uname 00:05:00.146 02:10:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:00.146 02:10:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4193225 00:05:00.146 02:10:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:00.146 02:10:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:00.146 02:10:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4193225' 00:05:00.146 killing process with pid 4193225 00:05:00.147 02:10:03 -- common/autotest_common.sh@955 -- # kill 4193225 00:05:00.147 02:10:03 -- common/autotest_common.sh@960 -- # wait 4193225 00:05:00.405 00:05:00.406 real 0m1.780s 00:05:00.406 user 0m1.913s 00:05:00.406 sys 0m0.570s 00:05:00.406 02:10:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:00.406 02:10:04 -- common/autotest_common.sh@10 -- # set +x 00:05:00.406 ************************************ 00:05:00.406 END TEST default_locks_via_rpc 00:05:00.406 ************************************ 00:05:00.665 02:10:04 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:05:00.665 02:10:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:00.665 02:10:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:00.665 02:10:04 -- common/autotest_common.sh@10 -- # set +x 00:05:00.665 ************************************ 00:05:00.665 START TEST non_locking_app_on_locked_coremask 00:05:00.665 ************************************ 00:05:00.665 02:10:04 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:05:00.665 02:10:04 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=4193518 00:05:00.665 02:10:04 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:00.665 02:10:04 -- event/cpu_locks.sh@81 -- # waitforlisten 4193518 /var/tmp/spdk.sock 00:05:00.665 02:10:04 -- common/autotest_common.sh@829 -- # '[' -z 4193518 ']' 00:05:00.665 02:10:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:00.665 02:10:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:00.665 02:10:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:00.665 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:00.665 02:10:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:00.665 02:10:04 -- common/autotest_common.sh@10 -- # set +x 00:05:00.665 [2024-11-29 02:10:04.152997] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:00.665 [2024-11-29 02:10:04.153097] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4193518 ] 00:05:00.665 EAL: No free 2048 kB hugepages reported on node 1 00:05:00.665 [2024-11-29 02:10:04.210068] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:00.665 [2024-11-29 02:10:04.319415] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:00.665 [2024-11-29 02:10:04.319612] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:01.600 02:10:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:01.600 02:10:05 -- common/autotest_common.sh@862 -- # return 0 00:05:01.600 02:10:05 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=4193658 00:05:01.600 02:10:05 -- event/cpu_locks.sh@85 -- # waitforlisten 4193658 /var/tmp/spdk2.sock 00:05:01.600 02:10:05 -- common/autotest_common.sh@829 -- # '[' -z 4193658 ']' 00:05:01.600 02:10:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:01.600 02:10:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:01.600 02:10:05 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:05:01.600 02:10:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:01.600 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:01.600 02:10:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:01.600 02:10:05 -- common/autotest_common.sh@10 -- # set +x 00:05:01.600 [2024-11-29 02:10:05.208600] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:01.600 [2024-11-29 02:10:05.208675] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4193658 ] 00:05:01.600 EAL: No free 2048 kB hugepages reported on node 1 00:05:01.858 [2024-11-29 02:10:05.296198] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:01.858 [2024-11-29 02:10:05.296243] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:01.858 [2024-11-29 02:10:05.521664] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:01.858 [2024-11-29 02:10:05.521865] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:02.792 02:10:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:02.792 02:10:06 -- common/autotest_common.sh@862 -- # return 0 00:05:02.792 02:10:06 -- event/cpu_locks.sh@87 -- # locks_exist 4193518 00:05:02.792 02:10:06 -- event/cpu_locks.sh@22 -- # lslocks -p 4193518 00:05:02.792 02:10:06 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:03.050 lslocks: write error 00:05:03.050 02:10:06 -- event/cpu_locks.sh@89 -- # killprocess 4193518 00:05:03.050 02:10:06 -- common/autotest_common.sh@936 -- # '[' -z 4193518 ']' 00:05:03.050 02:10:06 -- common/autotest_common.sh@940 -- # kill -0 4193518 00:05:03.050 02:10:06 -- common/autotest_common.sh@941 -- # uname 00:05:03.050 02:10:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:03.050 02:10:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4193518 00:05:03.050 02:10:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:03.050 02:10:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:03.050 02:10:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4193518' 00:05:03.050 killing process with pid 4193518 00:05:03.050 02:10:06 -- common/autotest_common.sh@955 -- # kill 4193518 00:05:03.050 02:10:06 -- common/autotest_common.sh@960 -- # wait 4193518 00:05:03.985 02:10:07 -- event/cpu_locks.sh@90 -- # killprocess 4193658 00:05:03.985 02:10:07 -- common/autotest_common.sh@936 -- # '[' -z 4193658 ']' 00:05:03.985 02:10:07 -- common/autotest_common.sh@940 -- # kill -0 4193658 00:05:03.985 02:10:07 -- common/autotest_common.sh@941 -- # uname 00:05:03.985 02:10:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:03.985 02:10:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4193658 00:05:03.985 02:10:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:03.985 02:10:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:03.985 02:10:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4193658' 00:05:03.985 killing process with pid 4193658 00:05:03.985 02:10:07 -- common/autotest_common.sh@955 -- # kill 4193658 00:05:03.985 02:10:07 -- common/autotest_common.sh@960 -- # wait 4193658 00:05:04.552 00:05:04.552 real 0m3.913s 00:05:04.552 user 0m4.325s 00:05:04.552 sys 0m1.063s 00:05:04.552 02:10:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:04.552 02:10:08 -- common/autotest_common.sh@10 -- # set +x 00:05:04.552 ************************************ 00:05:04.552 END TEST non_locking_app_on_locked_coremask 00:05:04.552 ************************************ 00:05:04.552 02:10:08 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:05:04.552 02:10:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:04.552 02:10:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:04.552 02:10:08 -- common/autotest_common.sh@10 -- # set +x 00:05:04.552 ************************************ 00:05:04.552 START TEST locking_app_on_unlocked_coremask 00:05:04.552 ************************************ 00:05:04.552 02:10:08 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:05:04.552 02:10:08 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=4193974 00:05:04.552 02:10:08 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:05:04.552 02:10:08 -- event/cpu_locks.sh@99 -- # waitforlisten 4193974 /var/tmp/spdk.sock 00:05:04.552 02:10:08 -- common/autotest_common.sh@829 -- # '[' -z 4193974 ']' 00:05:04.552 02:10:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:04.552 02:10:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:04.552 02:10:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:04.552 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:04.552 02:10:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:04.552 02:10:08 -- common/autotest_common.sh@10 -- # set +x 00:05:04.552 [2024-11-29 02:10:08.090623] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:04.552 [2024-11-29 02:10:08.090724] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4193974 ] 00:05:04.552 EAL: No free 2048 kB hugepages reported on node 1 00:05:04.552 [2024-11-29 02:10:08.148721] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:04.552 [2024-11-29 02:10:08.148779] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:04.811 [2024-11-29 02:10:08.258229] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:04.811 [2024-11-29 02:10:08.258425] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:05.746 02:10:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:05.746 02:10:09 -- common/autotest_common.sh@862 -- # return 0 00:05:05.746 02:10:09 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=4194112 00:05:05.746 02:10:09 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:05.746 02:10:09 -- event/cpu_locks.sh@103 -- # waitforlisten 4194112 /var/tmp/spdk2.sock 00:05:05.747 02:10:09 -- common/autotest_common.sh@829 -- # '[' -z 4194112 ']' 00:05:05.747 02:10:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:05.747 02:10:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:05.747 02:10:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:05.747 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:05.747 02:10:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:05.747 02:10:09 -- common/autotest_common.sh@10 -- # set +x 00:05:05.747 [2024-11-29 02:10:09.106765] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:05.747 [2024-11-29 02:10:09.106843] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4194112 ] 00:05:05.747 EAL: No free 2048 kB hugepages reported on node 1 00:05:05.747 [2024-11-29 02:10:09.193229] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:05.747 [2024-11-29 02:10:09.416312] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:05.747 [2024-11-29 02:10:09.416524] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:06.682 02:10:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:06.682 02:10:10 -- common/autotest_common.sh@862 -- # return 0 00:05:06.682 02:10:10 -- event/cpu_locks.sh@105 -- # locks_exist 4194112 00:05:06.682 02:10:10 -- event/cpu_locks.sh@22 -- # lslocks -p 4194112 00:05:06.682 02:10:10 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:06.941 lslocks: write error 00:05:06.941 02:10:10 -- event/cpu_locks.sh@107 -- # killprocess 4193974 00:05:06.941 02:10:10 -- common/autotest_common.sh@936 -- # '[' -z 4193974 ']' 00:05:06.941 02:10:10 -- common/autotest_common.sh@940 -- # kill -0 4193974 00:05:06.941 02:10:10 -- common/autotest_common.sh@941 -- # uname 00:05:06.941 02:10:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:06.941 02:10:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4193974 00:05:06.941 02:10:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:06.941 02:10:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:06.941 02:10:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4193974' 00:05:06.941 killing process with pid 4193974 00:05:06.941 02:10:10 -- common/autotest_common.sh@955 -- # kill 4193974 00:05:06.941 02:10:10 -- common/autotest_common.sh@960 -- # wait 4193974 00:05:07.970 02:10:11 -- event/cpu_locks.sh@108 -- # killprocess 4194112 00:05:07.970 02:10:11 -- common/autotest_common.sh@936 -- # '[' -z 4194112 ']' 00:05:07.970 02:10:11 -- common/autotest_common.sh@940 -- # kill -0 4194112 00:05:07.970 02:10:11 -- common/autotest_common.sh@941 -- # uname 00:05:07.970 02:10:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:07.970 02:10:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4194112 00:05:07.970 02:10:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:07.970 02:10:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:07.970 02:10:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4194112' 00:05:07.970 killing process with pid 4194112 00:05:07.970 02:10:11 -- common/autotest_common.sh@955 -- # kill 4194112 00:05:07.970 02:10:11 -- common/autotest_common.sh@960 -- # wait 4194112 00:05:08.536 00:05:08.536 real 0m3.945s 00:05:08.536 user 0m4.359s 00:05:08.536 sys 0m1.062s 00:05:08.536 02:10:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:08.536 02:10:11 -- common/autotest_common.sh@10 -- # set +x 00:05:08.536 ************************************ 00:05:08.536 END TEST locking_app_on_unlocked_coremask 00:05:08.536 ************************************ 00:05:08.536 02:10:12 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:05:08.536 02:10:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:08.536 02:10:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:08.536 02:10:12 -- common/autotest_common.sh@10 -- # set +x 00:05:08.536 ************************************ 00:05:08.536 START TEST locking_app_on_locked_coremask 00:05:08.536 ************************************ 00:05:08.536 02:10:12 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:05:08.536 02:10:12 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=597 00:05:08.536 02:10:12 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:08.536 02:10:12 -- event/cpu_locks.sh@116 -- # waitforlisten 597 /var/tmp/spdk.sock 00:05:08.536 02:10:12 -- common/autotest_common.sh@829 -- # '[' -z 597 ']' 00:05:08.536 02:10:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:08.536 02:10:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:08.536 02:10:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:08.536 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:08.536 02:10:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:08.536 02:10:12 -- common/autotest_common.sh@10 -- # set +x 00:05:08.537 [2024-11-29 02:10:12.063487] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:08.537 [2024-11-29 02:10:12.063571] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid597 ] 00:05:08.537 EAL: No free 2048 kB hugepages reported on node 1 00:05:08.537 [2024-11-29 02:10:12.124760] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:08.796 [2024-11-29 02:10:12.235617] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:08.796 [2024-11-29 02:10:12.235783] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:09.362 02:10:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:09.362 02:10:13 -- common/autotest_common.sh@862 -- # return 0 00:05:09.362 02:10:13 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=793 00:05:09.362 02:10:13 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:09.362 02:10:13 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 793 /var/tmp/spdk2.sock 00:05:09.362 02:10:13 -- common/autotest_common.sh@650 -- # local es=0 00:05:09.362 02:10:13 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 793 /var/tmp/spdk2.sock 00:05:09.362 02:10:13 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:09.362 02:10:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:09.362 02:10:13 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:09.362 02:10:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:09.362 02:10:13 -- common/autotest_common.sh@653 -- # waitforlisten 793 /var/tmp/spdk2.sock 00:05:09.362 02:10:13 -- common/autotest_common.sh@829 -- # '[' -z 793 ']' 00:05:09.362 02:10:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:09.362 02:10:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:09.362 02:10:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:09.362 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:09.362 02:10:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:09.362 02:10:13 -- common/autotest_common.sh@10 -- # set +x 00:05:09.620 [2024-11-29 02:10:13.066043] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:09.620 [2024-11-29 02:10:13.066125] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid793 ] 00:05:09.620 EAL: No free 2048 kB hugepages reported on node 1 00:05:09.620 [2024-11-29 02:10:13.163196] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 597 has claimed it. 00:05:09.620 [2024-11-29 02:10:13.163256] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:10.186 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (793) - No such process 00:05:10.186 ERROR: process (pid: 793) is no longer running 00:05:10.186 02:10:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:10.186 02:10:13 -- common/autotest_common.sh@862 -- # return 1 00:05:10.186 02:10:13 -- common/autotest_common.sh@653 -- # es=1 00:05:10.186 02:10:13 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:10.186 02:10:13 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:10.186 02:10:13 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:10.186 02:10:13 -- event/cpu_locks.sh@122 -- # locks_exist 597 00:05:10.186 02:10:13 -- event/cpu_locks.sh@22 -- # lslocks -p 597 00:05:10.186 02:10:13 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:10.443 lslocks: write error 00:05:10.444 02:10:14 -- event/cpu_locks.sh@124 -- # killprocess 597 00:05:10.444 02:10:14 -- common/autotest_common.sh@936 -- # '[' -z 597 ']' 00:05:10.444 02:10:14 -- common/autotest_common.sh@940 -- # kill -0 597 00:05:10.444 02:10:14 -- common/autotest_common.sh@941 -- # uname 00:05:10.444 02:10:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:10.444 02:10:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 597 00:05:10.444 02:10:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:10.444 02:10:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:10.444 02:10:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 597' 00:05:10.444 killing process with pid 597 00:05:10.444 02:10:14 -- common/autotest_common.sh@955 -- # kill 597 00:05:10.444 02:10:14 -- common/autotest_common.sh@960 -- # wait 597 00:05:11.010 00:05:11.010 real 0m2.537s 00:05:11.010 user 0m2.894s 00:05:11.010 sys 0m0.676s 00:05:11.010 02:10:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:11.010 02:10:14 -- common/autotest_common.sh@10 -- # set +x 00:05:11.010 ************************************ 00:05:11.010 END TEST locking_app_on_locked_coremask 00:05:11.010 ************************************ 00:05:11.010 02:10:14 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:05:11.010 02:10:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:11.010 02:10:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:11.010 02:10:14 -- common/autotest_common.sh@10 -- # set +x 00:05:11.010 ************************************ 00:05:11.010 START TEST locking_overlapped_coremask 00:05:11.010 ************************************ 00:05:11.010 02:10:14 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:05:11.010 02:10:14 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=975 00:05:11.010 02:10:14 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:05:11.010 02:10:14 -- event/cpu_locks.sh@133 -- # waitforlisten 975 /var/tmp/spdk.sock 00:05:11.010 02:10:14 -- common/autotest_common.sh@829 -- # '[' -z 975 ']' 00:05:11.011 02:10:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:11.011 02:10:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:11.011 02:10:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:11.011 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:11.011 02:10:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:11.011 02:10:14 -- common/autotest_common.sh@10 -- # set +x 00:05:11.011 [2024-11-29 02:10:14.628915] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:11.011 [2024-11-29 02:10:14.629006] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid975 ] 00:05:11.011 EAL: No free 2048 kB hugepages reported on node 1 00:05:11.011 [2024-11-29 02:10:14.690529] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:11.269 [2024-11-29 02:10:14.802926] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:11.269 [2024-11-29 02:10:14.803166] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:11.269 [2024-11-29 02:10:14.803234] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:11.269 [2024-11-29 02:10:14.803237] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:12.201 02:10:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:12.201 02:10:15 -- common/autotest_common.sh@862 -- # return 0 00:05:12.201 02:10:15 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=1118 00:05:12.201 02:10:15 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:05:12.201 02:10:15 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 1118 /var/tmp/spdk2.sock 00:05:12.201 02:10:15 -- common/autotest_common.sh@650 -- # local es=0 00:05:12.201 02:10:15 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1118 /var/tmp/spdk2.sock 00:05:12.201 02:10:15 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:12.201 02:10:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:12.201 02:10:15 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:12.201 02:10:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:12.201 02:10:15 -- common/autotest_common.sh@653 -- # waitforlisten 1118 /var/tmp/spdk2.sock 00:05:12.201 02:10:15 -- common/autotest_common.sh@829 -- # '[' -z 1118 ']' 00:05:12.201 02:10:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:12.201 02:10:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:12.201 02:10:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:12.201 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:12.201 02:10:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:12.201 02:10:15 -- common/autotest_common.sh@10 -- # set +x 00:05:12.201 [2024-11-29 02:10:15.612236] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:12.201 [2024-11-29 02:10:15.612313] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1118 ] 00:05:12.201 EAL: No free 2048 kB hugepages reported on node 1 00:05:12.201 [2024-11-29 02:10:15.698142] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 975 has claimed it. 00:05:12.201 [2024-11-29 02:10:15.698212] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:12.767 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1118) - No such process 00:05:12.767 ERROR: process (pid: 1118) is no longer running 00:05:12.767 02:10:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:12.767 02:10:16 -- common/autotest_common.sh@862 -- # return 1 00:05:12.767 02:10:16 -- common/autotest_common.sh@653 -- # es=1 00:05:12.767 02:10:16 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:12.767 02:10:16 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:12.767 02:10:16 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:12.767 02:10:16 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:05:12.767 02:10:16 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:12.767 02:10:16 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:12.767 02:10:16 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:12.767 02:10:16 -- event/cpu_locks.sh@141 -- # killprocess 975 00:05:12.767 02:10:16 -- common/autotest_common.sh@936 -- # '[' -z 975 ']' 00:05:12.767 02:10:16 -- common/autotest_common.sh@940 -- # kill -0 975 00:05:12.767 02:10:16 -- common/autotest_common.sh@941 -- # uname 00:05:12.767 02:10:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:12.767 02:10:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 975 00:05:12.767 02:10:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:12.767 02:10:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:12.767 02:10:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 975' 00:05:12.767 killing process with pid 975 00:05:12.767 02:10:16 -- common/autotest_common.sh@955 -- # kill 975 00:05:12.767 02:10:16 -- common/autotest_common.sh@960 -- # wait 975 00:05:13.334 00:05:13.334 real 0m2.218s 00:05:13.334 user 0m6.224s 00:05:13.334 sys 0m0.497s 00:05:13.334 02:10:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:13.334 02:10:16 -- common/autotest_common.sh@10 -- # set +x 00:05:13.334 ************************************ 00:05:13.334 END TEST locking_overlapped_coremask 00:05:13.334 ************************************ 00:05:13.334 02:10:16 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:05:13.334 02:10:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:13.334 02:10:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:13.334 02:10:16 -- common/autotest_common.sh@10 -- # set +x 00:05:13.334 ************************************ 00:05:13.334 START TEST locking_overlapped_coremask_via_rpc 00:05:13.334 ************************************ 00:05:13.334 02:10:16 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:05:13.334 02:10:16 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=1283 00:05:13.334 02:10:16 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:05:13.334 02:10:16 -- event/cpu_locks.sh@149 -- # waitforlisten 1283 /var/tmp/spdk.sock 00:05:13.334 02:10:16 -- common/autotest_common.sh@829 -- # '[' -z 1283 ']' 00:05:13.334 02:10:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:13.334 02:10:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:13.334 02:10:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:13.334 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:13.334 02:10:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:13.334 02:10:16 -- common/autotest_common.sh@10 -- # set +x 00:05:13.334 [2024-11-29 02:10:16.879906] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:13.334 [2024-11-29 02:10:16.880003] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1283 ] 00:05:13.334 EAL: No free 2048 kB hugepages reported on node 1 00:05:13.334 [2024-11-29 02:10:16.937333] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:13.334 [2024-11-29 02:10:16.937374] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:13.593 [2024-11-29 02:10:17.048135] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:13.593 [2024-11-29 02:10:17.048370] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:13.593 [2024-11-29 02:10:17.048427] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:13.593 [2024-11-29 02:10:17.048432] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:14.159 02:10:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:14.159 02:10:17 -- common/autotest_common.sh@862 -- # return 0 00:05:14.159 02:10:17 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=1427 00:05:14.159 02:10:17 -- event/cpu_locks.sh@153 -- # waitforlisten 1427 /var/tmp/spdk2.sock 00:05:14.159 02:10:17 -- common/autotest_common.sh@829 -- # '[' -z 1427 ']' 00:05:14.159 02:10:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:14.159 02:10:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:14.159 02:10:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:14.159 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:14.159 02:10:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:14.159 02:10:17 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:05:14.159 02:10:17 -- common/autotest_common.sh@10 -- # set +x 00:05:14.418 [2024-11-29 02:10:17.883540] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:14.418 [2024-11-29 02:10:17.883617] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1427 ] 00:05:14.418 EAL: No free 2048 kB hugepages reported on node 1 00:05:14.418 [2024-11-29 02:10:17.970436] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:14.418 [2024-11-29 02:10:17.970469] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:14.676 [2024-11-29 02:10:18.186687] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:14.676 [2024-11-29 02:10:18.186909] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:14.676 [2024-11-29 02:10:18.186972] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:05:14.676 [2024-11-29 02:10:18.186974] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:15.242 02:10:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:15.242 02:10:18 -- common/autotest_common.sh@862 -- # return 0 00:05:15.242 02:10:18 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:05:15.242 02:10:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:15.242 02:10:18 -- common/autotest_common.sh@10 -- # set +x 00:05:15.242 02:10:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:15.242 02:10:18 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:15.242 02:10:18 -- common/autotest_common.sh@650 -- # local es=0 00:05:15.242 02:10:18 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:15.242 02:10:18 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:05:15.242 02:10:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:15.242 02:10:18 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:05:15.242 02:10:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:15.242 02:10:18 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:15.242 02:10:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:15.242 02:10:18 -- common/autotest_common.sh@10 -- # set +x 00:05:15.242 [2024-11-29 02:10:18.833488] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1283 has claimed it. 00:05:15.242 request: 00:05:15.242 { 00:05:15.242 "method": "framework_enable_cpumask_locks", 00:05:15.242 "req_id": 1 00:05:15.242 } 00:05:15.242 Got JSON-RPC error response 00:05:15.242 response: 00:05:15.242 { 00:05:15.242 "code": -32603, 00:05:15.242 "message": "Failed to claim CPU core: 2" 00:05:15.242 } 00:05:15.242 02:10:18 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:05:15.242 02:10:18 -- common/autotest_common.sh@653 -- # es=1 00:05:15.242 02:10:18 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:15.242 02:10:18 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:15.242 02:10:18 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:15.242 02:10:18 -- event/cpu_locks.sh@158 -- # waitforlisten 1283 /var/tmp/spdk.sock 00:05:15.242 02:10:18 -- common/autotest_common.sh@829 -- # '[' -z 1283 ']' 00:05:15.242 02:10:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:15.242 02:10:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:15.242 02:10:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:15.242 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:15.242 02:10:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:15.242 02:10:18 -- common/autotest_common.sh@10 -- # set +x 00:05:15.500 02:10:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:15.500 02:10:19 -- common/autotest_common.sh@862 -- # return 0 00:05:15.500 02:10:19 -- event/cpu_locks.sh@159 -- # waitforlisten 1427 /var/tmp/spdk2.sock 00:05:15.500 02:10:19 -- common/autotest_common.sh@829 -- # '[' -z 1427 ']' 00:05:15.500 02:10:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:15.500 02:10:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:15.500 02:10:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:15.500 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:15.500 02:10:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:15.500 02:10:19 -- common/autotest_common.sh@10 -- # set +x 00:05:15.759 02:10:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:15.759 02:10:19 -- common/autotest_common.sh@862 -- # return 0 00:05:15.759 02:10:19 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:05:15.759 02:10:19 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:15.759 02:10:19 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:15.759 02:10:19 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:15.759 00:05:15.759 real 0m2.510s 00:05:15.759 user 0m1.250s 00:05:15.759 sys 0m0.198s 00:05:15.759 02:10:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:15.759 02:10:19 -- common/autotest_common.sh@10 -- # set +x 00:05:15.759 ************************************ 00:05:15.759 END TEST locking_overlapped_coremask_via_rpc 00:05:15.759 ************************************ 00:05:15.759 02:10:19 -- event/cpu_locks.sh@174 -- # cleanup 00:05:15.759 02:10:19 -- event/cpu_locks.sh@15 -- # [[ -z 1283 ]] 00:05:15.759 02:10:19 -- event/cpu_locks.sh@15 -- # killprocess 1283 00:05:15.759 02:10:19 -- common/autotest_common.sh@936 -- # '[' -z 1283 ']' 00:05:15.759 02:10:19 -- common/autotest_common.sh@940 -- # kill -0 1283 00:05:15.759 02:10:19 -- common/autotest_common.sh@941 -- # uname 00:05:15.759 02:10:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:15.759 02:10:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1283 00:05:15.759 02:10:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:15.759 02:10:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:15.759 02:10:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1283' 00:05:15.759 killing process with pid 1283 00:05:15.759 02:10:19 -- common/autotest_common.sh@955 -- # kill 1283 00:05:15.759 02:10:19 -- common/autotest_common.sh@960 -- # wait 1283 00:05:16.325 02:10:19 -- event/cpu_locks.sh@16 -- # [[ -z 1427 ]] 00:05:16.325 02:10:19 -- event/cpu_locks.sh@16 -- # killprocess 1427 00:05:16.325 02:10:19 -- common/autotest_common.sh@936 -- # '[' -z 1427 ']' 00:05:16.325 02:10:19 -- common/autotest_common.sh@940 -- # kill -0 1427 00:05:16.325 02:10:19 -- common/autotest_common.sh@941 -- # uname 00:05:16.325 02:10:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:16.325 02:10:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1427 00:05:16.325 02:10:19 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:16.325 02:10:19 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:16.325 02:10:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1427' 00:05:16.325 killing process with pid 1427 00:05:16.325 02:10:19 -- common/autotest_common.sh@955 -- # kill 1427 00:05:16.325 02:10:19 -- common/autotest_common.sh@960 -- # wait 1427 00:05:16.890 02:10:20 -- event/cpu_locks.sh@18 -- # rm -f 00:05:16.890 02:10:20 -- event/cpu_locks.sh@1 -- # cleanup 00:05:16.890 02:10:20 -- event/cpu_locks.sh@15 -- # [[ -z 1283 ]] 00:05:16.890 02:10:20 -- event/cpu_locks.sh@15 -- # killprocess 1283 00:05:16.890 02:10:20 -- common/autotest_common.sh@936 -- # '[' -z 1283 ']' 00:05:16.890 02:10:20 -- common/autotest_common.sh@940 -- # kill -0 1283 00:05:16.890 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1283) - No such process 00:05:16.890 02:10:20 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1283 is not found' 00:05:16.890 Process with pid 1283 is not found 00:05:16.890 02:10:20 -- event/cpu_locks.sh@16 -- # [[ -z 1427 ]] 00:05:16.891 02:10:20 -- event/cpu_locks.sh@16 -- # killprocess 1427 00:05:16.891 02:10:20 -- common/autotest_common.sh@936 -- # '[' -z 1427 ']' 00:05:16.891 02:10:20 -- common/autotest_common.sh@940 -- # kill -0 1427 00:05:16.891 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1427) - No such process 00:05:16.891 02:10:20 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1427 is not found' 00:05:16.891 Process with pid 1427 is not found 00:05:16.891 02:10:20 -- event/cpu_locks.sh@18 -- # rm -f 00:05:16.891 00:05:16.891 real 0m20.066s 00:05:16.891 user 0m35.578s 00:05:16.891 sys 0m5.469s 00:05:16.891 02:10:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:16.891 02:10:20 -- common/autotest_common.sh@10 -- # set +x 00:05:16.891 ************************************ 00:05:16.891 END TEST cpu_locks 00:05:16.891 ************************************ 00:05:16.891 00:05:16.891 real 0m46.213s 00:05:16.891 user 1m27.429s 00:05:16.891 sys 0m9.296s 00:05:16.891 02:10:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:16.891 02:10:20 -- common/autotest_common.sh@10 -- # set +x 00:05:16.891 ************************************ 00:05:16.891 END TEST event 00:05:16.891 ************************************ 00:05:16.891 02:10:20 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:16.891 02:10:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:16.891 02:10:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:16.891 02:10:20 -- common/autotest_common.sh@10 -- # set +x 00:05:16.891 ************************************ 00:05:16.891 START TEST thread 00:05:16.891 ************************************ 00:05:16.891 02:10:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:16.891 * Looking for test storage... 00:05:16.891 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:05:16.891 02:10:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:16.891 02:10:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:16.891 02:10:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:16.891 02:10:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:16.891 02:10:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:16.891 02:10:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:16.891 02:10:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:16.891 02:10:20 -- scripts/common.sh@335 -- # IFS=.-: 00:05:16.891 02:10:20 -- scripts/common.sh@335 -- # read -ra ver1 00:05:16.891 02:10:20 -- scripts/common.sh@336 -- # IFS=.-: 00:05:16.891 02:10:20 -- scripts/common.sh@336 -- # read -ra ver2 00:05:16.891 02:10:20 -- scripts/common.sh@337 -- # local 'op=<' 00:05:16.891 02:10:20 -- scripts/common.sh@339 -- # ver1_l=2 00:05:16.891 02:10:20 -- scripts/common.sh@340 -- # ver2_l=1 00:05:16.891 02:10:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:16.891 02:10:20 -- scripts/common.sh@343 -- # case "$op" in 00:05:16.891 02:10:20 -- scripts/common.sh@344 -- # : 1 00:05:16.891 02:10:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:16.891 02:10:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:16.891 02:10:20 -- scripts/common.sh@364 -- # decimal 1 00:05:16.891 02:10:20 -- scripts/common.sh@352 -- # local d=1 00:05:16.891 02:10:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:16.891 02:10:20 -- scripts/common.sh@354 -- # echo 1 00:05:16.891 02:10:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:16.891 02:10:20 -- scripts/common.sh@365 -- # decimal 2 00:05:16.891 02:10:20 -- scripts/common.sh@352 -- # local d=2 00:05:16.891 02:10:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:16.891 02:10:20 -- scripts/common.sh@354 -- # echo 2 00:05:16.891 02:10:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:16.891 02:10:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:16.891 02:10:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:16.891 02:10:20 -- scripts/common.sh@367 -- # return 0 00:05:16.891 02:10:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:16.891 02:10:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:16.891 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:16.891 --rc genhtml_branch_coverage=1 00:05:16.891 --rc genhtml_function_coverage=1 00:05:16.891 --rc genhtml_legend=1 00:05:16.891 --rc geninfo_all_blocks=1 00:05:16.891 --rc geninfo_unexecuted_blocks=1 00:05:16.891 00:05:16.891 ' 00:05:16.891 02:10:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:16.891 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:16.891 --rc genhtml_branch_coverage=1 00:05:16.891 --rc genhtml_function_coverage=1 00:05:16.891 --rc genhtml_legend=1 00:05:16.891 --rc geninfo_all_blocks=1 00:05:16.891 --rc geninfo_unexecuted_blocks=1 00:05:16.891 00:05:16.891 ' 00:05:16.891 02:10:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:16.891 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:16.891 --rc genhtml_branch_coverage=1 00:05:16.891 --rc genhtml_function_coverage=1 00:05:16.891 --rc genhtml_legend=1 00:05:16.891 --rc geninfo_all_blocks=1 00:05:16.891 --rc geninfo_unexecuted_blocks=1 00:05:16.891 00:05:16.891 ' 00:05:16.891 02:10:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:16.891 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:16.891 --rc genhtml_branch_coverage=1 00:05:16.891 --rc genhtml_function_coverage=1 00:05:16.891 --rc genhtml_legend=1 00:05:16.891 --rc geninfo_all_blocks=1 00:05:16.891 --rc geninfo_unexecuted_blocks=1 00:05:16.891 00:05:16.891 ' 00:05:16.891 02:10:20 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:16.891 02:10:20 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:16.891 02:10:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:16.891 02:10:20 -- common/autotest_common.sh@10 -- # set +x 00:05:16.891 ************************************ 00:05:16.891 START TEST thread_poller_perf 00:05:16.891 ************************************ 00:05:16.891 02:10:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:16.891 [2024-11-29 02:10:20.537127] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:16.891 [2024-11-29 02:10:20.537215] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1818 ] 00:05:16.891 EAL: No free 2048 kB hugepages reported on node 1 00:05:17.149 [2024-11-29 02:10:20.594455] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:17.149 [2024-11-29 02:10:20.703019] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:17.149 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:05:18.523 [2024-11-29T01:10:22.204Z] ====================================== 00:05:18.523 [2024-11-29T01:10:22.204Z] busy:2714836562 (cyc) 00:05:18.523 [2024-11-29T01:10:22.204Z] total_run_count: 280000 00:05:18.523 [2024-11-29T01:10:22.204Z] tsc_hz: 2700000000 (cyc) 00:05:18.523 [2024-11-29T01:10:22.204Z] ====================================== 00:05:18.524 [2024-11-29T01:10:22.205Z] poller_cost: 9695 (cyc), 3590 (nsec) 00:05:18.524 00:05:18.524 real 0m1.309s 00:05:18.524 user 0m1.221s 00:05:18.524 sys 0m0.081s 00:05:18.524 02:10:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:18.524 02:10:21 -- common/autotest_common.sh@10 -- # set +x 00:05:18.524 ************************************ 00:05:18.524 END TEST thread_poller_perf 00:05:18.524 ************************************ 00:05:18.524 02:10:21 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:18.524 02:10:21 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:18.524 02:10:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:18.524 02:10:21 -- common/autotest_common.sh@10 -- # set +x 00:05:18.524 ************************************ 00:05:18.524 START TEST thread_poller_perf 00:05:18.524 ************************************ 00:05:18.524 02:10:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:18.524 [2024-11-29 02:10:21.874973] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:18.524 [2024-11-29 02:10:21.875058] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1985 ] 00:05:18.524 EAL: No free 2048 kB hugepages reported on node 1 00:05:18.524 [2024-11-29 02:10:21.939299] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:18.524 [2024-11-29 02:10:22.057135] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:18.524 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:05:19.896 [2024-11-29T01:10:23.577Z] ====================================== 00:05:19.896 [2024-11-29T01:10:23.577Z] busy:2703259148 (cyc) 00:05:19.896 [2024-11-29T01:10:23.577Z] total_run_count: 3817000 00:05:19.896 [2024-11-29T01:10:23.577Z] tsc_hz: 2700000000 (cyc) 00:05:19.896 [2024-11-29T01:10:23.577Z] ====================================== 00:05:19.896 [2024-11-29T01:10:23.577Z] poller_cost: 708 (cyc), 262 (nsec) 00:05:19.896 00:05:19.896 real 0m1.316s 00:05:19.896 user 0m1.221s 00:05:19.896 sys 0m0.087s 00:05:19.896 02:10:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:19.896 02:10:23 -- common/autotest_common.sh@10 -- # set +x 00:05:19.896 ************************************ 00:05:19.896 END TEST thread_poller_perf 00:05:19.896 ************************************ 00:05:19.896 02:10:23 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:05:19.896 00:05:19.896 real 0m2.813s 00:05:19.896 user 0m2.559s 00:05:19.896 sys 0m0.257s 00:05:19.896 02:10:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:19.896 02:10:23 -- common/autotest_common.sh@10 -- # set +x 00:05:19.896 ************************************ 00:05:19.896 END TEST thread 00:05:19.896 ************************************ 00:05:19.896 02:10:23 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:19.896 02:10:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:19.896 02:10:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:19.896 02:10:23 -- common/autotest_common.sh@10 -- # set +x 00:05:19.896 ************************************ 00:05:19.896 START TEST accel 00:05:19.896 ************************************ 00:05:19.896 02:10:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:19.896 * Looking for test storage... 00:05:19.896 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:19.896 02:10:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:19.896 02:10:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:19.896 02:10:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:19.896 02:10:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:19.896 02:10:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:19.896 02:10:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:19.896 02:10:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:19.896 02:10:23 -- scripts/common.sh@335 -- # IFS=.-: 00:05:19.896 02:10:23 -- scripts/common.sh@335 -- # read -ra ver1 00:05:19.896 02:10:23 -- scripts/common.sh@336 -- # IFS=.-: 00:05:19.896 02:10:23 -- scripts/common.sh@336 -- # read -ra ver2 00:05:19.896 02:10:23 -- scripts/common.sh@337 -- # local 'op=<' 00:05:19.896 02:10:23 -- scripts/common.sh@339 -- # ver1_l=2 00:05:19.896 02:10:23 -- scripts/common.sh@340 -- # ver2_l=1 00:05:19.896 02:10:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:19.896 02:10:23 -- scripts/common.sh@343 -- # case "$op" in 00:05:19.896 02:10:23 -- scripts/common.sh@344 -- # : 1 00:05:19.896 02:10:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:19.896 02:10:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:19.896 02:10:23 -- scripts/common.sh@364 -- # decimal 1 00:05:19.896 02:10:23 -- scripts/common.sh@352 -- # local d=1 00:05:19.896 02:10:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:19.896 02:10:23 -- scripts/common.sh@354 -- # echo 1 00:05:19.896 02:10:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:19.896 02:10:23 -- scripts/common.sh@365 -- # decimal 2 00:05:19.896 02:10:23 -- scripts/common.sh@352 -- # local d=2 00:05:19.896 02:10:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:19.896 02:10:23 -- scripts/common.sh@354 -- # echo 2 00:05:19.896 02:10:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:19.896 02:10:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:19.896 02:10:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:19.896 02:10:23 -- scripts/common.sh@367 -- # return 0 00:05:19.896 02:10:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:19.896 02:10:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:19.896 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:19.896 --rc genhtml_branch_coverage=1 00:05:19.896 --rc genhtml_function_coverage=1 00:05:19.896 --rc genhtml_legend=1 00:05:19.896 --rc geninfo_all_blocks=1 00:05:19.896 --rc geninfo_unexecuted_blocks=1 00:05:19.896 00:05:19.896 ' 00:05:19.896 02:10:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:19.896 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:19.896 --rc genhtml_branch_coverage=1 00:05:19.896 --rc genhtml_function_coverage=1 00:05:19.896 --rc genhtml_legend=1 00:05:19.896 --rc geninfo_all_blocks=1 00:05:19.896 --rc geninfo_unexecuted_blocks=1 00:05:19.896 00:05:19.896 ' 00:05:19.896 02:10:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:19.896 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:19.896 --rc genhtml_branch_coverage=1 00:05:19.896 --rc genhtml_function_coverage=1 00:05:19.896 --rc genhtml_legend=1 00:05:19.896 --rc geninfo_all_blocks=1 00:05:19.896 --rc geninfo_unexecuted_blocks=1 00:05:19.896 00:05:19.896 ' 00:05:19.896 02:10:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:19.896 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:19.896 --rc genhtml_branch_coverage=1 00:05:19.896 --rc genhtml_function_coverage=1 00:05:19.897 --rc genhtml_legend=1 00:05:19.897 --rc geninfo_all_blocks=1 00:05:19.897 --rc geninfo_unexecuted_blocks=1 00:05:19.897 00:05:19.897 ' 00:05:19.897 02:10:23 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:05:19.897 02:10:23 -- accel/accel.sh@74 -- # get_expected_opcs 00:05:19.897 02:10:23 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:19.897 02:10:23 -- accel/accel.sh@59 -- # spdk_tgt_pid=2375 00:05:19.897 02:10:23 -- accel/accel.sh@60 -- # waitforlisten 2375 00:05:19.897 02:10:23 -- common/autotest_common.sh@829 -- # '[' -z 2375 ']' 00:05:19.897 02:10:23 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:05:19.897 02:10:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:19.897 02:10:23 -- accel/accel.sh@58 -- # build_accel_config 00:05:19.897 02:10:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:19.897 02:10:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:19.897 02:10:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:19.897 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:19.897 02:10:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:19.897 02:10:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:19.897 02:10:23 -- common/autotest_common.sh@10 -- # set +x 00:05:19.897 02:10:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:19.897 02:10:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:19.897 02:10:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:19.897 02:10:23 -- accel/accel.sh@41 -- # local IFS=, 00:05:19.897 02:10:23 -- accel/accel.sh@42 -- # jq -r . 00:05:19.897 [2024-11-29 02:10:23.409955] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:19.897 [2024-11-29 02:10:23.410036] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2375 ] 00:05:19.897 EAL: No free 2048 kB hugepages reported on node 1 00:05:19.897 [2024-11-29 02:10:23.468113] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:20.155 [2024-11-29 02:10:23.577777] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:20.155 [2024-11-29 02:10:23.577969] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:20.720 02:10:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:20.720 02:10:24 -- common/autotest_common.sh@862 -- # return 0 00:05:20.720 02:10:24 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:05:20.720 02:10:24 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:05:20.720 02:10:24 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:05:20.720 02:10:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:20.720 02:10:24 -- common/autotest_common.sh@10 -- # set +x 00:05:20.720 02:10:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:20.979 02:10:24 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # IFS== 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # read -r opc module 00:05:20.979 02:10:24 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:20.979 02:10:24 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # IFS== 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # read -r opc module 00:05:20.979 02:10:24 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:20.979 02:10:24 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # IFS== 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # read -r opc module 00:05:20.979 02:10:24 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:20.979 02:10:24 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # IFS== 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # read -r opc module 00:05:20.979 02:10:24 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:20.979 02:10:24 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # IFS== 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # read -r opc module 00:05:20.979 02:10:24 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:20.979 02:10:24 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # IFS== 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # read -r opc module 00:05:20.979 02:10:24 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:20.979 02:10:24 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # IFS== 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # read -r opc module 00:05:20.979 02:10:24 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:20.979 02:10:24 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # IFS== 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # read -r opc module 00:05:20.979 02:10:24 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:20.979 02:10:24 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # IFS== 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # read -r opc module 00:05:20.979 02:10:24 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:20.979 02:10:24 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # IFS== 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # read -r opc module 00:05:20.979 02:10:24 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:20.979 02:10:24 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # IFS== 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # read -r opc module 00:05:20.979 02:10:24 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:20.979 02:10:24 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # IFS== 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # read -r opc module 00:05:20.979 02:10:24 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:20.979 02:10:24 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # IFS== 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # read -r opc module 00:05:20.979 02:10:24 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:20.979 02:10:24 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # IFS== 00:05:20.979 02:10:24 -- accel/accel.sh@64 -- # read -r opc module 00:05:20.979 02:10:24 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:20.979 02:10:24 -- accel/accel.sh@67 -- # killprocess 2375 00:05:20.979 02:10:24 -- common/autotest_common.sh@936 -- # '[' -z 2375 ']' 00:05:20.979 02:10:24 -- common/autotest_common.sh@940 -- # kill -0 2375 00:05:20.979 02:10:24 -- common/autotest_common.sh@941 -- # uname 00:05:20.979 02:10:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:20.979 02:10:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2375 00:05:20.979 02:10:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:20.979 02:10:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:20.979 02:10:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2375' 00:05:20.979 killing process with pid 2375 00:05:20.979 02:10:24 -- common/autotest_common.sh@955 -- # kill 2375 00:05:20.979 02:10:24 -- common/autotest_common.sh@960 -- # wait 2375 00:05:21.546 02:10:24 -- accel/accel.sh@68 -- # trap - ERR 00:05:21.546 02:10:24 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:05:21.546 02:10:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:05:21.546 02:10:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:21.546 02:10:24 -- common/autotest_common.sh@10 -- # set +x 00:05:21.546 02:10:24 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:05:21.546 02:10:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:05:21.546 02:10:24 -- accel/accel.sh@12 -- # build_accel_config 00:05:21.546 02:10:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:21.546 02:10:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:21.546 02:10:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:21.546 02:10:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:21.546 02:10:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:21.546 02:10:24 -- accel/accel.sh@41 -- # local IFS=, 00:05:21.546 02:10:24 -- accel/accel.sh@42 -- # jq -r . 00:05:21.546 02:10:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:21.546 02:10:24 -- common/autotest_common.sh@10 -- # set +x 00:05:21.546 02:10:24 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:05:21.546 02:10:24 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:21.546 02:10:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:21.546 02:10:24 -- common/autotest_common.sh@10 -- # set +x 00:05:21.546 ************************************ 00:05:21.546 START TEST accel_missing_filename 00:05:21.546 ************************************ 00:05:21.546 02:10:24 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:05:21.546 02:10:24 -- common/autotest_common.sh@650 -- # local es=0 00:05:21.546 02:10:24 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:05:21.546 02:10:24 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:21.546 02:10:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:21.546 02:10:24 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:21.546 02:10:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:21.546 02:10:24 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:05:21.546 02:10:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:05:21.546 02:10:24 -- accel/accel.sh@12 -- # build_accel_config 00:05:21.546 02:10:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:21.546 02:10:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:21.546 02:10:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:21.546 02:10:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:21.546 02:10:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:21.546 02:10:24 -- accel/accel.sh@41 -- # local IFS=, 00:05:21.546 02:10:24 -- accel/accel.sh@42 -- # jq -r . 00:05:21.546 [2024-11-29 02:10:25.008879] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:21.546 [2024-11-29 02:10:25.008966] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2615 ] 00:05:21.546 EAL: No free 2048 kB hugepages reported on node 1 00:05:21.546 [2024-11-29 02:10:25.073112] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:21.546 [2024-11-29 02:10:25.186738] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:21.804 [2024-11-29 02:10:25.246035] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:21.804 [2024-11-29 02:10:25.330675] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:21.804 A filename is required. 00:05:21.804 02:10:25 -- common/autotest_common.sh@653 -- # es=234 00:05:21.804 02:10:25 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:21.804 02:10:25 -- common/autotest_common.sh@662 -- # es=106 00:05:21.804 02:10:25 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:21.804 02:10:25 -- common/autotest_common.sh@670 -- # es=1 00:05:21.804 02:10:25 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:21.804 00:05:21.804 real 0m0.460s 00:05:21.804 user 0m0.359s 00:05:21.804 sys 0m0.135s 00:05:21.804 02:10:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:21.804 02:10:25 -- common/autotest_common.sh@10 -- # set +x 00:05:21.804 ************************************ 00:05:21.804 END TEST accel_missing_filename 00:05:21.804 ************************************ 00:05:21.804 02:10:25 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:21.804 02:10:25 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:21.804 02:10:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:21.804 02:10:25 -- common/autotest_common.sh@10 -- # set +x 00:05:21.804 ************************************ 00:05:21.804 START TEST accel_compress_verify 00:05:21.804 ************************************ 00:05:21.804 02:10:25 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:21.804 02:10:25 -- common/autotest_common.sh@650 -- # local es=0 00:05:21.804 02:10:25 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:21.804 02:10:25 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:21.804 02:10:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:21.804 02:10:25 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:21.804 02:10:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:21.804 02:10:25 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:21.804 02:10:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:21.804 02:10:25 -- accel/accel.sh@12 -- # build_accel_config 00:05:21.804 02:10:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:21.804 02:10:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:21.804 02:10:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:21.804 02:10:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:21.804 02:10:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:21.804 02:10:25 -- accel/accel.sh@41 -- # local IFS=, 00:05:21.804 02:10:25 -- accel/accel.sh@42 -- # jq -r . 00:05:22.062 [2024-11-29 02:10:25.491285] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:22.062 [2024-11-29 02:10:25.491359] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2768 ] 00:05:22.062 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.062 [2024-11-29 02:10:25.553809] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:22.062 [2024-11-29 02:10:25.671064] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:22.062 [2024-11-29 02:10:25.733132] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:22.320 [2024-11-29 02:10:25.817544] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:22.320 00:05:22.320 Compression does not support the verify option, aborting. 00:05:22.320 02:10:25 -- common/autotest_common.sh@653 -- # es=161 00:05:22.320 02:10:25 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:22.320 02:10:25 -- common/autotest_common.sh@662 -- # es=33 00:05:22.320 02:10:25 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:22.320 02:10:25 -- common/autotest_common.sh@670 -- # es=1 00:05:22.320 02:10:25 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:22.320 00:05:22.320 real 0m0.469s 00:05:22.320 user 0m0.366s 00:05:22.320 sys 0m0.136s 00:05:22.320 02:10:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:22.320 02:10:25 -- common/autotest_common.sh@10 -- # set +x 00:05:22.320 ************************************ 00:05:22.320 END TEST accel_compress_verify 00:05:22.320 ************************************ 00:05:22.321 02:10:25 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:05:22.321 02:10:25 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:22.321 02:10:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:22.321 02:10:25 -- common/autotest_common.sh@10 -- # set +x 00:05:22.321 ************************************ 00:05:22.321 START TEST accel_wrong_workload 00:05:22.321 ************************************ 00:05:22.321 02:10:25 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:05:22.321 02:10:25 -- common/autotest_common.sh@650 -- # local es=0 00:05:22.321 02:10:25 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:05:22.321 02:10:25 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:22.321 02:10:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:22.321 02:10:25 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:22.321 02:10:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:22.321 02:10:25 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:05:22.321 02:10:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:05:22.321 02:10:25 -- accel/accel.sh@12 -- # build_accel_config 00:05:22.321 02:10:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:22.321 02:10:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:22.321 02:10:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:22.321 02:10:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:22.321 02:10:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:22.321 02:10:25 -- accel/accel.sh@41 -- # local IFS=, 00:05:22.321 02:10:25 -- accel/accel.sh@42 -- # jq -r . 00:05:22.321 Unsupported workload type: foobar 00:05:22.321 [2024-11-29 02:10:25.983226] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:05:22.321 accel_perf options: 00:05:22.321 [-h help message] 00:05:22.321 [-q queue depth per core] 00:05:22.321 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:22.321 [-T number of threads per core 00:05:22.321 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:22.321 [-t time in seconds] 00:05:22.321 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:22.321 [ dif_verify, , dif_generate, dif_generate_copy 00:05:22.321 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:22.321 [-l for compress/decompress workloads, name of uncompressed input file 00:05:22.321 [-S for crc32c workload, use this seed value (default 0) 00:05:22.321 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:22.321 [-f for fill workload, use this BYTE value (default 255) 00:05:22.321 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:22.321 [-y verify result if this switch is on] 00:05:22.321 [-a tasks to allocate per core (default: same value as -q)] 00:05:22.321 Can be used to spread operations across a wider range of memory. 00:05:22.321 02:10:25 -- common/autotest_common.sh@653 -- # es=1 00:05:22.321 02:10:25 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:22.321 02:10:25 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:22.321 02:10:25 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:22.321 00:05:22.321 real 0m0.022s 00:05:22.321 user 0m0.012s 00:05:22.321 sys 0m0.010s 00:05:22.321 02:10:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:22.321 02:10:25 -- common/autotest_common.sh@10 -- # set +x 00:05:22.321 ************************************ 00:05:22.321 END TEST accel_wrong_workload 00:05:22.321 ************************************ 00:05:22.579 Error: writing output failed: Broken pipe 00:05:22.579 02:10:26 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:05:22.579 02:10:26 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:22.579 02:10:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:22.579 02:10:26 -- common/autotest_common.sh@10 -- # set +x 00:05:22.579 ************************************ 00:05:22.579 START TEST accel_negative_buffers 00:05:22.579 ************************************ 00:05:22.579 02:10:26 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:05:22.579 02:10:26 -- common/autotest_common.sh@650 -- # local es=0 00:05:22.579 02:10:26 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:05:22.579 02:10:26 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:22.579 02:10:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:22.579 02:10:26 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:22.579 02:10:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:22.579 02:10:26 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:05:22.579 02:10:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:05:22.579 02:10:26 -- accel/accel.sh@12 -- # build_accel_config 00:05:22.579 02:10:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:22.579 02:10:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:22.579 02:10:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:22.579 02:10:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:22.579 02:10:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:22.579 02:10:26 -- accel/accel.sh@41 -- # local IFS=, 00:05:22.579 02:10:26 -- accel/accel.sh@42 -- # jq -r . 00:05:22.580 -x option must be non-negative. 00:05:22.580 [2024-11-29 02:10:26.034953] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:05:22.580 accel_perf options: 00:05:22.580 [-h help message] 00:05:22.580 [-q queue depth per core] 00:05:22.580 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:22.580 [-T number of threads per core 00:05:22.580 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:22.580 [-t time in seconds] 00:05:22.580 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:22.580 [ dif_verify, , dif_generate, dif_generate_copy 00:05:22.580 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:22.580 [-l for compress/decompress workloads, name of uncompressed input file 00:05:22.580 [-S for crc32c workload, use this seed value (default 0) 00:05:22.580 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:22.580 [-f for fill workload, use this BYTE value (default 255) 00:05:22.580 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:22.580 [-y verify result if this switch is on] 00:05:22.580 [-a tasks to allocate per core (default: same value as -q)] 00:05:22.580 Can be used to spread operations across a wider range of memory. 00:05:22.580 02:10:26 -- common/autotest_common.sh@653 -- # es=1 00:05:22.580 02:10:26 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:22.580 02:10:26 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:22.580 02:10:26 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:22.580 00:05:22.580 real 0m0.025s 00:05:22.580 user 0m0.010s 00:05:22.580 sys 0m0.016s 00:05:22.580 02:10:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:22.580 02:10:26 -- common/autotest_common.sh@10 -- # set +x 00:05:22.580 ************************************ 00:05:22.580 END TEST accel_negative_buffers 00:05:22.580 ************************************ 00:05:22.580 Error: writing output failed: Broken pipe 00:05:22.580 02:10:26 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:05:22.580 02:10:26 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:22.580 02:10:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:22.580 02:10:26 -- common/autotest_common.sh@10 -- # set +x 00:05:22.580 ************************************ 00:05:22.580 START TEST accel_crc32c 00:05:22.580 ************************************ 00:05:22.580 02:10:26 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:05:22.580 02:10:26 -- accel/accel.sh@16 -- # local accel_opc 00:05:22.580 02:10:26 -- accel/accel.sh@17 -- # local accel_module 00:05:22.580 02:10:26 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:22.580 02:10:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:22.580 02:10:26 -- accel/accel.sh@12 -- # build_accel_config 00:05:22.580 02:10:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:22.580 02:10:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:22.580 02:10:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:22.580 02:10:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:22.580 02:10:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:22.580 02:10:26 -- accel/accel.sh@41 -- # local IFS=, 00:05:22.580 02:10:26 -- accel/accel.sh@42 -- # jq -r . 00:05:22.580 [2024-11-29 02:10:26.078125] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:22.580 [2024-11-29 02:10:26.078192] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2828 ] 00:05:22.580 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.580 [2024-11-29 02:10:26.141955] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:22.839 [2024-11-29 02:10:26.259468] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:24.213 02:10:27 -- accel/accel.sh@18 -- # out=' 00:05:24.213 SPDK Configuration: 00:05:24.213 Core mask: 0x1 00:05:24.213 00:05:24.213 Accel Perf Configuration: 00:05:24.213 Workload Type: crc32c 00:05:24.213 CRC-32C seed: 32 00:05:24.213 Transfer size: 4096 bytes 00:05:24.213 Vector count 1 00:05:24.213 Module: software 00:05:24.213 Queue depth: 32 00:05:24.213 Allocate depth: 32 00:05:24.213 # threads/core: 1 00:05:24.213 Run time: 1 seconds 00:05:24.213 Verify: Yes 00:05:24.213 00:05:24.213 Running for 1 seconds... 00:05:24.213 00:05:24.213 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:24.213 ------------------------------------------------------------------------------------ 00:05:24.213 0,0 406400/s 1587 MiB/s 0 0 00:05:24.213 ==================================================================================== 00:05:24.213 Total 406400/s 1587 MiB/s 0 0' 00:05:24.213 02:10:27 -- accel/accel.sh@20 -- # IFS=: 00:05:24.213 02:10:27 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:24.213 02:10:27 -- accel/accel.sh@20 -- # read -r var val 00:05:24.213 02:10:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:24.213 02:10:27 -- accel/accel.sh@12 -- # build_accel_config 00:05:24.213 02:10:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:24.213 02:10:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:24.213 02:10:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:24.213 02:10:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:24.213 02:10:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:24.213 02:10:27 -- accel/accel.sh@41 -- # local IFS=, 00:05:24.213 02:10:27 -- accel/accel.sh@42 -- # jq -r . 00:05:24.213 [2024-11-29 02:10:27.548472] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:24.213 [2024-11-29 02:10:27.548548] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3012 ] 00:05:24.213 EAL: No free 2048 kB hugepages reported on node 1 00:05:24.213 [2024-11-29 02:10:27.613462] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:24.213 [2024-11-29 02:10:27.729265] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:24.213 02:10:27 -- accel/accel.sh@21 -- # val= 00:05:24.213 02:10:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.213 02:10:27 -- accel/accel.sh@20 -- # IFS=: 00:05:24.213 02:10:27 -- accel/accel.sh@20 -- # read -r var val 00:05:24.214 02:10:27 -- accel/accel.sh@21 -- # val= 00:05:24.214 02:10:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # IFS=: 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # read -r var val 00:05:24.214 02:10:27 -- accel/accel.sh@21 -- # val=0x1 00:05:24.214 02:10:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # IFS=: 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # read -r var val 00:05:24.214 02:10:27 -- accel/accel.sh@21 -- # val= 00:05:24.214 02:10:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # IFS=: 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # read -r var val 00:05:24.214 02:10:27 -- accel/accel.sh@21 -- # val= 00:05:24.214 02:10:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # IFS=: 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # read -r var val 00:05:24.214 02:10:27 -- accel/accel.sh@21 -- # val=crc32c 00:05:24.214 02:10:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.214 02:10:27 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # IFS=: 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # read -r var val 00:05:24.214 02:10:27 -- accel/accel.sh@21 -- # val=32 00:05:24.214 02:10:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # IFS=: 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # read -r var val 00:05:24.214 02:10:27 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:24.214 02:10:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # IFS=: 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # read -r var val 00:05:24.214 02:10:27 -- accel/accel.sh@21 -- # val= 00:05:24.214 02:10:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # IFS=: 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # read -r var val 00:05:24.214 02:10:27 -- accel/accel.sh@21 -- # val=software 00:05:24.214 02:10:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.214 02:10:27 -- accel/accel.sh@23 -- # accel_module=software 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # IFS=: 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # read -r var val 00:05:24.214 02:10:27 -- accel/accel.sh@21 -- # val=32 00:05:24.214 02:10:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # IFS=: 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # read -r var val 00:05:24.214 02:10:27 -- accel/accel.sh@21 -- # val=32 00:05:24.214 02:10:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # IFS=: 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # read -r var val 00:05:24.214 02:10:27 -- accel/accel.sh@21 -- # val=1 00:05:24.214 02:10:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # IFS=: 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # read -r var val 00:05:24.214 02:10:27 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:24.214 02:10:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # IFS=: 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # read -r var val 00:05:24.214 02:10:27 -- accel/accel.sh@21 -- # val=Yes 00:05:24.214 02:10:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # IFS=: 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # read -r var val 00:05:24.214 02:10:27 -- accel/accel.sh@21 -- # val= 00:05:24.214 02:10:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # IFS=: 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # read -r var val 00:05:24.214 02:10:27 -- accel/accel.sh@21 -- # val= 00:05:24.214 02:10:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # IFS=: 00:05:24.214 02:10:27 -- accel/accel.sh@20 -- # read -r var val 00:05:25.588 02:10:28 -- accel/accel.sh@21 -- # val= 00:05:25.588 02:10:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.588 02:10:28 -- accel/accel.sh@20 -- # IFS=: 00:05:25.588 02:10:28 -- accel/accel.sh@20 -- # read -r var val 00:05:25.588 02:10:28 -- accel/accel.sh@21 -- # val= 00:05:25.588 02:10:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.588 02:10:28 -- accel/accel.sh@20 -- # IFS=: 00:05:25.588 02:10:28 -- accel/accel.sh@20 -- # read -r var val 00:05:25.588 02:10:28 -- accel/accel.sh@21 -- # val= 00:05:25.588 02:10:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.588 02:10:28 -- accel/accel.sh@20 -- # IFS=: 00:05:25.588 02:10:28 -- accel/accel.sh@20 -- # read -r var val 00:05:25.589 02:10:28 -- accel/accel.sh@21 -- # val= 00:05:25.589 02:10:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.589 02:10:28 -- accel/accel.sh@20 -- # IFS=: 00:05:25.589 02:10:28 -- accel/accel.sh@20 -- # read -r var val 00:05:25.589 02:10:28 -- accel/accel.sh@21 -- # val= 00:05:25.589 02:10:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.589 02:10:28 -- accel/accel.sh@20 -- # IFS=: 00:05:25.589 02:10:28 -- accel/accel.sh@20 -- # read -r var val 00:05:25.589 02:10:28 -- accel/accel.sh@21 -- # val= 00:05:25.589 02:10:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.589 02:10:28 -- accel/accel.sh@20 -- # IFS=: 00:05:25.589 02:10:28 -- accel/accel.sh@20 -- # read -r var val 00:05:25.589 02:10:28 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:25.589 02:10:28 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:25.589 02:10:28 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:25.589 00:05:25.589 real 0m2.930s 00:05:25.589 user 0m2.642s 00:05:25.589 sys 0m0.279s 00:05:25.589 02:10:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:25.589 02:10:28 -- common/autotest_common.sh@10 -- # set +x 00:05:25.589 ************************************ 00:05:25.589 END TEST accel_crc32c 00:05:25.589 ************************************ 00:05:25.589 02:10:29 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:25.589 02:10:29 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:25.589 02:10:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:25.589 02:10:29 -- common/autotest_common.sh@10 -- # set +x 00:05:25.589 ************************************ 00:05:25.589 START TEST accel_crc32c_C2 00:05:25.589 ************************************ 00:05:25.589 02:10:29 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:25.589 02:10:29 -- accel/accel.sh@16 -- # local accel_opc 00:05:25.589 02:10:29 -- accel/accel.sh@17 -- # local accel_module 00:05:25.589 02:10:29 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:25.589 02:10:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:25.589 02:10:29 -- accel/accel.sh@12 -- # build_accel_config 00:05:25.589 02:10:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:25.589 02:10:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:25.589 02:10:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:25.589 02:10:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:25.589 02:10:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:25.589 02:10:29 -- accel/accel.sh@41 -- # local IFS=, 00:05:25.589 02:10:29 -- accel/accel.sh@42 -- # jq -r . 00:05:25.589 [2024-11-29 02:10:29.032281] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:25.589 [2024-11-29 02:10:29.032362] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3257 ] 00:05:25.589 EAL: No free 2048 kB hugepages reported on node 1 00:05:25.589 [2024-11-29 02:10:29.093261] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:25.589 [2024-11-29 02:10:29.209757] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:26.964 02:10:30 -- accel/accel.sh@18 -- # out=' 00:05:26.964 SPDK Configuration: 00:05:26.964 Core mask: 0x1 00:05:26.964 00:05:26.964 Accel Perf Configuration: 00:05:26.964 Workload Type: crc32c 00:05:26.964 CRC-32C seed: 0 00:05:26.964 Transfer size: 4096 bytes 00:05:26.964 Vector count 2 00:05:26.964 Module: software 00:05:26.964 Queue depth: 32 00:05:26.964 Allocate depth: 32 00:05:26.964 # threads/core: 1 00:05:26.964 Run time: 1 seconds 00:05:26.964 Verify: Yes 00:05:26.964 00:05:26.964 Running for 1 seconds... 00:05:26.964 00:05:26.964 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:26.964 ------------------------------------------------------------------------------------ 00:05:26.964 0,0 314496/s 2457 MiB/s 0 0 00:05:26.964 ==================================================================================== 00:05:26.964 Total 314496/s 1228 MiB/s 0 0' 00:05:26.964 02:10:30 -- accel/accel.sh@20 -- # IFS=: 00:05:26.964 02:10:30 -- accel/accel.sh@20 -- # read -r var val 00:05:26.964 02:10:30 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:26.964 02:10:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:26.964 02:10:30 -- accel/accel.sh@12 -- # build_accel_config 00:05:26.964 02:10:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:26.964 02:10:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:26.964 02:10:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:26.964 02:10:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:26.964 02:10:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:26.964 02:10:30 -- accel/accel.sh@41 -- # local IFS=, 00:05:26.964 02:10:30 -- accel/accel.sh@42 -- # jq -r . 00:05:26.964 [2024-11-29 02:10:30.508683] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:26.964 [2024-11-29 02:10:30.508768] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3397 ] 00:05:26.964 EAL: No free 2048 kB hugepages reported on node 1 00:05:26.964 [2024-11-29 02:10:30.569665] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:27.223 [2024-11-29 02:10:30.686560] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.223 02:10:30 -- accel/accel.sh@21 -- # val= 00:05:27.223 02:10:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # IFS=: 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # read -r var val 00:05:27.223 02:10:30 -- accel/accel.sh@21 -- # val= 00:05:27.223 02:10:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # IFS=: 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # read -r var val 00:05:27.223 02:10:30 -- accel/accel.sh@21 -- # val=0x1 00:05:27.223 02:10:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # IFS=: 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # read -r var val 00:05:27.223 02:10:30 -- accel/accel.sh@21 -- # val= 00:05:27.223 02:10:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # IFS=: 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # read -r var val 00:05:27.223 02:10:30 -- accel/accel.sh@21 -- # val= 00:05:27.223 02:10:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # IFS=: 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # read -r var val 00:05:27.223 02:10:30 -- accel/accel.sh@21 -- # val=crc32c 00:05:27.223 02:10:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.223 02:10:30 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # IFS=: 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # read -r var val 00:05:27.223 02:10:30 -- accel/accel.sh@21 -- # val=0 00:05:27.223 02:10:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # IFS=: 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # read -r var val 00:05:27.223 02:10:30 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:27.223 02:10:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # IFS=: 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # read -r var val 00:05:27.223 02:10:30 -- accel/accel.sh@21 -- # val= 00:05:27.223 02:10:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # IFS=: 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # read -r var val 00:05:27.223 02:10:30 -- accel/accel.sh@21 -- # val=software 00:05:27.223 02:10:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.223 02:10:30 -- accel/accel.sh@23 -- # accel_module=software 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # IFS=: 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # read -r var val 00:05:27.223 02:10:30 -- accel/accel.sh@21 -- # val=32 00:05:27.223 02:10:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # IFS=: 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # read -r var val 00:05:27.223 02:10:30 -- accel/accel.sh@21 -- # val=32 00:05:27.223 02:10:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # IFS=: 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # read -r var val 00:05:27.223 02:10:30 -- accel/accel.sh@21 -- # val=1 00:05:27.223 02:10:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # IFS=: 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # read -r var val 00:05:27.223 02:10:30 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:27.223 02:10:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # IFS=: 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # read -r var val 00:05:27.223 02:10:30 -- accel/accel.sh@21 -- # val=Yes 00:05:27.223 02:10:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # IFS=: 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # read -r var val 00:05:27.223 02:10:30 -- accel/accel.sh@21 -- # val= 00:05:27.223 02:10:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # IFS=: 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # read -r var val 00:05:27.223 02:10:30 -- accel/accel.sh@21 -- # val= 00:05:27.223 02:10:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # IFS=: 00:05:27.223 02:10:30 -- accel/accel.sh@20 -- # read -r var val 00:05:28.596 02:10:31 -- accel/accel.sh@21 -- # val= 00:05:28.596 02:10:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.596 02:10:31 -- accel/accel.sh@20 -- # IFS=: 00:05:28.596 02:10:31 -- accel/accel.sh@20 -- # read -r var val 00:05:28.596 02:10:31 -- accel/accel.sh@21 -- # val= 00:05:28.596 02:10:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.596 02:10:31 -- accel/accel.sh@20 -- # IFS=: 00:05:28.596 02:10:31 -- accel/accel.sh@20 -- # read -r var val 00:05:28.596 02:10:31 -- accel/accel.sh@21 -- # val= 00:05:28.596 02:10:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.596 02:10:31 -- accel/accel.sh@20 -- # IFS=: 00:05:28.596 02:10:31 -- accel/accel.sh@20 -- # read -r var val 00:05:28.596 02:10:31 -- accel/accel.sh@21 -- # val= 00:05:28.596 02:10:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.596 02:10:31 -- accel/accel.sh@20 -- # IFS=: 00:05:28.596 02:10:31 -- accel/accel.sh@20 -- # read -r var val 00:05:28.596 02:10:31 -- accel/accel.sh@21 -- # val= 00:05:28.596 02:10:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.596 02:10:31 -- accel/accel.sh@20 -- # IFS=: 00:05:28.596 02:10:31 -- accel/accel.sh@20 -- # read -r var val 00:05:28.596 02:10:31 -- accel/accel.sh@21 -- # val= 00:05:28.596 02:10:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.596 02:10:31 -- accel/accel.sh@20 -- # IFS=: 00:05:28.596 02:10:31 -- accel/accel.sh@20 -- # read -r var val 00:05:28.596 02:10:31 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:28.596 02:10:31 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:28.596 02:10:31 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:28.596 00:05:28.596 real 0m2.953s 00:05:28.596 user 0m2.664s 00:05:28.596 sys 0m0.278s 00:05:28.596 02:10:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:28.596 02:10:31 -- common/autotest_common.sh@10 -- # set +x 00:05:28.596 ************************************ 00:05:28.596 END TEST accel_crc32c_C2 00:05:28.596 ************************************ 00:05:28.596 02:10:31 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:28.596 02:10:31 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:28.596 02:10:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:28.596 02:10:31 -- common/autotest_common.sh@10 -- # set +x 00:05:28.596 ************************************ 00:05:28.596 START TEST accel_copy 00:05:28.596 ************************************ 00:05:28.596 02:10:31 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:05:28.596 02:10:31 -- accel/accel.sh@16 -- # local accel_opc 00:05:28.596 02:10:31 -- accel/accel.sh@17 -- # local accel_module 00:05:28.596 02:10:31 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:05:28.596 02:10:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:28.596 02:10:31 -- accel/accel.sh@12 -- # build_accel_config 00:05:28.596 02:10:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:28.596 02:10:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:28.597 02:10:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:28.597 02:10:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:28.597 02:10:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:28.597 02:10:31 -- accel/accel.sh@41 -- # local IFS=, 00:05:28.597 02:10:32 -- accel/accel.sh@42 -- # jq -r . 00:05:28.597 [2024-11-29 02:10:32.016361] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:28.597 [2024-11-29 02:10:32.016465] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3569 ] 00:05:28.597 EAL: No free 2048 kB hugepages reported on node 1 00:05:28.597 [2024-11-29 02:10:32.079301] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:28.597 [2024-11-29 02:10:32.199449] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:29.970 02:10:33 -- accel/accel.sh@18 -- # out=' 00:05:29.970 SPDK Configuration: 00:05:29.970 Core mask: 0x1 00:05:29.970 00:05:29.970 Accel Perf Configuration: 00:05:29.970 Workload Type: copy 00:05:29.970 Transfer size: 4096 bytes 00:05:29.970 Vector count 1 00:05:29.970 Module: software 00:05:29.970 Queue depth: 32 00:05:29.970 Allocate depth: 32 00:05:29.970 # threads/core: 1 00:05:29.970 Run time: 1 seconds 00:05:29.970 Verify: Yes 00:05:29.970 00:05:29.970 Running for 1 seconds... 00:05:29.970 00:05:29.970 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:29.970 ------------------------------------------------------------------------------------ 00:05:29.970 0,0 278112/s 1086 MiB/s 0 0 00:05:29.970 ==================================================================================== 00:05:29.970 Total 278112/s 1086 MiB/s 0 0' 00:05:29.970 02:10:33 -- accel/accel.sh@20 -- # IFS=: 00:05:29.970 02:10:33 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:29.970 02:10:33 -- accel/accel.sh@20 -- # read -r var val 00:05:29.970 02:10:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:29.970 02:10:33 -- accel/accel.sh@12 -- # build_accel_config 00:05:29.971 02:10:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:29.971 02:10:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:29.971 02:10:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:29.971 02:10:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:29.971 02:10:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:29.971 02:10:33 -- accel/accel.sh@41 -- # local IFS=, 00:05:29.971 02:10:33 -- accel/accel.sh@42 -- # jq -r . 00:05:29.971 [2024-11-29 02:10:33.476152] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:29.971 [2024-11-29 02:10:33.476235] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3825 ] 00:05:29.971 EAL: No free 2048 kB hugepages reported on node 1 00:05:29.971 [2024-11-29 02:10:33.537423] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:30.229 [2024-11-29 02:10:33.654484] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:30.229 02:10:33 -- accel/accel.sh@21 -- # val= 00:05:30.229 02:10:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.229 02:10:33 -- accel/accel.sh@20 -- # IFS=: 00:05:30.229 02:10:33 -- accel/accel.sh@20 -- # read -r var val 00:05:30.229 02:10:33 -- accel/accel.sh@21 -- # val= 00:05:30.229 02:10:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.229 02:10:33 -- accel/accel.sh@20 -- # IFS=: 00:05:30.229 02:10:33 -- accel/accel.sh@20 -- # read -r var val 00:05:30.229 02:10:33 -- accel/accel.sh@21 -- # val=0x1 00:05:30.229 02:10:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.229 02:10:33 -- accel/accel.sh@20 -- # IFS=: 00:05:30.229 02:10:33 -- accel/accel.sh@20 -- # read -r var val 00:05:30.229 02:10:33 -- accel/accel.sh@21 -- # val= 00:05:30.229 02:10:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.229 02:10:33 -- accel/accel.sh@20 -- # IFS=: 00:05:30.229 02:10:33 -- accel/accel.sh@20 -- # read -r var val 00:05:30.229 02:10:33 -- accel/accel.sh@21 -- # val= 00:05:30.229 02:10:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.229 02:10:33 -- accel/accel.sh@20 -- # IFS=: 00:05:30.229 02:10:33 -- accel/accel.sh@20 -- # read -r var val 00:05:30.229 02:10:33 -- accel/accel.sh@21 -- # val=copy 00:05:30.229 02:10:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.229 02:10:33 -- accel/accel.sh@24 -- # accel_opc=copy 00:05:30.229 02:10:33 -- accel/accel.sh@20 -- # IFS=: 00:05:30.229 02:10:33 -- accel/accel.sh@20 -- # read -r var val 00:05:30.229 02:10:33 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:30.229 02:10:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.229 02:10:33 -- accel/accel.sh@20 -- # IFS=: 00:05:30.229 02:10:33 -- accel/accel.sh@20 -- # read -r var val 00:05:30.229 02:10:33 -- accel/accel.sh@21 -- # val= 00:05:30.229 02:10:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.229 02:10:33 -- accel/accel.sh@20 -- # IFS=: 00:05:30.229 02:10:33 -- accel/accel.sh@20 -- # read -r var val 00:05:30.229 02:10:33 -- accel/accel.sh@21 -- # val=software 00:05:30.229 02:10:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.229 02:10:33 -- accel/accel.sh@23 -- # accel_module=software 00:05:30.229 02:10:33 -- accel/accel.sh@20 -- # IFS=: 00:05:30.229 02:10:33 -- accel/accel.sh@20 -- # read -r var val 00:05:30.229 02:10:33 -- accel/accel.sh@21 -- # val=32 00:05:30.229 02:10:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.229 02:10:33 -- accel/accel.sh@20 -- # IFS=: 00:05:30.229 02:10:33 -- accel/accel.sh@20 -- # read -r var val 00:05:30.229 02:10:33 -- accel/accel.sh@21 -- # val=32 00:05:30.229 02:10:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.229 02:10:33 -- accel/accel.sh@20 -- # IFS=: 00:05:30.229 02:10:33 -- accel/accel.sh@20 -- # read -r var val 00:05:30.229 02:10:33 -- accel/accel.sh@21 -- # val=1 00:05:30.229 02:10:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.229 02:10:33 -- accel/accel.sh@20 -- # IFS=: 00:05:30.229 02:10:33 -- accel/accel.sh@20 -- # read -r var val 00:05:30.229 02:10:33 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:30.229 02:10:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.229 02:10:33 -- accel/accel.sh@20 -- # IFS=: 00:05:30.229 02:10:33 -- accel/accel.sh@20 -- # read -r var val 00:05:30.229 02:10:33 -- accel/accel.sh@21 -- # val=Yes 00:05:30.229 02:10:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.230 02:10:33 -- accel/accel.sh@20 -- # IFS=: 00:05:30.230 02:10:33 -- accel/accel.sh@20 -- # read -r var val 00:05:30.230 02:10:33 -- accel/accel.sh@21 -- # val= 00:05:30.230 02:10:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.230 02:10:33 -- accel/accel.sh@20 -- # IFS=: 00:05:30.230 02:10:33 -- accel/accel.sh@20 -- # read -r var val 00:05:30.230 02:10:33 -- accel/accel.sh@21 -- # val= 00:05:30.230 02:10:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.230 02:10:33 -- accel/accel.sh@20 -- # IFS=: 00:05:30.230 02:10:33 -- accel/accel.sh@20 -- # read -r var val 00:05:31.603 02:10:34 -- accel/accel.sh@21 -- # val= 00:05:31.603 02:10:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.603 02:10:34 -- accel/accel.sh@20 -- # IFS=: 00:05:31.603 02:10:34 -- accel/accel.sh@20 -- # read -r var val 00:05:31.603 02:10:34 -- accel/accel.sh@21 -- # val= 00:05:31.603 02:10:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.603 02:10:34 -- accel/accel.sh@20 -- # IFS=: 00:05:31.603 02:10:34 -- accel/accel.sh@20 -- # read -r var val 00:05:31.603 02:10:34 -- accel/accel.sh@21 -- # val= 00:05:31.603 02:10:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.603 02:10:34 -- accel/accel.sh@20 -- # IFS=: 00:05:31.603 02:10:34 -- accel/accel.sh@20 -- # read -r var val 00:05:31.603 02:10:34 -- accel/accel.sh@21 -- # val= 00:05:31.603 02:10:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.603 02:10:34 -- accel/accel.sh@20 -- # IFS=: 00:05:31.603 02:10:34 -- accel/accel.sh@20 -- # read -r var val 00:05:31.603 02:10:34 -- accel/accel.sh@21 -- # val= 00:05:31.603 02:10:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.603 02:10:34 -- accel/accel.sh@20 -- # IFS=: 00:05:31.603 02:10:34 -- accel/accel.sh@20 -- # read -r var val 00:05:31.603 02:10:34 -- accel/accel.sh@21 -- # val= 00:05:31.604 02:10:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.604 02:10:34 -- accel/accel.sh@20 -- # IFS=: 00:05:31.604 02:10:34 -- accel/accel.sh@20 -- # read -r var val 00:05:31.604 02:10:34 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:31.604 02:10:34 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:05:31.604 02:10:34 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:31.604 00:05:31.604 real 0m2.938s 00:05:31.604 user 0m2.639s 00:05:31.604 sys 0m0.288s 00:05:31.604 02:10:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:31.604 02:10:34 -- common/autotest_common.sh@10 -- # set +x 00:05:31.604 ************************************ 00:05:31.604 END TEST accel_copy 00:05:31.604 ************************************ 00:05:31.604 02:10:34 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:31.604 02:10:34 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:31.604 02:10:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:31.604 02:10:34 -- common/autotest_common.sh@10 -- # set +x 00:05:31.604 ************************************ 00:05:31.604 START TEST accel_fill 00:05:31.604 ************************************ 00:05:31.604 02:10:34 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:31.604 02:10:34 -- accel/accel.sh@16 -- # local accel_opc 00:05:31.604 02:10:34 -- accel/accel.sh@17 -- # local accel_module 00:05:31.604 02:10:34 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:31.604 02:10:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:31.604 02:10:34 -- accel/accel.sh@12 -- # build_accel_config 00:05:31.604 02:10:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:31.604 02:10:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:31.604 02:10:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:31.604 02:10:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:31.604 02:10:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:31.604 02:10:34 -- accel/accel.sh@41 -- # local IFS=, 00:05:31.604 02:10:34 -- accel/accel.sh@42 -- # jq -r . 00:05:31.604 [2024-11-29 02:10:34.976517] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:31.604 [2024-11-29 02:10:34.976591] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3984 ] 00:05:31.604 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.604 [2024-11-29 02:10:35.040601] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:31.604 [2024-11-29 02:10:35.157014] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:32.978 02:10:36 -- accel/accel.sh@18 -- # out=' 00:05:32.978 SPDK Configuration: 00:05:32.978 Core mask: 0x1 00:05:32.978 00:05:32.978 Accel Perf Configuration: 00:05:32.978 Workload Type: fill 00:05:32.978 Fill pattern: 0x80 00:05:32.978 Transfer size: 4096 bytes 00:05:32.978 Vector count 1 00:05:32.978 Module: software 00:05:32.978 Queue depth: 64 00:05:32.978 Allocate depth: 64 00:05:32.978 # threads/core: 1 00:05:32.978 Run time: 1 seconds 00:05:32.978 Verify: Yes 00:05:32.978 00:05:32.978 Running for 1 seconds... 00:05:32.978 00:05:32.978 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:32.978 ------------------------------------------------------------------------------------ 00:05:32.978 0,0 405120/s 1582 MiB/s 0 0 00:05:32.978 ==================================================================================== 00:05:32.978 Total 405120/s 1582 MiB/s 0 0' 00:05:32.978 02:10:36 -- accel/accel.sh@20 -- # IFS=: 00:05:32.978 02:10:36 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:32.978 02:10:36 -- accel/accel.sh@20 -- # read -r var val 00:05:32.978 02:10:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:32.978 02:10:36 -- accel/accel.sh@12 -- # build_accel_config 00:05:32.978 02:10:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:32.978 02:10:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:32.978 02:10:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:32.978 02:10:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:32.978 02:10:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:32.978 02:10:36 -- accel/accel.sh@41 -- # local IFS=, 00:05:32.978 02:10:36 -- accel/accel.sh@42 -- # jq -r . 00:05:32.978 [2024-11-29 02:10:36.460439] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:32.978 [2024-11-29 02:10:36.460525] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4126 ] 00:05:32.978 EAL: No free 2048 kB hugepages reported on node 1 00:05:32.978 [2024-11-29 02:10:36.521632] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:32.978 [2024-11-29 02:10:36.639618] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.237 02:10:36 -- accel/accel.sh@21 -- # val= 00:05:33.237 02:10:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # IFS=: 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # read -r var val 00:05:33.237 02:10:36 -- accel/accel.sh@21 -- # val= 00:05:33.237 02:10:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # IFS=: 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # read -r var val 00:05:33.237 02:10:36 -- accel/accel.sh@21 -- # val=0x1 00:05:33.237 02:10:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # IFS=: 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # read -r var val 00:05:33.237 02:10:36 -- accel/accel.sh@21 -- # val= 00:05:33.237 02:10:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # IFS=: 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # read -r var val 00:05:33.237 02:10:36 -- accel/accel.sh@21 -- # val= 00:05:33.237 02:10:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # IFS=: 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # read -r var val 00:05:33.237 02:10:36 -- accel/accel.sh@21 -- # val=fill 00:05:33.237 02:10:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.237 02:10:36 -- accel/accel.sh@24 -- # accel_opc=fill 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # IFS=: 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # read -r var val 00:05:33.237 02:10:36 -- accel/accel.sh@21 -- # val=0x80 00:05:33.237 02:10:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # IFS=: 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # read -r var val 00:05:33.237 02:10:36 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:33.237 02:10:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # IFS=: 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # read -r var val 00:05:33.237 02:10:36 -- accel/accel.sh@21 -- # val= 00:05:33.237 02:10:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # IFS=: 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # read -r var val 00:05:33.237 02:10:36 -- accel/accel.sh@21 -- # val=software 00:05:33.237 02:10:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.237 02:10:36 -- accel/accel.sh@23 -- # accel_module=software 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # IFS=: 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # read -r var val 00:05:33.237 02:10:36 -- accel/accel.sh@21 -- # val=64 00:05:33.237 02:10:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # IFS=: 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # read -r var val 00:05:33.237 02:10:36 -- accel/accel.sh@21 -- # val=64 00:05:33.237 02:10:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # IFS=: 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # read -r var val 00:05:33.237 02:10:36 -- accel/accel.sh@21 -- # val=1 00:05:33.237 02:10:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # IFS=: 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # read -r var val 00:05:33.237 02:10:36 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:33.237 02:10:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # IFS=: 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # read -r var val 00:05:33.237 02:10:36 -- accel/accel.sh@21 -- # val=Yes 00:05:33.237 02:10:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # IFS=: 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # read -r var val 00:05:33.237 02:10:36 -- accel/accel.sh@21 -- # val= 00:05:33.237 02:10:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # IFS=: 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # read -r var val 00:05:33.237 02:10:36 -- accel/accel.sh@21 -- # val= 00:05:33.237 02:10:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # IFS=: 00:05:33.237 02:10:36 -- accel/accel.sh@20 -- # read -r var val 00:05:34.614 02:10:37 -- accel/accel.sh@21 -- # val= 00:05:34.614 02:10:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.614 02:10:37 -- accel/accel.sh@20 -- # IFS=: 00:05:34.614 02:10:37 -- accel/accel.sh@20 -- # read -r var val 00:05:34.614 02:10:37 -- accel/accel.sh@21 -- # val= 00:05:34.614 02:10:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.614 02:10:37 -- accel/accel.sh@20 -- # IFS=: 00:05:34.614 02:10:37 -- accel/accel.sh@20 -- # read -r var val 00:05:34.614 02:10:37 -- accel/accel.sh@21 -- # val= 00:05:34.614 02:10:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.614 02:10:37 -- accel/accel.sh@20 -- # IFS=: 00:05:34.614 02:10:37 -- accel/accel.sh@20 -- # read -r var val 00:05:34.614 02:10:37 -- accel/accel.sh@21 -- # val= 00:05:34.614 02:10:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.614 02:10:37 -- accel/accel.sh@20 -- # IFS=: 00:05:34.614 02:10:37 -- accel/accel.sh@20 -- # read -r var val 00:05:34.614 02:10:37 -- accel/accel.sh@21 -- # val= 00:05:34.614 02:10:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.614 02:10:37 -- accel/accel.sh@20 -- # IFS=: 00:05:34.614 02:10:37 -- accel/accel.sh@20 -- # read -r var val 00:05:34.614 02:10:37 -- accel/accel.sh@21 -- # val= 00:05:34.614 02:10:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.614 02:10:37 -- accel/accel.sh@20 -- # IFS=: 00:05:34.614 02:10:37 -- accel/accel.sh@20 -- # read -r var val 00:05:34.614 02:10:37 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:34.614 02:10:37 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:05:34.614 02:10:37 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:34.614 00:05:34.614 real 0m2.959s 00:05:34.614 user 0m2.651s 00:05:34.614 sys 0m0.298s 00:05:34.614 02:10:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:34.614 02:10:37 -- common/autotest_common.sh@10 -- # set +x 00:05:34.614 ************************************ 00:05:34.614 END TEST accel_fill 00:05:34.614 ************************************ 00:05:34.614 02:10:37 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:34.614 02:10:37 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:34.614 02:10:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.614 02:10:37 -- common/autotest_common.sh@10 -- # set +x 00:05:34.614 ************************************ 00:05:34.614 START TEST accel_copy_crc32c 00:05:34.614 ************************************ 00:05:34.614 02:10:37 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:05:34.614 02:10:37 -- accel/accel.sh@16 -- # local accel_opc 00:05:34.614 02:10:37 -- accel/accel.sh@17 -- # local accel_module 00:05:34.614 02:10:37 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:34.614 02:10:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:34.614 02:10:37 -- accel/accel.sh@12 -- # build_accel_config 00:05:34.614 02:10:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:34.614 02:10:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:34.614 02:10:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:34.614 02:10:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:34.614 02:10:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:34.614 02:10:37 -- accel/accel.sh@41 -- # local IFS=, 00:05:34.614 02:10:37 -- accel/accel.sh@42 -- # jq -r . 00:05:34.614 [2024-11-29 02:10:37.958927] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:34.614 [2024-11-29 02:10:37.959007] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4413 ] 00:05:34.614 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.614 [2024-11-29 02:10:38.022852] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:34.614 [2024-11-29 02:10:38.142609] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.989 02:10:39 -- accel/accel.sh@18 -- # out=' 00:05:35.989 SPDK Configuration: 00:05:35.989 Core mask: 0x1 00:05:35.989 00:05:35.989 Accel Perf Configuration: 00:05:35.989 Workload Type: copy_crc32c 00:05:35.989 CRC-32C seed: 0 00:05:35.989 Vector size: 4096 bytes 00:05:35.989 Transfer size: 4096 bytes 00:05:35.989 Vector count 1 00:05:35.989 Module: software 00:05:35.989 Queue depth: 32 00:05:35.989 Allocate depth: 32 00:05:35.989 # threads/core: 1 00:05:35.989 Run time: 1 seconds 00:05:35.989 Verify: Yes 00:05:35.989 00:05:35.989 Running for 1 seconds... 00:05:35.989 00:05:35.989 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:35.989 ------------------------------------------------------------------------------------ 00:05:35.989 0,0 215904/s 843 MiB/s 0 0 00:05:35.989 ==================================================================================== 00:05:35.989 Total 215904/s 843 MiB/s 0 0' 00:05:35.989 02:10:39 -- accel/accel.sh@20 -- # IFS=: 00:05:35.989 02:10:39 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:35.989 02:10:39 -- accel/accel.sh@20 -- # read -r var val 00:05:35.989 02:10:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:35.989 02:10:39 -- accel/accel.sh@12 -- # build_accel_config 00:05:35.989 02:10:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:35.989 02:10:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.989 02:10:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.989 02:10:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:35.989 02:10:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:35.989 02:10:39 -- accel/accel.sh@41 -- # local IFS=, 00:05:35.989 02:10:39 -- accel/accel.sh@42 -- # jq -r . 00:05:35.989 [2024-11-29 02:10:39.446731] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:35.989 [2024-11-29 02:10:39.446818] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4554 ] 00:05:35.989 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.989 [2024-11-29 02:10:39.509276] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:35.989 [2024-11-29 02:10:39.629140] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.248 02:10:39 -- accel/accel.sh@21 -- # val= 00:05:36.248 02:10:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.248 02:10:39 -- accel/accel.sh@20 -- # IFS=: 00:05:36.248 02:10:39 -- accel/accel.sh@20 -- # read -r var val 00:05:36.248 02:10:39 -- accel/accel.sh@21 -- # val= 00:05:36.248 02:10:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.248 02:10:39 -- accel/accel.sh@20 -- # IFS=: 00:05:36.248 02:10:39 -- accel/accel.sh@20 -- # read -r var val 00:05:36.248 02:10:39 -- accel/accel.sh@21 -- # val=0x1 00:05:36.248 02:10:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.248 02:10:39 -- accel/accel.sh@20 -- # IFS=: 00:05:36.248 02:10:39 -- accel/accel.sh@20 -- # read -r var val 00:05:36.248 02:10:39 -- accel/accel.sh@21 -- # val= 00:05:36.249 02:10:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # IFS=: 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # read -r var val 00:05:36.249 02:10:39 -- accel/accel.sh@21 -- # val= 00:05:36.249 02:10:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # IFS=: 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # read -r var val 00:05:36.249 02:10:39 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:36.249 02:10:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.249 02:10:39 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # IFS=: 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # read -r var val 00:05:36.249 02:10:39 -- accel/accel.sh@21 -- # val=0 00:05:36.249 02:10:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # IFS=: 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # read -r var val 00:05:36.249 02:10:39 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:36.249 02:10:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # IFS=: 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # read -r var val 00:05:36.249 02:10:39 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:36.249 02:10:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # IFS=: 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # read -r var val 00:05:36.249 02:10:39 -- accel/accel.sh@21 -- # val= 00:05:36.249 02:10:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # IFS=: 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # read -r var val 00:05:36.249 02:10:39 -- accel/accel.sh@21 -- # val=software 00:05:36.249 02:10:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.249 02:10:39 -- accel/accel.sh@23 -- # accel_module=software 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # IFS=: 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # read -r var val 00:05:36.249 02:10:39 -- accel/accel.sh@21 -- # val=32 00:05:36.249 02:10:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # IFS=: 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # read -r var val 00:05:36.249 02:10:39 -- accel/accel.sh@21 -- # val=32 00:05:36.249 02:10:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # IFS=: 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # read -r var val 00:05:36.249 02:10:39 -- accel/accel.sh@21 -- # val=1 00:05:36.249 02:10:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # IFS=: 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # read -r var val 00:05:36.249 02:10:39 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:36.249 02:10:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # IFS=: 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # read -r var val 00:05:36.249 02:10:39 -- accel/accel.sh@21 -- # val=Yes 00:05:36.249 02:10:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # IFS=: 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # read -r var val 00:05:36.249 02:10:39 -- accel/accel.sh@21 -- # val= 00:05:36.249 02:10:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # IFS=: 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # read -r var val 00:05:36.249 02:10:39 -- accel/accel.sh@21 -- # val= 00:05:36.249 02:10:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # IFS=: 00:05:36.249 02:10:39 -- accel/accel.sh@20 -- # read -r var val 00:05:37.624 02:10:40 -- accel/accel.sh@21 -- # val= 00:05:37.624 02:10:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.624 02:10:40 -- accel/accel.sh@20 -- # IFS=: 00:05:37.624 02:10:40 -- accel/accel.sh@20 -- # read -r var val 00:05:37.624 02:10:40 -- accel/accel.sh@21 -- # val= 00:05:37.624 02:10:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.624 02:10:40 -- accel/accel.sh@20 -- # IFS=: 00:05:37.624 02:10:40 -- accel/accel.sh@20 -- # read -r var val 00:05:37.624 02:10:40 -- accel/accel.sh@21 -- # val= 00:05:37.624 02:10:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.624 02:10:40 -- accel/accel.sh@20 -- # IFS=: 00:05:37.624 02:10:40 -- accel/accel.sh@20 -- # read -r var val 00:05:37.624 02:10:40 -- accel/accel.sh@21 -- # val= 00:05:37.624 02:10:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.624 02:10:40 -- accel/accel.sh@20 -- # IFS=: 00:05:37.624 02:10:40 -- accel/accel.sh@20 -- # read -r var val 00:05:37.624 02:10:40 -- accel/accel.sh@21 -- # val= 00:05:37.624 02:10:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.624 02:10:40 -- accel/accel.sh@20 -- # IFS=: 00:05:37.624 02:10:40 -- accel/accel.sh@20 -- # read -r var val 00:05:37.624 02:10:40 -- accel/accel.sh@21 -- # val= 00:05:37.624 02:10:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.624 02:10:40 -- accel/accel.sh@20 -- # IFS=: 00:05:37.624 02:10:40 -- accel/accel.sh@20 -- # read -r var val 00:05:37.624 02:10:40 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:37.624 02:10:40 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:37.624 02:10:40 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:37.624 00:05:37.624 real 0m2.974s 00:05:37.624 user 0m2.681s 00:05:37.624 sys 0m0.283s 00:05:37.624 02:10:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:37.624 02:10:40 -- common/autotest_common.sh@10 -- # set +x 00:05:37.624 ************************************ 00:05:37.624 END TEST accel_copy_crc32c 00:05:37.624 ************************************ 00:05:37.624 02:10:40 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:37.624 02:10:40 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:37.624 02:10:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:37.624 02:10:40 -- common/autotest_common.sh@10 -- # set +x 00:05:37.624 ************************************ 00:05:37.624 START TEST accel_copy_crc32c_C2 00:05:37.624 ************************************ 00:05:37.624 02:10:40 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:37.624 02:10:40 -- accel/accel.sh@16 -- # local accel_opc 00:05:37.624 02:10:40 -- accel/accel.sh@17 -- # local accel_module 00:05:37.624 02:10:40 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:37.624 02:10:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:37.624 02:10:40 -- accel/accel.sh@12 -- # build_accel_config 00:05:37.624 02:10:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:37.624 02:10:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:37.624 02:10:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:37.624 02:10:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:37.624 02:10:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:37.624 02:10:40 -- accel/accel.sh@41 -- # local IFS=, 00:05:37.624 02:10:40 -- accel/accel.sh@42 -- # jq -r . 00:05:37.624 [2024-11-29 02:10:40.957606] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:37.624 [2024-11-29 02:10:40.957688] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4717 ] 00:05:37.624 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.624 [2024-11-29 02:10:41.019249] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:37.624 [2024-11-29 02:10:41.139027] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.012 02:10:42 -- accel/accel.sh@18 -- # out=' 00:05:39.012 SPDK Configuration: 00:05:39.012 Core mask: 0x1 00:05:39.012 00:05:39.012 Accel Perf Configuration: 00:05:39.012 Workload Type: copy_crc32c 00:05:39.012 CRC-32C seed: 0 00:05:39.012 Vector size: 4096 bytes 00:05:39.012 Transfer size: 8192 bytes 00:05:39.012 Vector count 2 00:05:39.012 Module: software 00:05:39.012 Queue depth: 32 00:05:39.012 Allocate depth: 32 00:05:39.012 # threads/core: 1 00:05:39.012 Run time: 1 seconds 00:05:39.013 Verify: Yes 00:05:39.013 00:05:39.013 Running for 1 seconds... 00:05:39.013 00:05:39.013 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:39.013 ------------------------------------------------------------------------------------ 00:05:39.013 0,0 154624/s 1208 MiB/s 0 0 00:05:39.013 ==================================================================================== 00:05:39.013 Total 154624/s 604 MiB/s 0 0' 00:05:39.013 02:10:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.013 02:10:42 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:39.013 02:10:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.013 02:10:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:39.013 02:10:42 -- accel/accel.sh@12 -- # build_accel_config 00:05:39.013 02:10:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:39.013 02:10:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:39.013 02:10:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:39.013 02:10:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:39.013 02:10:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:39.013 02:10:42 -- accel/accel.sh@41 -- # local IFS=, 00:05:39.013 02:10:42 -- accel/accel.sh@42 -- # jq -r . 00:05:39.013 [2024-11-29 02:10:42.428762] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:39.013 [2024-11-29 02:10:42.428844] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4978 ] 00:05:39.013 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.013 [2024-11-29 02:10:42.490508] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.013 [2024-11-29 02:10:42.608424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.014 02:10:42 -- accel/accel.sh@21 -- # val= 00:05:39.014 02:10:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.014 02:10:42 -- accel/accel.sh@21 -- # val= 00:05:39.014 02:10:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.014 02:10:42 -- accel/accel.sh@21 -- # val=0x1 00:05:39.014 02:10:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.014 02:10:42 -- accel/accel.sh@21 -- # val= 00:05:39.014 02:10:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.014 02:10:42 -- accel/accel.sh@21 -- # val= 00:05:39.014 02:10:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.014 02:10:42 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:39.014 02:10:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.014 02:10:42 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.014 02:10:42 -- accel/accel.sh@21 -- # val=0 00:05:39.014 02:10:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.014 02:10:42 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:39.014 02:10:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.014 02:10:42 -- accel/accel.sh@21 -- # val='8192 bytes' 00:05:39.014 02:10:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.014 02:10:42 -- accel/accel.sh@21 -- # val= 00:05:39.014 02:10:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.014 02:10:42 -- accel/accel.sh@21 -- # val=software 00:05:39.014 02:10:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.014 02:10:42 -- accel/accel.sh@23 -- # accel_module=software 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.014 02:10:42 -- accel/accel.sh@21 -- # val=32 00:05:39.014 02:10:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.014 02:10:42 -- accel/accel.sh@21 -- # val=32 00:05:39.014 02:10:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.014 02:10:42 -- accel/accel.sh@21 -- # val=1 00:05:39.014 02:10:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.014 02:10:42 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:39.014 02:10:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.014 02:10:42 -- accel/accel.sh@21 -- # val=Yes 00:05:39.014 02:10:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.014 02:10:42 -- accel/accel.sh@21 -- # val= 00:05:39.014 02:10:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.014 02:10:42 -- accel/accel.sh@21 -- # val= 00:05:39.014 02:10:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.014 02:10:42 -- accel/accel.sh@20 -- # read -r var val 00:05:40.388 02:10:43 -- accel/accel.sh@21 -- # val= 00:05:40.388 02:10:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.388 02:10:43 -- accel/accel.sh@20 -- # IFS=: 00:05:40.388 02:10:43 -- accel/accel.sh@20 -- # read -r var val 00:05:40.388 02:10:43 -- accel/accel.sh@21 -- # val= 00:05:40.388 02:10:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.388 02:10:43 -- accel/accel.sh@20 -- # IFS=: 00:05:40.388 02:10:43 -- accel/accel.sh@20 -- # read -r var val 00:05:40.388 02:10:43 -- accel/accel.sh@21 -- # val= 00:05:40.388 02:10:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.388 02:10:43 -- accel/accel.sh@20 -- # IFS=: 00:05:40.388 02:10:43 -- accel/accel.sh@20 -- # read -r var val 00:05:40.388 02:10:43 -- accel/accel.sh@21 -- # val= 00:05:40.388 02:10:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.388 02:10:43 -- accel/accel.sh@20 -- # IFS=: 00:05:40.388 02:10:43 -- accel/accel.sh@20 -- # read -r var val 00:05:40.388 02:10:43 -- accel/accel.sh@21 -- # val= 00:05:40.388 02:10:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.388 02:10:43 -- accel/accel.sh@20 -- # IFS=: 00:05:40.388 02:10:43 -- accel/accel.sh@20 -- # read -r var val 00:05:40.388 02:10:43 -- accel/accel.sh@21 -- # val= 00:05:40.388 02:10:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.388 02:10:43 -- accel/accel.sh@20 -- # IFS=: 00:05:40.388 02:10:43 -- accel/accel.sh@20 -- # read -r var val 00:05:40.388 02:10:43 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:40.388 02:10:43 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:40.388 02:10:43 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:40.388 00:05:40.388 real 0m2.938s 00:05:40.388 user 0m2.656s 00:05:40.388 sys 0m0.272s 00:05:40.388 02:10:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:40.388 02:10:43 -- common/autotest_common.sh@10 -- # set +x 00:05:40.388 ************************************ 00:05:40.388 END TEST accel_copy_crc32c_C2 00:05:40.388 ************************************ 00:05:40.388 02:10:43 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:40.388 02:10:43 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:40.388 02:10:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.388 02:10:43 -- common/autotest_common.sh@10 -- # set +x 00:05:40.388 ************************************ 00:05:40.388 START TEST accel_dualcast 00:05:40.388 ************************************ 00:05:40.388 02:10:43 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:05:40.388 02:10:43 -- accel/accel.sh@16 -- # local accel_opc 00:05:40.388 02:10:43 -- accel/accel.sh@17 -- # local accel_module 00:05:40.388 02:10:43 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:05:40.388 02:10:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:40.388 02:10:43 -- accel/accel.sh@12 -- # build_accel_config 00:05:40.388 02:10:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:40.388 02:10:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:40.388 02:10:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:40.388 02:10:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:40.388 02:10:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:40.388 02:10:43 -- accel/accel.sh@41 -- # local IFS=, 00:05:40.388 02:10:43 -- accel/accel.sh@42 -- # jq -r . 00:05:40.388 [2024-11-29 02:10:43.919565] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:40.388 [2024-11-29 02:10:43.919646] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid5145 ] 00:05:40.388 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.388 [2024-11-29 02:10:43.980770] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:40.647 [2024-11-29 02:10:44.102062] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.021 02:10:45 -- accel/accel.sh@18 -- # out=' 00:05:42.021 SPDK Configuration: 00:05:42.022 Core mask: 0x1 00:05:42.022 00:05:42.022 Accel Perf Configuration: 00:05:42.022 Workload Type: dualcast 00:05:42.022 Transfer size: 4096 bytes 00:05:42.022 Vector count 1 00:05:42.022 Module: software 00:05:42.022 Queue depth: 32 00:05:42.022 Allocate depth: 32 00:05:42.022 # threads/core: 1 00:05:42.022 Run time: 1 seconds 00:05:42.022 Verify: Yes 00:05:42.022 00:05:42.022 Running for 1 seconds... 00:05:42.022 00:05:42.022 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:42.022 ------------------------------------------------------------------------------------ 00:05:42.022 0,0 298080/s 1164 MiB/s 0 0 00:05:42.022 ==================================================================================== 00:05:42.022 Total 298080/s 1164 MiB/s 0 0' 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.022 02:10:45 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.022 02:10:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:42.022 02:10:45 -- accel/accel.sh@12 -- # build_accel_config 00:05:42.022 02:10:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:42.022 02:10:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:42.022 02:10:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:42.022 02:10:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:42.022 02:10:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:42.022 02:10:45 -- accel/accel.sh@41 -- # local IFS=, 00:05:42.022 02:10:45 -- accel/accel.sh@42 -- # jq -r . 00:05:42.022 [2024-11-29 02:10:45.406459] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:42.022 [2024-11-29 02:10:45.406544] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid5285 ] 00:05:42.022 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.022 [2024-11-29 02:10:45.468362] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:42.022 [2024-11-29 02:10:45.588538] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.022 02:10:45 -- accel/accel.sh@21 -- # val= 00:05:42.022 02:10:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.022 02:10:45 -- accel/accel.sh@21 -- # val= 00:05:42.022 02:10:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.022 02:10:45 -- accel/accel.sh@21 -- # val=0x1 00:05:42.022 02:10:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.022 02:10:45 -- accel/accel.sh@21 -- # val= 00:05:42.022 02:10:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.022 02:10:45 -- accel/accel.sh@21 -- # val= 00:05:42.022 02:10:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.022 02:10:45 -- accel/accel.sh@21 -- # val=dualcast 00:05:42.022 02:10:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.022 02:10:45 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.022 02:10:45 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:42.022 02:10:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.022 02:10:45 -- accel/accel.sh@21 -- # val= 00:05:42.022 02:10:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.022 02:10:45 -- accel/accel.sh@21 -- # val=software 00:05:42.022 02:10:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.022 02:10:45 -- accel/accel.sh@23 -- # accel_module=software 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.022 02:10:45 -- accel/accel.sh@21 -- # val=32 00:05:42.022 02:10:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.022 02:10:45 -- accel/accel.sh@21 -- # val=32 00:05:42.022 02:10:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.022 02:10:45 -- accel/accel.sh@21 -- # val=1 00:05:42.022 02:10:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.022 02:10:45 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:42.022 02:10:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.022 02:10:45 -- accel/accel.sh@21 -- # val=Yes 00:05:42.022 02:10:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.022 02:10:45 -- accel/accel.sh@21 -- # val= 00:05:42.022 02:10:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.022 02:10:45 -- accel/accel.sh@21 -- # val= 00:05:42.022 02:10:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.022 02:10:45 -- accel/accel.sh@20 -- # read -r var val 00:05:43.397 02:10:46 -- accel/accel.sh@21 -- # val= 00:05:43.397 02:10:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.397 02:10:46 -- accel/accel.sh@20 -- # IFS=: 00:05:43.397 02:10:46 -- accel/accel.sh@20 -- # read -r var val 00:05:43.397 02:10:46 -- accel/accel.sh@21 -- # val= 00:05:43.397 02:10:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.398 02:10:46 -- accel/accel.sh@20 -- # IFS=: 00:05:43.398 02:10:46 -- accel/accel.sh@20 -- # read -r var val 00:05:43.398 02:10:46 -- accel/accel.sh@21 -- # val= 00:05:43.398 02:10:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.398 02:10:46 -- accel/accel.sh@20 -- # IFS=: 00:05:43.398 02:10:46 -- accel/accel.sh@20 -- # read -r var val 00:05:43.398 02:10:46 -- accel/accel.sh@21 -- # val= 00:05:43.398 02:10:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.398 02:10:46 -- accel/accel.sh@20 -- # IFS=: 00:05:43.398 02:10:46 -- accel/accel.sh@20 -- # read -r var val 00:05:43.398 02:10:46 -- accel/accel.sh@21 -- # val= 00:05:43.398 02:10:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.398 02:10:46 -- accel/accel.sh@20 -- # IFS=: 00:05:43.398 02:10:46 -- accel/accel.sh@20 -- # read -r var val 00:05:43.398 02:10:46 -- accel/accel.sh@21 -- # val= 00:05:43.398 02:10:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.398 02:10:46 -- accel/accel.sh@20 -- # IFS=: 00:05:43.398 02:10:46 -- accel/accel.sh@20 -- # read -r var val 00:05:43.398 02:10:46 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:43.398 02:10:46 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:05:43.398 02:10:46 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:43.398 00:05:43.398 real 0m2.968s 00:05:43.398 user 0m2.663s 00:05:43.398 sys 0m0.295s 00:05:43.398 02:10:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:43.398 02:10:46 -- common/autotest_common.sh@10 -- # set +x 00:05:43.398 ************************************ 00:05:43.398 END TEST accel_dualcast 00:05:43.398 ************************************ 00:05:43.398 02:10:46 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:05:43.398 02:10:46 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:43.398 02:10:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:43.398 02:10:46 -- common/autotest_common.sh@10 -- # set +x 00:05:43.398 ************************************ 00:05:43.398 START TEST accel_compare 00:05:43.398 ************************************ 00:05:43.398 02:10:46 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:05:43.398 02:10:46 -- accel/accel.sh@16 -- # local accel_opc 00:05:43.398 02:10:46 -- accel/accel.sh@17 -- # local accel_module 00:05:43.398 02:10:46 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:05:43.398 02:10:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:43.398 02:10:46 -- accel/accel.sh@12 -- # build_accel_config 00:05:43.398 02:10:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:43.398 02:10:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:43.398 02:10:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:43.398 02:10:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:43.398 02:10:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:43.398 02:10:46 -- accel/accel.sh@41 -- # local IFS=, 00:05:43.398 02:10:46 -- accel/accel.sh@42 -- # jq -r . 00:05:43.398 [2024-11-29 02:10:46.912044] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:43.398 [2024-11-29 02:10:46.912127] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid5563 ] 00:05:43.398 EAL: No free 2048 kB hugepages reported on node 1 00:05:43.398 [2024-11-29 02:10:46.973135] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:43.656 [2024-11-29 02:10:47.095085] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.031 02:10:48 -- accel/accel.sh@18 -- # out=' 00:05:45.031 SPDK Configuration: 00:05:45.031 Core mask: 0x1 00:05:45.031 00:05:45.031 Accel Perf Configuration: 00:05:45.031 Workload Type: compare 00:05:45.031 Transfer size: 4096 bytes 00:05:45.031 Vector count 1 00:05:45.031 Module: software 00:05:45.031 Queue depth: 32 00:05:45.031 Allocate depth: 32 00:05:45.031 # threads/core: 1 00:05:45.031 Run time: 1 seconds 00:05:45.031 Verify: Yes 00:05:45.031 00:05:45.031 Running for 1 seconds... 00:05:45.031 00:05:45.031 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:45.031 ------------------------------------------------------------------------------------ 00:05:45.031 0,0 396256/s 1547 MiB/s 0 0 00:05:45.031 ==================================================================================== 00:05:45.031 Total 396256/s 1547 MiB/s 0 0' 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.031 02:10:48 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.031 02:10:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:45.031 02:10:48 -- accel/accel.sh@12 -- # build_accel_config 00:05:45.031 02:10:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:45.031 02:10:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:45.031 02:10:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:45.031 02:10:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:45.031 02:10:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:45.031 02:10:48 -- accel/accel.sh@41 -- # local IFS=, 00:05:45.031 02:10:48 -- accel/accel.sh@42 -- # jq -r . 00:05:45.031 [2024-11-29 02:10:48.386369] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:45.031 [2024-11-29 02:10:48.386461] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid5712 ] 00:05:45.031 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.031 [2024-11-29 02:10:48.448305] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:45.031 [2024-11-29 02:10:48.568298] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.031 02:10:48 -- accel/accel.sh@21 -- # val= 00:05:45.031 02:10:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.031 02:10:48 -- accel/accel.sh@21 -- # val= 00:05:45.031 02:10:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.031 02:10:48 -- accel/accel.sh@21 -- # val=0x1 00:05:45.031 02:10:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.031 02:10:48 -- accel/accel.sh@21 -- # val= 00:05:45.031 02:10:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.031 02:10:48 -- accel/accel.sh@21 -- # val= 00:05:45.031 02:10:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.031 02:10:48 -- accel/accel.sh@21 -- # val=compare 00:05:45.031 02:10:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.031 02:10:48 -- accel/accel.sh@24 -- # accel_opc=compare 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.031 02:10:48 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:45.031 02:10:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.031 02:10:48 -- accel/accel.sh@21 -- # val= 00:05:45.031 02:10:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.031 02:10:48 -- accel/accel.sh@21 -- # val=software 00:05:45.031 02:10:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.031 02:10:48 -- accel/accel.sh@23 -- # accel_module=software 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.031 02:10:48 -- accel/accel.sh@21 -- # val=32 00:05:45.031 02:10:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.031 02:10:48 -- accel/accel.sh@21 -- # val=32 00:05:45.031 02:10:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.031 02:10:48 -- accel/accel.sh@21 -- # val=1 00:05:45.031 02:10:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.031 02:10:48 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:45.031 02:10:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.031 02:10:48 -- accel/accel.sh@21 -- # val=Yes 00:05:45.031 02:10:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.031 02:10:48 -- accel/accel.sh@21 -- # val= 00:05:45.031 02:10:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.031 02:10:48 -- accel/accel.sh@21 -- # val= 00:05:45.031 02:10:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.031 02:10:48 -- accel/accel.sh@20 -- # read -r var val 00:05:46.405 02:10:49 -- accel/accel.sh@21 -- # val= 00:05:46.405 02:10:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.405 02:10:49 -- accel/accel.sh@20 -- # IFS=: 00:05:46.405 02:10:49 -- accel/accel.sh@20 -- # read -r var val 00:05:46.405 02:10:49 -- accel/accel.sh@21 -- # val= 00:05:46.405 02:10:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.405 02:10:49 -- accel/accel.sh@20 -- # IFS=: 00:05:46.405 02:10:49 -- accel/accel.sh@20 -- # read -r var val 00:05:46.405 02:10:49 -- accel/accel.sh@21 -- # val= 00:05:46.405 02:10:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.405 02:10:49 -- accel/accel.sh@20 -- # IFS=: 00:05:46.405 02:10:49 -- accel/accel.sh@20 -- # read -r var val 00:05:46.405 02:10:49 -- accel/accel.sh@21 -- # val= 00:05:46.405 02:10:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.405 02:10:49 -- accel/accel.sh@20 -- # IFS=: 00:05:46.405 02:10:49 -- accel/accel.sh@20 -- # read -r var val 00:05:46.405 02:10:49 -- accel/accel.sh@21 -- # val= 00:05:46.405 02:10:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.405 02:10:49 -- accel/accel.sh@20 -- # IFS=: 00:05:46.405 02:10:49 -- accel/accel.sh@20 -- # read -r var val 00:05:46.405 02:10:49 -- accel/accel.sh@21 -- # val= 00:05:46.405 02:10:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.405 02:10:49 -- accel/accel.sh@20 -- # IFS=: 00:05:46.405 02:10:49 -- accel/accel.sh@20 -- # read -r var val 00:05:46.405 02:10:49 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:46.405 02:10:49 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:05:46.405 02:10:49 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:46.405 00:05:46.405 real 0m2.960s 00:05:46.405 user 0m2.646s 00:05:46.405 sys 0m0.304s 00:05:46.405 02:10:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:46.405 02:10:49 -- common/autotest_common.sh@10 -- # set +x 00:05:46.405 ************************************ 00:05:46.405 END TEST accel_compare 00:05:46.405 ************************************ 00:05:46.405 02:10:49 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:05:46.405 02:10:49 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:46.405 02:10:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:46.405 02:10:49 -- common/autotest_common.sh@10 -- # set +x 00:05:46.405 ************************************ 00:05:46.405 START TEST accel_xor 00:05:46.405 ************************************ 00:05:46.405 02:10:49 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:05:46.405 02:10:49 -- accel/accel.sh@16 -- # local accel_opc 00:05:46.405 02:10:49 -- accel/accel.sh@17 -- # local accel_module 00:05:46.405 02:10:49 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:05:46.405 02:10:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:46.405 02:10:49 -- accel/accel.sh@12 -- # build_accel_config 00:05:46.405 02:10:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:46.405 02:10:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:46.405 02:10:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:46.405 02:10:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:46.405 02:10:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:46.405 02:10:49 -- accel/accel.sh@41 -- # local IFS=, 00:05:46.405 02:10:49 -- accel/accel.sh@42 -- # jq -r . 00:05:46.405 [2024-11-29 02:10:49.900795] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:46.405 [2024-11-29 02:10:49.900879] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid5872 ] 00:05:46.405 EAL: No free 2048 kB hugepages reported on node 1 00:05:46.405 [2024-11-29 02:10:49.961679] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:46.663 [2024-11-29 02:10:50.100087] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.037 02:10:51 -- accel/accel.sh@18 -- # out=' 00:05:48.037 SPDK Configuration: 00:05:48.037 Core mask: 0x1 00:05:48.037 00:05:48.037 Accel Perf Configuration: 00:05:48.037 Workload Type: xor 00:05:48.037 Source buffers: 2 00:05:48.037 Transfer size: 4096 bytes 00:05:48.037 Vector count 1 00:05:48.037 Module: software 00:05:48.037 Queue depth: 32 00:05:48.037 Allocate depth: 32 00:05:48.037 # threads/core: 1 00:05:48.037 Run time: 1 seconds 00:05:48.037 Verify: Yes 00:05:48.037 00:05:48.037 Running for 1 seconds... 00:05:48.037 00:05:48.037 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:48.037 ------------------------------------------------------------------------------------ 00:05:48.037 0,0 191232/s 747 MiB/s 0 0 00:05:48.037 ==================================================================================== 00:05:48.037 Total 191232/s 747 MiB/s 0 0' 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.037 02:10:51 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:05:48.037 02:10:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:48.037 02:10:51 -- accel/accel.sh@12 -- # build_accel_config 00:05:48.037 02:10:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:48.037 02:10:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:48.037 02:10:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:48.037 02:10:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:48.037 02:10:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:48.037 02:10:51 -- accel/accel.sh@41 -- # local IFS=, 00:05:48.037 02:10:51 -- accel/accel.sh@42 -- # jq -r . 00:05:48.037 [2024-11-29 02:10:51.401173] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:48.037 [2024-11-29 02:10:51.401256] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid6067 ] 00:05:48.037 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.037 [2024-11-29 02:10:51.466888] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:48.037 [2024-11-29 02:10:51.587148] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.037 02:10:51 -- accel/accel.sh@21 -- # val= 00:05:48.037 02:10:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.037 02:10:51 -- accel/accel.sh@21 -- # val= 00:05:48.037 02:10:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.037 02:10:51 -- accel/accel.sh@21 -- # val=0x1 00:05:48.037 02:10:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.037 02:10:51 -- accel/accel.sh@21 -- # val= 00:05:48.037 02:10:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.037 02:10:51 -- accel/accel.sh@21 -- # val= 00:05:48.037 02:10:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.037 02:10:51 -- accel/accel.sh@21 -- # val=xor 00:05:48.037 02:10:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.037 02:10:51 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.037 02:10:51 -- accel/accel.sh@21 -- # val=2 00:05:48.037 02:10:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.037 02:10:51 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:48.037 02:10:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.037 02:10:51 -- accel/accel.sh@21 -- # val= 00:05:48.037 02:10:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.037 02:10:51 -- accel/accel.sh@21 -- # val=software 00:05:48.037 02:10:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.037 02:10:51 -- accel/accel.sh@23 -- # accel_module=software 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.037 02:10:51 -- accel/accel.sh@21 -- # val=32 00:05:48.037 02:10:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.037 02:10:51 -- accel/accel.sh@21 -- # val=32 00:05:48.037 02:10:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.037 02:10:51 -- accel/accel.sh@21 -- # val=1 00:05:48.037 02:10:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.037 02:10:51 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:48.037 02:10:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.037 02:10:51 -- accel/accel.sh@21 -- # val=Yes 00:05:48.037 02:10:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.037 02:10:51 -- accel/accel.sh@21 -- # val= 00:05:48.037 02:10:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.037 02:10:51 -- accel/accel.sh@21 -- # val= 00:05:48.037 02:10:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.037 02:10:51 -- accel/accel.sh@20 -- # read -r var val 00:05:49.409 02:10:52 -- accel/accel.sh@21 -- # val= 00:05:49.409 02:10:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.409 02:10:52 -- accel/accel.sh@20 -- # IFS=: 00:05:49.409 02:10:52 -- accel/accel.sh@20 -- # read -r var val 00:05:49.409 02:10:52 -- accel/accel.sh@21 -- # val= 00:05:49.409 02:10:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.409 02:10:52 -- accel/accel.sh@20 -- # IFS=: 00:05:49.409 02:10:52 -- accel/accel.sh@20 -- # read -r var val 00:05:49.409 02:10:52 -- accel/accel.sh@21 -- # val= 00:05:49.409 02:10:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.409 02:10:52 -- accel/accel.sh@20 -- # IFS=: 00:05:49.409 02:10:52 -- accel/accel.sh@20 -- # read -r var val 00:05:49.409 02:10:52 -- accel/accel.sh@21 -- # val= 00:05:49.409 02:10:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.409 02:10:52 -- accel/accel.sh@20 -- # IFS=: 00:05:49.409 02:10:52 -- accel/accel.sh@20 -- # read -r var val 00:05:49.409 02:10:52 -- accel/accel.sh@21 -- # val= 00:05:49.409 02:10:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.409 02:10:52 -- accel/accel.sh@20 -- # IFS=: 00:05:49.409 02:10:52 -- accel/accel.sh@20 -- # read -r var val 00:05:49.409 02:10:52 -- accel/accel.sh@21 -- # val= 00:05:49.409 02:10:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.409 02:10:52 -- accel/accel.sh@20 -- # IFS=: 00:05:49.409 02:10:52 -- accel/accel.sh@20 -- # read -r var val 00:05:49.409 02:10:52 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:49.409 02:10:52 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:49.409 02:10:52 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:49.409 00:05:49.409 real 0m2.978s 00:05:49.409 user 0m2.678s 00:05:49.409 sys 0m0.289s 00:05:49.409 02:10:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:49.409 02:10:52 -- common/autotest_common.sh@10 -- # set +x 00:05:49.409 ************************************ 00:05:49.409 END TEST accel_xor 00:05:49.409 ************************************ 00:05:49.409 02:10:52 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:05:49.410 02:10:52 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:49.410 02:10:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:49.410 02:10:52 -- common/autotest_common.sh@10 -- # set +x 00:05:49.410 ************************************ 00:05:49.410 START TEST accel_xor 00:05:49.410 ************************************ 00:05:49.410 02:10:52 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:05:49.410 02:10:52 -- accel/accel.sh@16 -- # local accel_opc 00:05:49.410 02:10:52 -- accel/accel.sh@17 -- # local accel_module 00:05:49.410 02:10:52 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:05:49.410 02:10:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:49.410 02:10:52 -- accel/accel.sh@12 -- # build_accel_config 00:05:49.410 02:10:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:49.410 02:10:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:49.410 02:10:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:49.410 02:10:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:49.410 02:10:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:49.410 02:10:52 -- accel/accel.sh@41 -- # local IFS=, 00:05:49.410 02:10:52 -- accel/accel.sh@42 -- # jq -r . 00:05:49.410 [2024-11-29 02:10:52.901884] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:49.410 [2024-11-29 02:10:52.901965] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid6293 ] 00:05:49.410 EAL: No free 2048 kB hugepages reported on node 1 00:05:49.410 [2024-11-29 02:10:52.963955] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:49.410 [2024-11-29 02:10:53.084604] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.786 02:10:54 -- accel/accel.sh@18 -- # out=' 00:05:50.786 SPDK Configuration: 00:05:50.786 Core mask: 0x1 00:05:50.786 00:05:50.786 Accel Perf Configuration: 00:05:50.786 Workload Type: xor 00:05:50.786 Source buffers: 3 00:05:50.786 Transfer size: 4096 bytes 00:05:50.786 Vector count 1 00:05:50.786 Module: software 00:05:50.786 Queue depth: 32 00:05:50.786 Allocate depth: 32 00:05:50.786 # threads/core: 1 00:05:50.786 Run time: 1 seconds 00:05:50.786 Verify: Yes 00:05:50.786 00:05:50.786 Running for 1 seconds... 00:05:50.786 00:05:50.786 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:50.786 ------------------------------------------------------------------------------------ 00:05:50.786 0,0 182144/s 711 MiB/s 0 0 00:05:50.786 ==================================================================================== 00:05:50.786 Total 182144/s 711 MiB/s 0 0' 00:05:50.786 02:10:54 -- accel/accel.sh@20 -- # IFS=: 00:05:50.786 02:10:54 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:05:50.786 02:10:54 -- accel/accel.sh@20 -- # read -r var val 00:05:50.786 02:10:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:50.786 02:10:54 -- accel/accel.sh@12 -- # build_accel_config 00:05:50.786 02:10:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:50.786 02:10:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:50.786 02:10:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:50.786 02:10:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:50.786 02:10:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:50.786 02:10:54 -- accel/accel.sh@41 -- # local IFS=, 00:05:50.786 02:10:54 -- accel/accel.sh@42 -- # jq -r . 00:05:50.786 [2024-11-29 02:10:54.388552] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:50.786 [2024-11-29 02:10:54.388639] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid6440 ] 00:05:50.786 EAL: No free 2048 kB hugepages reported on node 1 00:05:50.786 [2024-11-29 02:10:54.449880] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:51.045 [2024-11-29 02:10:54.571123] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.045 02:10:54 -- accel/accel.sh@21 -- # val= 00:05:51.045 02:10:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.045 02:10:54 -- accel/accel.sh@21 -- # val= 00:05:51.045 02:10:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.045 02:10:54 -- accel/accel.sh@21 -- # val=0x1 00:05:51.045 02:10:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.045 02:10:54 -- accel/accel.sh@21 -- # val= 00:05:51.045 02:10:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.045 02:10:54 -- accel/accel.sh@21 -- # val= 00:05:51.045 02:10:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.045 02:10:54 -- accel/accel.sh@21 -- # val=xor 00:05:51.045 02:10:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.045 02:10:54 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.045 02:10:54 -- accel/accel.sh@21 -- # val=3 00:05:51.045 02:10:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.045 02:10:54 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:51.045 02:10:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.045 02:10:54 -- accel/accel.sh@21 -- # val= 00:05:51.045 02:10:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.045 02:10:54 -- accel/accel.sh@21 -- # val=software 00:05:51.045 02:10:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.045 02:10:54 -- accel/accel.sh@23 -- # accel_module=software 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.045 02:10:54 -- accel/accel.sh@21 -- # val=32 00:05:51.045 02:10:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.045 02:10:54 -- accel/accel.sh@21 -- # val=32 00:05:51.045 02:10:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.045 02:10:54 -- accel/accel.sh@21 -- # val=1 00:05:51.045 02:10:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.045 02:10:54 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:51.045 02:10:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.045 02:10:54 -- accel/accel.sh@21 -- # val=Yes 00:05:51.045 02:10:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.045 02:10:54 -- accel/accel.sh@21 -- # val= 00:05:51.045 02:10:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.045 02:10:54 -- accel/accel.sh@21 -- # val= 00:05:51.045 02:10:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.045 02:10:54 -- accel/accel.sh@20 -- # read -r var val 00:05:52.438 02:10:55 -- accel/accel.sh@21 -- # val= 00:05:52.438 02:10:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.438 02:10:55 -- accel/accel.sh@20 -- # IFS=: 00:05:52.438 02:10:55 -- accel/accel.sh@20 -- # read -r var val 00:05:52.438 02:10:55 -- accel/accel.sh@21 -- # val= 00:05:52.438 02:10:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.438 02:10:55 -- accel/accel.sh@20 -- # IFS=: 00:05:52.438 02:10:55 -- accel/accel.sh@20 -- # read -r var val 00:05:52.438 02:10:55 -- accel/accel.sh@21 -- # val= 00:05:52.438 02:10:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.438 02:10:55 -- accel/accel.sh@20 -- # IFS=: 00:05:52.438 02:10:55 -- accel/accel.sh@20 -- # read -r var val 00:05:52.438 02:10:55 -- accel/accel.sh@21 -- # val= 00:05:52.438 02:10:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.438 02:10:55 -- accel/accel.sh@20 -- # IFS=: 00:05:52.438 02:10:55 -- accel/accel.sh@20 -- # read -r var val 00:05:52.438 02:10:55 -- accel/accel.sh@21 -- # val= 00:05:52.438 02:10:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.438 02:10:55 -- accel/accel.sh@20 -- # IFS=: 00:05:52.438 02:10:55 -- accel/accel.sh@20 -- # read -r var val 00:05:52.438 02:10:55 -- accel/accel.sh@21 -- # val= 00:05:52.438 02:10:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.438 02:10:55 -- accel/accel.sh@20 -- # IFS=: 00:05:52.438 02:10:55 -- accel/accel.sh@20 -- # read -r var val 00:05:52.438 02:10:55 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:52.438 02:10:55 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:52.438 02:10:55 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:52.438 00:05:52.438 real 0m2.974s 00:05:52.438 user 0m2.682s 00:05:52.438 sys 0m0.283s 00:05:52.438 02:10:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:52.438 02:10:55 -- common/autotest_common.sh@10 -- # set +x 00:05:52.438 ************************************ 00:05:52.438 END TEST accel_xor 00:05:52.438 ************************************ 00:05:52.438 02:10:55 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:05:52.438 02:10:55 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:52.438 02:10:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:52.438 02:10:55 -- common/autotest_common.sh@10 -- # set +x 00:05:52.438 ************************************ 00:05:52.438 START TEST accel_dif_verify 00:05:52.438 ************************************ 00:05:52.438 02:10:55 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:05:52.438 02:10:55 -- accel/accel.sh@16 -- # local accel_opc 00:05:52.438 02:10:55 -- accel/accel.sh@17 -- # local accel_module 00:05:52.438 02:10:55 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:05:52.438 02:10:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:52.438 02:10:55 -- accel/accel.sh@12 -- # build_accel_config 00:05:52.438 02:10:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:52.438 02:10:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:52.438 02:10:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:52.438 02:10:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:52.438 02:10:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:52.438 02:10:55 -- accel/accel.sh@41 -- # local IFS=, 00:05:52.438 02:10:55 -- accel/accel.sh@42 -- # jq -r . 00:05:52.438 [2024-11-29 02:10:55.902063] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:52.438 [2024-11-29 02:10:55.902150] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid6607 ] 00:05:52.438 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.438 [2024-11-29 02:10:55.966745] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:52.438 [2024-11-29 02:10:56.087582] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:53.813 02:10:57 -- accel/accel.sh@18 -- # out=' 00:05:53.813 SPDK Configuration: 00:05:53.813 Core mask: 0x1 00:05:53.813 00:05:53.813 Accel Perf Configuration: 00:05:53.813 Workload Type: dif_verify 00:05:53.813 Vector size: 4096 bytes 00:05:53.813 Transfer size: 4096 bytes 00:05:53.813 Block size: 512 bytes 00:05:53.813 Metadata size: 8 bytes 00:05:53.813 Vector count 1 00:05:53.813 Module: software 00:05:53.813 Queue depth: 32 00:05:53.813 Allocate depth: 32 00:05:53.813 # threads/core: 1 00:05:53.813 Run time: 1 seconds 00:05:53.813 Verify: No 00:05:53.813 00:05:53.813 Running for 1 seconds... 00:05:53.813 00:05:53.813 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:53.813 ------------------------------------------------------------------------------------ 00:05:53.813 0,0 81888/s 324 MiB/s 0 0 00:05:53.813 ==================================================================================== 00:05:53.813 Total 81888/s 319 MiB/s 0 0' 00:05:53.813 02:10:57 -- accel/accel.sh@20 -- # IFS=: 00:05:53.813 02:10:57 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:05:53.813 02:10:57 -- accel/accel.sh@20 -- # read -r var val 00:05:53.813 02:10:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:53.813 02:10:57 -- accel/accel.sh@12 -- # build_accel_config 00:05:53.813 02:10:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:53.813 02:10:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:53.813 02:10:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:53.813 02:10:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:53.813 02:10:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:53.813 02:10:57 -- accel/accel.sh@41 -- # local IFS=, 00:05:53.813 02:10:57 -- accel/accel.sh@42 -- # jq -r . 00:05:53.813 [2024-11-29 02:10:57.387919] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:53.814 [2024-11-29 02:10:57.388010] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid6874 ] 00:05:53.814 EAL: No free 2048 kB hugepages reported on node 1 00:05:53.814 [2024-11-29 02:10:57.449733] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:54.072 [2024-11-29 02:10:57.568968] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.072 02:10:57 -- accel/accel.sh@21 -- # val= 00:05:54.072 02:10:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.072 02:10:57 -- accel/accel.sh@21 -- # val= 00:05:54.072 02:10:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.072 02:10:57 -- accel/accel.sh@21 -- # val=0x1 00:05:54.072 02:10:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.072 02:10:57 -- accel/accel.sh@21 -- # val= 00:05:54.072 02:10:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.072 02:10:57 -- accel/accel.sh@21 -- # val= 00:05:54.072 02:10:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.072 02:10:57 -- accel/accel.sh@21 -- # val=dif_verify 00:05:54.072 02:10:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.072 02:10:57 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.072 02:10:57 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:54.072 02:10:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.072 02:10:57 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:54.072 02:10:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.072 02:10:57 -- accel/accel.sh@21 -- # val='512 bytes' 00:05:54.072 02:10:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.072 02:10:57 -- accel/accel.sh@21 -- # val='8 bytes' 00:05:54.072 02:10:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.072 02:10:57 -- accel/accel.sh@21 -- # val= 00:05:54.072 02:10:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.072 02:10:57 -- accel/accel.sh@21 -- # val=software 00:05:54.072 02:10:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.072 02:10:57 -- accel/accel.sh@23 -- # accel_module=software 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.072 02:10:57 -- accel/accel.sh@21 -- # val=32 00:05:54.072 02:10:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.072 02:10:57 -- accel/accel.sh@21 -- # val=32 00:05:54.072 02:10:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.072 02:10:57 -- accel/accel.sh@21 -- # val=1 00:05:54.072 02:10:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.072 02:10:57 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:54.072 02:10:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.072 02:10:57 -- accel/accel.sh@21 -- # val=No 00:05:54.072 02:10:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.072 02:10:57 -- accel/accel.sh@21 -- # val= 00:05:54.072 02:10:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.072 02:10:57 -- accel/accel.sh@21 -- # val= 00:05:54.072 02:10:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.072 02:10:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.073 02:10:57 -- accel/accel.sh@20 -- # read -r var val 00:05:55.447 02:10:58 -- accel/accel.sh@21 -- # val= 00:05:55.447 02:10:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.447 02:10:58 -- accel/accel.sh@20 -- # IFS=: 00:05:55.447 02:10:58 -- accel/accel.sh@20 -- # read -r var val 00:05:55.447 02:10:58 -- accel/accel.sh@21 -- # val= 00:05:55.447 02:10:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.447 02:10:58 -- accel/accel.sh@20 -- # IFS=: 00:05:55.447 02:10:58 -- accel/accel.sh@20 -- # read -r var val 00:05:55.447 02:10:58 -- accel/accel.sh@21 -- # val= 00:05:55.447 02:10:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.447 02:10:58 -- accel/accel.sh@20 -- # IFS=: 00:05:55.447 02:10:58 -- accel/accel.sh@20 -- # read -r var val 00:05:55.447 02:10:58 -- accel/accel.sh@21 -- # val= 00:05:55.447 02:10:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.447 02:10:58 -- accel/accel.sh@20 -- # IFS=: 00:05:55.447 02:10:58 -- accel/accel.sh@20 -- # read -r var val 00:05:55.447 02:10:58 -- accel/accel.sh@21 -- # val= 00:05:55.447 02:10:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.447 02:10:58 -- accel/accel.sh@20 -- # IFS=: 00:05:55.447 02:10:58 -- accel/accel.sh@20 -- # read -r var val 00:05:55.447 02:10:58 -- accel/accel.sh@21 -- # val= 00:05:55.447 02:10:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.447 02:10:58 -- accel/accel.sh@20 -- # IFS=: 00:05:55.447 02:10:58 -- accel/accel.sh@20 -- # read -r var val 00:05:55.447 02:10:58 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:55.448 02:10:58 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:05:55.448 02:10:58 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:55.448 00:05:55.448 real 0m2.972s 00:05:55.448 user 0m2.660s 00:05:55.448 sys 0m0.303s 00:05:55.448 02:10:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:55.448 02:10:58 -- common/autotest_common.sh@10 -- # set +x 00:05:55.448 ************************************ 00:05:55.448 END TEST accel_dif_verify 00:05:55.448 ************************************ 00:05:55.448 02:10:58 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:05:55.448 02:10:58 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:55.448 02:10:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:55.448 02:10:58 -- common/autotest_common.sh@10 -- # set +x 00:05:55.448 ************************************ 00:05:55.448 START TEST accel_dif_generate 00:05:55.448 ************************************ 00:05:55.448 02:10:58 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:05:55.448 02:10:58 -- accel/accel.sh@16 -- # local accel_opc 00:05:55.448 02:10:58 -- accel/accel.sh@17 -- # local accel_module 00:05:55.448 02:10:58 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:05:55.448 02:10:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:05:55.448 02:10:58 -- accel/accel.sh@12 -- # build_accel_config 00:05:55.448 02:10:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:55.448 02:10:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:55.448 02:10:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:55.448 02:10:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:55.448 02:10:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:55.448 02:10:58 -- accel/accel.sh@41 -- # local IFS=, 00:05:55.448 02:10:58 -- accel/accel.sh@42 -- # jq -r . 00:05:55.448 [2024-11-29 02:10:58.895711] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:55.448 [2024-11-29 02:10:58.895793] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid7032 ] 00:05:55.448 EAL: No free 2048 kB hugepages reported on node 1 00:05:55.448 [2024-11-29 02:10:58.956610] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:55.448 [2024-11-29 02:10:59.077961] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.823 02:11:00 -- accel/accel.sh@18 -- # out=' 00:05:56.823 SPDK Configuration: 00:05:56.823 Core mask: 0x1 00:05:56.823 00:05:56.823 Accel Perf Configuration: 00:05:56.823 Workload Type: dif_generate 00:05:56.823 Vector size: 4096 bytes 00:05:56.823 Transfer size: 4096 bytes 00:05:56.823 Block size: 512 bytes 00:05:56.823 Metadata size: 8 bytes 00:05:56.823 Vector count 1 00:05:56.823 Module: software 00:05:56.823 Queue depth: 32 00:05:56.823 Allocate depth: 32 00:05:56.823 # threads/core: 1 00:05:56.823 Run time: 1 seconds 00:05:56.823 Verify: No 00:05:56.823 00:05:56.823 Running for 1 seconds... 00:05:56.823 00:05:56.823 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:56.823 ------------------------------------------------------------------------------------ 00:05:56.823 0,0 94912/s 376 MiB/s 0 0 00:05:56.823 ==================================================================================== 00:05:56.823 Total 94912/s 370 MiB/s 0 0' 00:05:56.823 02:11:00 -- accel/accel.sh@20 -- # IFS=: 00:05:56.823 02:11:00 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:05:56.823 02:11:00 -- accel/accel.sh@20 -- # read -r var val 00:05:56.823 02:11:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:05:56.823 02:11:00 -- accel/accel.sh@12 -- # build_accel_config 00:05:56.823 02:11:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:56.823 02:11:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:56.823 02:11:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:56.823 02:11:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:56.823 02:11:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:56.823 02:11:00 -- accel/accel.sh@41 -- # local IFS=, 00:05:56.823 02:11:00 -- accel/accel.sh@42 -- # jq -r . 00:05:56.823 [2024-11-29 02:11:00.382336] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:56.823 [2024-11-29 02:11:00.382453] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid7178 ] 00:05:56.823 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.823 [2024-11-29 02:11:00.446014] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:57.082 [2024-11-29 02:11:00.568745] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.082 02:11:00 -- accel/accel.sh@21 -- # val= 00:05:57.082 02:11:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.082 02:11:00 -- accel/accel.sh@21 -- # val= 00:05:57.082 02:11:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.082 02:11:00 -- accel/accel.sh@21 -- # val=0x1 00:05:57.082 02:11:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.082 02:11:00 -- accel/accel.sh@21 -- # val= 00:05:57.082 02:11:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.082 02:11:00 -- accel/accel.sh@21 -- # val= 00:05:57.082 02:11:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.082 02:11:00 -- accel/accel.sh@21 -- # val=dif_generate 00:05:57.082 02:11:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.082 02:11:00 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.082 02:11:00 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:57.082 02:11:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.082 02:11:00 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:57.082 02:11:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.082 02:11:00 -- accel/accel.sh@21 -- # val='512 bytes' 00:05:57.082 02:11:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.082 02:11:00 -- accel/accel.sh@21 -- # val='8 bytes' 00:05:57.082 02:11:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.082 02:11:00 -- accel/accel.sh@21 -- # val= 00:05:57.082 02:11:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.082 02:11:00 -- accel/accel.sh@21 -- # val=software 00:05:57.082 02:11:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.082 02:11:00 -- accel/accel.sh@23 -- # accel_module=software 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.082 02:11:00 -- accel/accel.sh@21 -- # val=32 00:05:57.082 02:11:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.082 02:11:00 -- accel/accel.sh@21 -- # val=32 00:05:57.082 02:11:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.082 02:11:00 -- accel/accel.sh@21 -- # val=1 00:05:57.082 02:11:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.082 02:11:00 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:57.082 02:11:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.082 02:11:00 -- accel/accel.sh@21 -- # val=No 00:05:57.082 02:11:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.082 02:11:00 -- accel/accel.sh@21 -- # val= 00:05:57.082 02:11:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.082 02:11:00 -- accel/accel.sh@21 -- # val= 00:05:57.082 02:11:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.082 02:11:00 -- accel/accel.sh@20 -- # read -r var val 00:05:58.456 02:11:01 -- accel/accel.sh@21 -- # val= 00:05:58.456 02:11:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.456 02:11:01 -- accel/accel.sh@20 -- # IFS=: 00:05:58.456 02:11:01 -- accel/accel.sh@20 -- # read -r var val 00:05:58.456 02:11:01 -- accel/accel.sh@21 -- # val= 00:05:58.456 02:11:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.456 02:11:01 -- accel/accel.sh@20 -- # IFS=: 00:05:58.456 02:11:01 -- accel/accel.sh@20 -- # read -r var val 00:05:58.456 02:11:01 -- accel/accel.sh@21 -- # val= 00:05:58.456 02:11:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.456 02:11:01 -- accel/accel.sh@20 -- # IFS=: 00:05:58.456 02:11:01 -- accel/accel.sh@20 -- # read -r var val 00:05:58.456 02:11:01 -- accel/accel.sh@21 -- # val= 00:05:58.456 02:11:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.456 02:11:01 -- accel/accel.sh@20 -- # IFS=: 00:05:58.456 02:11:01 -- accel/accel.sh@20 -- # read -r var val 00:05:58.456 02:11:01 -- accel/accel.sh@21 -- # val= 00:05:58.456 02:11:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.456 02:11:01 -- accel/accel.sh@20 -- # IFS=: 00:05:58.456 02:11:01 -- accel/accel.sh@20 -- # read -r var val 00:05:58.456 02:11:01 -- accel/accel.sh@21 -- # val= 00:05:58.456 02:11:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.456 02:11:01 -- accel/accel.sh@20 -- # IFS=: 00:05:58.456 02:11:01 -- accel/accel.sh@20 -- # read -r var val 00:05:58.456 02:11:01 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:58.456 02:11:01 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:05:58.456 02:11:01 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:58.456 00:05:58.456 real 0m2.973s 00:05:58.456 user 0m2.678s 00:05:58.456 sys 0m0.286s 00:05:58.456 02:11:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:58.456 02:11:01 -- common/autotest_common.sh@10 -- # set +x 00:05:58.456 ************************************ 00:05:58.456 END TEST accel_dif_generate 00:05:58.456 ************************************ 00:05:58.456 02:11:01 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:05:58.456 02:11:01 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:58.456 02:11:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:58.456 02:11:01 -- common/autotest_common.sh@10 -- # set +x 00:05:58.456 ************************************ 00:05:58.456 START TEST accel_dif_generate_copy 00:05:58.456 ************************************ 00:05:58.456 02:11:01 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:05:58.456 02:11:01 -- accel/accel.sh@16 -- # local accel_opc 00:05:58.456 02:11:01 -- accel/accel.sh@17 -- # local accel_module 00:05:58.456 02:11:01 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:05:58.456 02:11:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:05:58.456 02:11:01 -- accel/accel.sh@12 -- # build_accel_config 00:05:58.456 02:11:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:58.456 02:11:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:58.456 02:11:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:58.456 02:11:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:58.456 02:11:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:58.456 02:11:01 -- accel/accel.sh@41 -- # local IFS=, 00:05:58.456 02:11:01 -- accel/accel.sh@42 -- # jq -r . 00:05:58.456 [2024-11-29 02:11:01.892520] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:58.456 [2024-11-29 02:11:01.892604] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid7452 ] 00:05:58.456 EAL: No free 2048 kB hugepages reported on node 1 00:05:58.456 [2024-11-29 02:11:01.958052] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:58.456 [2024-11-29 02:11:02.075968] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.886 02:11:03 -- accel/accel.sh@18 -- # out=' 00:05:59.886 SPDK Configuration: 00:05:59.886 Core mask: 0x1 00:05:59.886 00:05:59.886 Accel Perf Configuration: 00:05:59.886 Workload Type: dif_generate_copy 00:05:59.886 Vector size: 4096 bytes 00:05:59.886 Transfer size: 4096 bytes 00:05:59.886 Vector count 1 00:05:59.886 Module: software 00:05:59.886 Queue depth: 32 00:05:59.886 Allocate depth: 32 00:05:59.886 # threads/core: 1 00:05:59.886 Run time: 1 seconds 00:05:59.886 Verify: No 00:05:59.886 00:05:59.886 Running for 1 seconds... 00:05:59.886 00:05:59.886 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:59.886 ------------------------------------------------------------------------------------ 00:05:59.886 0,0 75616/s 299 MiB/s 0 0 00:05:59.886 ==================================================================================== 00:05:59.886 Total 75616/s 295 MiB/s 0 0' 00:05:59.886 02:11:03 -- accel/accel.sh@20 -- # IFS=: 00:05:59.886 02:11:03 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:05:59.886 02:11:03 -- accel/accel.sh@20 -- # read -r var val 00:05:59.886 02:11:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:05:59.886 02:11:03 -- accel/accel.sh@12 -- # build_accel_config 00:05:59.886 02:11:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:59.886 02:11:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:59.886 02:11:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:59.886 02:11:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:59.886 02:11:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:59.886 02:11:03 -- accel/accel.sh@41 -- # local IFS=, 00:05:59.886 02:11:03 -- accel/accel.sh@42 -- # jq -r . 00:05:59.886 [2024-11-29 02:11:03.368132] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:59.886 [2024-11-29 02:11:03.368220] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid7606 ] 00:05:59.886 EAL: No free 2048 kB hugepages reported on node 1 00:05:59.886 [2024-11-29 02:11:03.428981] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:00.189 [2024-11-29 02:11:03.550476] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:00.189 02:11:03 -- accel/accel.sh@21 -- # val= 00:06:00.189 02:11:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.189 02:11:03 -- accel/accel.sh@21 -- # val= 00:06:00.189 02:11:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.189 02:11:03 -- accel/accel.sh@21 -- # val=0x1 00:06:00.189 02:11:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.189 02:11:03 -- accel/accel.sh@21 -- # val= 00:06:00.189 02:11:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.189 02:11:03 -- accel/accel.sh@21 -- # val= 00:06:00.189 02:11:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.189 02:11:03 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:06:00.189 02:11:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.189 02:11:03 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.189 02:11:03 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:00.189 02:11:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.189 02:11:03 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:00.189 02:11:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.189 02:11:03 -- accel/accel.sh@21 -- # val= 00:06:00.189 02:11:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.189 02:11:03 -- accel/accel.sh@21 -- # val=software 00:06:00.189 02:11:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.189 02:11:03 -- accel/accel.sh@23 -- # accel_module=software 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.189 02:11:03 -- accel/accel.sh@21 -- # val=32 00:06:00.189 02:11:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.189 02:11:03 -- accel/accel.sh@21 -- # val=32 00:06:00.189 02:11:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.189 02:11:03 -- accel/accel.sh@21 -- # val=1 00:06:00.189 02:11:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.189 02:11:03 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:00.189 02:11:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.189 02:11:03 -- accel/accel.sh@21 -- # val=No 00:06:00.189 02:11:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.189 02:11:03 -- accel/accel.sh@21 -- # val= 00:06:00.189 02:11:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.189 02:11:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.189 02:11:03 -- accel/accel.sh@21 -- # val= 00:06:00.190 02:11:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.190 02:11:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.190 02:11:03 -- accel/accel.sh@20 -- # read -r var val 00:06:01.586 02:11:04 -- accel/accel.sh@21 -- # val= 00:06:01.586 02:11:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.586 02:11:04 -- accel/accel.sh@20 -- # IFS=: 00:06:01.586 02:11:04 -- accel/accel.sh@20 -- # read -r var val 00:06:01.586 02:11:04 -- accel/accel.sh@21 -- # val= 00:06:01.586 02:11:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.586 02:11:04 -- accel/accel.sh@20 -- # IFS=: 00:06:01.586 02:11:04 -- accel/accel.sh@20 -- # read -r var val 00:06:01.586 02:11:04 -- accel/accel.sh@21 -- # val= 00:06:01.586 02:11:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.586 02:11:04 -- accel/accel.sh@20 -- # IFS=: 00:06:01.586 02:11:04 -- accel/accel.sh@20 -- # read -r var val 00:06:01.586 02:11:04 -- accel/accel.sh@21 -- # val= 00:06:01.586 02:11:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.586 02:11:04 -- accel/accel.sh@20 -- # IFS=: 00:06:01.586 02:11:04 -- accel/accel.sh@20 -- # read -r var val 00:06:01.586 02:11:04 -- accel/accel.sh@21 -- # val= 00:06:01.586 02:11:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.586 02:11:04 -- accel/accel.sh@20 -- # IFS=: 00:06:01.586 02:11:04 -- accel/accel.sh@20 -- # read -r var val 00:06:01.586 02:11:04 -- accel/accel.sh@21 -- # val= 00:06:01.586 02:11:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.586 02:11:04 -- accel/accel.sh@20 -- # IFS=: 00:06:01.586 02:11:04 -- accel/accel.sh@20 -- # read -r var val 00:06:01.586 02:11:04 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:01.586 02:11:04 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:06:01.586 02:11:04 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:01.586 00:06:01.586 real 0m2.963s 00:06:01.586 user 0m2.668s 00:06:01.586 sys 0m0.285s 00:06:01.586 02:11:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:01.586 02:11:04 -- common/autotest_common.sh@10 -- # set +x 00:06:01.586 ************************************ 00:06:01.586 END TEST accel_dif_generate_copy 00:06:01.586 ************************************ 00:06:01.586 02:11:04 -- accel/accel.sh@107 -- # [[ y == y ]] 00:06:01.586 02:11:04 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:01.586 02:11:04 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:01.586 02:11:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:01.586 02:11:04 -- common/autotest_common.sh@10 -- # set +x 00:06:01.586 ************************************ 00:06:01.586 START TEST accel_comp 00:06:01.586 ************************************ 00:06:01.586 02:11:04 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:01.586 02:11:04 -- accel/accel.sh@16 -- # local accel_opc 00:06:01.586 02:11:04 -- accel/accel.sh@17 -- # local accel_module 00:06:01.586 02:11:04 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:01.586 02:11:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:01.586 02:11:04 -- accel/accel.sh@12 -- # build_accel_config 00:06:01.586 02:11:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:01.586 02:11:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:01.586 02:11:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:01.586 02:11:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:01.586 02:11:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:01.586 02:11:04 -- accel/accel.sh@41 -- # local IFS=, 00:06:01.586 02:11:04 -- accel/accel.sh@42 -- # jq -r . 00:06:01.586 [2024-11-29 02:11:04.882427] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:01.586 [2024-11-29 02:11:04.882509] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid7767 ] 00:06:01.586 EAL: No free 2048 kB hugepages reported on node 1 00:06:01.586 [2024-11-29 02:11:04.944157] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:01.586 [2024-11-29 02:11:05.065042] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.961 02:11:06 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:02.961 00:06:02.961 SPDK Configuration: 00:06:02.961 Core mask: 0x1 00:06:02.961 00:06:02.961 Accel Perf Configuration: 00:06:02.961 Workload Type: compress 00:06:02.961 Transfer size: 4096 bytes 00:06:02.961 Vector count 1 00:06:02.961 Module: software 00:06:02.961 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:02.961 Queue depth: 32 00:06:02.961 Allocate depth: 32 00:06:02.961 # threads/core: 1 00:06:02.961 Run time: 1 seconds 00:06:02.961 Verify: No 00:06:02.961 00:06:02.961 Running for 1 seconds... 00:06:02.961 00:06:02.961 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:02.961 ------------------------------------------------------------------------------------ 00:06:02.961 0,0 31424/s 130 MiB/s 0 0 00:06:02.961 ==================================================================================== 00:06:02.961 Total 31424/s 122 MiB/s 0 0' 00:06:02.961 02:11:06 -- accel/accel.sh@20 -- # IFS=: 00:06:02.961 02:11:06 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:02.961 02:11:06 -- accel/accel.sh@20 -- # read -r var val 00:06:02.961 02:11:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:02.961 02:11:06 -- accel/accel.sh@12 -- # build_accel_config 00:06:02.961 02:11:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:02.961 02:11:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:02.961 02:11:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:02.961 02:11:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:02.961 02:11:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:02.961 02:11:06 -- accel/accel.sh@41 -- # local IFS=, 00:06:02.961 02:11:06 -- accel/accel.sh@42 -- # jq -r . 00:06:02.961 [2024-11-29 02:11:06.364447] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:02.961 [2024-11-29 02:11:06.364537] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid8032 ] 00:06:02.961 EAL: No free 2048 kB hugepages reported on node 1 00:06:02.961 [2024-11-29 02:11:06.426964] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:02.961 [2024-11-29 02:11:06.542477] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.961 02:11:06 -- accel/accel.sh@21 -- # val= 00:06:02.961 02:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.961 02:11:06 -- accel/accel.sh@20 -- # IFS=: 00:06:02.961 02:11:06 -- accel/accel.sh@20 -- # read -r var val 00:06:02.961 02:11:06 -- accel/accel.sh@21 -- # val= 00:06:02.961 02:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.961 02:11:06 -- accel/accel.sh@20 -- # IFS=: 00:06:02.961 02:11:06 -- accel/accel.sh@20 -- # read -r var val 00:06:02.961 02:11:06 -- accel/accel.sh@21 -- # val= 00:06:02.961 02:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.961 02:11:06 -- accel/accel.sh@20 -- # IFS=: 00:06:02.961 02:11:06 -- accel/accel.sh@20 -- # read -r var val 00:06:02.961 02:11:06 -- accel/accel.sh@21 -- # val=0x1 00:06:02.961 02:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.961 02:11:06 -- accel/accel.sh@20 -- # IFS=: 00:06:02.961 02:11:06 -- accel/accel.sh@20 -- # read -r var val 00:06:02.961 02:11:06 -- accel/accel.sh@21 -- # val= 00:06:02.961 02:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.961 02:11:06 -- accel/accel.sh@20 -- # IFS=: 00:06:02.961 02:11:06 -- accel/accel.sh@20 -- # read -r var val 00:06:02.961 02:11:06 -- accel/accel.sh@21 -- # val= 00:06:02.961 02:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.961 02:11:06 -- accel/accel.sh@20 -- # IFS=: 00:06:02.961 02:11:06 -- accel/accel.sh@20 -- # read -r var val 00:06:02.961 02:11:06 -- accel/accel.sh@21 -- # val=compress 00:06:02.961 02:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.961 02:11:06 -- accel/accel.sh@24 -- # accel_opc=compress 00:06:02.961 02:11:06 -- accel/accel.sh@20 -- # IFS=: 00:06:02.961 02:11:06 -- accel/accel.sh@20 -- # read -r var val 00:06:02.961 02:11:06 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:02.961 02:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.961 02:11:06 -- accel/accel.sh@20 -- # IFS=: 00:06:02.961 02:11:06 -- accel/accel.sh@20 -- # read -r var val 00:06:02.961 02:11:06 -- accel/accel.sh@21 -- # val= 00:06:02.961 02:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.961 02:11:06 -- accel/accel.sh@20 -- # IFS=: 00:06:02.961 02:11:06 -- accel/accel.sh@20 -- # read -r var val 00:06:02.961 02:11:06 -- accel/accel.sh@21 -- # val=software 00:06:02.961 02:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.961 02:11:06 -- accel/accel.sh@23 -- # accel_module=software 00:06:02.961 02:11:06 -- accel/accel.sh@20 -- # IFS=: 00:06:02.961 02:11:06 -- accel/accel.sh@20 -- # read -r var val 00:06:02.961 02:11:06 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:02.961 02:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.962 02:11:06 -- accel/accel.sh@20 -- # IFS=: 00:06:02.962 02:11:06 -- accel/accel.sh@20 -- # read -r var val 00:06:02.962 02:11:06 -- accel/accel.sh@21 -- # val=32 00:06:02.962 02:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.962 02:11:06 -- accel/accel.sh@20 -- # IFS=: 00:06:02.962 02:11:06 -- accel/accel.sh@20 -- # read -r var val 00:06:02.962 02:11:06 -- accel/accel.sh@21 -- # val=32 00:06:02.962 02:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.962 02:11:06 -- accel/accel.sh@20 -- # IFS=: 00:06:02.962 02:11:06 -- accel/accel.sh@20 -- # read -r var val 00:06:02.962 02:11:06 -- accel/accel.sh@21 -- # val=1 00:06:02.962 02:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.962 02:11:06 -- accel/accel.sh@20 -- # IFS=: 00:06:02.962 02:11:06 -- accel/accel.sh@20 -- # read -r var val 00:06:02.962 02:11:06 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:02.962 02:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.962 02:11:06 -- accel/accel.sh@20 -- # IFS=: 00:06:02.962 02:11:06 -- accel/accel.sh@20 -- # read -r var val 00:06:02.962 02:11:06 -- accel/accel.sh@21 -- # val=No 00:06:02.962 02:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.962 02:11:06 -- accel/accel.sh@20 -- # IFS=: 00:06:02.962 02:11:06 -- accel/accel.sh@20 -- # read -r var val 00:06:02.962 02:11:06 -- accel/accel.sh@21 -- # val= 00:06:02.962 02:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.962 02:11:06 -- accel/accel.sh@20 -- # IFS=: 00:06:02.962 02:11:06 -- accel/accel.sh@20 -- # read -r var val 00:06:02.962 02:11:06 -- accel/accel.sh@21 -- # val= 00:06:02.962 02:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.962 02:11:06 -- accel/accel.sh@20 -- # IFS=: 00:06:02.962 02:11:06 -- accel/accel.sh@20 -- # read -r var val 00:06:04.337 02:11:07 -- accel/accel.sh@21 -- # val= 00:06:04.337 02:11:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.337 02:11:07 -- accel/accel.sh@20 -- # IFS=: 00:06:04.337 02:11:07 -- accel/accel.sh@20 -- # read -r var val 00:06:04.337 02:11:07 -- accel/accel.sh@21 -- # val= 00:06:04.337 02:11:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.337 02:11:07 -- accel/accel.sh@20 -- # IFS=: 00:06:04.337 02:11:07 -- accel/accel.sh@20 -- # read -r var val 00:06:04.337 02:11:07 -- accel/accel.sh@21 -- # val= 00:06:04.337 02:11:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.337 02:11:07 -- accel/accel.sh@20 -- # IFS=: 00:06:04.337 02:11:07 -- accel/accel.sh@20 -- # read -r var val 00:06:04.337 02:11:07 -- accel/accel.sh@21 -- # val= 00:06:04.337 02:11:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.337 02:11:07 -- accel/accel.sh@20 -- # IFS=: 00:06:04.337 02:11:07 -- accel/accel.sh@20 -- # read -r var val 00:06:04.337 02:11:07 -- accel/accel.sh@21 -- # val= 00:06:04.337 02:11:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.337 02:11:07 -- accel/accel.sh@20 -- # IFS=: 00:06:04.337 02:11:07 -- accel/accel.sh@20 -- # read -r var val 00:06:04.337 02:11:07 -- accel/accel.sh@21 -- # val= 00:06:04.337 02:11:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.337 02:11:07 -- accel/accel.sh@20 -- # IFS=: 00:06:04.337 02:11:07 -- accel/accel.sh@20 -- # read -r var val 00:06:04.337 02:11:07 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:04.337 02:11:07 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:06:04.337 02:11:07 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:04.337 00:06:04.337 real 0m2.956s 00:06:04.337 user 0m2.662s 00:06:04.337 sys 0m0.285s 00:06:04.337 02:11:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:04.337 02:11:07 -- common/autotest_common.sh@10 -- # set +x 00:06:04.337 ************************************ 00:06:04.337 END TEST accel_comp 00:06:04.337 ************************************ 00:06:04.337 02:11:07 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:04.337 02:11:07 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:04.337 02:11:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:04.337 02:11:07 -- common/autotest_common.sh@10 -- # set +x 00:06:04.337 ************************************ 00:06:04.337 START TEST accel_decomp 00:06:04.337 ************************************ 00:06:04.337 02:11:07 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:04.337 02:11:07 -- accel/accel.sh@16 -- # local accel_opc 00:06:04.337 02:11:07 -- accel/accel.sh@17 -- # local accel_module 00:06:04.337 02:11:07 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:04.337 02:11:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:04.337 02:11:07 -- accel/accel.sh@12 -- # build_accel_config 00:06:04.337 02:11:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:04.337 02:11:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:04.337 02:11:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:04.337 02:11:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:04.337 02:11:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:04.337 02:11:07 -- accel/accel.sh@41 -- # local IFS=, 00:06:04.337 02:11:07 -- accel/accel.sh@42 -- # jq -r . 00:06:04.337 [2024-11-29 02:11:07.862456] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:04.337 [2024-11-29 02:11:07.862539] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid8194 ] 00:06:04.337 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.337 [2024-11-29 02:11:07.924063] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:04.597 [2024-11-29 02:11:08.045224] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.974 02:11:09 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:05.974 00:06:05.974 SPDK Configuration: 00:06:05.974 Core mask: 0x1 00:06:05.974 00:06:05.974 Accel Perf Configuration: 00:06:05.974 Workload Type: decompress 00:06:05.974 Transfer size: 4096 bytes 00:06:05.974 Vector count 1 00:06:05.974 Module: software 00:06:05.974 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:05.974 Queue depth: 32 00:06:05.974 Allocate depth: 32 00:06:05.974 # threads/core: 1 00:06:05.974 Run time: 1 seconds 00:06:05.974 Verify: Yes 00:06:05.974 00:06:05.974 Running for 1 seconds... 00:06:05.974 00:06:05.974 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:05.974 ------------------------------------------------------------------------------------ 00:06:05.974 0,0 55200/s 101 MiB/s 0 0 00:06:05.974 ==================================================================================== 00:06:05.974 Total 55200/s 215 MiB/s 0 0' 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # IFS=: 00:06:05.974 02:11:09 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # read -r var val 00:06:05.974 02:11:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:05.974 02:11:09 -- accel/accel.sh@12 -- # build_accel_config 00:06:05.974 02:11:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:05.974 02:11:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:05.974 02:11:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:05.974 02:11:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:05.974 02:11:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:05.974 02:11:09 -- accel/accel.sh@41 -- # local IFS=, 00:06:05.974 02:11:09 -- accel/accel.sh@42 -- # jq -r . 00:06:05.974 [2024-11-29 02:11:09.353041] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:05.974 [2024-11-29 02:11:09.353129] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid8341 ] 00:06:05.974 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.974 [2024-11-29 02:11:09.414107] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:05.974 [2024-11-29 02:11:09.534088] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.974 02:11:09 -- accel/accel.sh@21 -- # val= 00:06:05.974 02:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # IFS=: 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # read -r var val 00:06:05.974 02:11:09 -- accel/accel.sh@21 -- # val= 00:06:05.974 02:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # IFS=: 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # read -r var val 00:06:05.974 02:11:09 -- accel/accel.sh@21 -- # val= 00:06:05.974 02:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # IFS=: 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # read -r var val 00:06:05.974 02:11:09 -- accel/accel.sh@21 -- # val=0x1 00:06:05.974 02:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # IFS=: 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # read -r var val 00:06:05.974 02:11:09 -- accel/accel.sh@21 -- # val= 00:06:05.974 02:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # IFS=: 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # read -r var val 00:06:05.974 02:11:09 -- accel/accel.sh@21 -- # val= 00:06:05.974 02:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # IFS=: 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # read -r var val 00:06:05.974 02:11:09 -- accel/accel.sh@21 -- # val=decompress 00:06:05.974 02:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.974 02:11:09 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # IFS=: 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # read -r var val 00:06:05.974 02:11:09 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:05.974 02:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # IFS=: 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # read -r var val 00:06:05.974 02:11:09 -- accel/accel.sh@21 -- # val= 00:06:05.974 02:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # IFS=: 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # read -r var val 00:06:05.974 02:11:09 -- accel/accel.sh@21 -- # val=software 00:06:05.974 02:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.974 02:11:09 -- accel/accel.sh@23 -- # accel_module=software 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # IFS=: 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # read -r var val 00:06:05.974 02:11:09 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:05.974 02:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # IFS=: 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # read -r var val 00:06:05.974 02:11:09 -- accel/accel.sh@21 -- # val=32 00:06:05.974 02:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # IFS=: 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # read -r var val 00:06:05.974 02:11:09 -- accel/accel.sh@21 -- # val=32 00:06:05.974 02:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # IFS=: 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # read -r var val 00:06:05.974 02:11:09 -- accel/accel.sh@21 -- # val=1 00:06:05.974 02:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # IFS=: 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # read -r var val 00:06:05.974 02:11:09 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:05.974 02:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # IFS=: 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # read -r var val 00:06:05.974 02:11:09 -- accel/accel.sh@21 -- # val=Yes 00:06:05.974 02:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # IFS=: 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # read -r var val 00:06:05.974 02:11:09 -- accel/accel.sh@21 -- # val= 00:06:05.974 02:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # IFS=: 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # read -r var val 00:06:05.974 02:11:09 -- accel/accel.sh@21 -- # val= 00:06:05.974 02:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.974 02:11:09 -- accel/accel.sh@20 -- # IFS=: 00:06:05.975 02:11:09 -- accel/accel.sh@20 -- # read -r var val 00:06:07.352 02:11:10 -- accel/accel.sh@21 -- # val= 00:06:07.352 02:11:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.352 02:11:10 -- accel/accel.sh@20 -- # IFS=: 00:06:07.352 02:11:10 -- accel/accel.sh@20 -- # read -r var val 00:06:07.352 02:11:10 -- accel/accel.sh@21 -- # val= 00:06:07.352 02:11:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.352 02:11:10 -- accel/accel.sh@20 -- # IFS=: 00:06:07.352 02:11:10 -- accel/accel.sh@20 -- # read -r var val 00:06:07.352 02:11:10 -- accel/accel.sh@21 -- # val= 00:06:07.352 02:11:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.352 02:11:10 -- accel/accel.sh@20 -- # IFS=: 00:06:07.352 02:11:10 -- accel/accel.sh@20 -- # read -r var val 00:06:07.352 02:11:10 -- accel/accel.sh@21 -- # val= 00:06:07.352 02:11:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.352 02:11:10 -- accel/accel.sh@20 -- # IFS=: 00:06:07.352 02:11:10 -- accel/accel.sh@20 -- # read -r var val 00:06:07.352 02:11:10 -- accel/accel.sh@21 -- # val= 00:06:07.352 02:11:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.352 02:11:10 -- accel/accel.sh@20 -- # IFS=: 00:06:07.352 02:11:10 -- accel/accel.sh@20 -- # read -r var val 00:06:07.352 02:11:10 -- accel/accel.sh@21 -- # val= 00:06:07.352 02:11:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.352 02:11:10 -- accel/accel.sh@20 -- # IFS=: 00:06:07.352 02:11:10 -- accel/accel.sh@20 -- # read -r var val 00:06:07.352 02:11:10 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:07.352 02:11:10 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:07.352 02:11:10 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:07.352 00:06:07.352 real 0m2.972s 00:06:07.352 user 0m2.676s 00:06:07.352 sys 0m0.287s 00:06:07.352 02:11:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:07.352 02:11:10 -- common/autotest_common.sh@10 -- # set +x 00:06:07.352 ************************************ 00:06:07.352 END TEST accel_decomp 00:06:07.352 ************************************ 00:06:07.352 02:11:10 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:07.352 02:11:10 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:07.352 02:11:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:07.352 02:11:10 -- common/autotest_common.sh@10 -- # set +x 00:06:07.352 ************************************ 00:06:07.352 START TEST accel_decmop_full 00:06:07.352 ************************************ 00:06:07.352 02:11:10 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:07.352 02:11:10 -- accel/accel.sh@16 -- # local accel_opc 00:06:07.352 02:11:10 -- accel/accel.sh@17 -- # local accel_module 00:06:07.352 02:11:10 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:07.352 02:11:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:07.352 02:11:10 -- accel/accel.sh@12 -- # build_accel_config 00:06:07.352 02:11:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:07.352 02:11:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:07.352 02:11:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:07.352 02:11:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:07.352 02:11:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:07.352 02:11:10 -- accel/accel.sh@41 -- # local IFS=, 00:06:07.352 02:11:10 -- accel/accel.sh@42 -- # jq -r . 00:06:07.352 [2024-11-29 02:11:10.859260] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:07.352 [2024-11-29 02:11:10.859344] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid8613 ] 00:06:07.352 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.352 [2024-11-29 02:11:10.921400] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:07.611 [2024-11-29 02:11:11.042685] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.988 02:11:12 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:08.988 00:06:08.988 SPDK Configuration: 00:06:08.988 Core mask: 0x1 00:06:08.988 00:06:08.988 Accel Perf Configuration: 00:06:08.988 Workload Type: decompress 00:06:08.988 Transfer size: 111250 bytes 00:06:08.988 Vector count 1 00:06:08.988 Module: software 00:06:08.988 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:08.988 Queue depth: 32 00:06:08.988 Allocate depth: 32 00:06:08.988 # threads/core: 1 00:06:08.988 Run time: 1 seconds 00:06:08.988 Verify: Yes 00:06:08.988 00:06:08.988 Running for 1 seconds... 00:06:08.988 00:06:08.988 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:08.988 ------------------------------------------------------------------------------------ 00:06:08.988 0,0 3776/s 155 MiB/s 0 0 00:06:08.988 ==================================================================================== 00:06:08.988 Total 3776/s 400 MiB/s 0 0' 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # IFS=: 00:06:08.988 02:11:12 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # read -r var val 00:06:08.988 02:11:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:08.988 02:11:12 -- accel/accel.sh@12 -- # build_accel_config 00:06:08.988 02:11:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:08.988 02:11:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:08.988 02:11:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:08.988 02:11:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:08.988 02:11:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:08.988 02:11:12 -- accel/accel.sh@41 -- # local IFS=, 00:06:08.988 02:11:12 -- accel/accel.sh@42 -- # jq -r . 00:06:08.988 [2024-11-29 02:11:12.353635] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:08.988 [2024-11-29 02:11:12.353725] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid8763 ] 00:06:08.988 EAL: No free 2048 kB hugepages reported on node 1 00:06:08.988 [2024-11-29 02:11:12.416204] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:08.988 [2024-11-29 02:11:12.534971] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.988 02:11:12 -- accel/accel.sh@21 -- # val= 00:06:08.988 02:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # IFS=: 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # read -r var val 00:06:08.988 02:11:12 -- accel/accel.sh@21 -- # val= 00:06:08.988 02:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # IFS=: 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # read -r var val 00:06:08.988 02:11:12 -- accel/accel.sh@21 -- # val= 00:06:08.988 02:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # IFS=: 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # read -r var val 00:06:08.988 02:11:12 -- accel/accel.sh@21 -- # val=0x1 00:06:08.988 02:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # IFS=: 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # read -r var val 00:06:08.988 02:11:12 -- accel/accel.sh@21 -- # val= 00:06:08.988 02:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # IFS=: 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # read -r var val 00:06:08.988 02:11:12 -- accel/accel.sh@21 -- # val= 00:06:08.988 02:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # IFS=: 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # read -r var val 00:06:08.988 02:11:12 -- accel/accel.sh@21 -- # val=decompress 00:06:08.988 02:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.988 02:11:12 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # IFS=: 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # read -r var val 00:06:08.988 02:11:12 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:08.988 02:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # IFS=: 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # read -r var val 00:06:08.988 02:11:12 -- accel/accel.sh@21 -- # val= 00:06:08.988 02:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # IFS=: 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # read -r var val 00:06:08.988 02:11:12 -- accel/accel.sh@21 -- # val=software 00:06:08.988 02:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.988 02:11:12 -- accel/accel.sh@23 -- # accel_module=software 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # IFS=: 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # read -r var val 00:06:08.988 02:11:12 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:08.988 02:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # IFS=: 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # read -r var val 00:06:08.988 02:11:12 -- accel/accel.sh@21 -- # val=32 00:06:08.988 02:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # IFS=: 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # read -r var val 00:06:08.988 02:11:12 -- accel/accel.sh@21 -- # val=32 00:06:08.988 02:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # IFS=: 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # read -r var val 00:06:08.988 02:11:12 -- accel/accel.sh@21 -- # val=1 00:06:08.988 02:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # IFS=: 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # read -r var val 00:06:08.988 02:11:12 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:08.988 02:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # IFS=: 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # read -r var val 00:06:08.988 02:11:12 -- accel/accel.sh@21 -- # val=Yes 00:06:08.988 02:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # IFS=: 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # read -r var val 00:06:08.988 02:11:12 -- accel/accel.sh@21 -- # val= 00:06:08.988 02:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # IFS=: 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # read -r var val 00:06:08.988 02:11:12 -- accel/accel.sh@21 -- # val= 00:06:08.988 02:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # IFS=: 00:06:08.988 02:11:12 -- accel/accel.sh@20 -- # read -r var val 00:06:10.364 02:11:13 -- accel/accel.sh@21 -- # val= 00:06:10.364 02:11:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.364 02:11:13 -- accel/accel.sh@20 -- # IFS=: 00:06:10.364 02:11:13 -- accel/accel.sh@20 -- # read -r var val 00:06:10.364 02:11:13 -- accel/accel.sh@21 -- # val= 00:06:10.364 02:11:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.364 02:11:13 -- accel/accel.sh@20 -- # IFS=: 00:06:10.364 02:11:13 -- accel/accel.sh@20 -- # read -r var val 00:06:10.364 02:11:13 -- accel/accel.sh@21 -- # val= 00:06:10.364 02:11:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.364 02:11:13 -- accel/accel.sh@20 -- # IFS=: 00:06:10.364 02:11:13 -- accel/accel.sh@20 -- # read -r var val 00:06:10.364 02:11:13 -- accel/accel.sh@21 -- # val= 00:06:10.364 02:11:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.364 02:11:13 -- accel/accel.sh@20 -- # IFS=: 00:06:10.364 02:11:13 -- accel/accel.sh@20 -- # read -r var val 00:06:10.364 02:11:13 -- accel/accel.sh@21 -- # val= 00:06:10.364 02:11:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.364 02:11:13 -- accel/accel.sh@20 -- # IFS=: 00:06:10.364 02:11:13 -- accel/accel.sh@20 -- # read -r var val 00:06:10.364 02:11:13 -- accel/accel.sh@21 -- # val= 00:06:10.364 02:11:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.364 02:11:13 -- accel/accel.sh@20 -- # IFS=: 00:06:10.364 02:11:13 -- accel/accel.sh@20 -- # read -r var val 00:06:10.364 02:11:13 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:10.364 02:11:13 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:10.364 02:11:13 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:10.364 00:06:10.364 real 0m2.975s 00:06:10.364 user 0m2.687s 00:06:10.364 sys 0m0.279s 00:06:10.364 02:11:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:10.364 02:11:13 -- common/autotest_common.sh@10 -- # set +x 00:06:10.364 ************************************ 00:06:10.364 END TEST accel_decmop_full 00:06:10.364 ************************************ 00:06:10.364 02:11:13 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:10.364 02:11:13 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:10.364 02:11:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:10.364 02:11:13 -- common/autotest_common.sh@10 -- # set +x 00:06:10.364 ************************************ 00:06:10.364 START TEST accel_decomp_mcore 00:06:10.364 ************************************ 00:06:10.364 02:11:13 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:10.364 02:11:13 -- accel/accel.sh@16 -- # local accel_opc 00:06:10.364 02:11:13 -- accel/accel.sh@17 -- # local accel_module 00:06:10.364 02:11:13 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:10.364 02:11:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:10.364 02:11:13 -- accel/accel.sh@12 -- # build_accel_config 00:06:10.364 02:11:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:10.364 02:11:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:10.364 02:11:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:10.364 02:11:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:10.364 02:11:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:10.364 02:11:13 -- accel/accel.sh@41 -- # local IFS=, 00:06:10.364 02:11:13 -- accel/accel.sh@42 -- # jq -r . 00:06:10.364 [2024-11-29 02:11:13.859407] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:10.364 [2024-11-29 02:11:13.859494] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid8922 ] 00:06:10.364 EAL: No free 2048 kB hugepages reported on node 1 00:06:10.364 [2024-11-29 02:11:13.922185] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:10.622 [2024-11-29 02:11:14.046280] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:10.622 [2024-11-29 02:11:14.046300] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:10.622 [2024-11-29 02:11:14.046353] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:10.622 [2024-11-29 02:11:14.046357] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:12.001 02:11:15 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:12.001 00:06:12.001 SPDK Configuration: 00:06:12.001 Core mask: 0xf 00:06:12.001 00:06:12.001 Accel Perf Configuration: 00:06:12.001 Workload Type: decompress 00:06:12.001 Transfer size: 4096 bytes 00:06:12.001 Vector count 1 00:06:12.001 Module: software 00:06:12.001 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:12.001 Queue depth: 32 00:06:12.001 Allocate depth: 32 00:06:12.001 # threads/core: 1 00:06:12.001 Run time: 1 seconds 00:06:12.001 Verify: Yes 00:06:12.001 00:06:12.001 Running for 1 seconds... 00:06:12.001 00:06:12.001 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:12.001 ------------------------------------------------------------------------------------ 00:06:12.001 0,0 49824/s 91 MiB/s 0 0 00:06:12.001 3,0 50496/s 93 MiB/s 0 0 00:06:12.001 2,0 50464/s 92 MiB/s 0 0 00:06:12.001 1,0 50144/s 92 MiB/s 0 0 00:06:12.001 ==================================================================================== 00:06:12.001 Total 200928/s 784 MiB/s 0 0' 00:06:12.001 02:11:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.001 02:11:15 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:12.001 02:11:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.001 02:11:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:12.001 02:11:15 -- accel/accel.sh@12 -- # build_accel_config 00:06:12.001 02:11:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:12.001 02:11:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:12.001 02:11:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:12.001 02:11:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:12.001 02:11:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:12.001 02:11:15 -- accel/accel.sh@41 -- # local IFS=, 00:06:12.001 02:11:15 -- accel/accel.sh@42 -- # jq -r . 00:06:12.001 [2024-11-29 02:11:15.357348] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:12.001 [2024-11-29 02:11:15.357444] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid9157 ] 00:06:12.001 EAL: No free 2048 kB hugepages reported on node 1 00:06:12.001 [2024-11-29 02:11:15.419862] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:12.001 [2024-11-29 02:11:15.543511] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:12.001 [2024-11-29 02:11:15.543565] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:12.001 [2024-11-29 02:11:15.543620] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:12.001 [2024-11-29 02:11:15.543623] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:12.001 02:11:15 -- accel/accel.sh@21 -- # val= 00:06:12.001 02:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.001 02:11:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.001 02:11:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.001 02:11:15 -- accel/accel.sh@21 -- # val= 00:06:12.001 02:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.001 02:11:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.001 02:11:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.002 02:11:15 -- accel/accel.sh@21 -- # val= 00:06:12.002 02:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.002 02:11:15 -- accel/accel.sh@21 -- # val=0xf 00:06:12.002 02:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.002 02:11:15 -- accel/accel.sh@21 -- # val= 00:06:12.002 02:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.002 02:11:15 -- accel/accel.sh@21 -- # val= 00:06:12.002 02:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.002 02:11:15 -- accel/accel.sh@21 -- # val=decompress 00:06:12.002 02:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.002 02:11:15 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.002 02:11:15 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:12.002 02:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.002 02:11:15 -- accel/accel.sh@21 -- # val= 00:06:12.002 02:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.002 02:11:15 -- accel/accel.sh@21 -- # val=software 00:06:12.002 02:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.002 02:11:15 -- accel/accel.sh@23 -- # accel_module=software 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.002 02:11:15 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:12.002 02:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.002 02:11:15 -- accel/accel.sh@21 -- # val=32 00:06:12.002 02:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.002 02:11:15 -- accel/accel.sh@21 -- # val=32 00:06:12.002 02:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.002 02:11:15 -- accel/accel.sh@21 -- # val=1 00:06:12.002 02:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.002 02:11:15 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:12.002 02:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.002 02:11:15 -- accel/accel.sh@21 -- # val=Yes 00:06:12.002 02:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.002 02:11:15 -- accel/accel.sh@21 -- # val= 00:06:12.002 02:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.002 02:11:15 -- accel/accel.sh@21 -- # val= 00:06:12.002 02:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.002 02:11:15 -- accel/accel.sh@20 -- # read -r var val 00:06:13.389 02:11:16 -- accel/accel.sh@21 -- # val= 00:06:13.389 02:11:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.389 02:11:16 -- accel/accel.sh@20 -- # IFS=: 00:06:13.389 02:11:16 -- accel/accel.sh@20 -- # read -r var val 00:06:13.389 02:11:16 -- accel/accel.sh@21 -- # val= 00:06:13.389 02:11:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.389 02:11:16 -- accel/accel.sh@20 -- # IFS=: 00:06:13.389 02:11:16 -- accel/accel.sh@20 -- # read -r var val 00:06:13.389 02:11:16 -- accel/accel.sh@21 -- # val= 00:06:13.389 02:11:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.389 02:11:16 -- accel/accel.sh@20 -- # IFS=: 00:06:13.389 02:11:16 -- accel/accel.sh@20 -- # read -r var val 00:06:13.389 02:11:16 -- accel/accel.sh@21 -- # val= 00:06:13.389 02:11:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.389 02:11:16 -- accel/accel.sh@20 -- # IFS=: 00:06:13.389 02:11:16 -- accel/accel.sh@20 -- # read -r var val 00:06:13.389 02:11:16 -- accel/accel.sh@21 -- # val= 00:06:13.389 02:11:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.389 02:11:16 -- accel/accel.sh@20 -- # IFS=: 00:06:13.389 02:11:16 -- accel/accel.sh@20 -- # read -r var val 00:06:13.389 02:11:16 -- accel/accel.sh@21 -- # val= 00:06:13.389 02:11:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.389 02:11:16 -- accel/accel.sh@20 -- # IFS=: 00:06:13.389 02:11:16 -- accel/accel.sh@20 -- # read -r var val 00:06:13.389 02:11:16 -- accel/accel.sh@21 -- # val= 00:06:13.389 02:11:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.389 02:11:16 -- accel/accel.sh@20 -- # IFS=: 00:06:13.389 02:11:16 -- accel/accel.sh@20 -- # read -r var val 00:06:13.389 02:11:16 -- accel/accel.sh@21 -- # val= 00:06:13.389 02:11:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.389 02:11:16 -- accel/accel.sh@20 -- # IFS=: 00:06:13.389 02:11:16 -- accel/accel.sh@20 -- # read -r var val 00:06:13.389 02:11:16 -- accel/accel.sh@21 -- # val= 00:06:13.389 02:11:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.389 02:11:16 -- accel/accel.sh@20 -- # IFS=: 00:06:13.389 02:11:16 -- accel/accel.sh@20 -- # read -r var val 00:06:13.389 02:11:16 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:13.389 02:11:16 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:13.389 02:11:16 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:13.389 00:06:13.389 real 0m3.002s 00:06:13.389 user 0m9.626s 00:06:13.389 sys 0m0.320s 00:06:13.389 02:11:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:13.389 02:11:16 -- common/autotest_common.sh@10 -- # set +x 00:06:13.389 ************************************ 00:06:13.389 END TEST accel_decomp_mcore 00:06:13.389 ************************************ 00:06:13.389 02:11:16 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:13.389 02:11:16 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:13.389 02:11:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:13.389 02:11:16 -- common/autotest_common.sh@10 -- # set +x 00:06:13.389 ************************************ 00:06:13.389 START TEST accel_decomp_full_mcore 00:06:13.389 ************************************ 00:06:13.389 02:11:16 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:13.389 02:11:16 -- accel/accel.sh@16 -- # local accel_opc 00:06:13.389 02:11:16 -- accel/accel.sh@17 -- # local accel_module 00:06:13.389 02:11:16 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:13.389 02:11:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:13.389 02:11:16 -- accel/accel.sh@12 -- # build_accel_config 00:06:13.389 02:11:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:13.389 02:11:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:13.389 02:11:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:13.389 02:11:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:13.389 02:11:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:13.389 02:11:16 -- accel/accel.sh@41 -- # local IFS=, 00:06:13.389 02:11:16 -- accel/accel.sh@42 -- # jq -r . 00:06:13.389 [2024-11-29 02:11:16.889547] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:13.389 [2024-11-29 02:11:16.889632] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid9348 ] 00:06:13.389 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.389 [2024-11-29 02:11:16.952506] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:13.651 [2024-11-29 02:11:17.077022] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:13.651 [2024-11-29 02:11:17.077077] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:13.651 [2024-11-29 02:11:17.077131] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:13.651 [2024-11-29 02:11:17.077134] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:15.038 02:11:18 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:15.038 00:06:15.038 SPDK Configuration: 00:06:15.038 Core mask: 0xf 00:06:15.038 00:06:15.038 Accel Perf Configuration: 00:06:15.038 Workload Type: decompress 00:06:15.038 Transfer size: 111250 bytes 00:06:15.038 Vector count 1 00:06:15.038 Module: software 00:06:15.038 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:15.038 Queue depth: 32 00:06:15.038 Allocate depth: 32 00:06:15.038 # threads/core: 1 00:06:15.038 Run time: 1 seconds 00:06:15.038 Verify: Yes 00:06:15.038 00:06:15.038 Running for 1 seconds... 00:06:15.038 00:06:15.038 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:15.038 ------------------------------------------------------------------------------------ 00:06:15.038 0,0 4192/s 173 MiB/s 0 0 00:06:15.038 3,0 4224/s 174 MiB/s 0 0 00:06:15.038 2,0 4192/s 173 MiB/s 0 0 00:06:15.038 1,0 4192/s 173 MiB/s 0 0 00:06:15.038 ==================================================================================== 00:06:15.038 Total 16800/s 1782 MiB/s 0 0' 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.038 02:11:18 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.038 02:11:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:15.038 02:11:18 -- accel/accel.sh@12 -- # build_accel_config 00:06:15.038 02:11:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:15.038 02:11:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:15.038 02:11:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:15.038 02:11:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:15.038 02:11:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:15.038 02:11:18 -- accel/accel.sh@41 -- # local IFS=, 00:06:15.038 02:11:18 -- accel/accel.sh@42 -- # jq -r . 00:06:15.038 [2024-11-29 02:11:18.397121] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:15.038 [2024-11-29 02:11:18.397205] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid9504 ] 00:06:15.038 EAL: No free 2048 kB hugepages reported on node 1 00:06:15.038 [2024-11-29 02:11:18.459054] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:15.038 [2024-11-29 02:11:18.580841] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:15.038 [2024-11-29 02:11:18.580947] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:15.038 [2024-11-29 02:11:18.580895] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:15.038 [2024-11-29 02:11:18.580950] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:15.038 02:11:18 -- accel/accel.sh@21 -- # val= 00:06:15.038 02:11:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.038 02:11:18 -- accel/accel.sh@21 -- # val= 00:06:15.038 02:11:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.038 02:11:18 -- accel/accel.sh@21 -- # val= 00:06:15.038 02:11:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.038 02:11:18 -- accel/accel.sh@21 -- # val=0xf 00:06:15.038 02:11:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.038 02:11:18 -- accel/accel.sh@21 -- # val= 00:06:15.038 02:11:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.038 02:11:18 -- accel/accel.sh@21 -- # val= 00:06:15.038 02:11:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.038 02:11:18 -- accel/accel.sh@21 -- # val=decompress 00:06:15.038 02:11:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.038 02:11:18 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.038 02:11:18 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:15.038 02:11:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.038 02:11:18 -- accel/accel.sh@21 -- # val= 00:06:15.038 02:11:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.038 02:11:18 -- accel/accel.sh@21 -- # val=software 00:06:15.038 02:11:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.038 02:11:18 -- accel/accel.sh@23 -- # accel_module=software 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.038 02:11:18 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:15.038 02:11:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.038 02:11:18 -- accel/accel.sh@21 -- # val=32 00:06:15.038 02:11:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.038 02:11:18 -- accel/accel.sh@21 -- # val=32 00:06:15.038 02:11:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.038 02:11:18 -- accel/accel.sh@21 -- # val=1 00:06:15.038 02:11:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.038 02:11:18 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:15.038 02:11:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.038 02:11:18 -- accel/accel.sh@21 -- # val=Yes 00:06:15.038 02:11:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.038 02:11:18 -- accel/accel.sh@21 -- # val= 00:06:15.038 02:11:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.038 02:11:18 -- accel/accel.sh@21 -- # val= 00:06:15.038 02:11:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.038 02:11:18 -- accel/accel.sh@20 -- # read -r var val 00:06:16.419 02:11:19 -- accel/accel.sh@21 -- # val= 00:06:16.419 02:11:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.419 02:11:19 -- accel/accel.sh@20 -- # IFS=: 00:06:16.419 02:11:19 -- accel/accel.sh@20 -- # read -r var val 00:06:16.419 02:11:19 -- accel/accel.sh@21 -- # val= 00:06:16.419 02:11:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.419 02:11:19 -- accel/accel.sh@20 -- # IFS=: 00:06:16.419 02:11:19 -- accel/accel.sh@20 -- # read -r var val 00:06:16.419 02:11:19 -- accel/accel.sh@21 -- # val= 00:06:16.419 02:11:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.419 02:11:19 -- accel/accel.sh@20 -- # IFS=: 00:06:16.419 02:11:19 -- accel/accel.sh@20 -- # read -r var val 00:06:16.419 02:11:19 -- accel/accel.sh@21 -- # val= 00:06:16.419 02:11:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.419 02:11:19 -- accel/accel.sh@20 -- # IFS=: 00:06:16.419 02:11:19 -- accel/accel.sh@20 -- # read -r var val 00:06:16.419 02:11:19 -- accel/accel.sh@21 -- # val= 00:06:16.419 02:11:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.419 02:11:19 -- accel/accel.sh@20 -- # IFS=: 00:06:16.419 02:11:19 -- accel/accel.sh@20 -- # read -r var val 00:06:16.419 02:11:19 -- accel/accel.sh@21 -- # val= 00:06:16.419 02:11:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.419 02:11:19 -- accel/accel.sh@20 -- # IFS=: 00:06:16.419 02:11:19 -- accel/accel.sh@20 -- # read -r var val 00:06:16.419 02:11:19 -- accel/accel.sh@21 -- # val= 00:06:16.419 02:11:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.419 02:11:19 -- accel/accel.sh@20 -- # IFS=: 00:06:16.419 02:11:19 -- accel/accel.sh@20 -- # read -r var val 00:06:16.419 02:11:19 -- accel/accel.sh@21 -- # val= 00:06:16.419 02:11:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.419 02:11:19 -- accel/accel.sh@20 -- # IFS=: 00:06:16.419 02:11:19 -- accel/accel.sh@20 -- # read -r var val 00:06:16.419 02:11:19 -- accel/accel.sh@21 -- # val= 00:06:16.419 02:11:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.419 02:11:19 -- accel/accel.sh@20 -- # IFS=: 00:06:16.419 02:11:19 -- accel/accel.sh@20 -- # read -r var val 00:06:16.419 02:11:19 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:16.419 02:11:19 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:16.419 02:11:19 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:16.419 00:06:16.419 real 0m3.018s 00:06:16.419 user 0m9.709s 00:06:16.419 sys 0m0.315s 00:06:16.419 02:11:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:16.419 02:11:19 -- common/autotest_common.sh@10 -- # set +x 00:06:16.419 ************************************ 00:06:16.419 END TEST accel_decomp_full_mcore 00:06:16.419 ************************************ 00:06:16.419 02:11:19 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:16.419 02:11:19 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:16.419 02:11:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:16.419 02:11:19 -- common/autotest_common.sh@10 -- # set +x 00:06:16.419 ************************************ 00:06:16.419 START TEST accel_decomp_mthread 00:06:16.419 ************************************ 00:06:16.419 02:11:19 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:16.419 02:11:19 -- accel/accel.sh@16 -- # local accel_opc 00:06:16.419 02:11:19 -- accel/accel.sh@17 -- # local accel_module 00:06:16.419 02:11:19 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:16.419 02:11:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:16.419 02:11:19 -- accel/accel.sh@12 -- # build_accel_config 00:06:16.419 02:11:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:16.419 02:11:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:16.419 02:11:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:16.419 02:11:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:16.419 02:11:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:16.419 02:11:19 -- accel/accel.sh@41 -- # local IFS=, 00:06:16.419 02:11:19 -- accel/accel.sh@42 -- # jq -r . 00:06:16.419 [2024-11-29 02:11:19.933331] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:16.419 [2024-11-29 02:11:19.933424] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid9754 ] 00:06:16.419 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.419 [2024-11-29 02:11:19.996424] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:16.679 [2024-11-29 02:11:20.123596] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:18.064 02:11:21 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:18.064 00:06:18.064 SPDK Configuration: 00:06:18.064 Core mask: 0x1 00:06:18.064 00:06:18.064 Accel Perf Configuration: 00:06:18.064 Workload Type: decompress 00:06:18.064 Transfer size: 4096 bytes 00:06:18.064 Vector count 1 00:06:18.064 Module: software 00:06:18.064 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:18.064 Queue depth: 32 00:06:18.064 Allocate depth: 32 00:06:18.064 # threads/core: 2 00:06:18.064 Run time: 1 seconds 00:06:18.064 Verify: Yes 00:06:18.064 00:06:18.064 Running for 1 seconds... 00:06:18.064 00:06:18.064 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:18.064 ------------------------------------------------------------------------------------ 00:06:18.064 0,1 27968/s 51 MiB/s 0 0 00:06:18.064 0,0 27872/s 51 MiB/s 0 0 00:06:18.064 ==================================================================================== 00:06:18.064 Total 55840/s 218 MiB/s 0 0' 00:06:18.064 02:11:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.064 02:11:21 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:18.064 02:11:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.064 02:11:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:18.064 02:11:21 -- accel/accel.sh@12 -- # build_accel_config 00:06:18.064 02:11:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:18.064 02:11:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:18.064 02:11:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:18.064 02:11:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:18.064 02:11:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:18.064 02:11:21 -- accel/accel.sh@41 -- # local IFS=, 00:06:18.064 02:11:21 -- accel/accel.sh@42 -- # jq -r . 00:06:18.064 [2024-11-29 02:11:21.434992] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:18.064 [2024-11-29 02:11:21.435078] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid9926 ] 00:06:18.064 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.064 [2024-11-29 02:11:21.496471] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:18.064 [2024-11-29 02:11:21.616581] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:18.064 02:11:21 -- accel/accel.sh@21 -- # val= 00:06:18.064 02:11:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.064 02:11:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.064 02:11:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.064 02:11:21 -- accel/accel.sh@21 -- # val= 00:06:18.064 02:11:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.064 02:11:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.064 02:11:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.064 02:11:21 -- accel/accel.sh@21 -- # val= 00:06:18.064 02:11:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.064 02:11:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.064 02:11:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.064 02:11:21 -- accel/accel.sh@21 -- # val=0x1 00:06:18.064 02:11:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.064 02:11:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.064 02:11:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.064 02:11:21 -- accel/accel.sh@21 -- # val= 00:06:18.064 02:11:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.064 02:11:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.064 02:11:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.064 02:11:21 -- accel/accel.sh@21 -- # val= 00:06:18.064 02:11:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.064 02:11:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.064 02:11:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.064 02:11:21 -- accel/accel.sh@21 -- # val=decompress 00:06:18.064 02:11:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.064 02:11:21 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:18.064 02:11:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.064 02:11:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.064 02:11:21 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:18.065 02:11:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.065 02:11:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.065 02:11:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.065 02:11:21 -- accel/accel.sh@21 -- # val= 00:06:18.065 02:11:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.065 02:11:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.065 02:11:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.065 02:11:21 -- accel/accel.sh@21 -- # val=software 00:06:18.065 02:11:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.065 02:11:21 -- accel/accel.sh@23 -- # accel_module=software 00:06:18.065 02:11:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.065 02:11:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.065 02:11:21 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:18.065 02:11:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.065 02:11:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.065 02:11:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.065 02:11:21 -- accel/accel.sh@21 -- # val=32 00:06:18.065 02:11:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.065 02:11:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.065 02:11:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.065 02:11:21 -- accel/accel.sh@21 -- # val=32 00:06:18.065 02:11:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.065 02:11:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.065 02:11:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.065 02:11:21 -- accel/accel.sh@21 -- # val=2 00:06:18.065 02:11:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.065 02:11:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.065 02:11:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.065 02:11:21 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:18.065 02:11:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.065 02:11:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.065 02:11:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.065 02:11:21 -- accel/accel.sh@21 -- # val=Yes 00:06:18.065 02:11:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.065 02:11:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.065 02:11:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.065 02:11:21 -- accel/accel.sh@21 -- # val= 00:06:18.065 02:11:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.065 02:11:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.065 02:11:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.065 02:11:21 -- accel/accel.sh@21 -- # val= 00:06:18.065 02:11:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.065 02:11:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.065 02:11:21 -- accel/accel.sh@20 -- # read -r var val 00:06:19.438 02:11:22 -- accel/accel.sh@21 -- # val= 00:06:19.438 02:11:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.438 02:11:22 -- accel/accel.sh@20 -- # IFS=: 00:06:19.438 02:11:22 -- accel/accel.sh@20 -- # read -r var val 00:06:19.438 02:11:22 -- accel/accel.sh@21 -- # val= 00:06:19.438 02:11:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.438 02:11:22 -- accel/accel.sh@20 -- # IFS=: 00:06:19.438 02:11:22 -- accel/accel.sh@20 -- # read -r var val 00:06:19.438 02:11:22 -- accel/accel.sh@21 -- # val= 00:06:19.438 02:11:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.438 02:11:22 -- accel/accel.sh@20 -- # IFS=: 00:06:19.438 02:11:22 -- accel/accel.sh@20 -- # read -r var val 00:06:19.438 02:11:22 -- accel/accel.sh@21 -- # val= 00:06:19.438 02:11:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.438 02:11:22 -- accel/accel.sh@20 -- # IFS=: 00:06:19.438 02:11:22 -- accel/accel.sh@20 -- # read -r var val 00:06:19.438 02:11:22 -- accel/accel.sh@21 -- # val= 00:06:19.438 02:11:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.438 02:11:22 -- accel/accel.sh@20 -- # IFS=: 00:06:19.438 02:11:22 -- accel/accel.sh@20 -- # read -r var val 00:06:19.438 02:11:22 -- accel/accel.sh@21 -- # val= 00:06:19.438 02:11:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.438 02:11:22 -- accel/accel.sh@20 -- # IFS=: 00:06:19.438 02:11:22 -- accel/accel.sh@20 -- # read -r var val 00:06:19.438 02:11:22 -- accel/accel.sh@21 -- # val= 00:06:19.438 02:11:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.438 02:11:22 -- accel/accel.sh@20 -- # IFS=: 00:06:19.438 02:11:22 -- accel/accel.sh@20 -- # read -r var val 00:06:19.438 02:11:22 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:19.438 02:11:22 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:19.438 02:11:22 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:19.438 00:06:19.438 real 0m2.995s 00:06:19.438 user 0m2.677s 00:06:19.438 sys 0m0.309s 00:06:19.438 02:11:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:19.438 02:11:22 -- common/autotest_common.sh@10 -- # set +x 00:06:19.438 ************************************ 00:06:19.438 END TEST accel_decomp_mthread 00:06:19.438 ************************************ 00:06:19.438 02:11:22 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:19.438 02:11:22 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:19.438 02:11:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:19.438 02:11:22 -- common/autotest_common.sh@10 -- # set +x 00:06:19.438 ************************************ 00:06:19.438 START TEST accel_deomp_full_mthread 00:06:19.438 ************************************ 00:06:19.438 02:11:22 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:19.438 02:11:22 -- accel/accel.sh@16 -- # local accel_opc 00:06:19.438 02:11:22 -- accel/accel.sh@17 -- # local accel_module 00:06:19.438 02:11:22 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:19.438 02:11:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:19.438 02:11:22 -- accel/accel.sh@12 -- # build_accel_config 00:06:19.438 02:11:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:19.438 02:11:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:19.438 02:11:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:19.438 02:11:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:19.438 02:11:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:19.438 02:11:22 -- accel/accel.sh@41 -- # local IFS=, 00:06:19.438 02:11:22 -- accel/accel.sh@42 -- # jq -r . 00:06:19.438 [2024-11-29 02:11:22.956235] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:19.438 [2024-11-29 02:11:22.956322] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid10084 ] 00:06:19.438 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.438 [2024-11-29 02:11:23.019269] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:19.697 [2024-11-29 02:11:23.139221] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:21.079 02:11:24 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:21.079 00:06:21.079 SPDK Configuration: 00:06:21.079 Core mask: 0x1 00:06:21.079 00:06:21.079 Accel Perf Configuration: 00:06:21.079 Workload Type: decompress 00:06:21.079 Transfer size: 111250 bytes 00:06:21.079 Vector count 1 00:06:21.079 Module: software 00:06:21.079 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:21.079 Queue depth: 32 00:06:21.079 Allocate depth: 32 00:06:21.079 # threads/core: 2 00:06:21.079 Run time: 1 seconds 00:06:21.079 Verify: Yes 00:06:21.079 00:06:21.079 Running for 1 seconds... 00:06:21.079 00:06:21.079 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:21.079 ------------------------------------------------------------------------------------ 00:06:21.079 0,1 1952/s 80 MiB/s 0 0 00:06:21.079 0,0 1920/s 79 MiB/s 0 0 00:06:21.079 ==================================================================================== 00:06:21.079 Total 3872/s 410 MiB/s 0 0' 00:06:21.079 02:11:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.079 02:11:24 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:21.079 02:11:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.080 02:11:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:21.080 02:11:24 -- accel/accel.sh@12 -- # build_accel_config 00:06:21.080 02:11:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:21.080 02:11:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:21.080 02:11:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:21.080 02:11:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:21.080 02:11:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:21.080 02:11:24 -- accel/accel.sh@41 -- # local IFS=, 00:06:21.080 02:11:24 -- accel/accel.sh@42 -- # jq -r . 00:06:21.080 [2024-11-29 02:11:24.461830] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:21.080 [2024-11-29 02:11:24.461913] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid10317 ] 00:06:21.080 EAL: No free 2048 kB hugepages reported on node 1 00:06:21.080 [2024-11-29 02:11:24.526086] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:21.080 [2024-11-29 02:11:24.646710] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:21.080 02:11:24 -- accel/accel.sh@21 -- # val= 00:06:21.080 02:11:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.080 02:11:24 -- accel/accel.sh@21 -- # val= 00:06:21.080 02:11:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.080 02:11:24 -- accel/accel.sh@21 -- # val= 00:06:21.080 02:11:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.080 02:11:24 -- accel/accel.sh@21 -- # val=0x1 00:06:21.080 02:11:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.080 02:11:24 -- accel/accel.sh@21 -- # val= 00:06:21.080 02:11:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.080 02:11:24 -- accel/accel.sh@21 -- # val= 00:06:21.080 02:11:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.080 02:11:24 -- accel/accel.sh@21 -- # val=decompress 00:06:21.080 02:11:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.080 02:11:24 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.080 02:11:24 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:21.080 02:11:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.080 02:11:24 -- accel/accel.sh@21 -- # val= 00:06:21.080 02:11:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.080 02:11:24 -- accel/accel.sh@21 -- # val=software 00:06:21.080 02:11:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.080 02:11:24 -- accel/accel.sh@23 -- # accel_module=software 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.080 02:11:24 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:21.080 02:11:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.080 02:11:24 -- accel/accel.sh@21 -- # val=32 00:06:21.080 02:11:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.080 02:11:24 -- accel/accel.sh@21 -- # val=32 00:06:21.080 02:11:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.080 02:11:24 -- accel/accel.sh@21 -- # val=2 00:06:21.080 02:11:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.080 02:11:24 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:21.080 02:11:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.080 02:11:24 -- accel/accel.sh@21 -- # val=Yes 00:06:21.080 02:11:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.080 02:11:24 -- accel/accel.sh@21 -- # val= 00:06:21.080 02:11:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.080 02:11:24 -- accel/accel.sh@21 -- # val= 00:06:21.080 02:11:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.080 02:11:24 -- accel/accel.sh@20 -- # read -r var val 00:06:22.460 02:11:25 -- accel/accel.sh@21 -- # val= 00:06:22.460 02:11:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.460 02:11:25 -- accel/accel.sh@20 -- # IFS=: 00:06:22.460 02:11:25 -- accel/accel.sh@20 -- # read -r var val 00:06:22.460 02:11:25 -- accel/accel.sh@21 -- # val= 00:06:22.460 02:11:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.460 02:11:25 -- accel/accel.sh@20 -- # IFS=: 00:06:22.460 02:11:25 -- accel/accel.sh@20 -- # read -r var val 00:06:22.460 02:11:25 -- accel/accel.sh@21 -- # val= 00:06:22.460 02:11:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.460 02:11:25 -- accel/accel.sh@20 -- # IFS=: 00:06:22.460 02:11:25 -- accel/accel.sh@20 -- # read -r var val 00:06:22.460 02:11:25 -- accel/accel.sh@21 -- # val= 00:06:22.460 02:11:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.460 02:11:25 -- accel/accel.sh@20 -- # IFS=: 00:06:22.460 02:11:25 -- accel/accel.sh@20 -- # read -r var val 00:06:22.460 02:11:25 -- accel/accel.sh@21 -- # val= 00:06:22.460 02:11:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.460 02:11:25 -- accel/accel.sh@20 -- # IFS=: 00:06:22.460 02:11:25 -- accel/accel.sh@20 -- # read -r var val 00:06:22.460 02:11:25 -- accel/accel.sh@21 -- # val= 00:06:22.460 02:11:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.460 02:11:25 -- accel/accel.sh@20 -- # IFS=: 00:06:22.460 02:11:25 -- accel/accel.sh@20 -- # read -r var val 00:06:22.460 02:11:25 -- accel/accel.sh@21 -- # val= 00:06:22.460 02:11:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.460 02:11:25 -- accel/accel.sh@20 -- # IFS=: 00:06:22.460 02:11:25 -- accel/accel.sh@20 -- # read -r var val 00:06:22.460 02:11:25 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:22.460 02:11:25 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:22.460 02:11:25 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:22.460 00:06:22.460 real 0m3.029s 00:06:22.460 user 0m2.741s 00:06:22.460 sys 0m0.279s 00:06:22.460 02:11:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:22.460 02:11:25 -- common/autotest_common.sh@10 -- # set +x 00:06:22.460 ************************************ 00:06:22.460 END TEST accel_deomp_full_mthread 00:06:22.460 ************************************ 00:06:22.460 02:11:25 -- accel/accel.sh@116 -- # [[ n == y ]] 00:06:22.460 02:11:25 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:22.460 02:11:25 -- accel/accel.sh@129 -- # build_accel_config 00:06:22.460 02:11:25 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:22.460 02:11:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:22.460 02:11:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:22.460 02:11:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:22.460 02:11:25 -- common/autotest_common.sh@10 -- # set +x 00:06:22.460 02:11:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:22.460 02:11:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:22.460 02:11:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:22.460 02:11:25 -- accel/accel.sh@41 -- # local IFS=, 00:06:22.460 02:11:25 -- accel/accel.sh@42 -- # jq -r . 00:06:22.460 ************************************ 00:06:22.460 START TEST accel_dif_functional_tests 00:06:22.460 ************************************ 00:06:22.460 02:11:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:22.460 [2024-11-29 02:11:26.028774] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:22.460 [2024-11-29 02:11:26.028861] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid10509 ] 00:06:22.460 EAL: No free 2048 kB hugepages reported on node 1 00:06:22.460 [2024-11-29 02:11:26.089847] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:22.721 [2024-11-29 02:11:26.212797] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:22.721 [2024-11-29 02:11:26.212851] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:22.721 [2024-11-29 02:11:26.212855] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:22.721 00:06:22.721 00:06:22.721 CUnit - A unit testing framework for C - Version 2.1-3 00:06:22.721 http://cunit.sourceforge.net/ 00:06:22.721 00:06:22.721 00:06:22.721 Suite: accel_dif 00:06:22.721 Test: verify: DIF generated, GUARD check ...passed 00:06:22.721 Test: verify: DIF generated, APPTAG check ...passed 00:06:22.721 Test: verify: DIF generated, REFTAG check ...passed 00:06:22.721 Test: verify: DIF not generated, GUARD check ...[2024-11-29 02:11:26.315899] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:22.721 [2024-11-29 02:11:26.315974] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:22.721 passed 00:06:22.721 Test: verify: DIF not generated, APPTAG check ...[2024-11-29 02:11:26.316017] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:22.721 [2024-11-29 02:11:26.316047] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:22.721 passed 00:06:22.721 Test: verify: DIF not generated, REFTAG check ...[2024-11-29 02:11:26.316081] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:22.721 [2024-11-29 02:11:26.316108] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:22.721 passed 00:06:22.721 Test: verify: APPTAG correct, APPTAG check ...passed 00:06:22.721 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-29 02:11:26.316179] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:06:22.721 passed 00:06:22.721 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:06:22.721 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:06:22.721 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:06:22.721 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-29 02:11:26.316333] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:06:22.721 passed 00:06:22.721 Test: generate copy: DIF generated, GUARD check ...passed 00:06:22.721 Test: generate copy: DIF generated, APTTAG check ...passed 00:06:22.721 Test: generate copy: DIF generated, REFTAG check ...passed 00:06:22.721 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:06:22.721 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:06:22.721 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:06:22.721 Test: generate copy: iovecs-len validate ...[2024-11-29 02:11:26.316600] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:06:22.721 passed 00:06:22.721 Test: generate copy: buffer alignment validate ...passed 00:06:22.721 00:06:22.721 Run Summary: Type Total Ran Passed Failed Inactive 00:06:22.721 suites 1 1 n/a 0 0 00:06:22.721 tests 20 20 20 0 0 00:06:22.721 asserts 204 204 204 0 n/a 00:06:22.721 00:06:22.721 Elapsed time = 0.003 seconds 00:06:22.981 00:06:22.981 real 0m0.595s 00:06:22.981 user 0m0.907s 00:06:22.981 sys 0m0.186s 00:06:22.982 02:11:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:22.982 02:11:26 -- common/autotest_common.sh@10 -- # set +x 00:06:22.982 ************************************ 00:06:22.982 END TEST accel_dif_functional_tests 00:06:22.982 ************************************ 00:06:22.982 00:06:22.982 real 1m3.390s 00:06:22.982 user 1m11.274s 00:06:22.982 sys 0m7.271s 00:06:22.982 02:11:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:22.982 02:11:26 -- common/autotest_common.sh@10 -- # set +x 00:06:22.982 ************************************ 00:06:22.982 END TEST accel 00:06:22.982 ************************************ 00:06:22.982 02:11:26 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:22.982 02:11:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:22.982 02:11:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:22.982 02:11:26 -- common/autotest_common.sh@10 -- # set +x 00:06:22.982 ************************************ 00:06:22.982 START TEST accel_rpc 00:06:22.982 ************************************ 00:06:22.982 02:11:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:23.241 * Looking for test storage... 00:06:23.241 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:23.241 02:11:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:23.241 02:11:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:23.241 02:11:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:23.241 02:11:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:23.241 02:11:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:23.241 02:11:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:23.241 02:11:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:23.241 02:11:26 -- scripts/common.sh@335 -- # IFS=.-: 00:06:23.241 02:11:26 -- scripts/common.sh@335 -- # read -ra ver1 00:06:23.241 02:11:26 -- scripts/common.sh@336 -- # IFS=.-: 00:06:23.241 02:11:26 -- scripts/common.sh@336 -- # read -ra ver2 00:06:23.241 02:11:26 -- scripts/common.sh@337 -- # local 'op=<' 00:06:23.241 02:11:26 -- scripts/common.sh@339 -- # ver1_l=2 00:06:23.241 02:11:26 -- scripts/common.sh@340 -- # ver2_l=1 00:06:23.241 02:11:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:23.241 02:11:26 -- scripts/common.sh@343 -- # case "$op" in 00:06:23.241 02:11:26 -- scripts/common.sh@344 -- # : 1 00:06:23.241 02:11:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:23.241 02:11:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:23.241 02:11:26 -- scripts/common.sh@364 -- # decimal 1 00:06:23.241 02:11:26 -- scripts/common.sh@352 -- # local d=1 00:06:23.241 02:11:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:23.241 02:11:26 -- scripts/common.sh@354 -- # echo 1 00:06:23.241 02:11:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:23.241 02:11:26 -- scripts/common.sh@365 -- # decimal 2 00:06:23.241 02:11:26 -- scripts/common.sh@352 -- # local d=2 00:06:23.241 02:11:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:23.241 02:11:26 -- scripts/common.sh@354 -- # echo 2 00:06:23.241 02:11:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:23.241 02:11:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:23.241 02:11:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:23.241 02:11:26 -- scripts/common.sh@367 -- # return 0 00:06:23.242 02:11:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:23.242 02:11:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:23.242 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:23.242 --rc genhtml_branch_coverage=1 00:06:23.242 --rc genhtml_function_coverage=1 00:06:23.242 --rc genhtml_legend=1 00:06:23.242 --rc geninfo_all_blocks=1 00:06:23.242 --rc geninfo_unexecuted_blocks=1 00:06:23.242 00:06:23.242 ' 00:06:23.242 02:11:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:23.242 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:23.242 --rc genhtml_branch_coverage=1 00:06:23.242 --rc genhtml_function_coverage=1 00:06:23.242 --rc genhtml_legend=1 00:06:23.242 --rc geninfo_all_blocks=1 00:06:23.242 --rc geninfo_unexecuted_blocks=1 00:06:23.242 00:06:23.242 ' 00:06:23.242 02:11:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:23.242 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:23.242 --rc genhtml_branch_coverage=1 00:06:23.242 --rc genhtml_function_coverage=1 00:06:23.242 --rc genhtml_legend=1 00:06:23.242 --rc geninfo_all_blocks=1 00:06:23.242 --rc geninfo_unexecuted_blocks=1 00:06:23.242 00:06:23.242 ' 00:06:23.242 02:11:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:23.242 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:23.242 --rc genhtml_branch_coverage=1 00:06:23.242 --rc genhtml_function_coverage=1 00:06:23.242 --rc genhtml_legend=1 00:06:23.242 --rc geninfo_all_blocks=1 00:06:23.242 --rc geninfo_unexecuted_blocks=1 00:06:23.242 00:06:23.242 ' 00:06:23.242 02:11:26 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:23.242 02:11:26 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=10711 00:06:23.242 02:11:26 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:06:23.242 02:11:26 -- accel/accel_rpc.sh@15 -- # waitforlisten 10711 00:06:23.242 02:11:26 -- common/autotest_common.sh@829 -- # '[' -z 10711 ']' 00:06:23.242 02:11:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:23.242 02:11:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:23.242 02:11:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:23.242 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:23.242 02:11:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:23.242 02:11:26 -- common/autotest_common.sh@10 -- # set +x 00:06:23.242 [2024-11-29 02:11:26.812951] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:23.242 [2024-11-29 02:11:26.813044] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid10711 ] 00:06:23.242 EAL: No free 2048 kB hugepages reported on node 1 00:06:23.242 [2024-11-29 02:11:26.868152] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:23.501 [2024-11-29 02:11:26.977610] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:23.501 [2024-11-29 02:11:26.977788] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:23.501 02:11:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:23.501 02:11:27 -- common/autotest_common.sh@862 -- # return 0 00:06:23.501 02:11:27 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:06:23.501 02:11:27 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:06:23.501 02:11:27 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:06:23.501 02:11:27 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:06:23.501 02:11:27 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:06:23.501 02:11:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:23.501 02:11:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:23.501 02:11:27 -- common/autotest_common.sh@10 -- # set +x 00:06:23.501 ************************************ 00:06:23.501 START TEST accel_assign_opcode 00:06:23.501 ************************************ 00:06:23.501 02:11:27 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:06:23.501 02:11:27 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:06:23.501 02:11:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:23.501 02:11:27 -- common/autotest_common.sh@10 -- # set +x 00:06:23.501 [2024-11-29 02:11:27.018288] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:06:23.501 02:11:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:23.501 02:11:27 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:06:23.501 02:11:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:23.501 02:11:27 -- common/autotest_common.sh@10 -- # set +x 00:06:23.501 [2024-11-29 02:11:27.026301] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:06:23.501 02:11:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:23.501 02:11:27 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:06:23.501 02:11:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:23.501 02:11:27 -- common/autotest_common.sh@10 -- # set +x 00:06:23.763 02:11:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:23.763 02:11:27 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:06:23.763 02:11:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:23.763 02:11:27 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:06:23.763 02:11:27 -- common/autotest_common.sh@10 -- # set +x 00:06:23.763 02:11:27 -- accel/accel_rpc.sh@42 -- # grep software 00:06:23.763 02:11:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:23.763 software 00:06:23.763 00:06:23.763 real 0m0.303s 00:06:23.763 user 0m0.039s 00:06:23.763 sys 0m0.006s 00:06:23.763 02:11:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:23.763 02:11:27 -- common/autotest_common.sh@10 -- # set +x 00:06:23.763 ************************************ 00:06:23.763 END TEST accel_assign_opcode 00:06:23.763 ************************************ 00:06:23.763 02:11:27 -- accel/accel_rpc.sh@55 -- # killprocess 10711 00:06:23.763 02:11:27 -- common/autotest_common.sh@936 -- # '[' -z 10711 ']' 00:06:23.763 02:11:27 -- common/autotest_common.sh@940 -- # kill -0 10711 00:06:23.763 02:11:27 -- common/autotest_common.sh@941 -- # uname 00:06:23.763 02:11:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:23.763 02:11:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 10711 00:06:23.763 02:11:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:23.763 02:11:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:23.763 02:11:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 10711' 00:06:23.763 killing process with pid 10711 00:06:23.763 02:11:27 -- common/autotest_common.sh@955 -- # kill 10711 00:06:23.763 02:11:27 -- common/autotest_common.sh@960 -- # wait 10711 00:06:24.334 00:06:24.334 real 0m1.223s 00:06:24.334 user 0m1.148s 00:06:24.334 sys 0m0.409s 00:06:24.334 02:11:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:24.334 02:11:27 -- common/autotest_common.sh@10 -- # set +x 00:06:24.334 ************************************ 00:06:24.334 END TEST accel_rpc 00:06:24.334 ************************************ 00:06:24.334 02:11:27 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:24.334 02:11:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:24.334 02:11:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:24.334 02:11:27 -- common/autotest_common.sh@10 -- # set +x 00:06:24.334 ************************************ 00:06:24.334 START TEST app_cmdline 00:06:24.334 ************************************ 00:06:24.334 02:11:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:24.334 * Looking for test storage... 00:06:24.334 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:24.334 02:11:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:24.334 02:11:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:24.334 02:11:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:24.334 02:11:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:24.334 02:11:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:24.334 02:11:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:24.334 02:11:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:24.334 02:11:28 -- scripts/common.sh@335 -- # IFS=.-: 00:06:24.334 02:11:28 -- scripts/common.sh@335 -- # read -ra ver1 00:06:24.334 02:11:28 -- scripts/common.sh@336 -- # IFS=.-: 00:06:24.334 02:11:28 -- scripts/common.sh@336 -- # read -ra ver2 00:06:24.334 02:11:28 -- scripts/common.sh@337 -- # local 'op=<' 00:06:24.334 02:11:28 -- scripts/common.sh@339 -- # ver1_l=2 00:06:24.334 02:11:28 -- scripts/common.sh@340 -- # ver2_l=1 00:06:24.334 02:11:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:24.334 02:11:28 -- scripts/common.sh@343 -- # case "$op" in 00:06:24.334 02:11:28 -- scripts/common.sh@344 -- # : 1 00:06:24.334 02:11:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:24.334 02:11:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:24.334 02:11:28 -- scripts/common.sh@364 -- # decimal 1 00:06:24.596 02:11:28 -- scripts/common.sh@352 -- # local d=1 00:06:24.596 02:11:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:24.596 02:11:28 -- scripts/common.sh@354 -- # echo 1 00:06:24.596 02:11:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:24.596 02:11:28 -- scripts/common.sh@365 -- # decimal 2 00:06:24.596 02:11:28 -- scripts/common.sh@352 -- # local d=2 00:06:24.596 02:11:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:24.596 02:11:28 -- scripts/common.sh@354 -- # echo 2 00:06:24.596 02:11:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:24.596 02:11:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:24.596 02:11:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:24.596 02:11:28 -- scripts/common.sh@367 -- # return 0 00:06:24.596 02:11:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:24.596 02:11:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:24.596 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:24.596 --rc genhtml_branch_coverage=1 00:06:24.596 --rc genhtml_function_coverage=1 00:06:24.596 --rc genhtml_legend=1 00:06:24.596 --rc geninfo_all_blocks=1 00:06:24.596 --rc geninfo_unexecuted_blocks=1 00:06:24.596 00:06:24.596 ' 00:06:24.596 02:11:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:24.596 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:24.596 --rc genhtml_branch_coverage=1 00:06:24.596 --rc genhtml_function_coverage=1 00:06:24.596 --rc genhtml_legend=1 00:06:24.596 --rc geninfo_all_blocks=1 00:06:24.596 --rc geninfo_unexecuted_blocks=1 00:06:24.596 00:06:24.596 ' 00:06:24.596 02:11:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:24.596 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:24.597 --rc genhtml_branch_coverage=1 00:06:24.597 --rc genhtml_function_coverage=1 00:06:24.597 --rc genhtml_legend=1 00:06:24.597 --rc geninfo_all_blocks=1 00:06:24.597 --rc geninfo_unexecuted_blocks=1 00:06:24.597 00:06:24.597 ' 00:06:24.597 02:11:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:24.597 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:24.597 --rc genhtml_branch_coverage=1 00:06:24.597 --rc genhtml_function_coverage=1 00:06:24.597 --rc genhtml_legend=1 00:06:24.597 --rc geninfo_all_blocks=1 00:06:24.597 --rc geninfo_unexecuted_blocks=1 00:06:24.597 00:06:24.597 ' 00:06:24.597 02:11:28 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:06:24.597 02:11:28 -- app/cmdline.sh@17 -- # spdk_tgt_pid=10923 00:06:24.597 02:11:28 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:06:24.597 02:11:28 -- app/cmdline.sh@18 -- # waitforlisten 10923 00:06:24.597 02:11:28 -- common/autotest_common.sh@829 -- # '[' -z 10923 ']' 00:06:24.597 02:11:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:24.597 02:11:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:24.597 02:11:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:24.597 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:24.597 02:11:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:24.597 02:11:28 -- common/autotest_common.sh@10 -- # set +x 00:06:24.597 [2024-11-29 02:11:28.068203] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:24.597 [2024-11-29 02:11:28.068297] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid10923 ] 00:06:24.597 EAL: No free 2048 kB hugepages reported on node 1 00:06:24.597 [2024-11-29 02:11:28.124929] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:24.597 [2024-11-29 02:11:28.230008] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:24.597 [2024-11-29 02:11:28.230189] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:25.541 02:11:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:25.541 02:11:29 -- common/autotest_common.sh@862 -- # return 0 00:06:25.541 02:11:29 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:25.801 { 00:06:25.801 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:06:25.801 "fields": { 00:06:25.801 "major": 24, 00:06:25.801 "minor": 1, 00:06:25.801 "patch": 1, 00:06:25.801 "suffix": "-pre", 00:06:25.801 "commit": "c13c99a5e" 00:06:25.801 } 00:06:25.801 } 00:06:25.801 02:11:29 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:25.801 02:11:29 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:25.801 02:11:29 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:25.801 02:11:29 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:25.801 02:11:29 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:25.801 02:11:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:25.801 02:11:29 -- common/autotest_common.sh@10 -- # set +x 00:06:25.801 02:11:29 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:25.801 02:11:29 -- app/cmdline.sh@26 -- # sort 00:06:25.801 02:11:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:25.801 02:11:29 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:25.801 02:11:29 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:25.801 02:11:29 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:25.801 02:11:29 -- common/autotest_common.sh@650 -- # local es=0 00:06:25.801 02:11:29 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:25.801 02:11:29 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:25.801 02:11:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:25.801 02:11:29 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:25.801 02:11:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:25.801 02:11:29 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:25.801 02:11:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:25.801 02:11:29 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:25.801 02:11:29 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:06:25.801 02:11:29 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:26.061 request: 00:06:26.061 { 00:06:26.061 "method": "env_dpdk_get_mem_stats", 00:06:26.061 "req_id": 1 00:06:26.061 } 00:06:26.061 Got JSON-RPC error response 00:06:26.061 response: 00:06:26.061 { 00:06:26.061 "code": -32601, 00:06:26.061 "message": "Method not found" 00:06:26.061 } 00:06:26.061 02:11:29 -- common/autotest_common.sh@653 -- # es=1 00:06:26.061 02:11:29 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:26.061 02:11:29 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:26.061 02:11:29 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:26.061 02:11:29 -- app/cmdline.sh@1 -- # killprocess 10923 00:06:26.061 02:11:29 -- common/autotest_common.sh@936 -- # '[' -z 10923 ']' 00:06:26.061 02:11:29 -- common/autotest_common.sh@940 -- # kill -0 10923 00:06:26.061 02:11:29 -- common/autotest_common.sh@941 -- # uname 00:06:26.061 02:11:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:26.061 02:11:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 10923 00:06:26.061 02:11:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:26.061 02:11:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:26.061 02:11:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 10923' 00:06:26.061 killing process with pid 10923 00:06:26.061 02:11:29 -- common/autotest_common.sh@955 -- # kill 10923 00:06:26.061 02:11:29 -- common/autotest_common.sh@960 -- # wait 10923 00:06:26.665 00:06:26.665 real 0m2.322s 00:06:26.665 user 0m2.978s 00:06:26.665 sys 0m0.503s 00:06:26.665 02:11:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:26.665 02:11:30 -- common/autotest_common.sh@10 -- # set +x 00:06:26.665 ************************************ 00:06:26.665 END TEST app_cmdline 00:06:26.665 ************************************ 00:06:26.665 02:11:30 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:26.665 02:11:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:26.665 02:11:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:26.665 02:11:30 -- common/autotest_common.sh@10 -- # set +x 00:06:26.665 ************************************ 00:06:26.665 START TEST version 00:06:26.665 ************************************ 00:06:26.665 02:11:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:26.665 * Looking for test storage... 00:06:26.665 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:26.665 02:11:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:26.665 02:11:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:26.665 02:11:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:26.950 02:11:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:26.950 02:11:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:26.950 02:11:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:26.950 02:11:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:26.950 02:11:30 -- scripts/common.sh@335 -- # IFS=.-: 00:06:26.950 02:11:30 -- scripts/common.sh@335 -- # read -ra ver1 00:06:26.950 02:11:30 -- scripts/common.sh@336 -- # IFS=.-: 00:06:26.950 02:11:30 -- scripts/common.sh@336 -- # read -ra ver2 00:06:26.950 02:11:30 -- scripts/common.sh@337 -- # local 'op=<' 00:06:26.950 02:11:30 -- scripts/common.sh@339 -- # ver1_l=2 00:06:26.950 02:11:30 -- scripts/common.sh@340 -- # ver2_l=1 00:06:26.950 02:11:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:26.950 02:11:30 -- scripts/common.sh@343 -- # case "$op" in 00:06:26.950 02:11:30 -- scripts/common.sh@344 -- # : 1 00:06:26.950 02:11:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:26.950 02:11:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:26.950 02:11:30 -- scripts/common.sh@364 -- # decimal 1 00:06:26.950 02:11:30 -- scripts/common.sh@352 -- # local d=1 00:06:26.950 02:11:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:26.950 02:11:30 -- scripts/common.sh@354 -- # echo 1 00:06:26.950 02:11:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:26.950 02:11:30 -- scripts/common.sh@365 -- # decimal 2 00:06:26.950 02:11:30 -- scripts/common.sh@352 -- # local d=2 00:06:26.950 02:11:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:26.950 02:11:30 -- scripts/common.sh@354 -- # echo 2 00:06:26.950 02:11:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:26.950 02:11:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:26.950 02:11:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:26.950 02:11:30 -- scripts/common.sh@367 -- # return 0 00:06:26.950 02:11:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:26.950 02:11:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:26.950 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:26.950 --rc genhtml_branch_coverage=1 00:06:26.950 --rc genhtml_function_coverage=1 00:06:26.950 --rc genhtml_legend=1 00:06:26.950 --rc geninfo_all_blocks=1 00:06:26.950 --rc geninfo_unexecuted_blocks=1 00:06:26.950 00:06:26.950 ' 00:06:26.950 02:11:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:26.950 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:26.950 --rc genhtml_branch_coverage=1 00:06:26.950 --rc genhtml_function_coverage=1 00:06:26.950 --rc genhtml_legend=1 00:06:26.950 --rc geninfo_all_blocks=1 00:06:26.950 --rc geninfo_unexecuted_blocks=1 00:06:26.950 00:06:26.950 ' 00:06:26.950 02:11:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:26.950 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:26.950 --rc genhtml_branch_coverage=1 00:06:26.950 --rc genhtml_function_coverage=1 00:06:26.950 --rc genhtml_legend=1 00:06:26.950 --rc geninfo_all_blocks=1 00:06:26.950 --rc geninfo_unexecuted_blocks=1 00:06:26.950 00:06:26.950 ' 00:06:26.950 02:11:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:26.950 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:26.950 --rc genhtml_branch_coverage=1 00:06:26.950 --rc genhtml_function_coverage=1 00:06:26.950 --rc genhtml_legend=1 00:06:26.950 --rc geninfo_all_blocks=1 00:06:26.950 --rc geninfo_unexecuted_blocks=1 00:06:26.950 00:06:26.950 ' 00:06:26.950 02:11:30 -- app/version.sh@17 -- # get_header_version major 00:06:26.950 02:11:30 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:26.950 02:11:30 -- app/version.sh@14 -- # cut -f2 00:06:26.950 02:11:30 -- app/version.sh@14 -- # tr -d '"' 00:06:26.950 02:11:30 -- app/version.sh@17 -- # major=24 00:06:26.950 02:11:30 -- app/version.sh@18 -- # get_header_version minor 00:06:26.950 02:11:30 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:26.950 02:11:30 -- app/version.sh@14 -- # cut -f2 00:06:26.950 02:11:30 -- app/version.sh@14 -- # tr -d '"' 00:06:26.950 02:11:30 -- app/version.sh@18 -- # minor=1 00:06:26.950 02:11:30 -- app/version.sh@19 -- # get_header_version patch 00:06:26.951 02:11:30 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:26.951 02:11:30 -- app/version.sh@14 -- # cut -f2 00:06:26.951 02:11:30 -- app/version.sh@14 -- # tr -d '"' 00:06:26.951 02:11:30 -- app/version.sh@19 -- # patch=1 00:06:26.951 02:11:30 -- app/version.sh@20 -- # get_header_version suffix 00:06:26.951 02:11:30 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:26.951 02:11:30 -- app/version.sh@14 -- # cut -f2 00:06:26.951 02:11:30 -- app/version.sh@14 -- # tr -d '"' 00:06:26.951 02:11:30 -- app/version.sh@20 -- # suffix=-pre 00:06:26.951 02:11:30 -- app/version.sh@22 -- # version=24.1 00:06:26.951 02:11:30 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:26.951 02:11:30 -- app/version.sh@25 -- # version=24.1.1 00:06:26.951 02:11:30 -- app/version.sh@28 -- # version=24.1.1rc0 00:06:26.951 02:11:30 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:26.951 02:11:30 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:26.951 02:11:30 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:06:26.951 02:11:30 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:06:26.951 00:06:26.951 real 0m0.189s 00:06:26.951 user 0m0.134s 00:06:26.951 sys 0m0.079s 00:06:26.951 02:11:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:26.951 02:11:30 -- common/autotest_common.sh@10 -- # set +x 00:06:26.951 ************************************ 00:06:26.951 END TEST version 00:06:26.951 ************************************ 00:06:26.951 02:11:30 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:06:26.951 02:11:30 -- spdk/autotest.sh@191 -- # uname -s 00:06:26.951 02:11:30 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:06:26.951 02:11:30 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:26.951 02:11:30 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:26.951 02:11:30 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:06:26.951 02:11:30 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:06:26.951 02:11:30 -- spdk/autotest.sh@255 -- # timing_exit lib 00:06:26.951 02:11:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:26.951 02:11:30 -- common/autotest_common.sh@10 -- # set +x 00:06:26.951 02:11:30 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:06:26.951 02:11:30 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:06:26.951 02:11:30 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:06:26.951 02:11:30 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:06:26.951 02:11:30 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:06:26.951 02:11:30 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:06:26.951 02:11:30 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:26.951 02:11:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:26.951 02:11:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:26.951 02:11:30 -- common/autotest_common.sh@10 -- # set +x 00:06:26.951 ************************************ 00:06:26.951 START TEST nvmf_tcp 00:06:26.951 ************************************ 00:06:26.951 02:11:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:26.951 * Looking for test storage... 00:06:26.951 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:06:26.951 02:11:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:26.951 02:11:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:26.951 02:11:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:26.951 02:11:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:26.951 02:11:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:26.951 02:11:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:26.951 02:11:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:26.951 02:11:30 -- scripts/common.sh@335 -- # IFS=.-: 00:06:26.951 02:11:30 -- scripts/common.sh@335 -- # read -ra ver1 00:06:26.951 02:11:30 -- scripts/common.sh@336 -- # IFS=.-: 00:06:26.951 02:11:30 -- scripts/common.sh@336 -- # read -ra ver2 00:06:26.951 02:11:30 -- scripts/common.sh@337 -- # local 'op=<' 00:06:26.951 02:11:30 -- scripts/common.sh@339 -- # ver1_l=2 00:06:26.951 02:11:30 -- scripts/common.sh@340 -- # ver2_l=1 00:06:26.951 02:11:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:26.951 02:11:30 -- scripts/common.sh@343 -- # case "$op" in 00:06:26.951 02:11:30 -- scripts/common.sh@344 -- # : 1 00:06:26.951 02:11:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:26.951 02:11:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:26.951 02:11:30 -- scripts/common.sh@364 -- # decimal 1 00:06:26.951 02:11:30 -- scripts/common.sh@352 -- # local d=1 00:06:26.951 02:11:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:26.951 02:11:30 -- scripts/common.sh@354 -- # echo 1 00:06:26.951 02:11:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:26.951 02:11:30 -- scripts/common.sh@365 -- # decimal 2 00:06:26.951 02:11:30 -- scripts/common.sh@352 -- # local d=2 00:06:26.951 02:11:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:26.951 02:11:30 -- scripts/common.sh@354 -- # echo 2 00:06:26.951 02:11:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:26.951 02:11:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:26.951 02:11:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:26.951 02:11:30 -- scripts/common.sh@367 -- # return 0 00:06:26.951 02:11:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:26.951 02:11:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:26.951 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:26.951 --rc genhtml_branch_coverage=1 00:06:26.951 --rc genhtml_function_coverage=1 00:06:26.951 --rc genhtml_legend=1 00:06:26.951 --rc geninfo_all_blocks=1 00:06:26.951 --rc geninfo_unexecuted_blocks=1 00:06:26.951 00:06:26.951 ' 00:06:26.951 02:11:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:26.951 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:26.951 --rc genhtml_branch_coverage=1 00:06:26.951 --rc genhtml_function_coverage=1 00:06:26.951 --rc genhtml_legend=1 00:06:26.951 --rc geninfo_all_blocks=1 00:06:26.951 --rc geninfo_unexecuted_blocks=1 00:06:26.951 00:06:26.951 ' 00:06:26.951 02:11:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:26.951 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:26.951 --rc genhtml_branch_coverage=1 00:06:26.951 --rc genhtml_function_coverage=1 00:06:26.951 --rc genhtml_legend=1 00:06:26.951 --rc geninfo_all_blocks=1 00:06:26.951 --rc geninfo_unexecuted_blocks=1 00:06:26.951 00:06:26.951 ' 00:06:26.951 02:11:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:26.951 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:26.951 --rc genhtml_branch_coverage=1 00:06:26.951 --rc genhtml_function_coverage=1 00:06:26.951 --rc genhtml_legend=1 00:06:26.951 --rc geninfo_all_blocks=1 00:06:26.951 --rc geninfo_unexecuted_blocks=1 00:06:26.951 00:06:26.951 ' 00:06:26.951 02:11:30 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:26.951 02:11:30 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:26.951 02:11:30 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:26.951 02:11:30 -- nvmf/common.sh@7 -- # uname -s 00:06:26.951 02:11:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:26.951 02:11:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:26.951 02:11:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:26.951 02:11:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:26.951 02:11:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:26.951 02:11:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:26.951 02:11:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:26.951 02:11:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:26.951 02:11:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:26.951 02:11:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:26.951 02:11:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:26.951 02:11:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:26.951 02:11:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:26.951 02:11:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:26.951 02:11:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:26.951 02:11:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:26.951 02:11:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:26.951 02:11:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:26.951 02:11:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:26.951 02:11:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:26.951 02:11:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:26.951 02:11:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:26.951 02:11:30 -- paths/export.sh@5 -- # export PATH 00:06:26.951 02:11:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:26.951 02:11:30 -- nvmf/common.sh@46 -- # : 0 00:06:26.952 02:11:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:26.952 02:11:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:26.952 02:11:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:26.952 02:11:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:26.952 02:11:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:26.952 02:11:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:26.952 02:11:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:26.952 02:11:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:27.211 02:11:30 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:27.211 02:11:30 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:27.211 02:11:30 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:27.211 02:11:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:27.211 02:11:30 -- common/autotest_common.sh@10 -- # set +x 00:06:27.211 02:11:30 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:27.211 02:11:30 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:27.211 02:11:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:27.211 02:11:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.211 02:11:30 -- common/autotest_common.sh@10 -- # set +x 00:06:27.211 ************************************ 00:06:27.211 START TEST nvmf_example 00:06:27.211 ************************************ 00:06:27.211 02:11:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:27.211 * Looking for test storage... 00:06:27.211 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:27.211 02:11:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:27.211 02:11:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:27.211 02:11:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:27.211 02:11:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:27.211 02:11:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:27.211 02:11:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:27.211 02:11:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:27.211 02:11:30 -- scripts/common.sh@335 -- # IFS=.-: 00:06:27.211 02:11:30 -- scripts/common.sh@335 -- # read -ra ver1 00:06:27.211 02:11:30 -- scripts/common.sh@336 -- # IFS=.-: 00:06:27.211 02:11:30 -- scripts/common.sh@336 -- # read -ra ver2 00:06:27.211 02:11:30 -- scripts/common.sh@337 -- # local 'op=<' 00:06:27.211 02:11:30 -- scripts/common.sh@339 -- # ver1_l=2 00:06:27.211 02:11:30 -- scripts/common.sh@340 -- # ver2_l=1 00:06:27.211 02:11:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:27.211 02:11:30 -- scripts/common.sh@343 -- # case "$op" in 00:06:27.211 02:11:30 -- scripts/common.sh@344 -- # : 1 00:06:27.211 02:11:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:27.211 02:11:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:27.211 02:11:30 -- scripts/common.sh@364 -- # decimal 1 00:06:27.211 02:11:30 -- scripts/common.sh@352 -- # local d=1 00:06:27.211 02:11:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:27.211 02:11:30 -- scripts/common.sh@354 -- # echo 1 00:06:27.211 02:11:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:27.211 02:11:30 -- scripts/common.sh@365 -- # decimal 2 00:06:27.211 02:11:30 -- scripts/common.sh@352 -- # local d=2 00:06:27.211 02:11:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:27.211 02:11:30 -- scripts/common.sh@354 -- # echo 2 00:06:27.211 02:11:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:27.211 02:11:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:27.211 02:11:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:27.211 02:11:30 -- scripts/common.sh@367 -- # return 0 00:06:27.211 02:11:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:27.211 02:11:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:27.211 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.211 --rc genhtml_branch_coverage=1 00:06:27.211 --rc genhtml_function_coverage=1 00:06:27.211 --rc genhtml_legend=1 00:06:27.211 --rc geninfo_all_blocks=1 00:06:27.211 --rc geninfo_unexecuted_blocks=1 00:06:27.211 00:06:27.211 ' 00:06:27.211 02:11:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:27.211 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.211 --rc genhtml_branch_coverage=1 00:06:27.211 --rc genhtml_function_coverage=1 00:06:27.211 --rc genhtml_legend=1 00:06:27.211 --rc geninfo_all_blocks=1 00:06:27.211 --rc geninfo_unexecuted_blocks=1 00:06:27.211 00:06:27.211 ' 00:06:27.211 02:11:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:27.211 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.211 --rc genhtml_branch_coverage=1 00:06:27.212 --rc genhtml_function_coverage=1 00:06:27.212 --rc genhtml_legend=1 00:06:27.212 --rc geninfo_all_blocks=1 00:06:27.212 --rc geninfo_unexecuted_blocks=1 00:06:27.212 00:06:27.212 ' 00:06:27.212 02:11:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:27.212 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.212 --rc genhtml_branch_coverage=1 00:06:27.212 --rc genhtml_function_coverage=1 00:06:27.212 --rc genhtml_legend=1 00:06:27.212 --rc geninfo_all_blocks=1 00:06:27.212 --rc geninfo_unexecuted_blocks=1 00:06:27.212 00:06:27.212 ' 00:06:27.212 02:11:30 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:27.212 02:11:30 -- nvmf/common.sh@7 -- # uname -s 00:06:27.212 02:11:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:27.212 02:11:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:27.212 02:11:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:27.212 02:11:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:27.212 02:11:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:27.212 02:11:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:27.212 02:11:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:27.212 02:11:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:27.212 02:11:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:27.212 02:11:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:27.212 02:11:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:27.212 02:11:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:27.212 02:11:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:27.212 02:11:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:27.212 02:11:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:27.212 02:11:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:27.212 02:11:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:27.212 02:11:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:27.212 02:11:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:27.212 02:11:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.212 02:11:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.212 02:11:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.212 02:11:30 -- paths/export.sh@5 -- # export PATH 00:06:27.212 02:11:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.212 02:11:30 -- nvmf/common.sh@46 -- # : 0 00:06:27.212 02:11:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:27.212 02:11:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:27.212 02:11:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:27.212 02:11:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:27.212 02:11:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:27.212 02:11:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:27.212 02:11:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:27.212 02:11:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:27.212 02:11:30 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:27.212 02:11:30 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:27.212 02:11:30 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:27.212 02:11:30 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:27.212 02:11:30 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:27.212 02:11:30 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:27.212 02:11:30 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:27.212 02:11:30 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:27.212 02:11:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:27.212 02:11:30 -- common/autotest_common.sh@10 -- # set +x 00:06:27.212 02:11:30 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:27.212 02:11:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:27.212 02:11:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:27.212 02:11:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:27.212 02:11:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:27.212 02:11:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:27.212 02:11:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:27.212 02:11:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:27.212 02:11:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:27.212 02:11:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:27.212 02:11:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:27.212 02:11:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:27.212 02:11:30 -- common/autotest_common.sh@10 -- # set +x 00:06:29.754 02:11:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:29.754 02:11:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:29.754 02:11:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:29.754 02:11:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:29.754 02:11:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:29.754 02:11:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:29.754 02:11:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:29.754 02:11:32 -- nvmf/common.sh@294 -- # net_devs=() 00:06:29.754 02:11:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:29.754 02:11:32 -- nvmf/common.sh@295 -- # e810=() 00:06:29.754 02:11:32 -- nvmf/common.sh@295 -- # local -ga e810 00:06:29.754 02:11:32 -- nvmf/common.sh@296 -- # x722=() 00:06:29.754 02:11:32 -- nvmf/common.sh@296 -- # local -ga x722 00:06:29.754 02:11:32 -- nvmf/common.sh@297 -- # mlx=() 00:06:29.754 02:11:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:29.754 02:11:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:29.754 02:11:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:29.754 02:11:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:29.754 02:11:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:29.754 02:11:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:29.754 02:11:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:29.754 02:11:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:29.754 02:11:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:29.754 02:11:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:29.754 02:11:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:29.754 02:11:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:29.754 02:11:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:29.754 02:11:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:29.754 02:11:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:29.754 02:11:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:29.754 02:11:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:29.754 02:11:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:29.754 02:11:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:29.754 02:11:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:29.754 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:29.754 02:11:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:29.754 02:11:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:29.754 02:11:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:29.754 02:11:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:29.754 02:11:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:29.754 02:11:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:29.755 02:11:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:29.755 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:29.755 02:11:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:29.755 02:11:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:29.755 02:11:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:29.755 02:11:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:29.755 02:11:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:29.755 02:11:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:29.755 02:11:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:29.755 02:11:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:29.755 02:11:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:29.755 02:11:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:29.755 02:11:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:29.755 02:11:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:29.755 02:11:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:29.755 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:29.755 02:11:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:29.755 02:11:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:29.755 02:11:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:29.755 02:11:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:29.755 02:11:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:29.755 02:11:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:29.755 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:29.755 02:11:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:29.755 02:11:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:29.755 02:11:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:29.755 02:11:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:29.755 02:11:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:29.755 02:11:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:29.755 02:11:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:29.755 02:11:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:29.755 02:11:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:29.755 02:11:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:29.755 02:11:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:29.755 02:11:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:29.755 02:11:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:29.755 02:11:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:29.755 02:11:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:29.755 02:11:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:29.755 02:11:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:29.755 02:11:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:29.755 02:11:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:29.755 02:11:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:29.755 02:11:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:29.755 02:11:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:29.755 02:11:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:29.755 02:11:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:29.755 02:11:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:29.755 02:11:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:29.755 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:29.755 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.266 ms 00:06:29.755 00:06:29.755 --- 10.0.0.2 ping statistics --- 00:06:29.755 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:29.755 rtt min/avg/max/mdev = 0.266/0.266/0.266/0.000 ms 00:06:29.755 02:11:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:29.755 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:29.755 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.077 ms 00:06:29.755 00:06:29.755 --- 10.0.0.1 ping statistics --- 00:06:29.755 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:29.755 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:06:29.755 02:11:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:29.755 02:11:32 -- nvmf/common.sh@410 -- # return 0 00:06:29.755 02:11:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:29.755 02:11:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:29.755 02:11:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:29.755 02:11:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:29.755 02:11:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:29.755 02:11:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:29.755 02:11:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:29.755 02:11:33 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:29.755 02:11:33 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:29.755 02:11:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:29.755 02:11:33 -- common/autotest_common.sh@10 -- # set +x 00:06:29.755 02:11:33 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:06:29.755 02:11:33 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:06:29.755 02:11:33 -- target/nvmf_example.sh@34 -- # nvmfpid=12993 00:06:29.755 02:11:33 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:29.755 02:11:33 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:29.755 02:11:33 -- target/nvmf_example.sh@36 -- # waitforlisten 12993 00:06:29.755 02:11:33 -- common/autotest_common.sh@829 -- # '[' -z 12993 ']' 00:06:29.755 02:11:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:29.755 02:11:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:29.755 02:11:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:29.755 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:29.755 02:11:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:29.755 02:11:33 -- common/autotest_common.sh@10 -- # set +x 00:06:29.755 EAL: No free 2048 kB hugepages reported on node 1 00:06:30.700 02:11:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:30.700 02:11:34 -- common/autotest_common.sh@862 -- # return 0 00:06:30.700 02:11:34 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:30.700 02:11:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:30.700 02:11:34 -- common/autotest_common.sh@10 -- # set +x 00:06:30.700 02:11:34 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:30.700 02:11:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:30.700 02:11:34 -- common/autotest_common.sh@10 -- # set +x 00:06:30.700 02:11:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:30.700 02:11:34 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:30.700 02:11:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:30.700 02:11:34 -- common/autotest_common.sh@10 -- # set +x 00:06:30.700 02:11:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:30.700 02:11:34 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:30.700 02:11:34 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:30.700 02:11:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:30.700 02:11:34 -- common/autotest_common.sh@10 -- # set +x 00:06:30.700 02:11:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:30.700 02:11:34 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:30.700 02:11:34 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:30.700 02:11:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:30.700 02:11:34 -- common/autotest_common.sh@10 -- # set +x 00:06:30.700 02:11:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:30.700 02:11:34 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:30.700 02:11:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:30.700 02:11:34 -- common/autotest_common.sh@10 -- # set +x 00:06:30.700 02:11:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:30.700 02:11:34 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:30.700 02:11:34 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:30.700 EAL: No free 2048 kB hugepages reported on node 1 00:06:40.686 Initializing NVMe Controllers 00:06:40.686 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:06:40.686 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:40.686 Initialization complete. Launching workers. 00:06:40.686 ======================================================== 00:06:40.686 Latency(us) 00:06:40.686 Device Information : IOPS MiB/s Average min max 00:06:40.686 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15782.16 61.65 4054.73 870.01 15237.55 00:06:40.686 ======================================================== 00:06:40.686 Total : 15782.16 61.65 4054.73 870.01 15237.55 00:06:40.686 00:06:40.686 02:11:44 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:40.686 02:11:44 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:40.686 02:11:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:40.686 02:11:44 -- nvmf/common.sh@116 -- # sync 00:06:40.686 02:11:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:40.686 02:11:44 -- nvmf/common.sh@119 -- # set +e 00:06:40.686 02:11:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:40.686 02:11:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:40.686 rmmod nvme_tcp 00:06:40.686 rmmod nvme_fabrics 00:06:40.686 rmmod nvme_keyring 00:06:40.686 02:11:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:40.686 02:11:44 -- nvmf/common.sh@123 -- # set -e 00:06:40.686 02:11:44 -- nvmf/common.sh@124 -- # return 0 00:06:40.686 02:11:44 -- nvmf/common.sh@477 -- # '[' -n 12993 ']' 00:06:40.686 02:11:44 -- nvmf/common.sh@478 -- # killprocess 12993 00:06:40.686 02:11:44 -- common/autotest_common.sh@936 -- # '[' -z 12993 ']' 00:06:40.686 02:11:44 -- common/autotest_common.sh@940 -- # kill -0 12993 00:06:40.686 02:11:44 -- common/autotest_common.sh@941 -- # uname 00:06:40.686 02:11:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:40.686 02:11:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 12993 00:06:40.686 02:11:44 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:06:40.686 02:11:44 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:06:40.686 02:11:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 12993' 00:06:40.686 killing process with pid 12993 00:06:40.686 02:11:44 -- common/autotest_common.sh@955 -- # kill 12993 00:06:40.686 02:11:44 -- common/autotest_common.sh@960 -- # wait 12993 00:06:40.945 nvmf threads initialize successfully 00:06:40.945 bdev subsystem init successfully 00:06:40.945 created a nvmf target service 00:06:40.945 create targets's poll groups done 00:06:40.945 all subsystems of target started 00:06:40.945 nvmf target is running 00:06:40.945 all subsystems of target stopped 00:06:40.945 destroy targets's poll groups done 00:06:40.945 destroyed the nvmf target service 00:06:40.945 bdev subsystem finish successfully 00:06:40.945 nvmf threads destroy successfully 00:06:40.945 02:11:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:40.945 02:11:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:40.945 02:11:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:40.945 02:11:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:40.945 02:11:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:40.945 02:11:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:40.946 02:11:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:40.946 02:11:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:43.491 02:11:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:43.491 02:11:46 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:43.491 02:11:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:43.491 02:11:46 -- common/autotest_common.sh@10 -- # set +x 00:06:43.491 00:06:43.491 real 0m15.992s 00:06:43.491 user 0m45.015s 00:06:43.491 sys 0m3.252s 00:06:43.491 02:11:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:43.491 02:11:46 -- common/autotest_common.sh@10 -- # set +x 00:06:43.491 ************************************ 00:06:43.491 END TEST nvmf_example 00:06:43.491 ************************************ 00:06:43.491 02:11:46 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:43.491 02:11:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:43.491 02:11:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:43.491 02:11:46 -- common/autotest_common.sh@10 -- # set +x 00:06:43.491 ************************************ 00:06:43.491 START TEST nvmf_filesystem 00:06:43.491 ************************************ 00:06:43.491 02:11:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:43.491 * Looking for test storage... 00:06:43.491 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:43.491 02:11:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:43.491 02:11:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:43.491 02:11:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:43.491 02:11:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:43.491 02:11:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:43.491 02:11:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:43.491 02:11:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:43.491 02:11:46 -- scripts/common.sh@335 -- # IFS=.-: 00:06:43.491 02:11:46 -- scripts/common.sh@335 -- # read -ra ver1 00:06:43.491 02:11:46 -- scripts/common.sh@336 -- # IFS=.-: 00:06:43.491 02:11:46 -- scripts/common.sh@336 -- # read -ra ver2 00:06:43.491 02:11:46 -- scripts/common.sh@337 -- # local 'op=<' 00:06:43.491 02:11:46 -- scripts/common.sh@339 -- # ver1_l=2 00:06:43.491 02:11:46 -- scripts/common.sh@340 -- # ver2_l=1 00:06:43.491 02:11:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:43.491 02:11:46 -- scripts/common.sh@343 -- # case "$op" in 00:06:43.491 02:11:46 -- scripts/common.sh@344 -- # : 1 00:06:43.491 02:11:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:43.491 02:11:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:43.491 02:11:46 -- scripts/common.sh@364 -- # decimal 1 00:06:43.491 02:11:46 -- scripts/common.sh@352 -- # local d=1 00:06:43.491 02:11:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:43.491 02:11:46 -- scripts/common.sh@354 -- # echo 1 00:06:43.491 02:11:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:43.491 02:11:46 -- scripts/common.sh@365 -- # decimal 2 00:06:43.491 02:11:46 -- scripts/common.sh@352 -- # local d=2 00:06:43.491 02:11:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:43.491 02:11:46 -- scripts/common.sh@354 -- # echo 2 00:06:43.491 02:11:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:43.491 02:11:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:43.491 02:11:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:43.491 02:11:46 -- scripts/common.sh@367 -- # return 0 00:06:43.491 02:11:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:43.491 02:11:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:43.491 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.491 --rc genhtml_branch_coverage=1 00:06:43.491 --rc genhtml_function_coverage=1 00:06:43.491 --rc genhtml_legend=1 00:06:43.491 --rc geninfo_all_blocks=1 00:06:43.491 --rc geninfo_unexecuted_blocks=1 00:06:43.491 00:06:43.491 ' 00:06:43.491 02:11:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:43.491 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.491 --rc genhtml_branch_coverage=1 00:06:43.491 --rc genhtml_function_coverage=1 00:06:43.491 --rc genhtml_legend=1 00:06:43.491 --rc geninfo_all_blocks=1 00:06:43.491 --rc geninfo_unexecuted_blocks=1 00:06:43.491 00:06:43.491 ' 00:06:43.491 02:11:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:43.491 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.491 --rc genhtml_branch_coverage=1 00:06:43.491 --rc genhtml_function_coverage=1 00:06:43.491 --rc genhtml_legend=1 00:06:43.491 --rc geninfo_all_blocks=1 00:06:43.491 --rc geninfo_unexecuted_blocks=1 00:06:43.491 00:06:43.491 ' 00:06:43.491 02:11:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:43.491 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.491 --rc genhtml_branch_coverage=1 00:06:43.491 --rc genhtml_function_coverage=1 00:06:43.491 --rc genhtml_legend=1 00:06:43.491 --rc geninfo_all_blocks=1 00:06:43.491 --rc geninfo_unexecuted_blocks=1 00:06:43.491 00:06:43.491 ' 00:06:43.491 02:11:46 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:06:43.491 02:11:46 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:43.491 02:11:46 -- common/autotest_common.sh@34 -- # set -e 00:06:43.491 02:11:46 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:43.491 02:11:46 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:43.491 02:11:46 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:43.491 02:11:46 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:06:43.491 02:11:46 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:43.491 02:11:46 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:43.491 02:11:46 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:43.491 02:11:46 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:43.491 02:11:46 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:43.491 02:11:46 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:43.491 02:11:46 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:43.491 02:11:46 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:43.491 02:11:46 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:43.491 02:11:46 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:43.491 02:11:46 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:43.491 02:11:46 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:43.491 02:11:46 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:43.491 02:11:46 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:43.491 02:11:46 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:43.491 02:11:46 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:43.491 02:11:46 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:43.491 02:11:46 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:43.491 02:11:46 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:43.491 02:11:46 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:43.491 02:11:46 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:43.491 02:11:46 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:43.491 02:11:46 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:43.491 02:11:46 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:43.492 02:11:46 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:43.492 02:11:46 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:43.492 02:11:46 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:43.492 02:11:46 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:43.492 02:11:46 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:43.492 02:11:46 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:43.492 02:11:46 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:43.492 02:11:46 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:43.492 02:11:46 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:43.492 02:11:46 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:43.492 02:11:46 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:43.492 02:11:46 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:43.492 02:11:46 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:43.492 02:11:46 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:43.492 02:11:46 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:43.492 02:11:46 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:43.492 02:11:46 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:43.492 02:11:46 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:43.492 02:11:46 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:43.492 02:11:46 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:43.492 02:11:46 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:43.492 02:11:46 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:43.492 02:11:46 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:43.492 02:11:46 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:43.492 02:11:46 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:43.492 02:11:46 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:43.492 02:11:46 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:43.492 02:11:46 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:43.492 02:11:46 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:06:43.492 02:11:46 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:06:43.492 02:11:46 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:06:43.492 02:11:46 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:06:43.492 02:11:46 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:06:43.492 02:11:46 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:06:43.492 02:11:46 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:06:43.492 02:11:46 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:06:43.492 02:11:46 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:06:43.492 02:11:46 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:06:43.492 02:11:46 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:06:43.492 02:11:46 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:06:43.492 02:11:46 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:06:43.492 02:11:46 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:43.492 02:11:46 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:06:43.492 02:11:46 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:06:43.492 02:11:46 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:06:43.492 02:11:46 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:06:43.492 02:11:46 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:06:43.492 02:11:46 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:06:43.492 02:11:46 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:06:43.492 02:11:46 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:06:43.492 02:11:46 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:06:43.492 02:11:46 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:06:43.492 02:11:46 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:43.492 02:11:46 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:06:43.492 02:11:46 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:06:43.492 02:11:46 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:43.492 02:11:46 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:43.492 02:11:46 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:43.492 02:11:46 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:43.492 02:11:46 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:43.492 02:11:46 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:43.492 02:11:46 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:43.492 02:11:46 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:43.492 02:11:46 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:43.492 02:11:46 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:43.492 02:11:46 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:43.492 02:11:46 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:43.492 02:11:46 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:43.492 02:11:46 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:43.492 02:11:46 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:06:43.492 02:11:46 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:43.492 #define SPDK_CONFIG_H 00:06:43.492 #define SPDK_CONFIG_APPS 1 00:06:43.492 #define SPDK_CONFIG_ARCH native 00:06:43.492 #undef SPDK_CONFIG_ASAN 00:06:43.492 #undef SPDK_CONFIG_AVAHI 00:06:43.492 #undef SPDK_CONFIG_CET 00:06:43.492 #define SPDK_CONFIG_COVERAGE 1 00:06:43.492 #define SPDK_CONFIG_CROSS_PREFIX 00:06:43.492 #undef SPDK_CONFIG_CRYPTO 00:06:43.492 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:43.492 #undef SPDK_CONFIG_CUSTOMOCF 00:06:43.492 #undef SPDK_CONFIG_DAOS 00:06:43.492 #define SPDK_CONFIG_DAOS_DIR 00:06:43.492 #define SPDK_CONFIG_DEBUG 1 00:06:43.492 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:43.492 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:43.492 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:43.492 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:43.492 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:43.492 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:43.492 #define SPDK_CONFIG_EXAMPLES 1 00:06:43.492 #undef SPDK_CONFIG_FC 00:06:43.492 #define SPDK_CONFIG_FC_PATH 00:06:43.492 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:43.492 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:43.492 #undef SPDK_CONFIG_FUSE 00:06:43.492 #undef SPDK_CONFIG_FUZZER 00:06:43.492 #define SPDK_CONFIG_FUZZER_LIB 00:06:43.492 #undef SPDK_CONFIG_GOLANG 00:06:43.492 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:43.492 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:43.492 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:43.492 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:43.492 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:43.492 #define SPDK_CONFIG_IDXD 1 00:06:43.492 #define SPDK_CONFIG_IDXD_KERNEL 1 00:06:43.492 #undef SPDK_CONFIG_IPSEC_MB 00:06:43.492 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:43.492 #define SPDK_CONFIG_ISAL 1 00:06:43.492 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:43.492 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:43.492 #define SPDK_CONFIG_LIBDIR 00:06:43.492 #undef SPDK_CONFIG_LTO 00:06:43.492 #define SPDK_CONFIG_MAX_LCORES 00:06:43.492 #define SPDK_CONFIG_NVME_CUSE 1 00:06:43.492 #undef SPDK_CONFIG_OCF 00:06:43.492 #define SPDK_CONFIG_OCF_PATH 00:06:43.492 #define SPDK_CONFIG_OPENSSL_PATH 00:06:43.492 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:43.492 #undef SPDK_CONFIG_PGO_USE 00:06:43.492 #define SPDK_CONFIG_PREFIX /usr/local 00:06:43.492 #undef SPDK_CONFIG_RAID5F 00:06:43.492 #undef SPDK_CONFIG_RBD 00:06:43.492 #define SPDK_CONFIG_RDMA 1 00:06:43.492 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:43.492 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:43.492 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:43.492 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:43.492 #define SPDK_CONFIG_SHARED 1 00:06:43.492 #undef SPDK_CONFIG_SMA 00:06:43.492 #define SPDK_CONFIG_TESTS 1 00:06:43.492 #undef SPDK_CONFIG_TSAN 00:06:43.492 #define SPDK_CONFIG_UBLK 1 00:06:43.492 #define SPDK_CONFIG_UBSAN 1 00:06:43.492 #undef SPDK_CONFIG_UNIT_TESTS 00:06:43.492 #undef SPDK_CONFIG_URING 00:06:43.492 #define SPDK_CONFIG_URING_PATH 00:06:43.492 #undef SPDK_CONFIG_URING_ZNS 00:06:43.492 #undef SPDK_CONFIG_USDT 00:06:43.492 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:43.492 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:43.492 #undef SPDK_CONFIG_VFIO_USER 00:06:43.492 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:43.492 #define SPDK_CONFIG_VHOST 1 00:06:43.492 #define SPDK_CONFIG_VIRTIO 1 00:06:43.492 #undef SPDK_CONFIG_VTUNE 00:06:43.492 #define SPDK_CONFIG_VTUNE_DIR 00:06:43.492 #define SPDK_CONFIG_WERROR 1 00:06:43.492 #define SPDK_CONFIG_WPDK_DIR 00:06:43.492 #undef SPDK_CONFIG_XNVME 00:06:43.492 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:43.492 02:11:46 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:43.492 02:11:46 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:43.492 02:11:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:43.492 02:11:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:43.492 02:11:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:43.492 02:11:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.492 02:11:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.493 02:11:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.493 02:11:46 -- paths/export.sh@5 -- # export PATH 00:06:43.493 02:11:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.493 02:11:46 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:43.493 02:11:46 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:43.493 02:11:46 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:43.493 02:11:46 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:43.493 02:11:46 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:43.493 02:11:46 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:43.493 02:11:46 -- pm/common@16 -- # TEST_TAG=N/A 00:06:43.493 02:11:46 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:06:43.493 02:11:46 -- common/autotest_common.sh@52 -- # : 1 00:06:43.493 02:11:46 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:06:43.493 02:11:46 -- common/autotest_common.sh@56 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:43.493 02:11:46 -- common/autotest_common.sh@58 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:06:43.493 02:11:46 -- common/autotest_common.sh@60 -- # : 1 00:06:43.493 02:11:46 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:43.493 02:11:46 -- common/autotest_common.sh@62 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:06:43.493 02:11:46 -- common/autotest_common.sh@64 -- # : 00:06:43.493 02:11:46 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:06:43.493 02:11:46 -- common/autotest_common.sh@66 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:06:43.493 02:11:46 -- common/autotest_common.sh@68 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:06:43.493 02:11:46 -- common/autotest_common.sh@70 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:06:43.493 02:11:46 -- common/autotest_common.sh@72 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:43.493 02:11:46 -- common/autotest_common.sh@74 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:06:43.493 02:11:46 -- common/autotest_common.sh@76 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:06:43.493 02:11:46 -- common/autotest_common.sh@78 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:06:43.493 02:11:46 -- common/autotest_common.sh@80 -- # : 1 00:06:43.493 02:11:46 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:06:43.493 02:11:46 -- common/autotest_common.sh@82 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:06:43.493 02:11:46 -- common/autotest_common.sh@84 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:06:43.493 02:11:46 -- common/autotest_common.sh@86 -- # : 1 00:06:43.493 02:11:46 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:06:43.493 02:11:46 -- common/autotest_common.sh@88 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:06:43.493 02:11:46 -- common/autotest_common.sh@90 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:43.493 02:11:46 -- common/autotest_common.sh@92 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:06:43.493 02:11:46 -- common/autotest_common.sh@94 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:06:43.493 02:11:46 -- common/autotest_common.sh@96 -- # : tcp 00:06:43.493 02:11:46 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:43.493 02:11:46 -- common/autotest_common.sh@98 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:06:43.493 02:11:46 -- common/autotest_common.sh@100 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:06:43.493 02:11:46 -- common/autotest_common.sh@102 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:06:43.493 02:11:46 -- common/autotest_common.sh@104 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:06:43.493 02:11:46 -- common/autotest_common.sh@106 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:06:43.493 02:11:46 -- common/autotest_common.sh@108 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:06:43.493 02:11:46 -- common/autotest_common.sh@110 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:06:43.493 02:11:46 -- common/autotest_common.sh@112 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:43.493 02:11:46 -- common/autotest_common.sh@114 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:06:43.493 02:11:46 -- common/autotest_common.sh@116 -- # : 1 00:06:43.493 02:11:46 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:06:43.493 02:11:46 -- common/autotest_common.sh@118 -- # : 00:06:43.493 02:11:46 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:43.493 02:11:46 -- common/autotest_common.sh@120 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:06:43.493 02:11:46 -- common/autotest_common.sh@122 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:06:43.493 02:11:46 -- common/autotest_common.sh@124 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:06:43.493 02:11:46 -- common/autotest_common.sh@126 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:06:43.493 02:11:46 -- common/autotest_common.sh@128 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:06:43.493 02:11:46 -- common/autotest_common.sh@130 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:06:43.493 02:11:46 -- common/autotest_common.sh@132 -- # : 00:06:43.493 02:11:46 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:06:43.493 02:11:46 -- common/autotest_common.sh@134 -- # : true 00:06:43.493 02:11:46 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:06:43.493 02:11:46 -- common/autotest_common.sh@136 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:06:43.493 02:11:46 -- common/autotest_common.sh@138 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:06:43.493 02:11:46 -- common/autotest_common.sh@140 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:06:43.493 02:11:46 -- common/autotest_common.sh@142 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:06:43.493 02:11:46 -- common/autotest_common.sh@144 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:06:43.493 02:11:46 -- common/autotest_common.sh@146 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:06:43.493 02:11:46 -- common/autotest_common.sh@148 -- # : e810 00:06:43.493 02:11:46 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:06:43.493 02:11:46 -- common/autotest_common.sh@150 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:06:43.493 02:11:46 -- common/autotest_common.sh@152 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:06:43.493 02:11:46 -- common/autotest_common.sh@154 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:06:43.493 02:11:46 -- common/autotest_common.sh@156 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:06:43.493 02:11:46 -- common/autotest_common.sh@158 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:06:43.493 02:11:46 -- common/autotest_common.sh@160 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:06:43.493 02:11:46 -- common/autotest_common.sh@163 -- # : 00:06:43.493 02:11:46 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:06:43.493 02:11:46 -- common/autotest_common.sh@165 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:06:43.493 02:11:46 -- common/autotest_common.sh@167 -- # : 0 00:06:43.493 02:11:46 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:43.493 02:11:46 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:43.493 02:11:46 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:43.493 02:11:46 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:43.493 02:11:46 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:43.493 02:11:46 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:43.493 02:11:46 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:43.494 02:11:46 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:43.494 02:11:46 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:43.494 02:11:46 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:43.494 02:11:46 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:43.494 02:11:46 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:43.494 02:11:46 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:43.494 02:11:46 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:43.494 02:11:46 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:06:43.494 02:11:46 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:43.494 02:11:46 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:43.494 02:11:46 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:43.494 02:11:46 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:43.494 02:11:46 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:43.494 02:11:46 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:06:43.494 02:11:46 -- common/autotest_common.sh@196 -- # cat 00:06:43.494 02:11:46 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:06:43.494 02:11:46 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:43.494 02:11:46 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:43.494 02:11:46 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:43.494 02:11:46 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:43.494 02:11:46 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:06:43.494 02:11:46 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:06:43.494 02:11:46 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:43.494 02:11:46 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:43.494 02:11:46 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:43.494 02:11:46 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:43.494 02:11:46 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:43.494 02:11:46 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:43.494 02:11:46 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:43.494 02:11:46 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:43.494 02:11:46 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:43.494 02:11:46 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:43.494 02:11:46 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:43.494 02:11:46 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:43.494 02:11:46 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:06:43.494 02:11:46 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:06:43.494 02:11:46 -- common/autotest_common.sh@249 -- # _LCOV= 00:06:43.494 02:11:46 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:06:43.494 02:11:46 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:06:43.494 02:11:46 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:06:43.494 02:11:46 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:06:43.494 02:11:46 -- common/autotest_common.sh@255 -- # lcov_opt= 00:06:43.494 02:11:46 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:06:43.494 02:11:46 -- common/autotest_common.sh@259 -- # export valgrind= 00:06:43.494 02:11:46 -- common/autotest_common.sh@259 -- # valgrind= 00:06:43.494 02:11:46 -- common/autotest_common.sh@265 -- # uname -s 00:06:43.494 02:11:46 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:06:43.494 02:11:46 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:06:43.494 02:11:46 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:06:43.494 02:11:46 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:06:43.494 02:11:46 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:43.494 02:11:46 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:43.494 02:11:46 -- common/autotest_common.sh@275 -- # MAKE=make 00:06:43.494 02:11:46 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:06:43.494 02:11:46 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:06:43.494 02:11:46 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:06:43.494 02:11:46 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:06:43.494 02:11:46 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:06:43.494 02:11:46 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:06:43.494 02:11:46 -- common/autotest_common.sh@301 -- # for i in "$@" 00:06:43.494 02:11:46 -- common/autotest_common.sh@302 -- # case "$i" in 00:06:43.494 02:11:46 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:06:43.494 02:11:46 -- common/autotest_common.sh@319 -- # [[ -z 14741 ]] 00:06:43.494 02:11:46 -- common/autotest_common.sh@319 -- # kill -0 14741 00:06:43.494 02:11:46 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:06:43.494 02:11:46 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:06:43.494 02:11:46 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:06:43.494 02:11:46 -- common/autotest_common.sh@332 -- # local mount target_dir 00:06:43.494 02:11:46 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:06:43.494 02:11:46 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:06:43.494 02:11:46 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:06:43.494 02:11:46 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:06:43.494 02:11:46 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.IXPlx4 00:06:43.494 02:11:46 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:43.494 02:11:46 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:06:43.494 02:11:46 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:06:43.494 02:11:46 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.IXPlx4/tests/target /tmp/spdk.IXPlx4 00:06:43.494 02:11:46 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:06:43.494 02:11:46 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:43.494 02:11:46 -- common/autotest_common.sh@328 -- # df -T 00:06:43.494 02:11:46 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:06:43.494 02:11:46 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:06:43.494 02:11:46 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:06:43.494 02:11:46 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:06:43.494 02:11:46 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:06:43.494 02:11:46 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:06:43.494 02:11:46 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:43.494 02:11:46 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:06:43.494 02:11:46 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:06:43.494 02:11:46 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:06:43.494 02:11:46 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:06:43.494 02:11:46 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:06:43.494 02:11:46 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:43.494 02:11:46 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:06:43.494 02:11:46 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:06:43.494 02:11:46 -- common/autotest_common.sh@363 -- # avails["$mount"]=55282147328 00:06:43.494 02:11:46 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988519936 00:06:43.494 02:11:46 -- common/autotest_common.sh@364 -- # uses["$mount"]=6706372608 00:06:43.494 02:11:46 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:43.494 02:11:46 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:43.494 02:11:46 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:43.494 02:11:46 -- common/autotest_common.sh@363 -- # avails["$mount"]=30991667200 00:06:43.494 02:11:46 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994259968 00:06:43.494 02:11:46 -- common/autotest_common.sh@364 -- # uses["$mount"]=2592768 00:06:43.494 02:11:46 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:43.494 02:11:46 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:43.494 02:11:46 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:43.494 02:11:46 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388917248 00:06:43.494 02:11:46 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397707264 00:06:43.494 02:11:46 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:06:43.494 02:11:46 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:43.494 02:11:46 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:43.494 02:11:46 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:43.494 02:11:46 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993825792 00:06:43.494 02:11:46 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994259968 00:06:43.494 02:11:46 -- common/autotest_common.sh@364 -- # uses["$mount"]=434176 00:06:43.494 02:11:46 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:43.494 02:11:46 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:43.495 02:11:46 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:43.495 02:11:46 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:06:43.495 02:11:46 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:06:43.495 02:11:46 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:06:43.495 02:11:46 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:43.495 02:11:46 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:06:43.495 * Looking for test storage... 00:06:43.495 02:11:46 -- common/autotest_common.sh@369 -- # local target_space new_size 00:06:43.495 02:11:46 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:06:43.495 02:11:46 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:43.495 02:11:46 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:43.495 02:11:46 -- common/autotest_common.sh@373 -- # mount=/ 00:06:43.495 02:11:46 -- common/autotest_common.sh@375 -- # target_space=55282147328 00:06:43.495 02:11:46 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:06:43.495 02:11:46 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:06:43.495 02:11:46 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:06:43.495 02:11:46 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:06:43.495 02:11:46 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:06:43.495 02:11:46 -- common/autotest_common.sh@382 -- # new_size=8920965120 00:06:43.495 02:11:46 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:43.495 02:11:46 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:43.495 02:11:46 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:43.495 02:11:46 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:43.495 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:43.495 02:11:46 -- common/autotest_common.sh@390 -- # return 0 00:06:43.495 02:11:46 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:06:43.495 02:11:46 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:06:43.495 02:11:46 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:43.495 02:11:46 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:43.495 02:11:46 -- common/autotest_common.sh@1682 -- # true 00:06:43.495 02:11:46 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:06:43.495 02:11:46 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:43.495 02:11:46 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:43.495 02:11:46 -- common/autotest_common.sh@27 -- # exec 00:06:43.495 02:11:46 -- common/autotest_common.sh@29 -- # exec 00:06:43.495 02:11:46 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:43.495 02:11:46 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:43.495 02:11:46 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:43.495 02:11:46 -- common/autotest_common.sh@18 -- # set -x 00:06:43.495 02:11:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:43.495 02:11:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:43.495 02:11:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:43.495 02:11:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:43.495 02:11:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:43.495 02:11:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:43.495 02:11:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:43.495 02:11:46 -- scripts/common.sh@335 -- # IFS=.-: 00:06:43.495 02:11:46 -- scripts/common.sh@335 -- # read -ra ver1 00:06:43.495 02:11:46 -- scripts/common.sh@336 -- # IFS=.-: 00:06:43.495 02:11:46 -- scripts/common.sh@336 -- # read -ra ver2 00:06:43.495 02:11:46 -- scripts/common.sh@337 -- # local 'op=<' 00:06:43.495 02:11:46 -- scripts/common.sh@339 -- # ver1_l=2 00:06:43.495 02:11:46 -- scripts/common.sh@340 -- # ver2_l=1 00:06:43.495 02:11:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:43.495 02:11:46 -- scripts/common.sh@343 -- # case "$op" in 00:06:43.495 02:11:46 -- scripts/common.sh@344 -- # : 1 00:06:43.495 02:11:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:43.495 02:11:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:43.495 02:11:46 -- scripts/common.sh@364 -- # decimal 1 00:06:43.495 02:11:46 -- scripts/common.sh@352 -- # local d=1 00:06:43.495 02:11:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:43.495 02:11:46 -- scripts/common.sh@354 -- # echo 1 00:06:43.495 02:11:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:43.495 02:11:46 -- scripts/common.sh@365 -- # decimal 2 00:06:43.495 02:11:46 -- scripts/common.sh@352 -- # local d=2 00:06:43.495 02:11:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:43.495 02:11:46 -- scripts/common.sh@354 -- # echo 2 00:06:43.495 02:11:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:43.495 02:11:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:43.495 02:11:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:43.495 02:11:46 -- scripts/common.sh@367 -- # return 0 00:06:43.495 02:11:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:43.495 02:11:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:43.495 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.495 --rc genhtml_branch_coverage=1 00:06:43.495 --rc genhtml_function_coverage=1 00:06:43.495 --rc genhtml_legend=1 00:06:43.495 --rc geninfo_all_blocks=1 00:06:43.495 --rc geninfo_unexecuted_blocks=1 00:06:43.495 00:06:43.495 ' 00:06:43.495 02:11:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:43.495 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.495 --rc genhtml_branch_coverage=1 00:06:43.495 --rc genhtml_function_coverage=1 00:06:43.495 --rc genhtml_legend=1 00:06:43.495 --rc geninfo_all_blocks=1 00:06:43.495 --rc geninfo_unexecuted_blocks=1 00:06:43.495 00:06:43.495 ' 00:06:43.495 02:11:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:43.495 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.495 --rc genhtml_branch_coverage=1 00:06:43.495 --rc genhtml_function_coverage=1 00:06:43.495 --rc genhtml_legend=1 00:06:43.495 --rc geninfo_all_blocks=1 00:06:43.495 --rc geninfo_unexecuted_blocks=1 00:06:43.495 00:06:43.495 ' 00:06:43.495 02:11:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:43.495 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.495 --rc genhtml_branch_coverage=1 00:06:43.495 --rc genhtml_function_coverage=1 00:06:43.495 --rc genhtml_legend=1 00:06:43.495 --rc geninfo_all_blocks=1 00:06:43.495 --rc geninfo_unexecuted_blocks=1 00:06:43.495 00:06:43.495 ' 00:06:43.495 02:11:46 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:43.495 02:11:46 -- nvmf/common.sh@7 -- # uname -s 00:06:43.495 02:11:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:43.495 02:11:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:43.495 02:11:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:43.495 02:11:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:43.495 02:11:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:43.495 02:11:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:43.495 02:11:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:43.495 02:11:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:43.495 02:11:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:43.495 02:11:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:43.495 02:11:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:43.495 02:11:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:43.495 02:11:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:43.495 02:11:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:43.495 02:11:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:43.495 02:11:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:43.495 02:11:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:43.495 02:11:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:43.495 02:11:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:43.495 02:11:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.495 02:11:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.495 02:11:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.496 02:11:46 -- paths/export.sh@5 -- # export PATH 00:06:43.496 02:11:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.496 02:11:46 -- nvmf/common.sh@46 -- # : 0 00:06:43.496 02:11:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:43.496 02:11:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:43.496 02:11:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:43.496 02:11:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:43.496 02:11:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:43.496 02:11:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:43.496 02:11:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:43.496 02:11:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:43.496 02:11:46 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:43.496 02:11:46 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:43.496 02:11:46 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:43.496 02:11:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:43.496 02:11:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:43.496 02:11:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:43.496 02:11:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:43.496 02:11:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:43.496 02:11:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:43.496 02:11:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:43.496 02:11:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:43.496 02:11:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:43.496 02:11:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:43.496 02:11:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:43.496 02:11:46 -- common/autotest_common.sh@10 -- # set +x 00:06:45.409 02:11:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:45.409 02:11:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:45.409 02:11:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:45.409 02:11:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:45.409 02:11:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:45.409 02:11:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:45.409 02:11:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:45.409 02:11:48 -- nvmf/common.sh@294 -- # net_devs=() 00:06:45.409 02:11:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:45.409 02:11:48 -- nvmf/common.sh@295 -- # e810=() 00:06:45.409 02:11:48 -- nvmf/common.sh@295 -- # local -ga e810 00:06:45.409 02:11:48 -- nvmf/common.sh@296 -- # x722=() 00:06:45.409 02:11:48 -- nvmf/common.sh@296 -- # local -ga x722 00:06:45.409 02:11:48 -- nvmf/common.sh@297 -- # mlx=() 00:06:45.409 02:11:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:45.409 02:11:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:45.409 02:11:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:45.409 02:11:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:45.409 02:11:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:45.409 02:11:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:45.409 02:11:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:45.409 02:11:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:45.409 02:11:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:45.409 02:11:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:45.409 02:11:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:45.409 02:11:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:45.409 02:11:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:45.409 02:11:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:45.409 02:11:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:45.409 02:11:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:45.409 02:11:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:45.409 02:11:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:45.409 02:11:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:45.409 02:11:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:45.409 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:45.409 02:11:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:45.409 02:11:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:45.409 02:11:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:45.409 02:11:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:45.409 02:11:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:45.409 02:11:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:45.409 02:11:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:45.409 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:45.409 02:11:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:45.409 02:11:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:45.409 02:11:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:45.409 02:11:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:45.409 02:11:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:45.409 02:11:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:45.409 02:11:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:45.409 02:11:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:45.409 02:11:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:45.409 02:11:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:45.409 02:11:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:45.409 02:11:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:45.409 02:11:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:45.409 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:45.409 02:11:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:45.409 02:11:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:45.409 02:11:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:45.409 02:11:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:45.409 02:11:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:45.409 02:11:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:45.410 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:45.410 02:11:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:45.410 02:11:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:45.410 02:11:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:45.410 02:11:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:45.410 02:11:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:45.410 02:11:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:45.410 02:11:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:45.410 02:11:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:45.410 02:11:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:45.410 02:11:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:45.410 02:11:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:45.410 02:11:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:45.410 02:11:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:45.410 02:11:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:45.410 02:11:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:45.410 02:11:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:45.410 02:11:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:45.410 02:11:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:45.410 02:11:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:45.410 02:11:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:45.410 02:11:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:45.410 02:11:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:45.410 02:11:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:45.410 02:11:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:45.410 02:11:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:45.410 02:11:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:45.410 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:45.410 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.230 ms 00:06:45.410 00:06:45.410 --- 10.0.0.2 ping statistics --- 00:06:45.410 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:45.410 rtt min/avg/max/mdev = 0.230/0.230/0.230/0.000 ms 00:06:45.410 02:11:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:45.410 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:45.410 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.084 ms 00:06:45.410 00:06:45.410 --- 10.0.0.1 ping statistics --- 00:06:45.410 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:45.410 rtt min/avg/max/mdev = 0.084/0.084/0.084/0.000 ms 00:06:45.410 02:11:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:45.410 02:11:49 -- nvmf/common.sh@410 -- # return 0 00:06:45.410 02:11:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:45.410 02:11:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:45.410 02:11:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:45.410 02:11:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:45.410 02:11:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:45.410 02:11:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:45.410 02:11:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:45.410 02:11:49 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:06:45.410 02:11:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:45.410 02:11:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:45.410 02:11:49 -- common/autotest_common.sh@10 -- # set +x 00:06:45.410 ************************************ 00:06:45.410 START TEST nvmf_filesystem_no_in_capsule 00:06:45.410 ************************************ 00:06:45.410 02:11:49 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:06:45.410 02:11:49 -- target/filesystem.sh@47 -- # in_capsule=0 00:06:45.410 02:11:49 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:45.410 02:11:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:45.410 02:11:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:45.410 02:11:49 -- common/autotest_common.sh@10 -- # set +x 00:06:45.410 02:11:49 -- nvmf/common.sh@469 -- # nvmfpid=16387 00:06:45.410 02:11:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:45.410 02:11:49 -- nvmf/common.sh@470 -- # waitforlisten 16387 00:06:45.410 02:11:49 -- common/autotest_common.sh@829 -- # '[' -z 16387 ']' 00:06:45.410 02:11:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:45.410 02:11:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:45.410 02:11:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:45.410 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:45.410 02:11:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:45.410 02:11:49 -- common/autotest_common.sh@10 -- # set +x 00:06:45.671 [2024-11-29 02:11:49.122919] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:45.671 [2024-11-29 02:11:49.123007] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:45.671 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.671 [2024-11-29 02:11:49.191556] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:45.671 [2024-11-29 02:11:49.315847] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:45.671 [2024-11-29 02:11:49.316020] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:45.671 [2024-11-29 02:11:49.316040] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:45.671 [2024-11-29 02:11:49.316055] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:45.671 [2024-11-29 02:11:49.316148] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:45.671 [2024-11-29 02:11:49.316206] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:45.671 [2024-11-29 02:11:49.316264] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:45.671 [2024-11-29 02:11:49.316261] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:46.612 02:11:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:46.612 02:11:50 -- common/autotest_common.sh@862 -- # return 0 00:06:46.612 02:11:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:46.612 02:11:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:46.612 02:11:50 -- common/autotest_common.sh@10 -- # set +x 00:06:46.612 02:11:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:46.612 02:11:50 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:46.612 02:11:50 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:06:46.612 02:11:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.612 02:11:50 -- common/autotest_common.sh@10 -- # set +x 00:06:46.612 [2024-11-29 02:11:50.157217] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:46.612 02:11:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.612 02:11:50 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:46.612 02:11:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.612 02:11:50 -- common/autotest_common.sh@10 -- # set +x 00:06:46.873 Malloc1 00:06:46.873 02:11:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.873 02:11:50 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:46.873 02:11:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.873 02:11:50 -- common/autotest_common.sh@10 -- # set +x 00:06:46.873 02:11:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.873 02:11:50 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:46.873 02:11:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.873 02:11:50 -- common/autotest_common.sh@10 -- # set +x 00:06:46.873 02:11:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.873 02:11:50 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:46.873 02:11:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.873 02:11:50 -- common/autotest_common.sh@10 -- # set +x 00:06:46.873 [2024-11-29 02:11:50.353355] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:46.873 02:11:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.873 02:11:50 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:46.873 02:11:50 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:06:46.873 02:11:50 -- common/autotest_common.sh@1368 -- # local bdev_info 00:06:46.873 02:11:50 -- common/autotest_common.sh@1369 -- # local bs 00:06:46.873 02:11:50 -- common/autotest_common.sh@1370 -- # local nb 00:06:46.873 02:11:50 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:46.873 02:11:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.873 02:11:50 -- common/autotest_common.sh@10 -- # set +x 00:06:46.873 02:11:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.873 02:11:50 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:06:46.873 { 00:06:46.873 "name": "Malloc1", 00:06:46.873 "aliases": [ 00:06:46.873 "3dcd2a0f-6df3-494f-a0ec-eccd88d49a8f" 00:06:46.873 ], 00:06:46.873 "product_name": "Malloc disk", 00:06:46.873 "block_size": 512, 00:06:46.873 "num_blocks": 1048576, 00:06:46.873 "uuid": "3dcd2a0f-6df3-494f-a0ec-eccd88d49a8f", 00:06:46.873 "assigned_rate_limits": { 00:06:46.873 "rw_ios_per_sec": 0, 00:06:46.873 "rw_mbytes_per_sec": 0, 00:06:46.873 "r_mbytes_per_sec": 0, 00:06:46.873 "w_mbytes_per_sec": 0 00:06:46.873 }, 00:06:46.873 "claimed": true, 00:06:46.873 "claim_type": "exclusive_write", 00:06:46.873 "zoned": false, 00:06:46.873 "supported_io_types": { 00:06:46.873 "read": true, 00:06:46.873 "write": true, 00:06:46.873 "unmap": true, 00:06:46.873 "write_zeroes": true, 00:06:46.873 "flush": true, 00:06:46.873 "reset": true, 00:06:46.873 "compare": false, 00:06:46.873 "compare_and_write": false, 00:06:46.873 "abort": true, 00:06:46.873 "nvme_admin": false, 00:06:46.873 "nvme_io": false 00:06:46.873 }, 00:06:46.873 "memory_domains": [ 00:06:46.873 { 00:06:46.873 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:46.873 "dma_device_type": 2 00:06:46.873 } 00:06:46.873 ], 00:06:46.873 "driver_specific": {} 00:06:46.873 } 00:06:46.873 ]' 00:06:46.873 02:11:50 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:06:46.873 02:11:50 -- common/autotest_common.sh@1372 -- # bs=512 00:06:46.873 02:11:50 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:06:46.873 02:11:50 -- common/autotest_common.sh@1373 -- # nb=1048576 00:06:46.873 02:11:50 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:06:46.873 02:11:50 -- common/autotest_common.sh@1377 -- # echo 512 00:06:46.873 02:11:50 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:46.873 02:11:50 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:47.814 02:11:51 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:47.814 02:11:51 -- common/autotest_common.sh@1187 -- # local i=0 00:06:47.814 02:11:51 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:06:47.814 02:11:51 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:06:47.814 02:11:51 -- common/autotest_common.sh@1194 -- # sleep 2 00:06:49.728 02:11:53 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:06:49.728 02:11:53 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:06:49.728 02:11:53 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:06:49.728 02:11:53 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:06:49.728 02:11:53 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:06:49.728 02:11:53 -- common/autotest_common.sh@1197 -- # return 0 00:06:49.728 02:11:53 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:49.728 02:11:53 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:49.728 02:11:53 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:49.728 02:11:53 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:49.728 02:11:53 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:49.728 02:11:53 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:49.728 02:11:53 -- setup/common.sh@80 -- # echo 536870912 00:06:49.728 02:11:53 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:49.728 02:11:53 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:49.728 02:11:53 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:49.728 02:11:53 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:49.990 02:11:53 -- target/filesystem.sh@69 -- # partprobe 00:06:50.928 02:11:54 -- target/filesystem.sh@70 -- # sleep 1 00:06:51.867 02:11:55 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:06:51.867 02:11:55 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:51.867 02:11:55 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:51.867 02:11:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:51.867 02:11:55 -- common/autotest_common.sh@10 -- # set +x 00:06:51.867 ************************************ 00:06:51.867 START TEST filesystem_ext4 00:06:51.867 ************************************ 00:06:51.867 02:11:55 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:51.867 02:11:55 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:51.867 02:11:55 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:51.867 02:11:55 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:51.867 02:11:55 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:06:51.867 02:11:55 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:51.867 02:11:55 -- common/autotest_common.sh@914 -- # local i=0 00:06:51.867 02:11:55 -- common/autotest_common.sh@915 -- # local force 00:06:51.867 02:11:55 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:06:51.867 02:11:55 -- common/autotest_common.sh@918 -- # force=-F 00:06:51.867 02:11:55 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:51.867 mke2fs 1.47.0 (5-Feb-2023) 00:06:52.126 Discarding device blocks: 0/522240 done 00:06:52.126 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:52.126 Filesystem UUID: 5023b9ce-bd1a-43d8-9690-5d3a5cebd40d 00:06:52.126 Superblock backups stored on blocks: 00:06:52.126 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:52.126 00:06:52.126 Allocating group tables: 0/64 done 00:06:52.126 Writing inode tables: 0/64 done 00:06:54.667 Creating journal (8192 blocks): done 00:06:54.667 Writing superblocks and filesystem accounting information: 0/64 done 00:06:54.667 00:06:54.667 02:11:57 -- common/autotest_common.sh@931 -- # return 0 00:06:54.667 02:11:57 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:01.236 02:12:03 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:01.236 02:12:03 -- target/filesystem.sh@25 -- # sync 00:07:01.236 02:12:03 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:01.236 02:12:03 -- target/filesystem.sh@27 -- # sync 00:07:01.236 02:12:03 -- target/filesystem.sh@29 -- # i=0 00:07:01.236 02:12:03 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:01.236 02:12:03 -- target/filesystem.sh@37 -- # kill -0 16387 00:07:01.236 02:12:03 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:01.236 02:12:03 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:01.236 02:12:03 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:01.236 02:12:03 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:01.236 00:07:01.236 real 0m8.524s 00:07:01.236 user 0m0.016s 00:07:01.236 sys 0m0.066s 00:07:01.236 02:12:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:01.236 02:12:03 -- common/autotest_common.sh@10 -- # set +x 00:07:01.236 ************************************ 00:07:01.236 END TEST filesystem_ext4 00:07:01.236 ************************************ 00:07:01.236 02:12:03 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:01.236 02:12:03 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:01.236 02:12:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:01.236 02:12:03 -- common/autotest_common.sh@10 -- # set +x 00:07:01.236 ************************************ 00:07:01.236 START TEST filesystem_btrfs 00:07:01.236 ************************************ 00:07:01.236 02:12:04 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:01.236 02:12:04 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:01.236 02:12:04 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:01.236 02:12:04 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:01.236 02:12:04 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:01.236 02:12:04 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:01.236 02:12:04 -- common/autotest_common.sh@914 -- # local i=0 00:07:01.236 02:12:04 -- common/autotest_common.sh@915 -- # local force 00:07:01.236 02:12:04 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:01.236 02:12:04 -- common/autotest_common.sh@920 -- # force=-f 00:07:01.236 02:12:04 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:01.236 btrfs-progs v6.8.1 00:07:01.236 See https://btrfs.readthedocs.io for more information. 00:07:01.236 00:07:01.236 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:01.236 NOTE: several default settings have changed in version 5.15, please make sure 00:07:01.236 this does not affect your deployments: 00:07:01.236 - DUP for metadata (-m dup) 00:07:01.236 - enabled no-holes (-O no-holes) 00:07:01.236 - enabled free-space-tree (-R free-space-tree) 00:07:01.236 00:07:01.236 Label: (null) 00:07:01.236 UUID: df579165-4f43-47aa-a05a-20e97412d3f5 00:07:01.236 Node size: 16384 00:07:01.236 Sector size: 4096 (CPU page size: 4096) 00:07:01.236 Filesystem size: 510.00MiB 00:07:01.236 Block group profiles: 00:07:01.236 Data: single 8.00MiB 00:07:01.236 Metadata: DUP 32.00MiB 00:07:01.236 System: DUP 8.00MiB 00:07:01.236 SSD detected: yes 00:07:01.236 Zoned device: no 00:07:01.236 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:01.236 Checksum: crc32c 00:07:01.236 Number of devices: 1 00:07:01.236 Devices: 00:07:01.236 ID SIZE PATH 00:07:01.236 1 510.00MiB /dev/nvme0n1p1 00:07:01.236 00:07:01.236 02:12:04 -- common/autotest_common.sh@931 -- # return 0 00:07:01.236 02:12:04 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:01.236 02:12:04 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:01.236 02:12:04 -- target/filesystem.sh@25 -- # sync 00:07:01.236 02:12:04 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:01.236 02:12:04 -- target/filesystem.sh@27 -- # sync 00:07:01.236 02:12:04 -- target/filesystem.sh@29 -- # i=0 00:07:01.236 02:12:04 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:01.236 02:12:04 -- target/filesystem.sh@37 -- # kill -0 16387 00:07:01.236 02:12:04 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:01.236 02:12:04 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:01.236 02:12:04 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:01.236 02:12:04 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:01.236 00:07:01.236 real 0m0.578s 00:07:01.236 user 0m0.024s 00:07:01.236 sys 0m0.093s 00:07:01.236 02:12:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:01.236 02:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:01.236 ************************************ 00:07:01.236 END TEST filesystem_btrfs 00:07:01.236 ************************************ 00:07:01.236 02:12:04 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:07:01.237 02:12:04 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:01.237 02:12:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:01.237 02:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:01.237 ************************************ 00:07:01.237 START TEST filesystem_xfs 00:07:01.237 ************************************ 00:07:01.237 02:12:04 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:01.237 02:12:04 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:01.237 02:12:04 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:01.237 02:12:04 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:01.237 02:12:04 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:01.237 02:12:04 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:01.237 02:12:04 -- common/autotest_common.sh@914 -- # local i=0 00:07:01.237 02:12:04 -- common/autotest_common.sh@915 -- # local force 00:07:01.237 02:12:04 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:01.237 02:12:04 -- common/autotest_common.sh@920 -- # force=-f 00:07:01.237 02:12:04 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:01.237 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:01.237 = sectsz=512 attr=2, projid32bit=1 00:07:01.237 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:01.237 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:01.237 data = bsize=4096 blocks=130560, imaxpct=25 00:07:01.237 = sunit=0 swidth=0 blks 00:07:01.237 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:01.237 log =internal log bsize=4096 blocks=16384, version=2 00:07:01.237 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:01.237 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:02.173 Discarding blocks...Done. 00:07:02.173 02:12:05 -- common/autotest_common.sh@931 -- # return 0 00:07:02.173 02:12:05 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:04.080 02:12:07 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:04.080 02:12:07 -- target/filesystem.sh@25 -- # sync 00:07:04.080 02:12:07 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:04.080 02:12:07 -- target/filesystem.sh@27 -- # sync 00:07:04.080 02:12:07 -- target/filesystem.sh@29 -- # i=0 00:07:04.080 02:12:07 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:04.080 02:12:07 -- target/filesystem.sh@37 -- # kill -0 16387 00:07:04.080 02:12:07 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:04.080 02:12:07 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:04.080 02:12:07 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:04.080 02:12:07 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:04.080 00:07:04.080 real 0m2.971s 00:07:04.080 user 0m0.019s 00:07:04.080 sys 0m0.056s 00:07:04.080 02:12:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:04.080 02:12:07 -- common/autotest_common.sh@10 -- # set +x 00:07:04.080 ************************************ 00:07:04.080 END TEST filesystem_xfs 00:07:04.080 ************************************ 00:07:04.081 02:12:07 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:04.339 02:12:07 -- target/filesystem.sh@93 -- # sync 00:07:04.339 02:12:07 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:04.339 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:04.339 02:12:07 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:04.339 02:12:07 -- common/autotest_common.sh@1208 -- # local i=0 00:07:04.339 02:12:07 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:04.339 02:12:07 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:04.339 02:12:07 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:04.339 02:12:07 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:04.339 02:12:07 -- common/autotest_common.sh@1220 -- # return 0 00:07:04.339 02:12:07 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:04.339 02:12:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.339 02:12:07 -- common/autotest_common.sh@10 -- # set +x 00:07:04.339 02:12:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.339 02:12:07 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:04.339 02:12:07 -- target/filesystem.sh@101 -- # killprocess 16387 00:07:04.339 02:12:07 -- common/autotest_common.sh@936 -- # '[' -z 16387 ']' 00:07:04.339 02:12:07 -- common/autotest_common.sh@940 -- # kill -0 16387 00:07:04.340 02:12:07 -- common/autotest_common.sh@941 -- # uname 00:07:04.340 02:12:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:04.340 02:12:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 16387 00:07:04.340 02:12:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:04.340 02:12:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:04.340 02:12:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 16387' 00:07:04.340 killing process with pid 16387 00:07:04.340 02:12:08 -- common/autotest_common.sh@955 -- # kill 16387 00:07:04.340 02:12:08 -- common/autotest_common.sh@960 -- # wait 16387 00:07:04.906 02:12:08 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:04.906 00:07:04.906 real 0m19.405s 00:07:04.906 user 1m14.987s 00:07:04.906 sys 0m2.407s 00:07:04.906 02:12:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:04.906 02:12:08 -- common/autotest_common.sh@10 -- # set +x 00:07:04.906 ************************************ 00:07:04.906 END TEST nvmf_filesystem_no_in_capsule 00:07:04.906 ************************************ 00:07:04.906 02:12:08 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:07:04.906 02:12:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:04.906 02:12:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:04.906 02:12:08 -- common/autotest_common.sh@10 -- # set +x 00:07:04.906 ************************************ 00:07:04.906 START TEST nvmf_filesystem_in_capsule 00:07:04.906 ************************************ 00:07:04.906 02:12:08 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:07:04.906 02:12:08 -- target/filesystem.sh@47 -- # in_capsule=4096 00:07:04.906 02:12:08 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:04.906 02:12:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:04.906 02:12:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:04.906 02:12:08 -- common/autotest_common.sh@10 -- # set +x 00:07:04.906 02:12:08 -- nvmf/common.sh@469 -- # nvmfpid=19453 00:07:04.906 02:12:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:04.906 02:12:08 -- nvmf/common.sh@470 -- # waitforlisten 19453 00:07:04.906 02:12:08 -- common/autotest_common.sh@829 -- # '[' -z 19453 ']' 00:07:04.906 02:12:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:04.906 02:12:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:04.906 02:12:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:04.906 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:04.906 02:12:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:04.906 02:12:08 -- common/autotest_common.sh@10 -- # set +x 00:07:04.906 [2024-11-29 02:12:08.554452] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:04.906 [2024-11-29 02:12:08.554534] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:05.165 EAL: No free 2048 kB hugepages reported on node 1 00:07:05.165 [2024-11-29 02:12:08.624977] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:05.165 [2024-11-29 02:12:08.745739] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:05.165 [2024-11-29 02:12:08.745900] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:05.165 [2024-11-29 02:12:08.745921] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:05.165 [2024-11-29 02:12:08.745936] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:05.165 [2024-11-29 02:12:08.746030] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:05.165 [2024-11-29 02:12:08.746061] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:05.165 [2024-11-29 02:12:08.746111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:05.165 [2024-11-29 02:12:08.746114] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.099 02:12:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:06.099 02:12:09 -- common/autotest_common.sh@862 -- # return 0 00:07:06.099 02:12:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:06.099 02:12:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:06.099 02:12:09 -- common/autotest_common.sh@10 -- # set +x 00:07:06.099 02:12:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:06.099 02:12:09 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:06.099 02:12:09 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:07:06.099 02:12:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.099 02:12:09 -- common/autotest_common.sh@10 -- # set +x 00:07:06.099 [2024-11-29 02:12:09.559954] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:06.099 02:12:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.099 02:12:09 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:06.099 02:12:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.099 02:12:09 -- common/autotest_common.sh@10 -- # set +x 00:07:06.099 Malloc1 00:07:06.099 02:12:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.099 02:12:09 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:06.099 02:12:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.099 02:12:09 -- common/autotest_common.sh@10 -- # set +x 00:07:06.099 02:12:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.099 02:12:09 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:06.099 02:12:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.099 02:12:09 -- common/autotest_common.sh@10 -- # set +x 00:07:06.099 02:12:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.099 02:12:09 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:06.099 02:12:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.099 02:12:09 -- common/autotest_common.sh@10 -- # set +x 00:07:06.099 [2024-11-29 02:12:09.745827] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:06.099 02:12:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.099 02:12:09 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:06.099 02:12:09 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:07:06.099 02:12:09 -- common/autotest_common.sh@1368 -- # local bdev_info 00:07:06.100 02:12:09 -- common/autotest_common.sh@1369 -- # local bs 00:07:06.100 02:12:09 -- common/autotest_common.sh@1370 -- # local nb 00:07:06.100 02:12:09 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:06.100 02:12:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.100 02:12:09 -- common/autotest_common.sh@10 -- # set +x 00:07:06.100 02:12:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.100 02:12:09 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:07:06.100 { 00:07:06.100 "name": "Malloc1", 00:07:06.100 "aliases": [ 00:07:06.100 "3a20e088-915e-47a8-9ef9-21c7f8f7e222" 00:07:06.100 ], 00:07:06.100 "product_name": "Malloc disk", 00:07:06.100 "block_size": 512, 00:07:06.100 "num_blocks": 1048576, 00:07:06.100 "uuid": "3a20e088-915e-47a8-9ef9-21c7f8f7e222", 00:07:06.100 "assigned_rate_limits": { 00:07:06.100 "rw_ios_per_sec": 0, 00:07:06.100 "rw_mbytes_per_sec": 0, 00:07:06.100 "r_mbytes_per_sec": 0, 00:07:06.100 "w_mbytes_per_sec": 0 00:07:06.100 }, 00:07:06.100 "claimed": true, 00:07:06.100 "claim_type": "exclusive_write", 00:07:06.100 "zoned": false, 00:07:06.100 "supported_io_types": { 00:07:06.100 "read": true, 00:07:06.100 "write": true, 00:07:06.100 "unmap": true, 00:07:06.100 "write_zeroes": true, 00:07:06.100 "flush": true, 00:07:06.100 "reset": true, 00:07:06.100 "compare": false, 00:07:06.100 "compare_and_write": false, 00:07:06.100 "abort": true, 00:07:06.100 "nvme_admin": false, 00:07:06.100 "nvme_io": false 00:07:06.100 }, 00:07:06.100 "memory_domains": [ 00:07:06.100 { 00:07:06.100 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:06.100 "dma_device_type": 2 00:07:06.100 } 00:07:06.100 ], 00:07:06.100 "driver_specific": {} 00:07:06.100 } 00:07:06.100 ]' 00:07:06.100 02:12:09 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:06.358 02:12:09 -- common/autotest_common.sh@1372 -- # bs=512 00:07:06.358 02:12:09 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:06.358 02:12:09 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:06.358 02:12:09 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:06.358 02:12:09 -- common/autotest_common.sh@1377 -- # echo 512 00:07:06.358 02:12:09 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:06.358 02:12:09 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:06.923 02:12:10 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:06.923 02:12:10 -- common/autotest_common.sh@1187 -- # local i=0 00:07:06.923 02:12:10 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:06.923 02:12:10 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:06.923 02:12:10 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:08.820 02:12:12 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:08.820 02:12:12 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:08.820 02:12:12 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:08.820 02:12:12 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:08.820 02:12:12 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:08.820 02:12:12 -- common/autotest_common.sh@1197 -- # return 0 00:07:08.820 02:12:12 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:08.820 02:12:12 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:08.820 02:12:12 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:08.820 02:12:12 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:08.821 02:12:12 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:08.821 02:12:12 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:08.821 02:12:12 -- setup/common.sh@80 -- # echo 536870912 00:07:08.821 02:12:12 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:08.821 02:12:12 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:08.821 02:12:12 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:08.821 02:12:12 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:09.078 02:12:12 -- target/filesystem.sh@69 -- # partprobe 00:07:09.644 02:12:13 -- target/filesystem.sh@70 -- # sleep 1 00:07:11.024 02:12:14 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:07:11.024 02:12:14 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:11.024 02:12:14 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:11.024 02:12:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:11.024 02:12:14 -- common/autotest_common.sh@10 -- # set +x 00:07:11.024 ************************************ 00:07:11.024 START TEST filesystem_in_capsule_ext4 00:07:11.024 ************************************ 00:07:11.024 02:12:14 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:11.024 02:12:14 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:11.024 02:12:14 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:11.024 02:12:14 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:11.024 02:12:14 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:11.024 02:12:14 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:11.024 02:12:14 -- common/autotest_common.sh@914 -- # local i=0 00:07:11.024 02:12:14 -- common/autotest_common.sh@915 -- # local force 00:07:11.024 02:12:14 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:11.024 02:12:14 -- common/autotest_common.sh@918 -- # force=-F 00:07:11.024 02:12:14 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:11.024 mke2fs 1.47.0 (5-Feb-2023) 00:07:11.024 Discarding device blocks: 0/522240 done 00:07:11.024 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:11.024 Filesystem UUID: 916ed20e-a6db-4369-a39e-0fec6a623a38 00:07:11.024 Superblock backups stored on blocks: 00:07:11.024 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:11.024 00:07:11.024 Allocating group tables: 0/64 done 00:07:11.024 Writing inode tables: 0/64 done 00:07:11.973 Creating journal (8192 blocks): done 00:07:12.234 Writing superblocks and filesystem accounting information: 0/64 done 00:07:12.234 00:07:12.234 02:12:15 -- common/autotest_common.sh@931 -- # return 0 00:07:12.234 02:12:15 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:17.539 02:12:20 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:17.539 02:12:20 -- target/filesystem.sh@25 -- # sync 00:07:17.539 02:12:20 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:17.539 02:12:20 -- target/filesystem.sh@27 -- # sync 00:07:17.539 02:12:20 -- target/filesystem.sh@29 -- # i=0 00:07:17.539 02:12:20 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:17.539 02:12:21 -- target/filesystem.sh@37 -- # kill -0 19453 00:07:17.539 02:12:21 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:17.539 02:12:21 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:17.539 02:12:21 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:17.539 02:12:21 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:17.539 00:07:17.539 real 0m6.716s 00:07:17.539 user 0m0.014s 00:07:17.539 sys 0m0.070s 00:07:17.539 02:12:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:17.539 02:12:21 -- common/autotest_common.sh@10 -- # set +x 00:07:17.539 ************************************ 00:07:17.539 END TEST filesystem_in_capsule_ext4 00:07:17.539 ************************************ 00:07:17.539 02:12:21 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:17.539 02:12:21 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:17.539 02:12:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:17.539 02:12:21 -- common/autotest_common.sh@10 -- # set +x 00:07:17.539 ************************************ 00:07:17.539 START TEST filesystem_in_capsule_btrfs 00:07:17.539 ************************************ 00:07:17.539 02:12:21 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:17.539 02:12:21 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:17.539 02:12:21 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:17.539 02:12:21 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:17.539 02:12:21 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:17.539 02:12:21 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:17.539 02:12:21 -- common/autotest_common.sh@914 -- # local i=0 00:07:17.539 02:12:21 -- common/autotest_common.sh@915 -- # local force 00:07:17.539 02:12:21 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:17.539 02:12:21 -- common/autotest_common.sh@920 -- # force=-f 00:07:17.539 02:12:21 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:17.806 btrfs-progs v6.8.1 00:07:17.806 See https://btrfs.readthedocs.io for more information. 00:07:17.806 00:07:17.806 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:17.806 NOTE: several default settings have changed in version 5.15, please make sure 00:07:17.806 this does not affect your deployments: 00:07:17.806 - DUP for metadata (-m dup) 00:07:17.806 - enabled no-holes (-O no-holes) 00:07:17.806 - enabled free-space-tree (-R free-space-tree) 00:07:17.806 00:07:17.806 Label: (null) 00:07:17.806 UUID: c6d33100-24d3-47d2-a8ed-bb71799f8993 00:07:17.806 Node size: 16384 00:07:17.806 Sector size: 4096 (CPU page size: 4096) 00:07:17.806 Filesystem size: 510.00MiB 00:07:17.806 Block group profiles: 00:07:17.806 Data: single 8.00MiB 00:07:17.806 Metadata: DUP 32.00MiB 00:07:17.806 System: DUP 8.00MiB 00:07:17.806 SSD detected: yes 00:07:17.806 Zoned device: no 00:07:17.806 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:17.806 Checksum: crc32c 00:07:17.806 Number of devices: 1 00:07:17.806 Devices: 00:07:17.806 ID SIZE PATH 00:07:17.806 1 510.00MiB /dev/nvme0n1p1 00:07:17.806 00:07:17.806 02:12:21 -- common/autotest_common.sh@931 -- # return 0 00:07:17.806 02:12:21 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:18.746 02:12:22 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:18.746 02:12:22 -- target/filesystem.sh@25 -- # sync 00:07:18.746 02:12:22 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:18.746 02:12:22 -- target/filesystem.sh@27 -- # sync 00:07:18.746 02:12:22 -- target/filesystem.sh@29 -- # i=0 00:07:18.746 02:12:22 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:19.004 02:12:22 -- target/filesystem.sh@37 -- # kill -0 19453 00:07:19.004 02:12:22 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:19.004 02:12:22 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:19.004 02:12:22 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:19.004 02:12:22 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:19.004 00:07:19.004 real 0m1.390s 00:07:19.004 user 0m0.014s 00:07:19.004 sys 0m0.112s 00:07:19.004 02:12:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:19.004 02:12:22 -- common/autotest_common.sh@10 -- # set +x 00:07:19.004 ************************************ 00:07:19.004 END TEST filesystem_in_capsule_btrfs 00:07:19.004 ************************************ 00:07:19.004 02:12:22 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:07:19.004 02:12:22 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:19.004 02:12:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:19.004 02:12:22 -- common/autotest_common.sh@10 -- # set +x 00:07:19.004 ************************************ 00:07:19.004 START TEST filesystem_in_capsule_xfs 00:07:19.004 ************************************ 00:07:19.004 02:12:22 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:19.004 02:12:22 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:19.004 02:12:22 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:19.004 02:12:22 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:19.004 02:12:22 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:19.004 02:12:22 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:19.004 02:12:22 -- common/autotest_common.sh@914 -- # local i=0 00:07:19.004 02:12:22 -- common/autotest_common.sh@915 -- # local force 00:07:19.004 02:12:22 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:19.004 02:12:22 -- common/autotest_common.sh@920 -- # force=-f 00:07:19.004 02:12:22 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:19.004 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:19.004 = sectsz=512 attr=2, projid32bit=1 00:07:19.004 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:19.004 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:19.004 data = bsize=4096 blocks=130560, imaxpct=25 00:07:19.004 = sunit=0 swidth=0 blks 00:07:19.004 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:19.004 log =internal log bsize=4096 blocks=16384, version=2 00:07:19.004 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:19.004 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:19.944 Discarding blocks...Done. 00:07:19.944 02:12:23 -- common/autotest_common.sh@931 -- # return 0 00:07:19.944 02:12:23 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:22.482 02:12:25 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:22.482 02:12:25 -- target/filesystem.sh@25 -- # sync 00:07:22.482 02:12:25 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:22.482 02:12:25 -- target/filesystem.sh@27 -- # sync 00:07:22.482 02:12:25 -- target/filesystem.sh@29 -- # i=0 00:07:22.482 02:12:25 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:22.482 02:12:25 -- target/filesystem.sh@37 -- # kill -0 19453 00:07:22.482 02:12:25 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:22.482 02:12:25 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:22.482 02:12:25 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:22.482 02:12:25 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:22.482 00:07:22.482 real 0m3.299s 00:07:22.482 user 0m0.018s 00:07:22.482 sys 0m0.067s 00:07:22.482 02:12:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:22.482 02:12:25 -- common/autotest_common.sh@10 -- # set +x 00:07:22.482 ************************************ 00:07:22.482 END TEST filesystem_in_capsule_xfs 00:07:22.482 ************************************ 00:07:22.482 02:12:25 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:22.482 02:12:25 -- target/filesystem.sh@93 -- # sync 00:07:22.482 02:12:25 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:22.482 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:22.482 02:12:26 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:22.482 02:12:26 -- common/autotest_common.sh@1208 -- # local i=0 00:07:22.482 02:12:26 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:22.482 02:12:26 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:22.482 02:12:26 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:22.482 02:12:26 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:22.482 02:12:26 -- common/autotest_common.sh@1220 -- # return 0 00:07:22.482 02:12:26 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:22.482 02:12:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:22.482 02:12:26 -- common/autotest_common.sh@10 -- # set +x 00:07:22.482 02:12:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:22.482 02:12:26 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:22.482 02:12:26 -- target/filesystem.sh@101 -- # killprocess 19453 00:07:22.482 02:12:26 -- common/autotest_common.sh@936 -- # '[' -z 19453 ']' 00:07:22.482 02:12:26 -- common/autotest_common.sh@940 -- # kill -0 19453 00:07:22.482 02:12:26 -- common/autotest_common.sh@941 -- # uname 00:07:22.482 02:12:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:22.482 02:12:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 19453 00:07:22.482 02:12:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:22.482 02:12:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:22.482 02:12:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 19453' 00:07:22.482 killing process with pid 19453 00:07:22.482 02:12:26 -- common/autotest_common.sh@955 -- # kill 19453 00:07:22.482 02:12:26 -- common/autotest_common.sh@960 -- # wait 19453 00:07:23.051 02:12:26 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:23.051 00:07:23.051 real 0m18.135s 00:07:23.051 user 1m9.926s 00:07:23.051 sys 0m2.427s 00:07:23.051 02:12:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:23.051 02:12:26 -- common/autotest_common.sh@10 -- # set +x 00:07:23.051 ************************************ 00:07:23.051 END TEST nvmf_filesystem_in_capsule 00:07:23.051 ************************************ 00:07:23.051 02:12:26 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:23.051 02:12:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:23.051 02:12:26 -- nvmf/common.sh@116 -- # sync 00:07:23.051 02:12:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:23.051 02:12:26 -- nvmf/common.sh@119 -- # set +e 00:07:23.051 02:12:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:23.051 02:12:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:23.051 rmmod nvme_tcp 00:07:23.052 rmmod nvme_fabrics 00:07:23.052 rmmod nvme_keyring 00:07:23.052 02:12:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:23.052 02:12:26 -- nvmf/common.sh@123 -- # set -e 00:07:23.052 02:12:26 -- nvmf/common.sh@124 -- # return 0 00:07:23.052 02:12:26 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:07:23.052 02:12:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:23.052 02:12:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:23.052 02:12:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:23.052 02:12:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:23.052 02:12:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:23.052 02:12:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:23.052 02:12:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:23.052 02:12:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:25.591 02:12:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:25.591 00:07:25.591 real 0m42.113s 00:07:25.591 user 2m25.931s 00:07:25.591 sys 0m6.389s 00:07:25.591 02:12:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:25.591 02:12:28 -- common/autotest_common.sh@10 -- # set +x 00:07:25.591 ************************************ 00:07:25.591 END TEST nvmf_filesystem 00:07:25.591 ************************************ 00:07:25.591 02:12:28 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:25.591 02:12:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:25.591 02:12:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:25.591 02:12:28 -- common/autotest_common.sh@10 -- # set +x 00:07:25.591 ************************************ 00:07:25.591 START TEST nvmf_discovery 00:07:25.591 ************************************ 00:07:25.591 02:12:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:25.591 * Looking for test storage... 00:07:25.591 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:25.591 02:12:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:25.591 02:12:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:25.591 02:12:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:25.591 02:12:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:25.591 02:12:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:25.591 02:12:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:25.591 02:12:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:25.591 02:12:28 -- scripts/common.sh@335 -- # IFS=.-: 00:07:25.591 02:12:28 -- scripts/common.sh@335 -- # read -ra ver1 00:07:25.591 02:12:28 -- scripts/common.sh@336 -- # IFS=.-: 00:07:25.591 02:12:28 -- scripts/common.sh@336 -- # read -ra ver2 00:07:25.591 02:12:28 -- scripts/common.sh@337 -- # local 'op=<' 00:07:25.591 02:12:28 -- scripts/common.sh@339 -- # ver1_l=2 00:07:25.591 02:12:28 -- scripts/common.sh@340 -- # ver2_l=1 00:07:25.591 02:12:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:25.591 02:12:28 -- scripts/common.sh@343 -- # case "$op" in 00:07:25.591 02:12:28 -- scripts/common.sh@344 -- # : 1 00:07:25.591 02:12:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:25.591 02:12:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:25.591 02:12:28 -- scripts/common.sh@364 -- # decimal 1 00:07:25.591 02:12:28 -- scripts/common.sh@352 -- # local d=1 00:07:25.591 02:12:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:25.591 02:12:28 -- scripts/common.sh@354 -- # echo 1 00:07:25.591 02:12:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:25.591 02:12:28 -- scripts/common.sh@365 -- # decimal 2 00:07:25.591 02:12:28 -- scripts/common.sh@352 -- # local d=2 00:07:25.591 02:12:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:25.591 02:12:28 -- scripts/common.sh@354 -- # echo 2 00:07:25.591 02:12:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:25.591 02:12:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:25.591 02:12:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:25.591 02:12:28 -- scripts/common.sh@367 -- # return 0 00:07:25.591 02:12:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:25.591 02:12:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:25.591 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:25.591 --rc genhtml_branch_coverage=1 00:07:25.591 --rc genhtml_function_coverage=1 00:07:25.591 --rc genhtml_legend=1 00:07:25.591 --rc geninfo_all_blocks=1 00:07:25.591 --rc geninfo_unexecuted_blocks=1 00:07:25.591 00:07:25.591 ' 00:07:25.591 02:12:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:25.591 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:25.591 --rc genhtml_branch_coverage=1 00:07:25.591 --rc genhtml_function_coverage=1 00:07:25.591 --rc genhtml_legend=1 00:07:25.591 --rc geninfo_all_blocks=1 00:07:25.591 --rc geninfo_unexecuted_blocks=1 00:07:25.591 00:07:25.591 ' 00:07:25.591 02:12:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:25.591 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:25.591 --rc genhtml_branch_coverage=1 00:07:25.591 --rc genhtml_function_coverage=1 00:07:25.591 --rc genhtml_legend=1 00:07:25.591 --rc geninfo_all_blocks=1 00:07:25.591 --rc geninfo_unexecuted_blocks=1 00:07:25.591 00:07:25.591 ' 00:07:25.591 02:12:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:25.591 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:25.592 --rc genhtml_branch_coverage=1 00:07:25.592 --rc genhtml_function_coverage=1 00:07:25.592 --rc genhtml_legend=1 00:07:25.592 --rc geninfo_all_blocks=1 00:07:25.592 --rc geninfo_unexecuted_blocks=1 00:07:25.592 00:07:25.592 ' 00:07:25.592 02:12:28 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:25.592 02:12:28 -- nvmf/common.sh@7 -- # uname -s 00:07:25.592 02:12:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:25.592 02:12:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:25.592 02:12:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:25.592 02:12:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:25.592 02:12:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:25.592 02:12:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:25.592 02:12:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:25.592 02:12:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:25.592 02:12:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:25.592 02:12:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:25.592 02:12:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:25.592 02:12:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:25.592 02:12:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:25.592 02:12:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:25.592 02:12:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:25.592 02:12:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:25.592 02:12:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:25.592 02:12:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:25.592 02:12:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:25.592 02:12:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:25.592 02:12:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:25.592 02:12:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:25.592 02:12:28 -- paths/export.sh@5 -- # export PATH 00:07:25.592 02:12:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:25.592 02:12:28 -- nvmf/common.sh@46 -- # : 0 00:07:25.592 02:12:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:25.592 02:12:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:25.592 02:12:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:25.592 02:12:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:25.592 02:12:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:25.592 02:12:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:25.592 02:12:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:25.592 02:12:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:25.592 02:12:28 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:25.592 02:12:28 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:25.592 02:12:28 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:25.592 02:12:28 -- target/discovery.sh@15 -- # hash nvme 00:07:25.592 02:12:28 -- target/discovery.sh@20 -- # nvmftestinit 00:07:25.592 02:12:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:25.592 02:12:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:25.592 02:12:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:25.592 02:12:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:25.592 02:12:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:25.592 02:12:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:25.592 02:12:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:25.592 02:12:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:25.592 02:12:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:25.592 02:12:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:25.592 02:12:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:25.592 02:12:28 -- common/autotest_common.sh@10 -- # set +x 00:07:27.496 02:12:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:27.496 02:12:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:27.496 02:12:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:27.496 02:12:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:27.496 02:12:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:27.496 02:12:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:27.496 02:12:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:27.496 02:12:31 -- nvmf/common.sh@294 -- # net_devs=() 00:07:27.496 02:12:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:27.496 02:12:31 -- nvmf/common.sh@295 -- # e810=() 00:07:27.496 02:12:31 -- nvmf/common.sh@295 -- # local -ga e810 00:07:27.496 02:12:31 -- nvmf/common.sh@296 -- # x722=() 00:07:27.496 02:12:31 -- nvmf/common.sh@296 -- # local -ga x722 00:07:27.496 02:12:31 -- nvmf/common.sh@297 -- # mlx=() 00:07:27.496 02:12:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:27.496 02:12:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:27.496 02:12:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:27.496 02:12:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:27.496 02:12:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:27.496 02:12:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:27.496 02:12:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:27.496 02:12:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:27.496 02:12:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:27.496 02:12:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:27.496 02:12:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:27.496 02:12:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:27.496 02:12:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:27.496 02:12:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:27.496 02:12:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:27.496 02:12:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:27.496 02:12:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:27.496 02:12:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:27.496 02:12:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:27.496 02:12:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:27.496 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:27.496 02:12:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:27.496 02:12:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:27.496 02:12:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:27.496 02:12:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:27.496 02:12:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:27.496 02:12:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:27.496 02:12:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:27.496 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:27.496 02:12:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:27.496 02:12:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:27.496 02:12:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:27.496 02:12:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:27.496 02:12:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:27.496 02:12:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:27.496 02:12:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:27.496 02:12:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:27.496 02:12:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:27.496 02:12:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:27.496 02:12:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:27.496 02:12:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:27.496 02:12:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:27.496 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:27.496 02:12:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:27.496 02:12:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:27.496 02:12:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:27.496 02:12:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:27.496 02:12:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:27.496 02:12:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:27.496 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:27.496 02:12:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:27.496 02:12:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:27.496 02:12:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:27.496 02:12:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:27.497 02:12:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:27.497 02:12:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:27.497 02:12:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:27.497 02:12:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:27.497 02:12:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:27.497 02:12:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:27.497 02:12:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:27.497 02:12:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:27.497 02:12:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:27.497 02:12:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:27.497 02:12:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:27.497 02:12:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:27.497 02:12:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:27.497 02:12:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:27.497 02:12:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:27.757 02:12:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:27.757 02:12:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:27.757 02:12:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:27.757 02:12:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:27.757 02:12:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:27.757 02:12:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:27.757 02:12:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:27.757 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:27.757 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.208 ms 00:07:27.757 00:07:27.757 --- 10.0.0.2 ping statistics --- 00:07:27.757 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:27.757 rtt min/avg/max/mdev = 0.208/0.208/0.208/0.000 ms 00:07:27.757 02:12:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:27.757 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:27.757 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.079 ms 00:07:27.757 00:07:27.757 --- 10.0.0.1 ping statistics --- 00:07:27.757 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:27.757 rtt min/avg/max/mdev = 0.079/0.079/0.079/0.000 ms 00:07:27.757 02:12:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:27.757 02:12:31 -- nvmf/common.sh@410 -- # return 0 00:07:27.757 02:12:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:27.757 02:12:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:27.757 02:12:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:27.757 02:12:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:27.757 02:12:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:27.757 02:12:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:27.757 02:12:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:27.757 02:12:31 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:27.757 02:12:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:27.757 02:12:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:27.757 02:12:31 -- common/autotest_common.sh@10 -- # set +x 00:07:27.757 02:12:31 -- nvmf/common.sh@469 -- # nvmfpid=23952 00:07:27.757 02:12:31 -- nvmf/common.sh@470 -- # waitforlisten 23952 00:07:27.757 02:12:31 -- common/autotest_common.sh@829 -- # '[' -z 23952 ']' 00:07:27.757 02:12:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:27.757 02:12:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:27.757 02:12:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:27.757 02:12:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:27.757 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:27.757 02:12:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:27.757 02:12:31 -- common/autotest_common.sh@10 -- # set +x 00:07:27.757 [2024-11-29 02:12:31.331990] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:27.757 [2024-11-29 02:12:31.332074] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:27.757 EAL: No free 2048 kB hugepages reported on node 1 00:07:27.757 [2024-11-29 02:12:31.401127] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:28.015 [2024-11-29 02:12:31.519959] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:28.015 [2024-11-29 02:12:31.520125] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:28.015 [2024-11-29 02:12:31.520149] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:28.015 [2024-11-29 02:12:31.520164] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:28.015 [2024-11-29 02:12:31.520257] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:28.015 [2024-11-29 02:12:31.520301] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:28.015 [2024-11-29 02:12:31.520353] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:28.015 [2024-11-29 02:12:31.520356] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:28.950 02:12:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:28.950 02:12:32 -- common/autotest_common.sh@862 -- # return 0 00:07:28.950 02:12:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:28.950 02:12:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:28.950 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:28.950 02:12:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:28.950 02:12:32 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:28.950 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:28.950 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:28.950 [2024-11-29 02:12:32.326991] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:28.950 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:28.950 02:12:32 -- target/discovery.sh@26 -- # seq 1 4 00:07:28.950 02:12:32 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:28.950 02:12:32 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:28.950 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:28.950 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:28.950 Null1 00:07:28.950 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:28.950 02:12:32 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:28.950 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:28.950 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:28.950 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:28.950 02:12:32 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:28.950 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:28.950 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:28.950 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:28.950 02:12:32 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:28.950 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:28.950 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:28.950 [2024-11-29 02:12:32.367266] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:28.950 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:28.950 02:12:32 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:28.950 02:12:32 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:28.950 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:28.950 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:28.950 Null2 00:07:28.950 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:28.950 02:12:32 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:28.950 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:28.950 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:28.950 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:28.950 02:12:32 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:28.950 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:28.950 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:28.950 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:28.950 02:12:32 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:07:28.950 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:28.950 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:28.950 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:28.950 02:12:32 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:28.950 02:12:32 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:28.950 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:28.950 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:28.950 Null3 00:07:28.950 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:28.950 02:12:32 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:28.950 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:28.950 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:28.950 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:28.950 02:12:32 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:28.950 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:28.950 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:28.950 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:28.950 02:12:32 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:07:28.950 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:28.950 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:28.950 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:28.950 02:12:32 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:28.950 02:12:32 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:28.950 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:28.950 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:28.950 Null4 00:07:28.950 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:28.950 02:12:32 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:28.950 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:28.950 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:28.950 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:28.950 02:12:32 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:28.950 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:28.950 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:28.950 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:28.950 02:12:32 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:07:28.950 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:28.950 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:28.950 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:28.950 02:12:32 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:28.950 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:28.950 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:28.950 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:28.950 02:12:32 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:07:28.950 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:28.950 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:28.950 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:28.950 02:12:32 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:07:29.209 00:07:29.209 Discovery Log Number of Records 6, Generation counter 6 00:07:29.209 =====Discovery Log Entry 0====== 00:07:29.209 trtype: tcp 00:07:29.209 adrfam: ipv4 00:07:29.209 subtype: current discovery subsystem 00:07:29.209 treq: not required 00:07:29.209 portid: 0 00:07:29.209 trsvcid: 4420 00:07:29.209 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:29.209 traddr: 10.0.0.2 00:07:29.209 eflags: explicit discovery connections, duplicate discovery information 00:07:29.209 sectype: none 00:07:29.209 =====Discovery Log Entry 1====== 00:07:29.209 trtype: tcp 00:07:29.209 adrfam: ipv4 00:07:29.209 subtype: nvme subsystem 00:07:29.209 treq: not required 00:07:29.209 portid: 0 00:07:29.209 trsvcid: 4420 00:07:29.209 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:29.209 traddr: 10.0.0.2 00:07:29.209 eflags: none 00:07:29.209 sectype: none 00:07:29.209 =====Discovery Log Entry 2====== 00:07:29.209 trtype: tcp 00:07:29.209 adrfam: ipv4 00:07:29.209 subtype: nvme subsystem 00:07:29.209 treq: not required 00:07:29.209 portid: 0 00:07:29.209 trsvcid: 4420 00:07:29.209 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:29.209 traddr: 10.0.0.2 00:07:29.209 eflags: none 00:07:29.209 sectype: none 00:07:29.209 =====Discovery Log Entry 3====== 00:07:29.209 trtype: tcp 00:07:29.209 adrfam: ipv4 00:07:29.209 subtype: nvme subsystem 00:07:29.209 treq: not required 00:07:29.209 portid: 0 00:07:29.209 trsvcid: 4420 00:07:29.209 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:29.209 traddr: 10.0.0.2 00:07:29.209 eflags: none 00:07:29.210 sectype: none 00:07:29.210 =====Discovery Log Entry 4====== 00:07:29.210 trtype: tcp 00:07:29.210 adrfam: ipv4 00:07:29.210 subtype: nvme subsystem 00:07:29.210 treq: not required 00:07:29.210 portid: 0 00:07:29.210 trsvcid: 4420 00:07:29.210 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:29.210 traddr: 10.0.0.2 00:07:29.210 eflags: none 00:07:29.210 sectype: none 00:07:29.210 =====Discovery Log Entry 5====== 00:07:29.210 trtype: tcp 00:07:29.210 adrfam: ipv4 00:07:29.210 subtype: discovery subsystem referral 00:07:29.210 treq: not required 00:07:29.210 portid: 0 00:07:29.210 trsvcid: 4430 00:07:29.210 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:29.210 traddr: 10.0.0.2 00:07:29.210 eflags: none 00:07:29.210 sectype: none 00:07:29.210 02:12:32 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:29.210 Perform nvmf subsystem discovery via RPC 00:07:29.210 02:12:32 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:29.210 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:29.210 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:29.210 [2024-11-29 02:12:32.684154] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:29.210 [ 00:07:29.210 { 00:07:29.210 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:29.210 "subtype": "Discovery", 00:07:29.210 "listen_addresses": [ 00:07:29.210 { 00:07:29.210 "transport": "TCP", 00:07:29.210 "trtype": "TCP", 00:07:29.210 "adrfam": "IPv4", 00:07:29.210 "traddr": "10.0.0.2", 00:07:29.210 "trsvcid": "4420" 00:07:29.210 } 00:07:29.210 ], 00:07:29.210 "allow_any_host": true, 00:07:29.210 "hosts": [] 00:07:29.210 }, 00:07:29.210 { 00:07:29.210 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:29.210 "subtype": "NVMe", 00:07:29.210 "listen_addresses": [ 00:07:29.210 { 00:07:29.210 "transport": "TCP", 00:07:29.210 "trtype": "TCP", 00:07:29.210 "adrfam": "IPv4", 00:07:29.210 "traddr": "10.0.0.2", 00:07:29.210 "trsvcid": "4420" 00:07:29.210 } 00:07:29.210 ], 00:07:29.210 "allow_any_host": true, 00:07:29.210 "hosts": [], 00:07:29.210 "serial_number": "SPDK00000000000001", 00:07:29.210 "model_number": "SPDK bdev Controller", 00:07:29.210 "max_namespaces": 32, 00:07:29.210 "min_cntlid": 1, 00:07:29.210 "max_cntlid": 65519, 00:07:29.210 "namespaces": [ 00:07:29.210 { 00:07:29.210 "nsid": 1, 00:07:29.210 "bdev_name": "Null1", 00:07:29.210 "name": "Null1", 00:07:29.210 "nguid": "169AF12C2D8A4C4CA1A2E418490DE259", 00:07:29.210 "uuid": "169af12c-2d8a-4c4c-a1a2-e418490de259" 00:07:29.210 } 00:07:29.210 ] 00:07:29.210 }, 00:07:29.210 { 00:07:29.210 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:29.210 "subtype": "NVMe", 00:07:29.210 "listen_addresses": [ 00:07:29.210 { 00:07:29.210 "transport": "TCP", 00:07:29.210 "trtype": "TCP", 00:07:29.210 "adrfam": "IPv4", 00:07:29.210 "traddr": "10.0.0.2", 00:07:29.210 "trsvcid": "4420" 00:07:29.210 } 00:07:29.210 ], 00:07:29.210 "allow_any_host": true, 00:07:29.210 "hosts": [], 00:07:29.210 "serial_number": "SPDK00000000000002", 00:07:29.210 "model_number": "SPDK bdev Controller", 00:07:29.210 "max_namespaces": 32, 00:07:29.210 "min_cntlid": 1, 00:07:29.210 "max_cntlid": 65519, 00:07:29.210 "namespaces": [ 00:07:29.210 { 00:07:29.210 "nsid": 1, 00:07:29.210 "bdev_name": "Null2", 00:07:29.210 "name": "Null2", 00:07:29.210 "nguid": "8D9DF56A95AA44969A85C39BFF4B03CC", 00:07:29.210 "uuid": "8d9df56a-95aa-4496-9a85-c39bff4b03cc" 00:07:29.210 } 00:07:29.210 ] 00:07:29.210 }, 00:07:29.210 { 00:07:29.210 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:29.210 "subtype": "NVMe", 00:07:29.210 "listen_addresses": [ 00:07:29.210 { 00:07:29.210 "transport": "TCP", 00:07:29.210 "trtype": "TCP", 00:07:29.210 "adrfam": "IPv4", 00:07:29.210 "traddr": "10.0.0.2", 00:07:29.210 "trsvcid": "4420" 00:07:29.210 } 00:07:29.210 ], 00:07:29.210 "allow_any_host": true, 00:07:29.210 "hosts": [], 00:07:29.210 "serial_number": "SPDK00000000000003", 00:07:29.210 "model_number": "SPDK bdev Controller", 00:07:29.210 "max_namespaces": 32, 00:07:29.210 "min_cntlid": 1, 00:07:29.210 "max_cntlid": 65519, 00:07:29.210 "namespaces": [ 00:07:29.210 { 00:07:29.210 "nsid": 1, 00:07:29.210 "bdev_name": "Null3", 00:07:29.210 "name": "Null3", 00:07:29.210 "nguid": "7FCB9DE270AB40B99704CCF5C66EE721", 00:07:29.210 "uuid": "7fcb9de2-70ab-40b9-9704-ccf5c66ee721" 00:07:29.210 } 00:07:29.210 ] 00:07:29.210 }, 00:07:29.210 { 00:07:29.210 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:29.210 "subtype": "NVMe", 00:07:29.210 "listen_addresses": [ 00:07:29.210 { 00:07:29.210 "transport": "TCP", 00:07:29.210 "trtype": "TCP", 00:07:29.210 "adrfam": "IPv4", 00:07:29.210 "traddr": "10.0.0.2", 00:07:29.210 "trsvcid": "4420" 00:07:29.210 } 00:07:29.210 ], 00:07:29.210 "allow_any_host": true, 00:07:29.210 "hosts": [], 00:07:29.210 "serial_number": "SPDK00000000000004", 00:07:29.210 "model_number": "SPDK bdev Controller", 00:07:29.210 "max_namespaces": 32, 00:07:29.210 "min_cntlid": 1, 00:07:29.210 "max_cntlid": 65519, 00:07:29.210 "namespaces": [ 00:07:29.210 { 00:07:29.210 "nsid": 1, 00:07:29.210 "bdev_name": "Null4", 00:07:29.210 "name": "Null4", 00:07:29.210 "nguid": "AF2851AFA3E64E5D8A111E0FEF0E56B8", 00:07:29.210 "uuid": "af2851af-a3e6-4e5d-8a11-1e0fef0e56b8" 00:07:29.210 } 00:07:29.210 ] 00:07:29.210 } 00:07:29.210 ] 00:07:29.210 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:29.210 02:12:32 -- target/discovery.sh@42 -- # seq 1 4 00:07:29.210 02:12:32 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:29.210 02:12:32 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:29.210 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:29.210 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:29.210 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:29.210 02:12:32 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:29.210 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:29.210 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:29.210 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:29.210 02:12:32 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:29.210 02:12:32 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:29.210 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:29.210 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:29.210 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:29.210 02:12:32 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:29.210 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:29.210 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:29.210 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:29.210 02:12:32 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:29.210 02:12:32 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:29.210 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:29.210 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:29.210 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:29.210 02:12:32 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:29.210 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:29.210 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:29.210 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:29.210 02:12:32 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:29.210 02:12:32 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:29.210 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:29.210 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:29.210 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:29.210 02:12:32 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:29.210 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:29.210 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:29.210 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:29.210 02:12:32 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:07:29.210 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:29.210 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:29.210 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:29.210 02:12:32 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:29.210 02:12:32 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:29.210 02:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:29.210 02:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:29.210 02:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:29.210 02:12:32 -- target/discovery.sh@49 -- # check_bdevs= 00:07:29.210 02:12:32 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:29.210 02:12:32 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:29.210 02:12:32 -- target/discovery.sh@57 -- # nvmftestfini 00:07:29.210 02:12:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:29.210 02:12:32 -- nvmf/common.sh@116 -- # sync 00:07:29.210 02:12:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:29.210 02:12:32 -- nvmf/common.sh@119 -- # set +e 00:07:29.210 02:12:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:29.210 02:12:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:29.210 rmmod nvme_tcp 00:07:29.210 rmmod nvme_fabrics 00:07:29.210 rmmod nvme_keyring 00:07:29.210 02:12:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:29.210 02:12:32 -- nvmf/common.sh@123 -- # set -e 00:07:29.210 02:12:32 -- nvmf/common.sh@124 -- # return 0 00:07:29.210 02:12:32 -- nvmf/common.sh@477 -- # '[' -n 23952 ']' 00:07:29.210 02:12:32 -- nvmf/common.sh@478 -- # killprocess 23952 00:07:29.211 02:12:32 -- common/autotest_common.sh@936 -- # '[' -z 23952 ']' 00:07:29.211 02:12:32 -- common/autotest_common.sh@940 -- # kill -0 23952 00:07:29.211 02:12:32 -- common/autotest_common.sh@941 -- # uname 00:07:29.211 02:12:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:29.211 02:12:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 23952 00:07:29.471 02:12:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:29.471 02:12:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:29.471 02:12:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 23952' 00:07:29.471 killing process with pid 23952 00:07:29.471 02:12:32 -- common/autotest_common.sh@955 -- # kill 23952 00:07:29.471 [2024-11-29 02:12:32.904220] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:29.471 02:12:32 -- common/autotest_common.sh@960 -- # wait 23952 00:07:29.730 02:12:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:29.730 02:12:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:29.730 02:12:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:29.730 02:12:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:29.730 02:12:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:29.730 02:12:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:29.731 02:12:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:29.731 02:12:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:31.641 02:12:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:31.641 00:07:31.641 real 0m6.424s 00:07:31.641 user 0m7.651s 00:07:31.641 sys 0m1.966s 00:07:31.641 02:12:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:31.641 02:12:35 -- common/autotest_common.sh@10 -- # set +x 00:07:31.641 ************************************ 00:07:31.641 END TEST nvmf_discovery 00:07:31.641 ************************************ 00:07:31.641 02:12:35 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:31.641 02:12:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:31.641 02:12:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:31.641 02:12:35 -- common/autotest_common.sh@10 -- # set +x 00:07:31.641 ************************************ 00:07:31.641 START TEST nvmf_referrals 00:07:31.641 ************************************ 00:07:31.641 02:12:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:31.641 * Looking for test storage... 00:07:31.641 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:31.641 02:12:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:31.641 02:12:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:31.641 02:12:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:31.900 02:12:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:31.900 02:12:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:31.900 02:12:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:31.900 02:12:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:31.900 02:12:35 -- scripts/common.sh@335 -- # IFS=.-: 00:07:31.900 02:12:35 -- scripts/common.sh@335 -- # read -ra ver1 00:07:31.900 02:12:35 -- scripts/common.sh@336 -- # IFS=.-: 00:07:31.900 02:12:35 -- scripts/common.sh@336 -- # read -ra ver2 00:07:31.900 02:12:35 -- scripts/common.sh@337 -- # local 'op=<' 00:07:31.900 02:12:35 -- scripts/common.sh@339 -- # ver1_l=2 00:07:31.900 02:12:35 -- scripts/common.sh@340 -- # ver2_l=1 00:07:31.900 02:12:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:31.901 02:12:35 -- scripts/common.sh@343 -- # case "$op" in 00:07:31.901 02:12:35 -- scripts/common.sh@344 -- # : 1 00:07:31.901 02:12:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:31.901 02:12:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:31.901 02:12:35 -- scripts/common.sh@364 -- # decimal 1 00:07:31.901 02:12:35 -- scripts/common.sh@352 -- # local d=1 00:07:31.901 02:12:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:31.901 02:12:35 -- scripts/common.sh@354 -- # echo 1 00:07:31.901 02:12:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:31.901 02:12:35 -- scripts/common.sh@365 -- # decimal 2 00:07:31.901 02:12:35 -- scripts/common.sh@352 -- # local d=2 00:07:31.901 02:12:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:31.901 02:12:35 -- scripts/common.sh@354 -- # echo 2 00:07:31.901 02:12:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:31.901 02:12:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:31.901 02:12:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:31.901 02:12:35 -- scripts/common.sh@367 -- # return 0 00:07:31.901 02:12:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:31.901 02:12:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:31.901 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:31.901 --rc genhtml_branch_coverage=1 00:07:31.901 --rc genhtml_function_coverage=1 00:07:31.901 --rc genhtml_legend=1 00:07:31.901 --rc geninfo_all_blocks=1 00:07:31.901 --rc geninfo_unexecuted_blocks=1 00:07:31.901 00:07:31.901 ' 00:07:31.901 02:12:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:31.901 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:31.901 --rc genhtml_branch_coverage=1 00:07:31.901 --rc genhtml_function_coverage=1 00:07:31.901 --rc genhtml_legend=1 00:07:31.901 --rc geninfo_all_blocks=1 00:07:31.901 --rc geninfo_unexecuted_blocks=1 00:07:31.901 00:07:31.901 ' 00:07:31.901 02:12:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:31.901 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:31.901 --rc genhtml_branch_coverage=1 00:07:31.901 --rc genhtml_function_coverage=1 00:07:31.901 --rc genhtml_legend=1 00:07:31.901 --rc geninfo_all_blocks=1 00:07:31.901 --rc geninfo_unexecuted_blocks=1 00:07:31.901 00:07:31.901 ' 00:07:31.901 02:12:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:31.901 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:31.901 --rc genhtml_branch_coverage=1 00:07:31.901 --rc genhtml_function_coverage=1 00:07:31.901 --rc genhtml_legend=1 00:07:31.901 --rc geninfo_all_blocks=1 00:07:31.901 --rc geninfo_unexecuted_blocks=1 00:07:31.901 00:07:31.901 ' 00:07:31.901 02:12:35 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:31.901 02:12:35 -- nvmf/common.sh@7 -- # uname -s 00:07:31.901 02:12:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:31.901 02:12:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:31.901 02:12:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:31.901 02:12:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:31.901 02:12:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:31.901 02:12:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:31.901 02:12:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:31.901 02:12:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:31.901 02:12:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:31.901 02:12:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:31.901 02:12:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:31.901 02:12:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:31.901 02:12:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:31.901 02:12:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:31.901 02:12:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:31.901 02:12:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:31.901 02:12:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:31.901 02:12:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:31.901 02:12:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:31.901 02:12:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:31.901 02:12:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:31.901 02:12:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:31.901 02:12:35 -- paths/export.sh@5 -- # export PATH 00:07:31.901 02:12:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:31.901 02:12:35 -- nvmf/common.sh@46 -- # : 0 00:07:31.901 02:12:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:31.901 02:12:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:31.901 02:12:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:31.901 02:12:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:31.901 02:12:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:31.901 02:12:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:31.901 02:12:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:31.901 02:12:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:31.901 02:12:35 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:31.901 02:12:35 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:31.901 02:12:35 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:31.901 02:12:35 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:31.901 02:12:35 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:31.901 02:12:35 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:31.901 02:12:35 -- target/referrals.sh@37 -- # nvmftestinit 00:07:31.901 02:12:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:31.901 02:12:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:31.901 02:12:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:31.901 02:12:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:31.901 02:12:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:31.901 02:12:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:31.901 02:12:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:31.901 02:12:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:31.901 02:12:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:31.901 02:12:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:31.901 02:12:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:31.901 02:12:35 -- common/autotest_common.sh@10 -- # set +x 00:07:34.440 02:12:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:34.440 02:12:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:34.440 02:12:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:34.440 02:12:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:34.440 02:12:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:34.440 02:12:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:34.440 02:12:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:34.440 02:12:37 -- nvmf/common.sh@294 -- # net_devs=() 00:07:34.440 02:12:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:34.440 02:12:37 -- nvmf/common.sh@295 -- # e810=() 00:07:34.440 02:12:37 -- nvmf/common.sh@295 -- # local -ga e810 00:07:34.440 02:12:37 -- nvmf/common.sh@296 -- # x722=() 00:07:34.440 02:12:37 -- nvmf/common.sh@296 -- # local -ga x722 00:07:34.440 02:12:37 -- nvmf/common.sh@297 -- # mlx=() 00:07:34.440 02:12:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:34.440 02:12:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:34.440 02:12:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:34.440 02:12:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:34.440 02:12:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:34.440 02:12:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:34.440 02:12:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:34.440 02:12:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:34.440 02:12:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:34.440 02:12:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:34.440 02:12:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:34.440 02:12:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:34.440 02:12:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:34.440 02:12:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:34.440 02:12:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:34.440 02:12:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:34.440 02:12:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:34.440 02:12:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:34.440 02:12:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:34.440 02:12:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:34.440 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:34.440 02:12:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:34.440 02:12:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:34.440 02:12:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:34.440 02:12:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:34.440 02:12:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:34.440 02:12:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:34.440 02:12:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:34.440 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:34.440 02:12:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:34.440 02:12:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:34.440 02:12:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:34.440 02:12:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:34.440 02:12:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:34.440 02:12:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:34.440 02:12:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:34.440 02:12:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:34.440 02:12:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:34.440 02:12:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:34.440 02:12:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:34.440 02:12:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:34.440 02:12:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:34.440 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:34.440 02:12:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:34.440 02:12:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:34.441 02:12:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:34.441 02:12:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:34.441 02:12:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:34.441 02:12:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:34.441 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:34.441 02:12:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:34.441 02:12:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:34.441 02:12:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:34.441 02:12:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:34.441 02:12:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:34.441 02:12:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:34.441 02:12:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:34.441 02:12:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:34.441 02:12:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:34.441 02:12:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:34.441 02:12:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:34.441 02:12:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:34.441 02:12:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:34.441 02:12:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:34.441 02:12:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:34.441 02:12:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:34.441 02:12:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:34.441 02:12:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:34.441 02:12:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:34.441 02:12:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:34.441 02:12:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:34.441 02:12:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:34.441 02:12:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:34.441 02:12:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:34.441 02:12:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:34.441 02:12:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:34.441 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:34.441 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.238 ms 00:07:34.441 00:07:34.441 --- 10.0.0.2 ping statistics --- 00:07:34.441 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:34.441 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:07:34.441 02:12:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:34.441 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:34.441 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.126 ms 00:07:34.441 00:07:34.441 --- 10.0.0.1 ping statistics --- 00:07:34.441 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:34.441 rtt min/avg/max/mdev = 0.126/0.126/0.126/0.000 ms 00:07:34.441 02:12:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:34.441 02:12:37 -- nvmf/common.sh@410 -- # return 0 00:07:34.441 02:12:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:34.441 02:12:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:34.441 02:12:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:34.441 02:12:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:34.441 02:12:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:34.441 02:12:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:34.441 02:12:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:34.441 02:12:37 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:34.441 02:12:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:34.441 02:12:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:34.441 02:12:37 -- common/autotest_common.sh@10 -- # set +x 00:07:34.441 02:12:37 -- nvmf/common.sh@469 -- # nvmfpid=26197 00:07:34.441 02:12:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:34.441 02:12:37 -- nvmf/common.sh@470 -- # waitforlisten 26197 00:07:34.441 02:12:37 -- common/autotest_common.sh@829 -- # '[' -z 26197 ']' 00:07:34.441 02:12:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:34.441 02:12:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:34.441 02:12:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:34.441 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:34.441 02:12:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:34.441 02:12:37 -- common/autotest_common.sh@10 -- # set +x 00:07:34.441 [2024-11-29 02:12:37.733726] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:34.441 [2024-11-29 02:12:37.733814] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:34.441 EAL: No free 2048 kB hugepages reported on node 1 00:07:34.441 [2024-11-29 02:12:37.803080] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:34.441 [2024-11-29 02:12:37.921652] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:34.441 [2024-11-29 02:12:37.921823] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:34.441 [2024-11-29 02:12:37.921844] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:34.441 [2024-11-29 02:12:37.921859] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:34.441 [2024-11-29 02:12:37.921940] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:34.441 [2024-11-29 02:12:37.921976] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:34.441 [2024-11-29 02:12:37.922027] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:34.441 [2024-11-29 02:12:37.922031] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:35.379 02:12:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:35.379 02:12:38 -- common/autotest_common.sh@862 -- # return 0 00:07:35.379 02:12:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:35.379 02:12:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:35.379 02:12:38 -- common/autotest_common.sh@10 -- # set +x 00:07:35.379 02:12:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:35.379 02:12:38 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:35.379 02:12:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:35.379 02:12:38 -- common/autotest_common.sh@10 -- # set +x 00:07:35.379 [2024-11-29 02:12:38.758127] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:35.379 02:12:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:35.379 02:12:38 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:07:35.379 02:12:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:35.379 02:12:38 -- common/autotest_common.sh@10 -- # set +x 00:07:35.379 [2024-11-29 02:12:38.770336] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:07:35.379 02:12:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:35.379 02:12:38 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:07:35.379 02:12:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:35.379 02:12:38 -- common/autotest_common.sh@10 -- # set +x 00:07:35.379 02:12:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:35.379 02:12:38 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:07:35.379 02:12:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:35.379 02:12:38 -- common/autotest_common.sh@10 -- # set +x 00:07:35.379 02:12:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:35.379 02:12:38 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:07:35.379 02:12:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:35.379 02:12:38 -- common/autotest_common.sh@10 -- # set +x 00:07:35.379 02:12:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:35.379 02:12:38 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:35.379 02:12:38 -- target/referrals.sh@48 -- # jq length 00:07:35.379 02:12:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:35.379 02:12:38 -- common/autotest_common.sh@10 -- # set +x 00:07:35.379 02:12:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:35.379 02:12:38 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:35.379 02:12:38 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:35.379 02:12:38 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:35.379 02:12:38 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:35.379 02:12:38 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:35.379 02:12:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:35.379 02:12:38 -- target/referrals.sh@21 -- # sort 00:07:35.379 02:12:38 -- common/autotest_common.sh@10 -- # set +x 00:07:35.379 02:12:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:35.379 02:12:38 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:35.379 02:12:38 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:35.379 02:12:38 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:35.379 02:12:38 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:35.379 02:12:38 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:35.379 02:12:38 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:35.379 02:12:38 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:35.379 02:12:38 -- target/referrals.sh@26 -- # sort 00:07:35.640 02:12:39 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:35.640 02:12:39 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:35.640 02:12:39 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:07:35.640 02:12:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:35.640 02:12:39 -- common/autotest_common.sh@10 -- # set +x 00:07:35.640 02:12:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:35.640 02:12:39 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:07:35.640 02:12:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:35.640 02:12:39 -- common/autotest_common.sh@10 -- # set +x 00:07:35.640 02:12:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:35.640 02:12:39 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:07:35.640 02:12:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:35.640 02:12:39 -- common/autotest_common.sh@10 -- # set +x 00:07:35.640 02:12:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:35.640 02:12:39 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:35.640 02:12:39 -- target/referrals.sh@56 -- # jq length 00:07:35.640 02:12:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:35.640 02:12:39 -- common/autotest_common.sh@10 -- # set +x 00:07:35.640 02:12:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:35.640 02:12:39 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:35.640 02:12:39 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:35.640 02:12:39 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:35.640 02:12:39 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:35.640 02:12:39 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:35.640 02:12:39 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:35.640 02:12:39 -- target/referrals.sh@26 -- # sort 00:07:35.898 02:12:39 -- target/referrals.sh@26 -- # echo 00:07:35.898 02:12:39 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:35.898 02:12:39 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:07:35.898 02:12:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:35.898 02:12:39 -- common/autotest_common.sh@10 -- # set +x 00:07:35.898 02:12:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:35.898 02:12:39 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:35.898 02:12:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:35.898 02:12:39 -- common/autotest_common.sh@10 -- # set +x 00:07:35.898 02:12:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:35.898 02:12:39 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:35.898 02:12:39 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:35.898 02:12:39 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:35.898 02:12:39 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:35.898 02:12:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:35.898 02:12:39 -- common/autotest_common.sh@10 -- # set +x 00:07:35.898 02:12:39 -- target/referrals.sh@21 -- # sort 00:07:35.898 02:12:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:35.898 02:12:39 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:35.898 02:12:39 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:35.898 02:12:39 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:35.898 02:12:39 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:35.898 02:12:39 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:35.899 02:12:39 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:35.899 02:12:39 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:35.899 02:12:39 -- target/referrals.sh@26 -- # sort 00:07:36.156 02:12:39 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:36.156 02:12:39 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:36.156 02:12:39 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:36.156 02:12:39 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:36.156 02:12:39 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:36.156 02:12:39 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:36.156 02:12:39 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:36.156 02:12:39 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:36.156 02:12:39 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:36.156 02:12:39 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:36.156 02:12:39 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:36.156 02:12:39 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:36.156 02:12:39 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:36.416 02:12:39 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:36.416 02:12:39 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:36.416 02:12:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:36.416 02:12:39 -- common/autotest_common.sh@10 -- # set +x 00:07:36.416 02:12:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:36.416 02:12:40 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:36.416 02:12:40 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:36.416 02:12:40 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:36.416 02:12:40 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:36.416 02:12:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:36.416 02:12:40 -- common/autotest_common.sh@10 -- # set +x 00:07:36.416 02:12:40 -- target/referrals.sh@21 -- # sort 00:07:36.416 02:12:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:36.416 02:12:40 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:36.416 02:12:40 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:36.416 02:12:40 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:36.416 02:12:40 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:36.416 02:12:40 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:36.416 02:12:40 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:36.416 02:12:40 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:36.416 02:12:40 -- target/referrals.sh@26 -- # sort 00:07:36.675 02:12:40 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:36.675 02:12:40 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:36.675 02:12:40 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:36.675 02:12:40 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:36.675 02:12:40 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:36.675 02:12:40 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:36.675 02:12:40 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:36.933 02:12:40 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:36.933 02:12:40 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:36.933 02:12:40 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:36.933 02:12:40 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:36.933 02:12:40 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:36.933 02:12:40 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:36.933 02:12:40 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:36.933 02:12:40 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:36.933 02:12:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:36.933 02:12:40 -- common/autotest_common.sh@10 -- # set +x 00:07:36.933 02:12:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:36.933 02:12:40 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:36.933 02:12:40 -- target/referrals.sh@82 -- # jq length 00:07:36.933 02:12:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:36.933 02:12:40 -- common/autotest_common.sh@10 -- # set +x 00:07:36.933 02:12:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.192 02:12:40 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:37.192 02:12:40 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:37.192 02:12:40 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:37.192 02:12:40 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:37.192 02:12:40 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:37.192 02:12:40 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:37.192 02:12:40 -- target/referrals.sh@26 -- # sort 00:07:37.192 02:12:40 -- target/referrals.sh@26 -- # echo 00:07:37.192 02:12:40 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:37.192 02:12:40 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:37.192 02:12:40 -- target/referrals.sh@86 -- # nvmftestfini 00:07:37.192 02:12:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:37.192 02:12:40 -- nvmf/common.sh@116 -- # sync 00:07:37.192 02:12:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:37.192 02:12:40 -- nvmf/common.sh@119 -- # set +e 00:07:37.192 02:12:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:37.192 02:12:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:37.192 rmmod nvme_tcp 00:07:37.192 rmmod nvme_fabrics 00:07:37.192 rmmod nvme_keyring 00:07:37.452 02:12:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:37.452 02:12:40 -- nvmf/common.sh@123 -- # set -e 00:07:37.452 02:12:40 -- nvmf/common.sh@124 -- # return 0 00:07:37.452 02:12:40 -- nvmf/common.sh@477 -- # '[' -n 26197 ']' 00:07:37.452 02:12:40 -- nvmf/common.sh@478 -- # killprocess 26197 00:07:37.452 02:12:40 -- common/autotest_common.sh@936 -- # '[' -z 26197 ']' 00:07:37.452 02:12:40 -- common/autotest_common.sh@940 -- # kill -0 26197 00:07:37.452 02:12:40 -- common/autotest_common.sh@941 -- # uname 00:07:37.452 02:12:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:37.452 02:12:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 26197 00:07:37.452 02:12:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:37.452 02:12:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:37.452 02:12:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 26197' 00:07:37.452 killing process with pid 26197 00:07:37.452 02:12:40 -- common/autotest_common.sh@955 -- # kill 26197 00:07:37.452 02:12:40 -- common/autotest_common.sh@960 -- # wait 26197 00:07:37.712 02:12:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:37.712 02:12:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:37.712 02:12:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:37.712 02:12:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:37.712 02:12:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:37.712 02:12:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:37.712 02:12:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:37.712 02:12:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:39.621 02:12:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:39.621 00:07:39.621 real 0m7.978s 00:07:39.621 user 0m14.641s 00:07:39.621 sys 0m2.330s 00:07:39.621 02:12:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:39.621 02:12:43 -- common/autotest_common.sh@10 -- # set +x 00:07:39.621 ************************************ 00:07:39.621 END TEST nvmf_referrals 00:07:39.621 ************************************ 00:07:39.621 02:12:43 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:39.621 02:12:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:39.621 02:12:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:39.621 02:12:43 -- common/autotest_common.sh@10 -- # set +x 00:07:39.621 ************************************ 00:07:39.621 START TEST nvmf_connect_disconnect 00:07:39.621 ************************************ 00:07:39.621 02:12:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:39.880 * Looking for test storage... 00:07:39.880 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:39.880 02:12:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:39.880 02:12:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:39.880 02:12:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:39.880 02:12:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:39.880 02:12:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:39.880 02:12:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:39.880 02:12:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:39.880 02:12:43 -- scripts/common.sh@335 -- # IFS=.-: 00:07:39.880 02:12:43 -- scripts/common.sh@335 -- # read -ra ver1 00:07:39.880 02:12:43 -- scripts/common.sh@336 -- # IFS=.-: 00:07:39.880 02:12:43 -- scripts/common.sh@336 -- # read -ra ver2 00:07:39.880 02:12:43 -- scripts/common.sh@337 -- # local 'op=<' 00:07:39.880 02:12:43 -- scripts/common.sh@339 -- # ver1_l=2 00:07:39.880 02:12:43 -- scripts/common.sh@340 -- # ver2_l=1 00:07:39.880 02:12:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:39.880 02:12:43 -- scripts/common.sh@343 -- # case "$op" in 00:07:39.880 02:12:43 -- scripts/common.sh@344 -- # : 1 00:07:39.880 02:12:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:39.880 02:12:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:39.880 02:12:43 -- scripts/common.sh@364 -- # decimal 1 00:07:39.880 02:12:43 -- scripts/common.sh@352 -- # local d=1 00:07:39.880 02:12:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:39.880 02:12:43 -- scripts/common.sh@354 -- # echo 1 00:07:39.880 02:12:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:39.880 02:12:43 -- scripts/common.sh@365 -- # decimal 2 00:07:39.880 02:12:43 -- scripts/common.sh@352 -- # local d=2 00:07:39.880 02:12:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:39.880 02:12:43 -- scripts/common.sh@354 -- # echo 2 00:07:39.880 02:12:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:39.880 02:12:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:39.880 02:12:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:39.880 02:12:43 -- scripts/common.sh@367 -- # return 0 00:07:39.880 02:12:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:39.880 02:12:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:39.880 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:39.880 --rc genhtml_branch_coverage=1 00:07:39.880 --rc genhtml_function_coverage=1 00:07:39.880 --rc genhtml_legend=1 00:07:39.880 --rc geninfo_all_blocks=1 00:07:39.880 --rc geninfo_unexecuted_blocks=1 00:07:39.880 00:07:39.880 ' 00:07:39.880 02:12:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:39.880 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:39.880 --rc genhtml_branch_coverage=1 00:07:39.880 --rc genhtml_function_coverage=1 00:07:39.880 --rc genhtml_legend=1 00:07:39.880 --rc geninfo_all_blocks=1 00:07:39.880 --rc geninfo_unexecuted_blocks=1 00:07:39.880 00:07:39.880 ' 00:07:39.880 02:12:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:39.880 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:39.880 --rc genhtml_branch_coverage=1 00:07:39.880 --rc genhtml_function_coverage=1 00:07:39.880 --rc genhtml_legend=1 00:07:39.880 --rc geninfo_all_blocks=1 00:07:39.880 --rc geninfo_unexecuted_blocks=1 00:07:39.880 00:07:39.880 ' 00:07:39.880 02:12:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:39.880 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:39.880 --rc genhtml_branch_coverage=1 00:07:39.880 --rc genhtml_function_coverage=1 00:07:39.880 --rc genhtml_legend=1 00:07:39.880 --rc geninfo_all_blocks=1 00:07:39.880 --rc geninfo_unexecuted_blocks=1 00:07:39.880 00:07:39.880 ' 00:07:39.880 02:12:43 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:39.880 02:12:43 -- nvmf/common.sh@7 -- # uname -s 00:07:39.880 02:12:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:39.880 02:12:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:39.880 02:12:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:39.880 02:12:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:39.880 02:12:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:39.880 02:12:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:39.880 02:12:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:39.880 02:12:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:39.880 02:12:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:39.880 02:12:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:39.880 02:12:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:39.881 02:12:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:39.881 02:12:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:39.881 02:12:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:39.881 02:12:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:39.881 02:12:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:39.881 02:12:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:39.881 02:12:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:39.881 02:12:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:39.881 02:12:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:39.881 02:12:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:39.881 02:12:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:39.881 02:12:43 -- paths/export.sh@5 -- # export PATH 00:07:39.881 02:12:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:39.881 02:12:43 -- nvmf/common.sh@46 -- # : 0 00:07:39.881 02:12:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:39.881 02:12:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:39.881 02:12:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:39.881 02:12:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:39.881 02:12:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:39.881 02:12:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:39.881 02:12:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:39.881 02:12:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:39.881 02:12:43 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:39.881 02:12:43 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:39.881 02:12:43 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:39.881 02:12:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:39.881 02:12:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:39.881 02:12:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:39.881 02:12:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:39.881 02:12:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:39.881 02:12:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:39.881 02:12:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:39.881 02:12:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:39.881 02:12:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:39.881 02:12:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:39.881 02:12:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:39.881 02:12:43 -- common/autotest_common.sh@10 -- # set +x 00:07:41.787 02:12:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:41.787 02:12:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:41.787 02:12:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:41.787 02:12:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:41.787 02:12:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:41.787 02:12:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:41.787 02:12:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:41.787 02:12:45 -- nvmf/common.sh@294 -- # net_devs=() 00:07:41.787 02:12:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:41.787 02:12:45 -- nvmf/common.sh@295 -- # e810=() 00:07:41.787 02:12:45 -- nvmf/common.sh@295 -- # local -ga e810 00:07:41.787 02:12:45 -- nvmf/common.sh@296 -- # x722=() 00:07:41.787 02:12:45 -- nvmf/common.sh@296 -- # local -ga x722 00:07:41.787 02:12:45 -- nvmf/common.sh@297 -- # mlx=() 00:07:41.787 02:12:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:41.787 02:12:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:41.787 02:12:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:41.787 02:12:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:41.787 02:12:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:41.787 02:12:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:41.787 02:12:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:41.787 02:12:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:41.787 02:12:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:41.787 02:12:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:41.787 02:12:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:41.787 02:12:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:41.787 02:12:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:41.787 02:12:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:41.787 02:12:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:41.787 02:12:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:41.787 02:12:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:41.787 02:12:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:41.787 02:12:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:41.787 02:12:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:41.787 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:41.787 02:12:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:41.788 02:12:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:41.788 02:12:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:41.788 02:12:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:41.788 02:12:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:41.788 02:12:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:41.788 02:12:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:41.788 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:41.788 02:12:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:41.788 02:12:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:41.788 02:12:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:41.788 02:12:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:41.788 02:12:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:41.788 02:12:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:41.788 02:12:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:41.788 02:12:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:41.788 02:12:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:41.788 02:12:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:41.788 02:12:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:41.788 02:12:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:41.788 02:12:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:41.788 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:41.788 02:12:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:41.788 02:12:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:41.788 02:12:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:41.788 02:12:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:41.788 02:12:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:41.788 02:12:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:41.788 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:41.788 02:12:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:41.788 02:12:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:41.788 02:12:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:41.788 02:12:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:41.788 02:12:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:41.788 02:12:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:41.788 02:12:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:41.788 02:12:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:41.788 02:12:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:41.788 02:12:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:41.788 02:12:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:41.788 02:12:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:41.788 02:12:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:41.788 02:12:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:41.788 02:12:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:41.788 02:12:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:41.788 02:12:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:41.788 02:12:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:41.788 02:12:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:42.048 02:12:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:42.048 02:12:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:42.049 02:12:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:42.049 02:12:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:42.049 02:12:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:42.049 02:12:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:42.049 02:12:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:42.049 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:42.049 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.211 ms 00:07:42.049 00:07:42.049 --- 10.0.0.2 ping statistics --- 00:07:42.049 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:42.049 rtt min/avg/max/mdev = 0.211/0.211/0.211/0.000 ms 00:07:42.049 02:12:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:42.049 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:42.049 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.091 ms 00:07:42.049 00:07:42.049 --- 10.0.0.1 ping statistics --- 00:07:42.049 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:42.049 rtt min/avg/max/mdev = 0.091/0.091/0.091/0.000 ms 00:07:42.049 02:12:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:42.049 02:12:45 -- nvmf/common.sh@410 -- # return 0 00:07:42.049 02:12:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:42.049 02:12:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:42.049 02:12:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:42.049 02:12:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:42.049 02:12:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:42.049 02:12:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:42.049 02:12:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:42.049 02:12:45 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:42.049 02:12:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:42.049 02:12:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:42.049 02:12:45 -- common/autotest_common.sh@10 -- # set +x 00:07:42.049 02:12:45 -- nvmf/common.sh@469 -- # nvmfpid=28655 00:07:42.049 02:12:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:42.049 02:12:45 -- nvmf/common.sh@470 -- # waitforlisten 28655 00:07:42.049 02:12:45 -- common/autotest_common.sh@829 -- # '[' -z 28655 ']' 00:07:42.049 02:12:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:42.049 02:12:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:42.049 02:12:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:42.049 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:42.049 02:12:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:42.049 02:12:45 -- common/autotest_common.sh@10 -- # set +x 00:07:42.049 [2024-11-29 02:12:45.631722] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:42.049 [2024-11-29 02:12:45.631791] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:42.049 EAL: No free 2048 kB hugepages reported on node 1 00:07:42.049 [2024-11-29 02:12:45.708651] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:42.309 [2024-11-29 02:12:45.835908] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:42.309 [2024-11-29 02:12:45.836082] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:42.309 [2024-11-29 02:12:45.836102] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:42.309 [2024-11-29 02:12:45.836117] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:42.309 [2024-11-29 02:12:45.836182] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:42.309 [2024-11-29 02:12:45.838417] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:42.309 [2024-11-29 02:12:45.838446] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:42.309 [2024-11-29 02:12:45.838449] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:43.246 02:12:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:43.246 02:12:46 -- common/autotest_common.sh@862 -- # return 0 00:07:43.246 02:12:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:43.246 02:12:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:43.246 02:12:46 -- common/autotest_common.sh@10 -- # set +x 00:07:43.246 02:12:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:43.246 02:12:46 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:43.246 02:12:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.246 02:12:46 -- common/autotest_common.sh@10 -- # set +x 00:07:43.246 [2024-11-29 02:12:46.734229] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:43.246 02:12:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.246 02:12:46 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:07:43.246 02:12:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.246 02:12:46 -- common/autotest_common.sh@10 -- # set +x 00:07:43.246 02:12:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.246 02:12:46 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:07:43.246 02:12:46 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:43.246 02:12:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.246 02:12:46 -- common/autotest_common.sh@10 -- # set +x 00:07:43.246 02:12:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.246 02:12:46 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:43.246 02:12:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.246 02:12:46 -- common/autotest_common.sh@10 -- # set +x 00:07:43.246 02:12:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.246 02:12:46 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:43.246 02:12:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.246 02:12:46 -- common/autotest_common.sh@10 -- # set +x 00:07:43.246 [2024-11-29 02:12:46.786164] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:43.246 02:12:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.246 02:12:46 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:07:43.246 02:12:46 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:07:43.246 02:12:46 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:07:43.246 02:12:46 -- target/connect_disconnect.sh@34 -- # set +x 00:07:45.793 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:48.340 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:50.251 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:52.788 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:54.720 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:57.277 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:59.808 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:01.717 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:04.256 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:06.791 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:08.703 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:11.245 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:13.781 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:15.689 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:18.225 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:20.129 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:22.666 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:25.207 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:27.113 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:29.672 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:32.213 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:34.121 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:36.658 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:38.564 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:41.139 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:43.677 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:45.583 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:48.118 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:50.653 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:52.560 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:55.103 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:57.007 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:59.545 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:02.081 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:03.989 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:06.532 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:08.438 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:10.976 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:13.518 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:15.426 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:17.965 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:20.505 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:22.406 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:24.999 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:27.529 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:29.440 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:31.981 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:33.891 [2024-11-29 02:14:37.356269] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9fe0 is same with the state(5) to be set 00:09:33.891 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:36.429 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:38.964 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:40.873 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:43.412 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:45.320 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:47.859 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:50.397 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:52.302 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:54.845 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:57.378 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:59.282 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:01.811 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:04.335 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:06.234 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:08.798 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:11.324 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:13.846 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:15.743 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:18.271 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:20.795 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:22.692 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:25.218 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:27.757 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:29.657 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:32.198 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:34.737 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:36.643 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:39.193 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:41.734 [2024-11-29 02:15:44.995182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9fe0 is same with the state(5) to be set 00:10:41.734 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:43.640 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:46.182 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:48.722 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:50.631 [2024-11-29 02:15:54.063154] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9fe0 is same with the state(5) to be set 00:10:50.631 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:53.219 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.129 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:57.665 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.572 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:02.113 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:04.654 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.564 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:09.101 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:11.638 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.548 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:16.091 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:18.634 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:20.540 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:23.077 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:24.987 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:27.525 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:29.427 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:31.959 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:34.492 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:34.492 02:16:37 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:11:34.492 02:16:37 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:11:34.492 02:16:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:34.492 02:16:37 -- nvmf/common.sh@116 -- # sync 00:11:34.492 02:16:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:34.492 02:16:37 -- nvmf/common.sh@119 -- # set +e 00:11:34.492 02:16:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:34.492 02:16:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:34.492 rmmod nvme_tcp 00:11:34.492 rmmod nvme_fabrics 00:11:34.492 rmmod nvme_keyring 00:11:34.492 02:16:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:34.492 02:16:37 -- nvmf/common.sh@123 -- # set -e 00:11:34.492 02:16:37 -- nvmf/common.sh@124 -- # return 0 00:11:34.492 02:16:37 -- nvmf/common.sh@477 -- # '[' -n 28655 ']' 00:11:34.492 02:16:37 -- nvmf/common.sh@478 -- # killprocess 28655 00:11:34.492 02:16:37 -- common/autotest_common.sh@936 -- # '[' -z 28655 ']' 00:11:34.492 02:16:37 -- common/autotest_common.sh@940 -- # kill -0 28655 00:11:34.492 02:16:37 -- common/autotest_common.sh@941 -- # uname 00:11:34.492 02:16:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:34.492 02:16:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 28655 00:11:34.493 02:16:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:34.493 02:16:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:34.493 02:16:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 28655' 00:11:34.493 killing process with pid 28655 00:11:34.493 02:16:37 -- common/autotest_common.sh@955 -- # kill 28655 00:11:34.493 02:16:37 -- common/autotest_common.sh@960 -- # wait 28655 00:11:34.493 02:16:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:34.493 02:16:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:34.493 02:16:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:34.493 02:16:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:34.493 02:16:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:34.493 02:16:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:34.493 02:16:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:34.493 02:16:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:36.424 02:16:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:36.424 00:11:36.424 real 3m56.825s 00:11:36.424 user 15m2.832s 00:11:36.424 sys 0m35.120s 00:11:36.424 02:16:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:36.424 02:16:40 -- common/autotest_common.sh@10 -- # set +x 00:11:36.424 ************************************ 00:11:36.424 END TEST nvmf_connect_disconnect 00:11:36.424 ************************************ 00:11:36.761 02:16:40 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:36.761 02:16:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:36.761 02:16:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:36.761 02:16:40 -- common/autotest_common.sh@10 -- # set +x 00:11:36.761 ************************************ 00:11:36.761 START TEST nvmf_multitarget 00:11:36.761 ************************************ 00:11:36.761 02:16:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:36.761 * Looking for test storage... 00:11:36.761 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:36.761 02:16:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:36.761 02:16:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:36.761 02:16:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:36.761 02:16:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:36.761 02:16:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:36.761 02:16:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:36.761 02:16:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:36.761 02:16:40 -- scripts/common.sh@335 -- # IFS=.-: 00:11:36.761 02:16:40 -- scripts/common.sh@335 -- # read -ra ver1 00:11:36.761 02:16:40 -- scripts/common.sh@336 -- # IFS=.-: 00:11:36.761 02:16:40 -- scripts/common.sh@336 -- # read -ra ver2 00:11:36.761 02:16:40 -- scripts/common.sh@337 -- # local 'op=<' 00:11:36.761 02:16:40 -- scripts/common.sh@339 -- # ver1_l=2 00:11:36.761 02:16:40 -- scripts/common.sh@340 -- # ver2_l=1 00:11:36.761 02:16:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:36.761 02:16:40 -- scripts/common.sh@343 -- # case "$op" in 00:11:36.761 02:16:40 -- scripts/common.sh@344 -- # : 1 00:11:36.761 02:16:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:36.761 02:16:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:36.761 02:16:40 -- scripts/common.sh@364 -- # decimal 1 00:11:36.761 02:16:40 -- scripts/common.sh@352 -- # local d=1 00:11:36.761 02:16:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:36.761 02:16:40 -- scripts/common.sh@354 -- # echo 1 00:11:36.761 02:16:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:36.761 02:16:40 -- scripts/common.sh@365 -- # decimal 2 00:11:36.761 02:16:40 -- scripts/common.sh@352 -- # local d=2 00:11:36.761 02:16:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:36.761 02:16:40 -- scripts/common.sh@354 -- # echo 2 00:11:36.761 02:16:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:36.761 02:16:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:36.761 02:16:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:36.761 02:16:40 -- scripts/common.sh@367 -- # return 0 00:11:36.761 02:16:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:36.761 02:16:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:36.761 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:36.761 --rc genhtml_branch_coverage=1 00:11:36.761 --rc genhtml_function_coverage=1 00:11:36.761 --rc genhtml_legend=1 00:11:36.761 --rc geninfo_all_blocks=1 00:11:36.761 --rc geninfo_unexecuted_blocks=1 00:11:36.761 00:11:36.761 ' 00:11:36.761 02:16:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:36.761 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:36.761 --rc genhtml_branch_coverage=1 00:11:36.761 --rc genhtml_function_coverage=1 00:11:36.761 --rc genhtml_legend=1 00:11:36.761 --rc geninfo_all_blocks=1 00:11:36.761 --rc geninfo_unexecuted_blocks=1 00:11:36.761 00:11:36.761 ' 00:11:36.761 02:16:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:36.761 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:36.761 --rc genhtml_branch_coverage=1 00:11:36.761 --rc genhtml_function_coverage=1 00:11:36.761 --rc genhtml_legend=1 00:11:36.761 --rc geninfo_all_blocks=1 00:11:36.761 --rc geninfo_unexecuted_blocks=1 00:11:36.761 00:11:36.761 ' 00:11:36.761 02:16:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:36.761 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:36.761 --rc genhtml_branch_coverage=1 00:11:36.761 --rc genhtml_function_coverage=1 00:11:36.761 --rc genhtml_legend=1 00:11:36.761 --rc geninfo_all_blocks=1 00:11:36.761 --rc geninfo_unexecuted_blocks=1 00:11:36.761 00:11:36.761 ' 00:11:36.761 02:16:40 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:36.761 02:16:40 -- nvmf/common.sh@7 -- # uname -s 00:11:36.761 02:16:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:36.761 02:16:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:36.761 02:16:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:36.761 02:16:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:36.761 02:16:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:36.761 02:16:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:36.761 02:16:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:36.761 02:16:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:36.761 02:16:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:36.761 02:16:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:36.761 02:16:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:36.761 02:16:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:36.761 02:16:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:36.761 02:16:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:36.761 02:16:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:36.761 02:16:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:36.761 02:16:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:36.761 02:16:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:36.761 02:16:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:36.761 02:16:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:36.761 02:16:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:36.761 02:16:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:36.762 02:16:40 -- paths/export.sh@5 -- # export PATH 00:11:36.762 02:16:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:36.762 02:16:40 -- nvmf/common.sh@46 -- # : 0 00:11:36.762 02:16:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:36.762 02:16:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:36.762 02:16:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:36.762 02:16:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:36.762 02:16:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:36.762 02:16:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:36.762 02:16:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:36.762 02:16:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:36.762 02:16:40 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:36.762 02:16:40 -- target/multitarget.sh@15 -- # nvmftestinit 00:11:36.762 02:16:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:36.762 02:16:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:36.762 02:16:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:36.762 02:16:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:36.762 02:16:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:36.762 02:16:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:36.762 02:16:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:36.762 02:16:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:36.762 02:16:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:36.762 02:16:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:36.762 02:16:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:36.762 02:16:40 -- common/autotest_common.sh@10 -- # set +x 00:11:38.696 02:16:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:38.696 02:16:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:38.696 02:16:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:38.696 02:16:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:38.696 02:16:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:38.696 02:16:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:38.696 02:16:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:38.696 02:16:42 -- nvmf/common.sh@294 -- # net_devs=() 00:11:38.696 02:16:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:38.696 02:16:42 -- nvmf/common.sh@295 -- # e810=() 00:11:38.696 02:16:42 -- nvmf/common.sh@295 -- # local -ga e810 00:11:38.696 02:16:42 -- nvmf/common.sh@296 -- # x722=() 00:11:38.696 02:16:42 -- nvmf/common.sh@296 -- # local -ga x722 00:11:38.696 02:16:42 -- nvmf/common.sh@297 -- # mlx=() 00:11:38.696 02:16:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:38.696 02:16:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:38.696 02:16:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:38.696 02:16:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:38.696 02:16:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:38.696 02:16:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:38.696 02:16:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:38.696 02:16:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:38.696 02:16:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:38.696 02:16:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:38.696 02:16:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:38.696 02:16:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:38.696 02:16:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:38.696 02:16:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:38.696 02:16:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:38.696 02:16:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:38.696 02:16:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:38.696 02:16:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:38.696 02:16:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:38.696 02:16:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:38.696 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:38.696 02:16:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:38.696 02:16:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:38.696 02:16:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:38.696 02:16:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:38.696 02:16:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:38.696 02:16:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:38.696 02:16:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:38.696 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:38.696 02:16:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:38.696 02:16:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:38.696 02:16:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:38.696 02:16:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:38.696 02:16:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:38.696 02:16:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:38.696 02:16:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:38.696 02:16:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:38.696 02:16:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:38.696 02:16:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:38.696 02:16:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:38.696 02:16:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:38.696 02:16:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:38.696 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:38.696 02:16:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:38.696 02:16:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:38.696 02:16:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:38.696 02:16:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:38.696 02:16:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:38.696 02:16:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:38.696 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:38.696 02:16:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:38.696 02:16:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:38.696 02:16:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:38.696 02:16:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:38.696 02:16:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:38.696 02:16:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:38.696 02:16:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:38.696 02:16:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:38.696 02:16:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:38.696 02:16:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:38.696 02:16:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:38.696 02:16:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:38.696 02:16:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:38.696 02:16:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:38.696 02:16:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:38.696 02:16:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:38.696 02:16:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:38.696 02:16:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:38.696 02:16:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:38.956 02:16:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:38.956 02:16:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:38.956 02:16:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:38.956 02:16:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:38.956 02:16:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:38.956 02:16:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:38.956 02:16:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:38.956 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:38.956 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.351 ms 00:11:38.956 00:11:38.956 --- 10.0.0.2 ping statistics --- 00:11:38.956 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:38.956 rtt min/avg/max/mdev = 0.351/0.351/0.351/0.000 ms 00:11:38.956 02:16:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:38.956 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:38.956 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.133 ms 00:11:38.956 00:11:38.956 --- 10.0.0.1 ping statistics --- 00:11:38.956 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:38.956 rtt min/avg/max/mdev = 0.133/0.133/0.133/0.000 ms 00:11:38.956 02:16:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:38.956 02:16:42 -- nvmf/common.sh@410 -- # return 0 00:11:38.956 02:16:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:38.956 02:16:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:38.956 02:16:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:38.956 02:16:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:38.956 02:16:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:38.956 02:16:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:38.956 02:16:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:38.956 02:16:42 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:11:38.956 02:16:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:38.956 02:16:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:38.956 02:16:42 -- common/autotest_common.sh@10 -- # set +x 00:11:38.956 02:16:42 -- nvmf/common.sh@469 -- # nvmfpid=60696 00:11:38.956 02:16:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:38.956 02:16:42 -- nvmf/common.sh@470 -- # waitforlisten 60696 00:11:38.956 02:16:42 -- common/autotest_common.sh@829 -- # '[' -z 60696 ']' 00:11:38.956 02:16:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:38.956 02:16:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:38.956 02:16:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:38.956 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:38.956 02:16:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:38.956 02:16:42 -- common/autotest_common.sh@10 -- # set +x 00:11:38.956 [2024-11-29 02:16:42.548575] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:38.956 [2024-11-29 02:16:42.548656] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:38.956 EAL: No free 2048 kB hugepages reported on node 1 00:11:38.956 [2024-11-29 02:16:42.616443] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:39.218 [2024-11-29 02:16:42.727191] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:39.218 [2024-11-29 02:16:42.727339] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:39.218 [2024-11-29 02:16:42.727356] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:39.218 [2024-11-29 02:16:42.727367] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:39.218 [2024-11-29 02:16:42.727444] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:39.218 [2024-11-29 02:16:42.727471] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:39.218 [2024-11-29 02:16:42.727532] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:39.218 [2024-11-29 02:16:42.727535] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:40.155 02:16:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:40.155 02:16:43 -- common/autotest_common.sh@862 -- # return 0 00:11:40.155 02:16:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:40.155 02:16:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:40.155 02:16:43 -- common/autotest_common.sh@10 -- # set +x 00:11:40.155 02:16:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:40.155 02:16:43 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:40.155 02:16:43 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:40.155 02:16:43 -- target/multitarget.sh@21 -- # jq length 00:11:40.155 02:16:43 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:11:40.155 02:16:43 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:11:40.155 "nvmf_tgt_1" 00:11:40.155 02:16:43 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:11:40.413 "nvmf_tgt_2" 00:11:40.413 02:16:43 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:40.413 02:16:43 -- target/multitarget.sh@28 -- # jq length 00:11:40.413 02:16:44 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:11:40.413 02:16:44 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:11:40.670 true 00:11:40.670 02:16:44 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:11:40.670 true 00:11:40.670 02:16:44 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:40.670 02:16:44 -- target/multitarget.sh@35 -- # jq length 00:11:40.928 02:16:44 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:11:40.928 02:16:44 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:11:40.928 02:16:44 -- target/multitarget.sh@41 -- # nvmftestfini 00:11:40.928 02:16:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:40.928 02:16:44 -- nvmf/common.sh@116 -- # sync 00:11:40.928 02:16:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:40.928 02:16:44 -- nvmf/common.sh@119 -- # set +e 00:11:40.928 02:16:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:40.928 02:16:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:40.928 rmmod nvme_tcp 00:11:40.928 rmmod nvme_fabrics 00:11:40.928 rmmod nvme_keyring 00:11:40.928 02:16:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:40.928 02:16:44 -- nvmf/common.sh@123 -- # set -e 00:11:40.928 02:16:44 -- nvmf/common.sh@124 -- # return 0 00:11:40.928 02:16:44 -- nvmf/common.sh@477 -- # '[' -n 60696 ']' 00:11:40.928 02:16:44 -- nvmf/common.sh@478 -- # killprocess 60696 00:11:40.928 02:16:44 -- common/autotest_common.sh@936 -- # '[' -z 60696 ']' 00:11:40.928 02:16:44 -- common/autotest_common.sh@940 -- # kill -0 60696 00:11:40.928 02:16:44 -- common/autotest_common.sh@941 -- # uname 00:11:40.928 02:16:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:40.928 02:16:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 60696 00:11:40.928 02:16:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:40.928 02:16:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:40.928 02:16:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 60696' 00:11:40.928 killing process with pid 60696 00:11:40.928 02:16:44 -- common/autotest_common.sh@955 -- # kill 60696 00:11:40.928 02:16:44 -- common/autotest_common.sh@960 -- # wait 60696 00:11:41.196 02:16:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:41.196 02:16:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:41.196 02:16:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:41.196 02:16:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:41.196 02:16:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:41.196 02:16:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:41.196 02:16:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:41.196 02:16:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:43.727 02:16:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:43.727 00:11:43.727 real 0m6.708s 00:11:43.727 user 0m9.854s 00:11:43.727 sys 0m2.057s 00:11:43.727 02:16:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:43.727 02:16:46 -- common/autotest_common.sh@10 -- # set +x 00:11:43.727 ************************************ 00:11:43.727 END TEST nvmf_multitarget 00:11:43.727 ************************************ 00:11:43.727 02:16:46 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:43.727 02:16:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:43.727 02:16:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:43.727 02:16:46 -- common/autotest_common.sh@10 -- # set +x 00:11:43.727 ************************************ 00:11:43.727 START TEST nvmf_rpc 00:11:43.727 ************************************ 00:11:43.727 02:16:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:43.727 * Looking for test storage... 00:11:43.727 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:43.727 02:16:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:43.727 02:16:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:43.727 02:16:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:43.727 02:16:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:43.727 02:16:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:43.727 02:16:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:43.727 02:16:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:43.727 02:16:46 -- scripts/common.sh@335 -- # IFS=.-: 00:11:43.727 02:16:46 -- scripts/common.sh@335 -- # read -ra ver1 00:11:43.728 02:16:46 -- scripts/common.sh@336 -- # IFS=.-: 00:11:43.728 02:16:46 -- scripts/common.sh@336 -- # read -ra ver2 00:11:43.728 02:16:46 -- scripts/common.sh@337 -- # local 'op=<' 00:11:43.728 02:16:46 -- scripts/common.sh@339 -- # ver1_l=2 00:11:43.728 02:16:46 -- scripts/common.sh@340 -- # ver2_l=1 00:11:43.728 02:16:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:43.728 02:16:46 -- scripts/common.sh@343 -- # case "$op" in 00:11:43.728 02:16:46 -- scripts/common.sh@344 -- # : 1 00:11:43.728 02:16:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:43.728 02:16:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:43.728 02:16:46 -- scripts/common.sh@364 -- # decimal 1 00:11:43.728 02:16:46 -- scripts/common.sh@352 -- # local d=1 00:11:43.728 02:16:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:43.728 02:16:46 -- scripts/common.sh@354 -- # echo 1 00:11:43.728 02:16:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:43.728 02:16:46 -- scripts/common.sh@365 -- # decimal 2 00:11:43.728 02:16:46 -- scripts/common.sh@352 -- # local d=2 00:11:43.728 02:16:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:43.728 02:16:46 -- scripts/common.sh@354 -- # echo 2 00:11:43.728 02:16:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:43.728 02:16:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:43.728 02:16:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:43.728 02:16:46 -- scripts/common.sh@367 -- # return 0 00:11:43.728 02:16:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:43.728 02:16:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:43.728 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:43.728 --rc genhtml_branch_coverage=1 00:11:43.728 --rc genhtml_function_coverage=1 00:11:43.728 --rc genhtml_legend=1 00:11:43.728 --rc geninfo_all_blocks=1 00:11:43.728 --rc geninfo_unexecuted_blocks=1 00:11:43.728 00:11:43.728 ' 00:11:43.728 02:16:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:43.728 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:43.728 --rc genhtml_branch_coverage=1 00:11:43.728 --rc genhtml_function_coverage=1 00:11:43.728 --rc genhtml_legend=1 00:11:43.728 --rc geninfo_all_blocks=1 00:11:43.728 --rc geninfo_unexecuted_blocks=1 00:11:43.728 00:11:43.728 ' 00:11:43.728 02:16:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:43.728 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:43.728 --rc genhtml_branch_coverage=1 00:11:43.728 --rc genhtml_function_coverage=1 00:11:43.728 --rc genhtml_legend=1 00:11:43.728 --rc geninfo_all_blocks=1 00:11:43.728 --rc geninfo_unexecuted_blocks=1 00:11:43.728 00:11:43.728 ' 00:11:43.728 02:16:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:43.728 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:43.728 --rc genhtml_branch_coverage=1 00:11:43.728 --rc genhtml_function_coverage=1 00:11:43.728 --rc genhtml_legend=1 00:11:43.728 --rc geninfo_all_blocks=1 00:11:43.728 --rc geninfo_unexecuted_blocks=1 00:11:43.728 00:11:43.728 ' 00:11:43.728 02:16:46 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:43.728 02:16:46 -- nvmf/common.sh@7 -- # uname -s 00:11:43.728 02:16:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:43.728 02:16:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:43.728 02:16:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:43.728 02:16:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:43.728 02:16:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:43.728 02:16:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:43.728 02:16:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:43.728 02:16:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:43.728 02:16:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:43.728 02:16:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:43.728 02:16:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:43.728 02:16:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:43.728 02:16:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:43.728 02:16:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:43.728 02:16:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:43.728 02:16:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:43.728 02:16:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:43.728 02:16:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:43.728 02:16:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:43.728 02:16:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:43.728 02:16:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:43.728 02:16:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:43.728 02:16:47 -- paths/export.sh@5 -- # export PATH 00:11:43.728 02:16:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:43.728 02:16:47 -- nvmf/common.sh@46 -- # : 0 00:11:43.728 02:16:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:43.728 02:16:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:43.728 02:16:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:43.728 02:16:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:43.728 02:16:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:43.728 02:16:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:43.728 02:16:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:43.728 02:16:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:43.728 02:16:47 -- target/rpc.sh@11 -- # loops=5 00:11:43.728 02:16:47 -- target/rpc.sh@23 -- # nvmftestinit 00:11:43.728 02:16:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:43.728 02:16:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:43.728 02:16:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:43.728 02:16:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:43.728 02:16:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:43.728 02:16:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:43.728 02:16:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:43.728 02:16:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:43.728 02:16:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:43.728 02:16:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:43.728 02:16:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:43.728 02:16:47 -- common/autotest_common.sh@10 -- # set +x 00:11:45.629 02:16:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:45.629 02:16:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:45.629 02:16:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:45.629 02:16:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:45.629 02:16:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:45.629 02:16:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:45.629 02:16:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:45.629 02:16:49 -- nvmf/common.sh@294 -- # net_devs=() 00:11:45.629 02:16:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:45.629 02:16:49 -- nvmf/common.sh@295 -- # e810=() 00:11:45.629 02:16:49 -- nvmf/common.sh@295 -- # local -ga e810 00:11:45.629 02:16:49 -- nvmf/common.sh@296 -- # x722=() 00:11:45.629 02:16:49 -- nvmf/common.sh@296 -- # local -ga x722 00:11:45.629 02:16:49 -- nvmf/common.sh@297 -- # mlx=() 00:11:45.629 02:16:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:45.629 02:16:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:45.629 02:16:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:45.629 02:16:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:45.629 02:16:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:45.629 02:16:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:45.629 02:16:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:45.629 02:16:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:45.629 02:16:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:45.629 02:16:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:45.629 02:16:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:45.629 02:16:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:45.629 02:16:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:45.629 02:16:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:45.629 02:16:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:45.629 02:16:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:45.629 02:16:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:45.629 02:16:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:45.629 02:16:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:45.629 02:16:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:45.629 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:45.629 02:16:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:45.629 02:16:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:45.629 02:16:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:45.630 02:16:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:45.630 02:16:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:45.630 02:16:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:45.630 02:16:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:45.630 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:45.630 02:16:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:45.630 02:16:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:45.630 02:16:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:45.630 02:16:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:45.630 02:16:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:45.630 02:16:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:45.630 02:16:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:45.630 02:16:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:45.630 02:16:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:45.630 02:16:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:45.630 02:16:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:45.630 02:16:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:45.630 02:16:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:45.630 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:45.630 02:16:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:45.630 02:16:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:45.630 02:16:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:45.630 02:16:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:45.630 02:16:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:45.630 02:16:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:45.630 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:45.630 02:16:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:45.630 02:16:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:45.630 02:16:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:45.630 02:16:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:45.630 02:16:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:45.630 02:16:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:45.630 02:16:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:45.630 02:16:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:45.630 02:16:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:45.630 02:16:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:45.630 02:16:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:45.630 02:16:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:45.630 02:16:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:45.630 02:16:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:45.630 02:16:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:45.630 02:16:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:45.630 02:16:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:45.630 02:16:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:45.630 02:16:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:45.630 02:16:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:45.630 02:16:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:45.630 02:16:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:45.630 02:16:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:45.630 02:16:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:45.630 02:16:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:45.630 02:16:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:45.630 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:45.630 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.212 ms 00:11:45.630 00:11:45.630 --- 10.0.0.2 ping statistics --- 00:11:45.630 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:45.630 rtt min/avg/max/mdev = 0.212/0.212/0.212/0.000 ms 00:11:45.630 02:16:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:45.630 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:45.630 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.079 ms 00:11:45.630 00:11:45.630 --- 10.0.0.1 ping statistics --- 00:11:45.630 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:45.630 rtt min/avg/max/mdev = 0.079/0.079/0.079/0.000 ms 00:11:45.630 02:16:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:45.630 02:16:49 -- nvmf/common.sh@410 -- # return 0 00:11:45.630 02:16:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:45.630 02:16:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:45.630 02:16:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:45.630 02:16:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:45.630 02:16:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:45.630 02:16:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:45.630 02:16:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:45.630 02:16:49 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:11:45.630 02:16:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:45.630 02:16:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:45.630 02:16:49 -- common/autotest_common.sh@10 -- # set +x 00:11:45.630 02:16:49 -- nvmf/common.sh@469 -- # nvmfpid=62953 00:11:45.630 02:16:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:45.630 02:16:49 -- nvmf/common.sh@470 -- # waitforlisten 62953 00:11:45.630 02:16:49 -- common/autotest_common.sh@829 -- # '[' -z 62953 ']' 00:11:45.630 02:16:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:45.630 02:16:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:45.630 02:16:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:45.630 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:45.630 02:16:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:45.630 02:16:49 -- common/autotest_common.sh@10 -- # set +x 00:11:45.630 [2024-11-29 02:16:49.261513] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:45.630 [2024-11-29 02:16:49.261606] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:45.630 EAL: No free 2048 kB hugepages reported on node 1 00:11:45.888 [2024-11-29 02:16:49.330449] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:45.888 [2024-11-29 02:16:49.448856] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:45.888 [2024-11-29 02:16:49.449030] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:45.888 [2024-11-29 02:16:49.449050] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:45.888 [2024-11-29 02:16:49.449077] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:45.888 [2024-11-29 02:16:49.449174] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:45.888 [2024-11-29 02:16:49.449233] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:45.888 [2024-11-29 02:16:49.449286] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:45.888 [2024-11-29 02:16:49.449289] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:46.822 02:16:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:46.822 02:16:50 -- common/autotest_common.sh@862 -- # return 0 00:11:46.822 02:16:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:46.822 02:16:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:46.822 02:16:50 -- common/autotest_common.sh@10 -- # set +x 00:11:46.822 02:16:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:46.822 02:16:50 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:11:46.822 02:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:46.822 02:16:50 -- common/autotest_common.sh@10 -- # set +x 00:11:46.822 02:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:46.822 02:16:50 -- target/rpc.sh@26 -- # stats='{ 00:11:46.822 "tick_rate": 2700000000, 00:11:46.822 "poll_groups": [ 00:11:46.822 { 00:11:46.822 "name": "nvmf_tgt_poll_group_0", 00:11:46.822 "admin_qpairs": 0, 00:11:46.822 "io_qpairs": 0, 00:11:46.822 "current_admin_qpairs": 0, 00:11:46.822 "current_io_qpairs": 0, 00:11:46.822 "pending_bdev_io": 0, 00:11:46.822 "completed_nvme_io": 0, 00:11:46.822 "transports": [] 00:11:46.822 }, 00:11:46.822 { 00:11:46.822 "name": "nvmf_tgt_poll_group_1", 00:11:46.822 "admin_qpairs": 0, 00:11:46.822 "io_qpairs": 0, 00:11:46.822 "current_admin_qpairs": 0, 00:11:46.822 "current_io_qpairs": 0, 00:11:46.822 "pending_bdev_io": 0, 00:11:46.822 "completed_nvme_io": 0, 00:11:46.822 "transports": [] 00:11:46.822 }, 00:11:46.822 { 00:11:46.822 "name": "nvmf_tgt_poll_group_2", 00:11:46.822 "admin_qpairs": 0, 00:11:46.822 "io_qpairs": 0, 00:11:46.822 "current_admin_qpairs": 0, 00:11:46.822 "current_io_qpairs": 0, 00:11:46.822 "pending_bdev_io": 0, 00:11:46.822 "completed_nvme_io": 0, 00:11:46.822 "transports": [] 00:11:46.822 }, 00:11:46.822 { 00:11:46.822 "name": "nvmf_tgt_poll_group_3", 00:11:46.822 "admin_qpairs": 0, 00:11:46.822 "io_qpairs": 0, 00:11:46.822 "current_admin_qpairs": 0, 00:11:46.822 "current_io_qpairs": 0, 00:11:46.822 "pending_bdev_io": 0, 00:11:46.822 "completed_nvme_io": 0, 00:11:46.822 "transports": [] 00:11:46.822 } 00:11:46.822 ] 00:11:46.822 }' 00:11:46.822 02:16:50 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:11:46.822 02:16:50 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:11:46.822 02:16:50 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:11:46.822 02:16:50 -- target/rpc.sh@15 -- # wc -l 00:11:46.822 02:16:50 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:11:46.822 02:16:50 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:11:46.822 02:16:50 -- target/rpc.sh@29 -- # [[ null == null ]] 00:11:46.822 02:16:50 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:11:46.822 02:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:46.822 02:16:50 -- common/autotest_common.sh@10 -- # set +x 00:11:46.822 [2024-11-29 02:16:50.352282] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:46.822 02:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:46.822 02:16:50 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:11:46.822 02:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:46.822 02:16:50 -- common/autotest_common.sh@10 -- # set +x 00:11:46.822 02:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:46.822 02:16:50 -- target/rpc.sh@33 -- # stats='{ 00:11:46.822 "tick_rate": 2700000000, 00:11:46.822 "poll_groups": [ 00:11:46.822 { 00:11:46.822 "name": "nvmf_tgt_poll_group_0", 00:11:46.822 "admin_qpairs": 0, 00:11:46.822 "io_qpairs": 0, 00:11:46.822 "current_admin_qpairs": 0, 00:11:46.822 "current_io_qpairs": 0, 00:11:46.822 "pending_bdev_io": 0, 00:11:46.822 "completed_nvme_io": 0, 00:11:46.822 "transports": [ 00:11:46.822 { 00:11:46.822 "trtype": "TCP" 00:11:46.822 } 00:11:46.822 ] 00:11:46.822 }, 00:11:46.822 { 00:11:46.822 "name": "nvmf_tgt_poll_group_1", 00:11:46.822 "admin_qpairs": 0, 00:11:46.822 "io_qpairs": 0, 00:11:46.822 "current_admin_qpairs": 0, 00:11:46.822 "current_io_qpairs": 0, 00:11:46.822 "pending_bdev_io": 0, 00:11:46.822 "completed_nvme_io": 0, 00:11:46.822 "transports": [ 00:11:46.822 { 00:11:46.822 "trtype": "TCP" 00:11:46.822 } 00:11:46.822 ] 00:11:46.822 }, 00:11:46.822 { 00:11:46.822 "name": "nvmf_tgt_poll_group_2", 00:11:46.822 "admin_qpairs": 0, 00:11:46.822 "io_qpairs": 0, 00:11:46.822 "current_admin_qpairs": 0, 00:11:46.822 "current_io_qpairs": 0, 00:11:46.822 "pending_bdev_io": 0, 00:11:46.822 "completed_nvme_io": 0, 00:11:46.822 "transports": [ 00:11:46.822 { 00:11:46.822 "trtype": "TCP" 00:11:46.822 } 00:11:46.822 ] 00:11:46.822 }, 00:11:46.822 { 00:11:46.822 "name": "nvmf_tgt_poll_group_3", 00:11:46.822 "admin_qpairs": 0, 00:11:46.822 "io_qpairs": 0, 00:11:46.822 "current_admin_qpairs": 0, 00:11:46.822 "current_io_qpairs": 0, 00:11:46.822 "pending_bdev_io": 0, 00:11:46.822 "completed_nvme_io": 0, 00:11:46.822 "transports": [ 00:11:46.822 { 00:11:46.822 "trtype": "TCP" 00:11:46.822 } 00:11:46.822 ] 00:11:46.822 } 00:11:46.822 ] 00:11:46.822 }' 00:11:46.822 02:16:50 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:11:46.822 02:16:50 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:46.822 02:16:50 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:46.822 02:16:50 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:46.822 02:16:50 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:11:46.822 02:16:50 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:11:46.822 02:16:50 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:46.822 02:16:50 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:46.822 02:16:50 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:46.822 02:16:50 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:11:46.822 02:16:50 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:11:46.822 02:16:50 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:11:46.822 02:16:50 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:11:46.822 02:16:50 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:11:46.822 02:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:46.822 02:16:50 -- common/autotest_common.sh@10 -- # set +x 00:11:46.822 Malloc1 00:11:46.822 02:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:46.822 02:16:50 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:11:46.822 02:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:46.822 02:16:50 -- common/autotest_common.sh@10 -- # set +x 00:11:46.822 02:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:46.822 02:16:50 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:46.822 02:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:46.822 02:16:50 -- common/autotest_common.sh@10 -- # set +x 00:11:46.822 02:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:46.822 02:16:50 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:11:46.822 02:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:46.822 02:16:50 -- common/autotest_common.sh@10 -- # set +x 00:11:46.822 02:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:46.823 02:16:50 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:46.823 02:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:46.823 02:16:50 -- common/autotest_common.sh@10 -- # set +x 00:11:46.823 [2024-11-29 02:16:50.498863] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:47.080 02:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:47.080 02:16:50 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:47.080 02:16:50 -- common/autotest_common.sh@650 -- # local es=0 00:11:47.080 02:16:50 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:47.080 02:16:50 -- common/autotest_common.sh@638 -- # local arg=nvme 00:11:47.080 02:16:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:47.080 02:16:50 -- common/autotest_common.sh@642 -- # type -t nvme 00:11:47.080 02:16:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:47.080 02:16:50 -- common/autotest_common.sh@644 -- # type -P nvme 00:11:47.080 02:16:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:47.080 02:16:50 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:11:47.080 02:16:50 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:11:47.080 02:16:50 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:47.080 [2024-11-29 02:16:50.521401] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:47.080 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:47.080 could not add new controller: failed to write to nvme-fabrics device 00:11:47.080 02:16:50 -- common/autotest_common.sh@653 -- # es=1 00:11:47.080 02:16:50 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:47.080 02:16:50 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:47.080 02:16:50 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:47.080 02:16:50 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:47.080 02:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:47.080 02:16:50 -- common/autotest_common.sh@10 -- # set +x 00:11:47.080 02:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:47.080 02:16:50 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:47.644 02:16:51 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:11:47.644 02:16:51 -- common/autotest_common.sh@1187 -- # local i=0 00:11:47.644 02:16:51 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:47.644 02:16:51 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:47.644 02:16:51 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:50.169 02:16:53 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:50.169 02:16:53 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:50.169 02:16:53 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:50.169 02:16:53 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:50.169 02:16:53 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:50.169 02:16:53 -- common/autotest_common.sh@1197 -- # return 0 00:11:50.169 02:16:53 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:50.169 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:50.169 02:16:53 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:50.169 02:16:53 -- common/autotest_common.sh@1208 -- # local i=0 00:11:50.169 02:16:53 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:50.169 02:16:53 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:50.169 02:16:53 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:50.169 02:16:53 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:50.169 02:16:53 -- common/autotest_common.sh@1220 -- # return 0 00:11:50.169 02:16:53 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:50.169 02:16:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:50.169 02:16:53 -- common/autotest_common.sh@10 -- # set +x 00:11:50.169 02:16:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:50.169 02:16:53 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:50.169 02:16:53 -- common/autotest_common.sh@650 -- # local es=0 00:11:50.169 02:16:53 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:50.169 02:16:53 -- common/autotest_common.sh@638 -- # local arg=nvme 00:11:50.169 02:16:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:50.169 02:16:53 -- common/autotest_common.sh@642 -- # type -t nvme 00:11:50.169 02:16:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:50.169 02:16:53 -- common/autotest_common.sh@644 -- # type -P nvme 00:11:50.169 02:16:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:50.169 02:16:53 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:11:50.169 02:16:53 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:11:50.169 02:16:53 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:50.169 [2024-11-29 02:16:53.400291] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:50.169 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:50.169 could not add new controller: failed to write to nvme-fabrics device 00:11:50.169 02:16:53 -- common/autotest_common.sh@653 -- # es=1 00:11:50.169 02:16:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:50.169 02:16:53 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:50.169 02:16:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:50.169 02:16:53 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:11:50.169 02:16:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:50.169 02:16:53 -- common/autotest_common.sh@10 -- # set +x 00:11:50.169 02:16:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:50.169 02:16:53 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:50.427 02:16:54 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:11:50.427 02:16:54 -- common/autotest_common.sh@1187 -- # local i=0 00:11:50.427 02:16:54 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:50.427 02:16:54 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:50.427 02:16:54 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:52.953 02:16:56 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:52.953 02:16:56 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:52.953 02:16:56 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:52.953 02:16:56 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:52.953 02:16:56 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:52.953 02:16:56 -- common/autotest_common.sh@1197 -- # return 0 00:11:52.953 02:16:56 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:52.953 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:52.953 02:16:56 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:52.953 02:16:56 -- common/autotest_common.sh@1208 -- # local i=0 00:11:52.953 02:16:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:52.953 02:16:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:52.953 02:16:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:52.953 02:16:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:52.953 02:16:56 -- common/autotest_common.sh@1220 -- # return 0 00:11:52.953 02:16:56 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:52.953 02:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:52.953 02:16:56 -- common/autotest_common.sh@10 -- # set +x 00:11:52.953 02:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:52.953 02:16:56 -- target/rpc.sh@81 -- # seq 1 5 00:11:52.953 02:16:56 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:52.953 02:16:56 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:52.953 02:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:52.953 02:16:56 -- common/autotest_common.sh@10 -- # set +x 00:11:52.953 02:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:52.953 02:16:56 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:52.953 02:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:52.953 02:16:56 -- common/autotest_common.sh@10 -- # set +x 00:11:52.953 [2024-11-29 02:16:56.187187] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:52.953 02:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:52.953 02:16:56 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:52.953 02:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:52.953 02:16:56 -- common/autotest_common.sh@10 -- # set +x 00:11:52.953 02:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:52.953 02:16:56 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:52.953 02:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:52.953 02:16:56 -- common/autotest_common.sh@10 -- # set +x 00:11:52.953 02:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:52.953 02:16:56 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:53.518 02:16:56 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:53.518 02:16:56 -- common/autotest_common.sh@1187 -- # local i=0 00:11:53.518 02:16:56 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:53.518 02:16:56 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:53.518 02:16:56 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:55.417 02:16:58 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:55.417 02:16:58 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:55.417 02:16:58 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:55.417 02:16:58 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:55.417 02:16:58 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:55.417 02:16:58 -- common/autotest_common.sh@1197 -- # return 0 00:11:55.417 02:16:58 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:55.417 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:55.417 02:16:58 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:55.417 02:16:58 -- common/autotest_common.sh@1208 -- # local i=0 00:11:55.417 02:16:58 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:55.417 02:16:58 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:55.417 02:16:58 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:55.417 02:16:58 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:55.417 02:16:58 -- common/autotest_common.sh@1220 -- # return 0 00:11:55.417 02:16:58 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:55.417 02:16:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.417 02:16:58 -- common/autotest_common.sh@10 -- # set +x 00:11:55.417 02:16:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.417 02:16:58 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:55.417 02:16:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.417 02:16:58 -- common/autotest_common.sh@10 -- # set +x 00:11:55.417 02:16:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.417 02:16:58 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:55.417 02:16:58 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:55.417 02:16:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.417 02:16:58 -- common/autotest_common.sh@10 -- # set +x 00:11:55.417 02:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.417 02:16:59 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:55.417 02:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.417 02:16:59 -- common/autotest_common.sh@10 -- # set +x 00:11:55.417 [2024-11-29 02:16:59.012536] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:55.417 02:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.417 02:16:59 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:55.417 02:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.417 02:16:59 -- common/autotest_common.sh@10 -- # set +x 00:11:55.417 02:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.417 02:16:59 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:55.417 02:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.417 02:16:59 -- common/autotest_common.sh@10 -- # set +x 00:11:55.417 02:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.417 02:16:59 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:55.983 02:16:59 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:55.983 02:16:59 -- common/autotest_common.sh@1187 -- # local i=0 00:11:55.983 02:16:59 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:55.983 02:16:59 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:55.983 02:16:59 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:58.510 02:17:01 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:58.510 02:17:01 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:58.510 02:17:01 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:58.510 02:17:01 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:58.510 02:17:01 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:58.510 02:17:01 -- common/autotest_common.sh@1197 -- # return 0 00:11:58.510 02:17:01 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:58.510 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:58.510 02:17:01 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:58.510 02:17:01 -- common/autotest_common.sh@1208 -- # local i=0 00:11:58.510 02:17:01 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:58.510 02:17:01 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:58.510 02:17:01 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:58.510 02:17:01 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:58.510 02:17:01 -- common/autotest_common.sh@1220 -- # return 0 00:11:58.510 02:17:01 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:58.510 02:17:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.510 02:17:01 -- common/autotest_common.sh@10 -- # set +x 00:11:58.510 02:17:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.510 02:17:01 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:58.510 02:17:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.510 02:17:01 -- common/autotest_common.sh@10 -- # set +x 00:11:58.510 02:17:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.510 02:17:01 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:58.510 02:17:01 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:58.510 02:17:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.510 02:17:01 -- common/autotest_common.sh@10 -- # set +x 00:11:58.510 02:17:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.510 02:17:01 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:58.511 02:17:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.511 02:17:01 -- common/autotest_common.sh@10 -- # set +x 00:11:58.511 [2024-11-29 02:17:01.799176] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:58.511 02:17:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.511 02:17:01 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:58.511 02:17:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.511 02:17:01 -- common/autotest_common.sh@10 -- # set +x 00:11:58.511 02:17:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.511 02:17:01 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:58.511 02:17:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.511 02:17:01 -- common/autotest_common.sh@10 -- # set +x 00:11:58.511 02:17:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.511 02:17:01 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:58.769 02:17:02 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:58.769 02:17:02 -- common/autotest_common.sh@1187 -- # local i=0 00:11:58.769 02:17:02 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:58.769 02:17:02 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:58.769 02:17:02 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:01.297 02:17:04 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:01.297 02:17:04 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:01.297 02:17:04 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:01.297 02:17:04 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:01.297 02:17:04 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:01.297 02:17:04 -- common/autotest_common.sh@1197 -- # return 0 00:12:01.297 02:17:04 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:01.297 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:01.297 02:17:04 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:01.297 02:17:04 -- common/autotest_common.sh@1208 -- # local i=0 00:12:01.297 02:17:04 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:01.297 02:17:04 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:01.297 02:17:04 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:01.297 02:17:04 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:01.297 02:17:04 -- common/autotest_common.sh@1220 -- # return 0 00:12:01.297 02:17:04 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:01.297 02:17:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.297 02:17:04 -- common/autotest_common.sh@10 -- # set +x 00:12:01.297 02:17:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.297 02:17:04 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:01.297 02:17:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.297 02:17:04 -- common/autotest_common.sh@10 -- # set +x 00:12:01.297 02:17:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.297 02:17:04 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:01.297 02:17:04 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:01.297 02:17:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.297 02:17:04 -- common/autotest_common.sh@10 -- # set +x 00:12:01.297 02:17:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.297 02:17:04 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:01.297 02:17:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.297 02:17:04 -- common/autotest_common.sh@10 -- # set +x 00:12:01.297 [2024-11-29 02:17:04.544419] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:01.297 02:17:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.297 02:17:04 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:01.297 02:17:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.297 02:17:04 -- common/autotest_common.sh@10 -- # set +x 00:12:01.297 02:17:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.297 02:17:04 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:01.297 02:17:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.297 02:17:04 -- common/autotest_common.sh@10 -- # set +x 00:12:01.297 02:17:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.297 02:17:04 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:01.873 02:17:05 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:01.873 02:17:05 -- common/autotest_common.sh@1187 -- # local i=0 00:12:01.873 02:17:05 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:01.873 02:17:05 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:01.873 02:17:05 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:03.772 02:17:07 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:03.772 02:17:07 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:03.772 02:17:07 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:03.772 02:17:07 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:03.772 02:17:07 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:03.772 02:17:07 -- common/autotest_common.sh@1197 -- # return 0 00:12:03.772 02:17:07 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:03.772 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:03.772 02:17:07 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:03.772 02:17:07 -- common/autotest_common.sh@1208 -- # local i=0 00:12:03.772 02:17:07 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:03.772 02:17:07 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:03.772 02:17:07 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:03.772 02:17:07 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:03.772 02:17:07 -- common/autotest_common.sh@1220 -- # return 0 00:12:03.772 02:17:07 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:03.772 02:17:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:03.772 02:17:07 -- common/autotest_common.sh@10 -- # set +x 00:12:03.772 02:17:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:03.772 02:17:07 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:03.772 02:17:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:03.772 02:17:07 -- common/autotest_common.sh@10 -- # set +x 00:12:03.772 02:17:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:03.772 02:17:07 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:03.772 02:17:07 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:03.772 02:17:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:03.772 02:17:07 -- common/autotest_common.sh@10 -- # set +x 00:12:03.772 02:17:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:03.772 02:17:07 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:03.772 02:17:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:03.772 02:17:07 -- common/autotest_common.sh@10 -- # set +x 00:12:03.772 [2024-11-29 02:17:07.408700] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:03.772 02:17:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:03.772 02:17:07 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:03.772 02:17:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:03.772 02:17:07 -- common/autotest_common.sh@10 -- # set +x 00:12:03.772 02:17:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:03.772 02:17:07 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:03.772 02:17:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:03.772 02:17:07 -- common/autotest_common.sh@10 -- # set +x 00:12:03.772 02:17:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:03.772 02:17:07 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:04.703 02:17:08 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:04.703 02:17:08 -- common/autotest_common.sh@1187 -- # local i=0 00:12:04.703 02:17:08 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:04.703 02:17:08 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:04.703 02:17:08 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:06.600 02:17:10 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:06.600 02:17:10 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:06.600 02:17:10 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:06.600 02:17:10 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:06.600 02:17:10 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:06.600 02:17:10 -- common/autotest_common.sh@1197 -- # return 0 00:12:06.600 02:17:10 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:06.600 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:06.600 02:17:10 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:06.600 02:17:10 -- common/autotest_common.sh@1208 -- # local i=0 00:12:06.600 02:17:10 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:06.600 02:17:10 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:06.600 02:17:10 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:06.600 02:17:10 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:06.600 02:17:10 -- common/autotest_common.sh@1220 -- # return 0 00:12:06.600 02:17:10 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:06.600 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.600 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.600 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.600 02:17:10 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:06.600 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.600 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.600 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.600 02:17:10 -- target/rpc.sh@99 -- # seq 1 5 00:12:06.600 02:17:10 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:06.600 02:17:10 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:06.600 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.600 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.600 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.600 02:17:10 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:06.600 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.600 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.600 [2024-11-29 02:17:10.231082] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:06.600 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.600 02:17:10 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:06.600 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.600 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.600 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.600 02:17:10 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:06.600 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.600 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.600 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.600 02:17:10 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:06.600 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.600 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.600 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.600 02:17:10 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:06.600 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.600 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.600 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.600 02:17:10 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:06.600 02:17:10 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:06.600 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.600 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.600 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.600 02:17:10 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:06.600 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.600 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.600 [2024-11-29 02:17:10.279149] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:06.858 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.858 02:17:10 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:06.858 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.858 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.858 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.858 02:17:10 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:06.858 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.858 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.858 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.858 02:17:10 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:06.858 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.858 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.858 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.858 02:17:10 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:06.858 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.858 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.858 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.858 02:17:10 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:06.858 02:17:10 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:06.858 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.858 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.858 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.858 02:17:10 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:06.858 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.858 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.858 [2024-11-29 02:17:10.327294] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:06.858 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.858 02:17:10 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:06.858 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.858 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.858 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.858 02:17:10 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:06.858 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.858 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.858 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.858 02:17:10 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:06.858 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.858 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.858 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.858 02:17:10 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:06.858 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.858 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.858 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.858 02:17:10 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:06.858 02:17:10 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:06.858 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.858 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.858 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.858 02:17:10 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:06.858 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.858 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.858 [2024-11-29 02:17:10.375472] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:06.858 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.858 02:17:10 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:06.858 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.858 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.858 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.858 02:17:10 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:06.858 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.858 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.858 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.858 02:17:10 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:06.858 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.858 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.858 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.858 02:17:10 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:06.858 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.858 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.858 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.858 02:17:10 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:06.858 02:17:10 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:06.858 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.859 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.859 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.859 02:17:10 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:06.859 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.859 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.859 [2024-11-29 02:17:10.423630] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:06.859 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.859 02:17:10 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:06.859 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.859 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.859 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.859 02:17:10 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:06.859 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.859 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.859 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.859 02:17:10 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:06.859 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.859 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.859 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.859 02:17:10 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:06.859 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.859 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.859 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.859 02:17:10 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:12:06.859 02:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.859 02:17:10 -- common/autotest_common.sh@10 -- # set +x 00:12:06.859 02:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.859 02:17:10 -- target/rpc.sh@110 -- # stats='{ 00:12:06.859 "tick_rate": 2700000000, 00:12:06.859 "poll_groups": [ 00:12:06.859 { 00:12:06.859 "name": "nvmf_tgt_poll_group_0", 00:12:06.859 "admin_qpairs": 2, 00:12:06.859 "io_qpairs": 84, 00:12:06.859 "current_admin_qpairs": 0, 00:12:06.859 "current_io_qpairs": 0, 00:12:06.859 "pending_bdev_io": 0, 00:12:06.859 "completed_nvme_io": 185, 00:12:06.859 "transports": [ 00:12:06.859 { 00:12:06.859 "trtype": "TCP" 00:12:06.859 } 00:12:06.859 ] 00:12:06.859 }, 00:12:06.859 { 00:12:06.859 "name": "nvmf_tgt_poll_group_1", 00:12:06.859 "admin_qpairs": 2, 00:12:06.859 "io_qpairs": 84, 00:12:06.859 "current_admin_qpairs": 0, 00:12:06.859 "current_io_qpairs": 0, 00:12:06.859 "pending_bdev_io": 0, 00:12:06.859 "completed_nvme_io": 168, 00:12:06.859 "transports": [ 00:12:06.859 { 00:12:06.859 "trtype": "TCP" 00:12:06.859 } 00:12:06.859 ] 00:12:06.859 }, 00:12:06.859 { 00:12:06.859 "name": "nvmf_tgt_poll_group_2", 00:12:06.859 "admin_qpairs": 1, 00:12:06.859 "io_qpairs": 84, 00:12:06.859 "current_admin_qpairs": 0, 00:12:06.859 "current_io_qpairs": 0, 00:12:06.859 "pending_bdev_io": 0, 00:12:06.859 "completed_nvme_io": 135, 00:12:06.859 "transports": [ 00:12:06.859 { 00:12:06.859 "trtype": "TCP" 00:12:06.859 } 00:12:06.859 ] 00:12:06.859 }, 00:12:06.859 { 00:12:06.859 "name": "nvmf_tgt_poll_group_3", 00:12:06.859 "admin_qpairs": 2, 00:12:06.859 "io_qpairs": 84, 00:12:06.859 "current_admin_qpairs": 0, 00:12:06.859 "current_io_qpairs": 0, 00:12:06.859 "pending_bdev_io": 0, 00:12:06.859 "completed_nvme_io": 198, 00:12:06.859 "transports": [ 00:12:06.859 { 00:12:06.859 "trtype": "TCP" 00:12:06.859 } 00:12:06.859 ] 00:12:06.859 } 00:12:06.859 ] 00:12:06.859 }' 00:12:06.859 02:17:10 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:12:06.859 02:17:10 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:06.859 02:17:10 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:06.859 02:17:10 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:06.859 02:17:10 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:12:06.859 02:17:10 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:12:06.859 02:17:10 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:06.859 02:17:10 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:06.859 02:17:10 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:07.117 02:17:10 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:12:07.117 02:17:10 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:12:07.117 02:17:10 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:12:07.117 02:17:10 -- target/rpc.sh@123 -- # nvmftestfini 00:12:07.117 02:17:10 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:07.117 02:17:10 -- nvmf/common.sh@116 -- # sync 00:12:07.117 02:17:10 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:07.117 02:17:10 -- nvmf/common.sh@119 -- # set +e 00:12:07.117 02:17:10 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:07.117 02:17:10 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:07.117 rmmod nvme_tcp 00:12:07.117 rmmod nvme_fabrics 00:12:07.117 rmmod nvme_keyring 00:12:07.117 02:17:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:07.117 02:17:10 -- nvmf/common.sh@123 -- # set -e 00:12:07.117 02:17:10 -- nvmf/common.sh@124 -- # return 0 00:12:07.117 02:17:10 -- nvmf/common.sh@477 -- # '[' -n 62953 ']' 00:12:07.117 02:17:10 -- nvmf/common.sh@478 -- # killprocess 62953 00:12:07.117 02:17:10 -- common/autotest_common.sh@936 -- # '[' -z 62953 ']' 00:12:07.117 02:17:10 -- common/autotest_common.sh@940 -- # kill -0 62953 00:12:07.117 02:17:10 -- common/autotest_common.sh@941 -- # uname 00:12:07.117 02:17:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:07.117 02:17:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 62953 00:12:07.117 02:17:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:07.117 02:17:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:07.117 02:17:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 62953' 00:12:07.117 killing process with pid 62953 00:12:07.117 02:17:10 -- common/autotest_common.sh@955 -- # kill 62953 00:12:07.117 02:17:10 -- common/autotest_common.sh@960 -- # wait 62953 00:12:07.376 02:17:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:07.376 02:17:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:07.376 02:17:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:07.376 02:17:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:07.376 02:17:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:07.376 02:17:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:07.376 02:17:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:07.376 02:17:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:09.913 02:17:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:09.913 00:12:09.913 real 0m26.136s 00:12:09.913 user 1m25.307s 00:12:09.913 sys 0m4.288s 00:12:09.913 02:17:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:09.913 02:17:12 -- common/autotest_common.sh@10 -- # set +x 00:12:09.913 ************************************ 00:12:09.913 END TEST nvmf_rpc 00:12:09.913 ************************************ 00:12:09.913 02:17:13 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:09.913 02:17:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:09.913 02:17:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:09.913 02:17:13 -- common/autotest_common.sh@10 -- # set +x 00:12:09.913 ************************************ 00:12:09.913 START TEST nvmf_invalid 00:12:09.913 ************************************ 00:12:09.913 02:17:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:09.913 * Looking for test storage... 00:12:09.913 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:09.913 02:17:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:09.913 02:17:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:09.913 02:17:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:09.913 02:17:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:09.913 02:17:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:09.913 02:17:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:09.913 02:17:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:09.913 02:17:13 -- scripts/common.sh@335 -- # IFS=.-: 00:12:09.913 02:17:13 -- scripts/common.sh@335 -- # read -ra ver1 00:12:09.913 02:17:13 -- scripts/common.sh@336 -- # IFS=.-: 00:12:09.913 02:17:13 -- scripts/common.sh@336 -- # read -ra ver2 00:12:09.913 02:17:13 -- scripts/common.sh@337 -- # local 'op=<' 00:12:09.913 02:17:13 -- scripts/common.sh@339 -- # ver1_l=2 00:12:09.913 02:17:13 -- scripts/common.sh@340 -- # ver2_l=1 00:12:09.913 02:17:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:09.913 02:17:13 -- scripts/common.sh@343 -- # case "$op" in 00:12:09.913 02:17:13 -- scripts/common.sh@344 -- # : 1 00:12:09.913 02:17:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:09.913 02:17:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:09.913 02:17:13 -- scripts/common.sh@364 -- # decimal 1 00:12:09.913 02:17:13 -- scripts/common.sh@352 -- # local d=1 00:12:09.913 02:17:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:09.913 02:17:13 -- scripts/common.sh@354 -- # echo 1 00:12:09.913 02:17:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:09.913 02:17:13 -- scripts/common.sh@365 -- # decimal 2 00:12:09.913 02:17:13 -- scripts/common.sh@352 -- # local d=2 00:12:09.913 02:17:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:09.913 02:17:13 -- scripts/common.sh@354 -- # echo 2 00:12:09.913 02:17:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:09.913 02:17:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:09.913 02:17:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:09.913 02:17:13 -- scripts/common.sh@367 -- # return 0 00:12:09.913 02:17:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:09.913 02:17:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:09.913 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:09.913 --rc genhtml_branch_coverage=1 00:12:09.913 --rc genhtml_function_coverage=1 00:12:09.913 --rc genhtml_legend=1 00:12:09.913 --rc geninfo_all_blocks=1 00:12:09.913 --rc geninfo_unexecuted_blocks=1 00:12:09.913 00:12:09.913 ' 00:12:09.913 02:17:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:09.913 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:09.913 --rc genhtml_branch_coverage=1 00:12:09.913 --rc genhtml_function_coverage=1 00:12:09.913 --rc genhtml_legend=1 00:12:09.913 --rc geninfo_all_blocks=1 00:12:09.913 --rc geninfo_unexecuted_blocks=1 00:12:09.913 00:12:09.913 ' 00:12:09.913 02:17:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:09.913 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:09.913 --rc genhtml_branch_coverage=1 00:12:09.913 --rc genhtml_function_coverage=1 00:12:09.913 --rc genhtml_legend=1 00:12:09.913 --rc geninfo_all_blocks=1 00:12:09.913 --rc geninfo_unexecuted_blocks=1 00:12:09.913 00:12:09.913 ' 00:12:09.913 02:17:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:09.913 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:09.913 --rc genhtml_branch_coverage=1 00:12:09.913 --rc genhtml_function_coverage=1 00:12:09.913 --rc genhtml_legend=1 00:12:09.913 --rc geninfo_all_blocks=1 00:12:09.913 --rc geninfo_unexecuted_blocks=1 00:12:09.913 00:12:09.913 ' 00:12:09.913 02:17:13 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:09.913 02:17:13 -- nvmf/common.sh@7 -- # uname -s 00:12:09.913 02:17:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:09.913 02:17:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:09.913 02:17:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:09.913 02:17:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:09.913 02:17:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:09.913 02:17:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:09.913 02:17:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:09.913 02:17:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:09.913 02:17:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:09.913 02:17:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:09.913 02:17:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:09.913 02:17:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:09.913 02:17:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:09.913 02:17:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:09.913 02:17:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:09.913 02:17:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:09.913 02:17:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:09.913 02:17:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:09.913 02:17:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:09.913 02:17:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:09.913 02:17:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:09.913 02:17:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:09.913 02:17:13 -- paths/export.sh@5 -- # export PATH 00:12:09.913 02:17:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:09.913 02:17:13 -- nvmf/common.sh@46 -- # : 0 00:12:09.913 02:17:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:09.913 02:17:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:09.913 02:17:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:09.913 02:17:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:09.913 02:17:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:09.913 02:17:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:09.913 02:17:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:09.913 02:17:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:09.913 02:17:13 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:09.913 02:17:13 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:09.913 02:17:13 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:12:09.913 02:17:13 -- target/invalid.sh@14 -- # target=foobar 00:12:09.913 02:17:13 -- target/invalid.sh@16 -- # RANDOM=0 00:12:09.913 02:17:13 -- target/invalid.sh@34 -- # nvmftestinit 00:12:09.913 02:17:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:09.913 02:17:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:09.913 02:17:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:09.913 02:17:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:09.913 02:17:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:09.913 02:17:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:09.913 02:17:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:09.913 02:17:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:09.913 02:17:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:09.913 02:17:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:09.913 02:17:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:09.913 02:17:13 -- common/autotest_common.sh@10 -- # set +x 00:12:11.821 02:17:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:11.821 02:17:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:11.821 02:17:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:11.821 02:17:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:11.821 02:17:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:11.821 02:17:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:11.821 02:17:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:11.821 02:17:15 -- nvmf/common.sh@294 -- # net_devs=() 00:12:11.821 02:17:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:11.821 02:17:15 -- nvmf/common.sh@295 -- # e810=() 00:12:11.821 02:17:15 -- nvmf/common.sh@295 -- # local -ga e810 00:12:11.821 02:17:15 -- nvmf/common.sh@296 -- # x722=() 00:12:11.821 02:17:15 -- nvmf/common.sh@296 -- # local -ga x722 00:12:11.821 02:17:15 -- nvmf/common.sh@297 -- # mlx=() 00:12:11.821 02:17:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:11.821 02:17:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:11.821 02:17:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:11.821 02:17:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:11.821 02:17:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:11.821 02:17:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:11.821 02:17:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:11.821 02:17:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:11.821 02:17:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:11.821 02:17:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:11.821 02:17:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:11.821 02:17:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:11.821 02:17:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:11.821 02:17:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:11.821 02:17:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:11.821 02:17:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:11.821 02:17:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:11.821 02:17:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:11.821 02:17:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:11.821 02:17:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:11.821 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:11.821 02:17:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:11.821 02:17:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:11.821 02:17:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:11.821 02:17:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:11.821 02:17:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:11.821 02:17:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:11.821 02:17:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:11.821 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:11.821 02:17:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:11.821 02:17:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:11.821 02:17:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:11.821 02:17:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:11.821 02:17:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:11.821 02:17:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:11.821 02:17:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:11.821 02:17:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:11.821 02:17:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:11.821 02:17:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:11.821 02:17:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:11.821 02:17:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:11.821 02:17:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:11.821 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:11.821 02:17:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:11.821 02:17:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:11.821 02:17:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:11.821 02:17:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:11.821 02:17:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:11.821 02:17:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:11.821 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:11.821 02:17:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:11.821 02:17:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:11.821 02:17:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:11.821 02:17:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:11.821 02:17:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:11.821 02:17:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:11.821 02:17:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:11.821 02:17:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:11.821 02:17:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:11.821 02:17:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:11.821 02:17:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:11.821 02:17:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:11.821 02:17:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:11.821 02:17:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:11.821 02:17:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:11.821 02:17:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:11.821 02:17:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:11.821 02:17:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:11.821 02:17:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:11.821 02:17:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:11.821 02:17:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:11.821 02:17:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:11.821 02:17:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:11.821 02:17:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:11.821 02:17:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:11.821 02:17:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:11.821 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:11.821 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.293 ms 00:12:11.821 00:12:11.821 --- 10.0.0.2 ping statistics --- 00:12:11.821 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:11.821 rtt min/avg/max/mdev = 0.293/0.293/0.293/0.000 ms 00:12:11.821 02:17:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:11.821 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:11.821 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.085 ms 00:12:11.821 00:12:11.821 --- 10.0.0.1 ping statistics --- 00:12:11.821 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:11.821 rtt min/avg/max/mdev = 0.085/0.085/0.085/0.000 ms 00:12:11.821 02:17:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:11.821 02:17:15 -- nvmf/common.sh@410 -- # return 0 00:12:11.821 02:17:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:11.821 02:17:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:11.821 02:17:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:11.821 02:17:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:11.821 02:17:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:11.821 02:17:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:11.821 02:17:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:11.821 02:17:15 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:12:11.821 02:17:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:11.821 02:17:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:11.821 02:17:15 -- common/autotest_common.sh@10 -- # set +x 00:12:12.082 02:17:15 -- nvmf/common.sh@469 -- # nvmfpid=67669 00:12:12.082 02:17:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:12.082 02:17:15 -- nvmf/common.sh@470 -- # waitforlisten 67669 00:12:12.082 02:17:15 -- common/autotest_common.sh@829 -- # '[' -z 67669 ']' 00:12:12.082 02:17:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:12.082 02:17:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:12.082 02:17:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:12.082 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:12.082 02:17:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:12.082 02:17:15 -- common/autotest_common.sh@10 -- # set +x 00:12:12.082 [2024-11-29 02:17:15.547389] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:12.082 [2024-11-29 02:17:15.547497] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:12.082 EAL: No free 2048 kB hugepages reported on node 1 00:12:12.082 [2024-11-29 02:17:15.612951] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:12.082 [2024-11-29 02:17:15.722641] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:12.082 [2024-11-29 02:17:15.722789] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:12.082 [2024-11-29 02:17:15.722806] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:12.082 [2024-11-29 02:17:15.722817] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:12.082 [2024-11-29 02:17:15.722879] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:12.082 [2024-11-29 02:17:15.722943] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:12.082 [2024-11-29 02:17:15.723009] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:12.082 [2024-11-29 02:17:15.723011] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:13.021 02:17:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:13.021 02:17:16 -- common/autotest_common.sh@862 -- # return 0 00:12:13.021 02:17:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:13.021 02:17:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:13.021 02:17:16 -- common/autotest_common.sh@10 -- # set +x 00:12:13.021 02:17:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:13.021 02:17:16 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:13.021 02:17:16 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode24668 00:12:13.279 [2024-11-29 02:17:16.779759] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:12:13.279 02:17:16 -- target/invalid.sh@40 -- # out='request: 00:12:13.279 { 00:12:13.279 "nqn": "nqn.2016-06.io.spdk:cnode24668", 00:12:13.279 "tgt_name": "foobar", 00:12:13.279 "method": "nvmf_create_subsystem", 00:12:13.279 "req_id": 1 00:12:13.279 } 00:12:13.279 Got JSON-RPC error response 00:12:13.279 response: 00:12:13.279 { 00:12:13.279 "code": -32603, 00:12:13.279 "message": "Unable to find target foobar" 00:12:13.279 }' 00:12:13.279 02:17:16 -- target/invalid.sh@41 -- # [[ request: 00:12:13.279 { 00:12:13.279 "nqn": "nqn.2016-06.io.spdk:cnode24668", 00:12:13.279 "tgt_name": "foobar", 00:12:13.279 "method": "nvmf_create_subsystem", 00:12:13.279 "req_id": 1 00:12:13.279 } 00:12:13.279 Got JSON-RPC error response 00:12:13.279 response: 00:12:13.279 { 00:12:13.279 "code": -32603, 00:12:13.279 "message": "Unable to find target foobar" 00:12:13.279 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:12:13.279 02:17:16 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:12:13.279 02:17:16 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode24256 00:12:13.536 [2024-11-29 02:17:17.024561] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode24256: invalid serial number 'SPDKISFASTANDAWESOME' 00:12:13.536 02:17:17 -- target/invalid.sh@45 -- # out='request: 00:12:13.536 { 00:12:13.536 "nqn": "nqn.2016-06.io.spdk:cnode24256", 00:12:13.536 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:13.536 "method": "nvmf_create_subsystem", 00:12:13.536 "req_id": 1 00:12:13.536 } 00:12:13.536 Got JSON-RPC error response 00:12:13.536 response: 00:12:13.536 { 00:12:13.536 "code": -32602, 00:12:13.536 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:13.536 }' 00:12:13.536 02:17:17 -- target/invalid.sh@46 -- # [[ request: 00:12:13.536 { 00:12:13.536 "nqn": "nqn.2016-06.io.spdk:cnode24256", 00:12:13.536 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:13.536 "method": "nvmf_create_subsystem", 00:12:13.536 "req_id": 1 00:12:13.536 } 00:12:13.536 Got JSON-RPC error response 00:12:13.536 response: 00:12:13.536 { 00:12:13.536 "code": -32602, 00:12:13.536 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:13.536 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:13.536 02:17:17 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:12:13.536 02:17:17 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode13836 00:12:13.842 [2024-11-29 02:17:17.277405] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode13836: invalid model number 'SPDK_Controller' 00:12:13.842 02:17:17 -- target/invalid.sh@50 -- # out='request: 00:12:13.842 { 00:12:13.842 "nqn": "nqn.2016-06.io.spdk:cnode13836", 00:12:13.842 "model_number": "SPDK_Controller\u001f", 00:12:13.842 "method": "nvmf_create_subsystem", 00:12:13.842 "req_id": 1 00:12:13.842 } 00:12:13.842 Got JSON-RPC error response 00:12:13.842 response: 00:12:13.842 { 00:12:13.842 "code": -32602, 00:12:13.842 "message": "Invalid MN SPDK_Controller\u001f" 00:12:13.842 }' 00:12:13.842 02:17:17 -- target/invalid.sh@51 -- # [[ request: 00:12:13.842 { 00:12:13.842 "nqn": "nqn.2016-06.io.spdk:cnode13836", 00:12:13.842 "model_number": "SPDK_Controller\u001f", 00:12:13.842 "method": "nvmf_create_subsystem", 00:12:13.842 "req_id": 1 00:12:13.842 } 00:12:13.842 Got JSON-RPC error response 00:12:13.842 response: 00:12:13.842 { 00:12:13.842 "code": -32602, 00:12:13.842 "message": "Invalid MN SPDK_Controller\u001f" 00:12:13.842 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:13.842 02:17:17 -- target/invalid.sh@54 -- # gen_random_s 21 00:12:13.842 02:17:17 -- target/invalid.sh@19 -- # local length=21 ll 00:12:13.842 02:17:17 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:13.842 02:17:17 -- target/invalid.sh@21 -- # local chars 00:12:13.842 02:17:17 -- target/invalid.sh@22 -- # local string 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # printf %x 95 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # string+=_ 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # printf %x 57 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x39' 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # string+=9 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # printf %x 89 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x59' 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # string+=Y 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # printf %x 109 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # string+=m 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # printf %x 83 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x53' 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # string+=S 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # printf %x 127 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # string+=$'\177' 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # printf %x 46 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # string+=. 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # printf %x 101 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x65' 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # string+=e 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # printf %x 39 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x27' 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # string+=\' 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # printf %x 127 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # string+=$'\177' 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # printf %x 37 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x25' 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # string+=% 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # printf %x 78 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # string+=N 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # printf %x 63 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # string+='?' 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # printf %x 34 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x22' 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # string+='"' 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # printf %x 33 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x21' 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # string+='!' 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # printf %x 112 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x70' 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # string+=p 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # printf %x 113 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x71' 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # string+=q 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.842 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # printf %x 56 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x38' 00:12:13.842 02:17:17 -- target/invalid.sh@25 -- # string+=8 00:12:13.843 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.843 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.843 02:17:17 -- target/invalid.sh@25 -- # printf %x 58 00:12:13.843 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:12:13.843 02:17:17 -- target/invalid.sh@25 -- # string+=: 00:12:13.843 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.843 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.843 02:17:17 -- target/invalid.sh@25 -- # printf %x 109 00:12:13.843 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:12:13.843 02:17:17 -- target/invalid.sh@25 -- # string+=m 00:12:13.843 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.843 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.843 02:17:17 -- target/invalid.sh@25 -- # printf %x 66 00:12:13.843 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x42' 00:12:13.843 02:17:17 -- target/invalid.sh@25 -- # string+=B 00:12:13.843 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.843 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.843 02:17:17 -- target/invalid.sh@28 -- # [[ _ == \- ]] 00:12:13.843 02:17:17 -- target/invalid.sh@31 -- # echo '_9YmS.e'\''%N?"!pq8:mB' 00:12:13.843 02:17:17 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s '_9YmS.e'\''%N?"!pq8:mB' nqn.2016-06.io.spdk:cnode3170 00:12:14.136 [2024-11-29 02:17:17.602454] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode3170: invalid serial number '_9YmS.e'%N?"!pq8:mB' 00:12:14.136 02:17:17 -- target/invalid.sh@54 -- # out='request: 00:12:14.136 { 00:12:14.136 "nqn": "nqn.2016-06.io.spdk:cnode3170", 00:12:14.136 "serial_number": "_9YmS\u007f.e'\''\u007f%N?\"!pq8:mB", 00:12:14.136 "method": "nvmf_create_subsystem", 00:12:14.136 "req_id": 1 00:12:14.136 } 00:12:14.136 Got JSON-RPC error response 00:12:14.136 response: 00:12:14.136 { 00:12:14.136 "code": -32602, 00:12:14.136 "message": "Invalid SN _9YmS\u007f.e'\''\u007f%N?\"!pq8:mB" 00:12:14.136 }' 00:12:14.136 02:17:17 -- target/invalid.sh@55 -- # [[ request: 00:12:14.136 { 00:12:14.136 "nqn": "nqn.2016-06.io.spdk:cnode3170", 00:12:14.136 "serial_number": "_9YmS\u007f.e'\u007f%N?\"!pq8:mB", 00:12:14.136 "method": "nvmf_create_subsystem", 00:12:14.136 "req_id": 1 00:12:14.136 } 00:12:14.136 Got JSON-RPC error response 00:12:14.136 response: 00:12:14.136 { 00:12:14.136 "code": -32602, 00:12:14.136 "message": "Invalid SN _9YmS\u007f.e'\u007f%N?\"!pq8:mB" 00:12:14.136 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:14.136 02:17:17 -- target/invalid.sh@58 -- # gen_random_s 41 00:12:14.136 02:17:17 -- target/invalid.sh@19 -- # local length=41 ll 00:12:14.136 02:17:17 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:14.136 02:17:17 -- target/invalid.sh@21 -- # local chars 00:12:14.136 02:17:17 -- target/invalid.sh@22 -- # local string 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # printf %x 70 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x46' 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # string+=F 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # printf %x 102 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x66' 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # string+=f 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # printf %x 34 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x22' 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # string+='"' 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # printf %x 109 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # string+=m 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # printf %x 53 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x35' 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # string+=5 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # printf %x 106 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # string+=j 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # printf %x 111 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # string+=o 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # printf %x 34 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x22' 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # string+='"' 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # printf %x 34 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x22' 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # string+='"' 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # printf %x 118 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x76' 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # string+=v 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # printf %x 96 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x60' 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # string+='`' 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # printf %x 114 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x72' 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # string+=r 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # printf %x 47 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # string+=/ 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # printf %x 35 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x23' 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # string+='#' 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.136 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # printf %x 106 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:12:14.136 02:17:17 -- target/invalid.sh@25 -- # string+=j 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # printf %x 116 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x74' 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # string+=t 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # printf %x 39 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x27' 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # string+=\' 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # printf %x 85 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x55' 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # string+=U 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # printf %x 77 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # string+=M 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # printf %x 62 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # string+='>' 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # printf %x 82 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x52' 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # string+=R 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # printf %x 117 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x75' 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # string+=u 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # printf %x 32 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x20' 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # string+=' ' 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # printf %x 88 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x58' 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # string+=X 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # printf %x 83 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x53' 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # string+=S 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # printf %x 108 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # string+=l 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # printf %x 67 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x43' 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # string+=C 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # printf %x 103 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x67' 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # string+=g 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # printf %x 127 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # string+=$'\177' 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # printf %x 96 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x60' 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # string+='`' 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # printf %x 37 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x25' 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # string+=% 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # printf %x 93 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # string+=']' 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # printf %x 122 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # string+=z 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # printf %x 85 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x55' 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # string+=U 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # printf %x 108 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # string+=l 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # printf %x 123 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # string+='{' 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # printf %x 59 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # string+=';' 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # printf %x 114 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x72' 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # string+=r 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # printf %x 41 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x29' 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # string+=')' 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # printf %x 79 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # string+=O 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # printf %x 33 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # echo -e '\x21' 00:12:14.137 02:17:17 -- target/invalid.sh@25 -- # string+='!' 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.137 02:17:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.137 02:17:17 -- target/invalid.sh@28 -- # [[ F == \- ]] 00:12:14.137 02:17:17 -- target/invalid.sh@31 -- # echo 'Ff"m5jo""v`r/#jt'\''UM>Ru XSlCg`%]zUl{;r)O!' 00:12:14.137 02:17:17 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'Ff"m5jo""v`r/#jt'\''UM>Ru XSlCg`%]zUl{;r)O!' nqn.2016-06.io.spdk:cnode16905 00:12:14.413 [2024-11-29 02:17:17.975647] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode16905: invalid model number 'Ff"m5jo""v`r/#jt'UM>Ru XSlCg`%]zUl{;r)O!' 00:12:14.413 02:17:17 -- target/invalid.sh@58 -- # out='request: 00:12:14.413 { 00:12:14.413 "nqn": "nqn.2016-06.io.spdk:cnode16905", 00:12:14.413 "model_number": "Ff\"m5jo\"\"v`r/#jt'\''UM>Ru XSlCg\u007f`%]zUl{;r)O!", 00:12:14.413 "method": "nvmf_create_subsystem", 00:12:14.413 "req_id": 1 00:12:14.413 } 00:12:14.413 Got JSON-RPC error response 00:12:14.413 response: 00:12:14.413 { 00:12:14.413 "code": -32602, 00:12:14.413 "message": "Invalid MN Ff\"m5jo\"\"v`r/#jt'\''UM>Ru XSlCg\u007f`%]zUl{;r)O!" 00:12:14.413 }' 00:12:14.413 02:17:17 -- target/invalid.sh@59 -- # [[ request: 00:12:14.413 { 00:12:14.413 "nqn": "nqn.2016-06.io.spdk:cnode16905", 00:12:14.413 "model_number": "Ff\"m5jo\"\"v`r/#jt'UM>Ru XSlCg\u007f`%]zUl{;r)O!", 00:12:14.413 "method": "nvmf_create_subsystem", 00:12:14.413 "req_id": 1 00:12:14.413 } 00:12:14.413 Got JSON-RPC error response 00:12:14.413 response: 00:12:14.413 { 00:12:14.413 "code": -32602, 00:12:14.413 "message": "Invalid MN Ff\"m5jo\"\"v`r/#jt'UM>Ru XSlCg\u007f`%]zUl{;r)O!" 00:12:14.413 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:14.413 02:17:17 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:12:14.671 [2024-11-29 02:17:18.224576] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:14.671 02:17:18 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:12:14.929 02:17:18 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:12:14.929 02:17:18 -- target/invalid.sh@67 -- # echo '' 00:12:14.929 02:17:18 -- target/invalid.sh@67 -- # head -n 1 00:12:14.929 02:17:18 -- target/invalid.sh@67 -- # IP= 00:12:14.929 02:17:18 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:12:15.187 [2024-11-29 02:17:18.734278] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:12:15.187 02:17:18 -- target/invalid.sh@69 -- # out='request: 00:12:15.187 { 00:12:15.187 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:15.187 "listen_address": { 00:12:15.187 "trtype": "tcp", 00:12:15.187 "traddr": "", 00:12:15.187 "trsvcid": "4421" 00:12:15.187 }, 00:12:15.187 "method": "nvmf_subsystem_remove_listener", 00:12:15.187 "req_id": 1 00:12:15.187 } 00:12:15.187 Got JSON-RPC error response 00:12:15.187 response: 00:12:15.187 { 00:12:15.187 "code": -32602, 00:12:15.187 "message": "Invalid parameters" 00:12:15.187 }' 00:12:15.187 02:17:18 -- target/invalid.sh@70 -- # [[ request: 00:12:15.187 { 00:12:15.187 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:15.187 "listen_address": { 00:12:15.187 "trtype": "tcp", 00:12:15.187 "traddr": "", 00:12:15.187 "trsvcid": "4421" 00:12:15.187 }, 00:12:15.187 "method": "nvmf_subsystem_remove_listener", 00:12:15.187 "req_id": 1 00:12:15.187 } 00:12:15.187 Got JSON-RPC error response 00:12:15.187 response: 00:12:15.187 { 00:12:15.187 "code": -32602, 00:12:15.187 "message": "Invalid parameters" 00:12:15.187 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:12:15.187 02:17:18 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11818 -i 0 00:12:15.446 [2024-11-29 02:17:18.991105] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode11818: invalid cntlid range [0-65519] 00:12:15.446 02:17:19 -- target/invalid.sh@73 -- # out='request: 00:12:15.446 { 00:12:15.446 "nqn": "nqn.2016-06.io.spdk:cnode11818", 00:12:15.446 "min_cntlid": 0, 00:12:15.446 "method": "nvmf_create_subsystem", 00:12:15.446 "req_id": 1 00:12:15.446 } 00:12:15.446 Got JSON-RPC error response 00:12:15.446 response: 00:12:15.446 { 00:12:15.446 "code": -32602, 00:12:15.446 "message": "Invalid cntlid range [0-65519]" 00:12:15.446 }' 00:12:15.446 02:17:19 -- target/invalid.sh@74 -- # [[ request: 00:12:15.446 { 00:12:15.446 "nqn": "nqn.2016-06.io.spdk:cnode11818", 00:12:15.446 "min_cntlid": 0, 00:12:15.446 "method": "nvmf_create_subsystem", 00:12:15.446 "req_id": 1 00:12:15.446 } 00:12:15.446 Got JSON-RPC error response 00:12:15.446 response: 00:12:15.446 { 00:12:15.446 "code": -32602, 00:12:15.446 "message": "Invalid cntlid range [0-65519]" 00:12:15.446 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:15.446 02:17:19 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode18388 -i 65520 00:12:15.704 [2024-11-29 02:17:19.243930] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode18388: invalid cntlid range [65520-65519] 00:12:15.704 02:17:19 -- target/invalid.sh@75 -- # out='request: 00:12:15.704 { 00:12:15.704 "nqn": "nqn.2016-06.io.spdk:cnode18388", 00:12:15.704 "min_cntlid": 65520, 00:12:15.704 "method": "nvmf_create_subsystem", 00:12:15.704 "req_id": 1 00:12:15.704 } 00:12:15.704 Got JSON-RPC error response 00:12:15.704 response: 00:12:15.704 { 00:12:15.704 "code": -32602, 00:12:15.704 "message": "Invalid cntlid range [65520-65519]" 00:12:15.704 }' 00:12:15.704 02:17:19 -- target/invalid.sh@76 -- # [[ request: 00:12:15.704 { 00:12:15.704 "nqn": "nqn.2016-06.io.spdk:cnode18388", 00:12:15.704 "min_cntlid": 65520, 00:12:15.704 "method": "nvmf_create_subsystem", 00:12:15.704 "req_id": 1 00:12:15.704 } 00:12:15.704 Got JSON-RPC error response 00:12:15.704 response: 00:12:15.704 { 00:12:15.704 "code": -32602, 00:12:15.704 "message": "Invalid cntlid range [65520-65519]" 00:12:15.704 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:15.704 02:17:19 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode27874 -I 0 00:12:15.962 [2024-11-29 02:17:19.488744] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode27874: invalid cntlid range [1-0] 00:12:15.962 02:17:19 -- target/invalid.sh@77 -- # out='request: 00:12:15.962 { 00:12:15.962 "nqn": "nqn.2016-06.io.spdk:cnode27874", 00:12:15.962 "max_cntlid": 0, 00:12:15.962 "method": "nvmf_create_subsystem", 00:12:15.962 "req_id": 1 00:12:15.962 } 00:12:15.962 Got JSON-RPC error response 00:12:15.962 response: 00:12:15.962 { 00:12:15.962 "code": -32602, 00:12:15.962 "message": "Invalid cntlid range [1-0]" 00:12:15.962 }' 00:12:15.962 02:17:19 -- target/invalid.sh@78 -- # [[ request: 00:12:15.962 { 00:12:15.962 "nqn": "nqn.2016-06.io.spdk:cnode27874", 00:12:15.962 "max_cntlid": 0, 00:12:15.962 "method": "nvmf_create_subsystem", 00:12:15.962 "req_id": 1 00:12:15.962 } 00:12:15.962 Got JSON-RPC error response 00:12:15.962 response: 00:12:15.962 { 00:12:15.962 "code": -32602, 00:12:15.962 "message": "Invalid cntlid range [1-0]" 00:12:15.962 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:15.962 02:17:19 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3937 -I 65520 00:12:16.220 [2024-11-29 02:17:19.753697] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode3937: invalid cntlid range [1-65520] 00:12:16.220 02:17:19 -- target/invalid.sh@79 -- # out='request: 00:12:16.220 { 00:12:16.220 "nqn": "nqn.2016-06.io.spdk:cnode3937", 00:12:16.220 "max_cntlid": 65520, 00:12:16.220 "method": "nvmf_create_subsystem", 00:12:16.220 "req_id": 1 00:12:16.220 } 00:12:16.220 Got JSON-RPC error response 00:12:16.220 response: 00:12:16.220 { 00:12:16.220 "code": -32602, 00:12:16.220 "message": "Invalid cntlid range [1-65520]" 00:12:16.220 }' 00:12:16.220 02:17:19 -- target/invalid.sh@80 -- # [[ request: 00:12:16.220 { 00:12:16.220 "nqn": "nqn.2016-06.io.spdk:cnode3937", 00:12:16.220 "max_cntlid": 65520, 00:12:16.220 "method": "nvmf_create_subsystem", 00:12:16.220 "req_id": 1 00:12:16.220 } 00:12:16.220 Got JSON-RPC error response 00:12:16.220 response: 00:12:16.220 { 00:12:16.220 "code": -32602, 00:12:16.220 "message": "Invalid cntlid range [1-65520]" 00:12:16.220 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:16.220 02:17:19 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8849 -i 6 -I 5 00:12:16.478 [2024-11-29 02:17:20.002542] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode8849: invalid cntlid range [6-5] 00:12:16.478 02:17:20 -- target/invalid.sh@83 -- # out='request: 00:12:16.478 { 00:12:16.478 "nqn": "nqn.2016-06.io.spdk:cnode8849", 00:12:16.478 "min_cntlid": 6, 00:12:16.478 "max_cntlid": 5, 00:12:16.478 "method": "nvmf_create_subsystem", 00:12:16.478 "req_id": 1 00:12:16.478 } 00:12:16.478 Got JSON-RPC error response 00:12:16.478 response: 00:12:16.478 { 00:12:16.478 "code": -32602, 00:12:16.478 "message": "Invalid cntlid range [6-5]" 00:12:16.478 }' 00:12:16.478 02:17:20 -- target/invalid.sh@84 -- # [[ request: 00:12:16.478 { 00:12:16.478 "nqn": "nqn.2016-06.io.spdk:cnode8849", 00:12:16.478 "min_cntlid": 6, 00:12:16.478 "max_cntlid": 5, 00:12:16.478 "method": "nvmf_create_subsystem", 00:12:16.478 "req_id": 1 00:12:16.478 } 00:12:16.478 Got JSON-RPC error response 00:12:16.478 response: 00:12:16.478 { 00:12:16.478 "code": -32602, 00:12:16.478 "message": "Invalid cntlid range [6-5]" 00:12:16.478 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:16.478 02:17:20 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:12:16.479 02:17:20 -- target/invalid.sh@87 -- # out='request: 00:12:16.479 { 00:12:16.479 "name": "foobar", 00:12:16.479 "method": "nvmf_delete_target", 00:12:16.479 "req_id": 1 00:12:16.479 } 00:12:16.479 Got JSON-RPC error response 00:12:16.479 response: 00:12:16.479 { 00:12:16.479 "code": -32602, 00:12:16.479 "message": "The specified target doesn'\''t exist, cannot delete it." 00:12:16.479 }' 00:12:16.479 02:17:20 -- target/invalid.sh@88 -- # [[ request: 00:12:16.479 { 00:12:16.479 "name": "foobar", 00:12:16.479 "method": "nvmf_delete_target", 00:12:16.479 "req_id": 1 00:12:16.479 } 00:12:16.479 Got JSON-RPC error response 00:12:16.479 response: 00:12:16.479 { 00:12:16.479 "code": -32602, 00:12:16.479 "message": "The specified target doesn't exist, cannot delete it." 00:12:16.479 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:12:16.479 02:17:20 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:12:16.479 02:17:20 -- target/invalid.sh@91 -- # nvmftestfini 00:12:16.479 02:17:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:16.479 02:17:20 -- nvmf/common.sh@116 -- # sync 00:12:16.479 02:17:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:16.479 02:17:20 -- nvmf/common.sh@119 -- # set +e 00:12:16.479 02:17:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:16.479 02:17:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:16.479 rmmod nvme_tcp 00:12:16.737 rmmod nvme_fabrics 00:12:16.737 rmmod nvme_keyring 00:12:16.737 02:17:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:16.737 02:17:20 -- nvmf/common.sh@123 -- # set -e 00:12:16.737 02:17:20 -- nvmf/common.sh@124 -- # return 0 00:12:16.737 02:17:20 -- nvmf/common.sh@477 -- # '[' -n 67669 ']' 00:12:16.737 02:17:20 -- nvmf/common.sh@478 -- # killprocess 67669 00:12:16.738 02:17:20 -- common/autotest_common.sh@936 -- # '[' -z 67669 ']' 00:12:16.738 02:17:20 -- common/autotest_common.sh@940 -- # kill -0 67669 00:12:16.738 02:17:20 -- common/autotest_common.sh@941 -- # uname 00:12:16.738 02:17:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:16.738 02:17:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 67669 00:12:16.738 02:17:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:16.738 02:17:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:16.738 02:17:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 67669' 00:12:16.738 killing process with pid 67669 00:12:16.738 02:17:20 -- common/autotest_common.sh@955 -- # kill 67669 00:12:16.738 02:17:20 -- common/autotest_common.sh@960 -- # wait 67669 00:12:16.998 02:17:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:16.998 02:17:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:16.998 02:17:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:16.998 02:17:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:16.998 02:17:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:16.998 02:17:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:16.998 02:17:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:16.998 02:17:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:18.907 02:17:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:18.907 00:12:18.907 real 0m9.530s 00:12:18.907 user 0m22.992s 00:12:18.907 sys 0m2.485s 00:12:18.907 02:17:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:18.907 02:17:22 -- common/autotest_common.sh@10 -- # set +x 00:12:18.907 ************************************ 00:12:18.907 END TEST nvmf_invalid 00:12:18.907 ************************************ 00:12:18.907 02:17:22 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:18.907 02:17:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:18.907 02:17:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:18.907 02:17:22 -- common/autotest_common.sh@10 -- # set +x 00:12:18.907 ************************************ 00:12:18.907 START TEST nvmf_abort 00:12:18.907 ************************************ 00:12:18.907 02:17:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:19.167 * Looking for test storage... 00:12:19.167 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:19.167 02:17:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:19.167 02:17:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:19.167 02:17:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:19.167 02:17:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:19.167 02:17:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:19.167 02:17:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:19.167 02:17:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:19.167 02:17:22 -- scripts/common.sh@335 -- # IFS=.-: 00:12:19.167 02:17:22 -- scripts/common.sh@335 -- # read -ra ver1 00:12:19.167 02:17:22 -- scripts/common.sh@336 -- # IFS=.-: 00:12:19.167 02:17:22 -- scripts/common.sh@336 -- # read -ra ver2 00:12:19.167 02:17:22 -- scripts/common.sh@337 -- # local 'op=<' 00:12:19.167 02:17:22 -- scripts/common.sh@339 -- # ver1_l=2 00:12:19.167 02:17:22 -- scripts/common.sh@340 -- # ver2_l=1 00:12:19.167 02:17:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:19.167 02:17:22 -- scripts/common.sh@343 -- # case "$op" in 00:12:19.167 02:17:22 -- scripts/common.sh@344 -- # : 1 00:12:19.167 02:17:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:19.167 02:17:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:19.167 02:17:22 -- scripts/common.sh@364 -- # decimal 1 00:12:19.167 02:17:22 -- scripts/common.sh@352 -- # local d=1 00:12:19.167 02:17:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:19.167 02:17:22 -- scripts/common.sh@354 -- # echo 1 00:12:19.167 02:17:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:19.167 02:17:22 -- scripts/common.sh@365 -- # decimal 2 00:12:19.167 02:17:22 -- scripts/common.sh@352 -- # local d=2 00:12:19.167 02:17:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:19.167 02:17:22 -- scripts/common.sh@354 -- # echo 2 00:12:19.167 02:17:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:19.167 02:17:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:19.167 02:17:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:19.167 02:17:22 -- scripts/common.sh@367 -- # return 0 00:12:19.167 02:17:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:19.167 02:17:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:19.167 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:19.167 --rc genhtml_branch_coverage=1 00:12:19.167 --rc genhtml_function_coverage=1 00:12:19.167 --rc genhtml_legend=1 00:12:19.167 --rc geninfo_all_blocks=1 00:12:19.167 --rc geninfo_unexecuted_blocks=1 00:12:19.167 00:12:19.167 ' 00:12:19.167 02:17:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:19.167 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:19.167 --rc genhtml_branch_coverage=1 00:12:19.167 --rc genhtml_function_coverage=1 00:12:19.167 --rc genhtml_legend=1 00:12:19.167 --rc geninfo_all_blocks=1 00:12:19.167 --rc geninfo_unexecuted_blocks=1 00:12:19.167 00:12:19.167 ' 00:12:19.167 02:17:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:19.167 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:19.167 --rc genhtml_branch_coverage=1 00:12:19.167 --rc genhtml_function_coverage=1 00:12:19.167 --rc genhtml_legend=1 00:12:19.167 --rc geninfo_all_blocks=1 00:12:19.167 --rc geninfo_unexecuted_blocks=1 00:12:19.167 00:12:19.167 ' 00:12:19.167 02:17:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:19.167 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:19.167 --rc genhtml_branch_coverage=1 00:12:19.167 --rc genhtml_function_coverage=1 00:12:19.167 --rc genhtml_legend=1 00:12:19.167 --rc geninfo_all_blocks=1 00:12:19.167 --rc geninfo_unexecuted_blocks=1 00:12:19.167 00:12:19.167 ' 00:12:19.167 02:17:22 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:19.167 02:17:22 -- nvmf/common.sh@7 -- # uname -s 00:12:19.167 02:17:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:19.167 02:17:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:19.167 02:17:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:19.167 02:17:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:19.167 02:17:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:19.167 02:17:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:19.167 02:17:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:19.167 02:17:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:19.167 02:17:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:19.168 02:17:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:19.168 02:17:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:19.168 02:17:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:19.168 02:17:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:19.168 02:17:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:19.168 02:17:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:19.168 02:17:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:19.168 02:17:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:19.168 02:17:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:19.168 02:17:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:19.168 02:17:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:19.168 02:17:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:19.168 02:17:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:19.168 02:17:22 -- paths/export.sh@5 -- # export PATH 00:12:19.168 02:17:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:19.168 02:17:22 -- nvmf/common.sh@46 -- # : 0 00:12:19.168 02:17:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:19.168 02:17:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:19.168 02:17:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:19.168 02:17:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:19.168 02:17:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:19.168 02:17:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:19.168 02:17:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:19.168 02:17:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:19.168 02:17:22 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:19.168 02:17:22 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:12:19.168 02:17:22 -- target/abort.sh@14 -- # nvmftestinit 00:12:19.168 02:17:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:19.168 02:17:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:19.168 02:17:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:19.168 02:17:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:19.168 02:17:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:19.168 02:17:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:19.168 02:17:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:19.168 02:17:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:19.168 02:17:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:19.168 02:17:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:19.168 02:17:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:19.168 02:17:22 -- common/autotest_common.sh@10 -- # set +x 00:12:21.703 02:17:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:21.703 02:17:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:21.703 02:17:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:21.703 02:17:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:21.703 02:17:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:21.703 02:17:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:21.703 02:17:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:21.703 02:17:24 -- nvmf/common.sh@294 -- # net_devs=() 00:12:21.703 02:17:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:21.703 02:17:24 -- nvmf/common.sh@295 -- # e810=() 00:12:21.703 02:17:24 -- nvmf/common.sh@295 -- # local -ga e810 00:12:21.703 02:17:24 -- nvmf/common.sh@296 -- # x722=() 00:12:21.703 02:17:24 -- nvmf/common.sh@296 -- # local -ga x722 00:12:21.703 02:17:24 -- nvmf/common.sh@297 -- # mlx=() 00:12:21.703 02:17:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:21.703 02:17:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:21.703 02:17:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:21.703 02:17:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:21.703 02:17:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:21.703 02:17:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:21.703 02:17:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:21.703 02:17:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:21.703 02:17:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:21.703 02:17:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:21.703 02:17:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:21.703 02:17:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:21.703 02:17:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:21.703 02:17:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:21.703 02:17:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:21.703 02:17:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:21.703 02:17:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:21.703 02:17:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:21.703 02:17:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:21.703 02:17:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:21.703 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:21.703 02:17:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:21.703 02:17:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:21.703 02:17:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:21.703 02:17:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:21.703 02:17:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:21.703 02:17:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:21.703 02:17:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:21.703 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:21.703 02:17:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:21.703 02:17:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:21.703 02:17:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:21.703 02:17:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:21.703 02:17:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:21.703 02:17:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:21.703 02:17:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:21.703 02:17:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:21.703 02:17:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:21.703 02:17:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:21.703 02:17:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:21.703 02:17:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:21.703 02:17:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:21.703 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:21.703 02:17:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:21.703 02:17:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:21.703 02:17:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:21.703 02:17:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:21.703 02:17:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:21.703 02:17:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:21.703 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:21.703 02:17:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:21.703 02:17:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:21.703 02:17:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:21.703 02:17:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:21.703 02:17:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:21.703 02:17:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:21.703 02:17:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:21.703 02:17:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:21.703 02:17:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:21.703 02:17:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:21.703 02:17:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:21.703 02:17:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:21.703 02:17:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:21.703 02:17:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:21.703 02:17:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:21.703 02:17:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:21.703 02:17:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:21.703 02:17:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:21.703 02:17:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:21.703 02:17:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:21.703 02:17:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:21.703 02:17:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:21.703 02:17:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:21.703 02:17:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:21.703 02:17:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:21.703 02:17:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:21.703 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:21.703 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.284 ms 00:12:21.703 00:12:21.703 --- 10.0.0.2 ping statistics --- 00:12:21.703 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:21.703 rtt min/avg/max/mdev = 0.284/0.284/0.284/0.000 ms 00:12:21.703 02:17:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:21.703 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:21.703 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.142 ms 00:12:21.703 00:12:21.703 --- 10.0.0.1 ping statistics --- 00:12:21.703 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:21.703 rtt min/avg/max/mdev = 0.142/0.142/0.142/0.000 ms 00:12:21.703 02:17:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:21.703 02:17:25 -- nvmf/common.sh@410 -- # return 0 00:12:21.703 02:17:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:21.703 02:17:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:21.703 02:17:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:21.703 02:17:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:21.703 02:17:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:21.703 02:17:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:21.703 02:17:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:21.704 02:17:25 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:12:21.704 02:17:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:21.704 02:17:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:21.704 02:17:25 -- common/autotest_common.sh@10 -- # set +x 00:12:21.704 02:17:25 -- nvmf/common.sh@469 -- # nvmfpid=70353 00:12:21.704 02:17:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:21.704 02:17:25 -- nvmf/common.sh@470 -- # waitforlisten 70353 00:12:21.704 02:17:25 -- common/autotest_common.sh@829 -- # '[' -z 70353 ']' 00:12:21.704 02:17:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:21.704 02:17:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:21.704 02:17:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:21.704 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:21.704 02:17:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:21.704 02:17:25 -- common/autotest_common.sh@10 -- # set +x 00:12:21.704 [2024-11-29 02:17:25.090671] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:21.704 [2024-11-29 02:17:25.090763] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:21.704 EAL: No free 2048 kB hugepages reported on node 1 00:12:21.704 [2024-11-29 02:17:25.157107] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:21.704 [2024-11-29 02:17:25.265484] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:21.704 [2024-11-29 02:17:25.265627] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:21.704 [2024-11-29 02:17:25.265645] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:21.704 [2024-11-29 02:17:25.265665] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:21.704 [2024-11-29 02:17:25.265763] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:21.704 [2024-11-29 02:17:25.265819] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:21.704 [2024-11-29 02:17:25.265822] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:22.641 02:17:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:22.641 02:17:26 -- common/autotest_common.sh@862 -- # return 0 00:12:22.641 02:17:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:22.641 02:17:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:22.641 02:17:26 -- common/autotest_common.sh@10 -- # set +x 00:12:22.641 02:17:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:22.641 02:17:26 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:12:22.641 02:17:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.641 02:17:26 -- common/autotest_common.sh@10 -- # set +x 00:12:22.641 [2024-11-29 02:17:26.098022] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:22.641 02:17:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.641 02:17:26 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:12:22.641 02:17:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.641 02:17:26 -- common/autotest_common.sh@10 -- # set +x 00:12:22.641 Malloc0 00:12:22.641 02:17:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.641 02:17:26 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:22.641 02:17:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.641 02:17:26 -- common/autotest_common.sh@10 -- # set +x 00:12:22.641 Delay0 00:12:22.641 02:17:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.641 02:17:26 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:22.641 02:17:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.641 02:17:26 -- common/autotest_common.sh@10 -- # set +x 00:12:22.641 02:17:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.641 02:17:26 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:12:22.641 02:17:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.641 02:17:26 -- common/autotest_common.sh@10 -- # set +x 00:12:22.641 02:17:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.641 02:17:26 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:12:22.641 02:17:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.641 02:17:26 -- common/autotest_common.sh@10 -- # set +x 00:12:22.641 [2024-11-29 02:17:26.168007] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:22.641 02:17:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.641 02:17:26 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:22.641 02:17:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.641 02:17:26 -- common/autotest_common.sh@10 -- # set +x 00:12:22.641 02:17:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.641 02:17:26 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:12:22.641 EAL: No free 2048 kB hugepages reported on node 1 00:12:22.641 [2024-11-29 02:17:26.304553] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:12:25.179 Initializing NVMe Controllers 00:12:25.179 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:12:25.179 controller IO queue size 128 less than required 00:12:25.179 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:12:25.179 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:12:25.179 Initialization complete. Launching workers. 00:12:25.179 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 33282 00:12:25.179 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 33343, failed to submit 62 00:12:25.179 success 33282, unsuccess 61, failed 0 00:12:25.179 02:17:28 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:25.179 02:17:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.179 02:17:28 -- common/autotest_common.sh@10 -- # set +x 00:12:25.179 02:17:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.179 02:17:28 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:12:25.179 02:17:28 -- target/abort.sh@38 -- # nvmftestfini 00:12:25.179 02:17:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:25.179 02:17:28 -- nvmf/common.sh@116 -- # sync 00:12:25.179 02:17:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:25.179 02:17:28 -- nvmf/common.sh@119 -- # set +e 00:12:25.179 02:17:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:25.179 02:17:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:25.179 rmmod nvme_tcp 00:12:25.179 rmmod nvme_fabrics 00:12:25.179 rmmod nvme_keyring 00:12:25.179 02:17:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:25.179 02:17:28 -- nvmf/common.sh@123 -- # set -e 00:12:25.179 02:17:28 -- nvmf/common.sh@124 -- # return 0 00:12:25.179 02:17:28 -- nvmf/common.sh@477 -- # '[' -n 70353 ']' 00:12:25.179 02:17:28 -- nvmf/common.sh@478 -- # killprocess 70353 00:12:25.179 02:17:28 -- common/autotest_common.sh@936 -- # '[' -z 70353 ']' 00:12:25.179 02:17:28 -- common/autotest_common.sh@940 -- # kill -0 70353 00:12:25.179 02:17:28 -- common/autotest_common.sh@941 -- # uname 00:12:25.180 02:17:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:25.180 02:17:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 70353 00:12:25.180 02:17:28 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:25.180 02:17:28 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:25.180 02:17:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 70353' 00:12:25.180 killing process with pid 70353 00:12:25.180 02:17:28 -- common/autotest_common.sh@955 -- # kill 70353 00:12:25.180 02:17:28 -- common/autotest_common.sh@960 -- # wait 70353 00:12:25.180 02:17:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:25.180 02:17:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:25.180 02:17:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:25.180 02:17:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:25.180 02:17:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:25.180 02:17:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:25.180 02:17:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:25.180 02:17:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:27.090 02:17:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:27.090 00:12:27.090 real 0m8.198s 00:12:27.090 user 0m13.000s 00:12:27.090 sys 0m2.581s 00:12:27.090 02:17:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:27.090 02:17:30 -- common/autotest_common.sh@10 -- # set +x 00:12:27.090 ************************************ 00:12:27.090 END TEST nvmf_abort 00:12:27.090 ************************************ 00:12:27.350 02:17:30 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:27.350 02:17:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:27.350 02:17:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:27.350 02:17:30 -- common/autotest_common.sh@10 -- # set +x 00:12:27.350 ************************************ 00:12:27.350 START TEST nvmf_ns_hotplug_stress 00:12:27.350 ************************************ 00:12:27.350 02:17:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:27.350 * Looking for test storage... 00:12:27.350 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:27.350 02:17:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:27.350 02:17:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:27.350 02:17:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:27.350 02:17:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:27.350 02:17:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:27.350 02:17:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:27.350 02:17:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:27.350 02:17:30 -- scripts/common.sh@335 -- # IFS=.-: 00:12:27.350 02:17:30 -- scripts/common.sh@335 -- # read -ra ver1 00:12:27.350 02:17:30 -- scripts/common.sh@336 -- # IFS=.-: 00:12:27.350 02:17:30 -- scripts/common.sh@336 -- # read -ra ver2 00:12:27.350 02:17:30 -- scripts/common.sh@337 -- # local 'op=<' 00:12:27.350 02:17:30 -- scripts/common.sh@339 -- # ver1_l=2 00:12:27.350 02:17:30 -- scripts/common.sh@340 -- # ver2_l=1 00:12:27.350 02:17:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:27.350 02:17:30 -- scripts/common.sh@343 -- # case "$op" in 00:12:27.350 02:17:30 -- scripts/common.sh@344 -- # : 1 00:12:27.350 02:17:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:27.350 02:17:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:27.350 02:17:30 -- scripts/common.sh@364 -- # decimal 1 00:12:27.350 02:17:30 -- scripts/common.sh@352 -- # local d=1 00:12:27.350 02:17:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:27.350 02:17:30 -- scripts/common.sh@354 -- # echo 1 00:12:27.350 02:17:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:27.350 02:17:30 -- scripts/common.sh@365 -- # decimal 2 00:12:27.350 02:17:30 -- scripts/common.sh@352 -- # local d=2 00:12:27.350 02:17:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:27.350 02:17:30 -- scripts/common.sh@354 -- # echo 2 00:12:27.350 02:17:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:27.350 02:17:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:27.350 02:17:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:27.350 02:17:30 -- scripts/common.sh@367 -- # return 0 00:12:27.350 02:17:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:27.350 02:17:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:27.350 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:27.350 --rc genhtml_branch_coverage=1 00:12:27.350 --rc genhtml_function_coverage=1 00:12:27.350 --rc genhtml_legend=1 00:12:27.350 --rc geninfo_all_blocks=1 00:12:27.350 --rc geninfo_unexecuted_blocks=1 00:12:27.350 00:12:27.350 ' 00:12:27.350 02:17:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:27.350 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:27.350 --rc genhtml_branch_coverage=1 00:12:27.350 --rc genhtml_function_coverage=1 00:12:27.350 --rc genhtml_legend=1 00:12:27.350 --rc geninfo_all_blocks=1 00:12:27.350 --rc geninfo_unexecuted_blocks=1 00:12:27.350 00:12:27.350 ' 00:12:27.350 02:17:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:27.350 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:27.350 --rc genhtml_branch_coverage=1 00:12:27.350 --rc genhtml_function_coverage=1 00:12:27.350 --rc genhtml_legend=1 00:12:27.350 --rc geninfo_all_blocks=1 00:12:27.350 --rc geninfo_unexecuted_blocks=1 00:12:27.350 00:12:27.350 ' 00:12:27.350 02:17:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:27.350 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:27.350 --rc genhtml_branch_coverage=1 00:12:27.350 --rc genhtml_function_coverage=1 00:12:27.350 --rc genhtml_legend=1 00:12:27.350 --rc geninfo_all_blocks=1 00:12:27.350 --rc geninfo_unexecuted_blocks=1 00:12:27.350 00:12:27.350 ' 00:12:27.350 02:17:30 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:27.350 02:17:30 -- nvmf/common.sh@7 -- # uname -s 00:12:27.350 02:17:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:27.350 02:17:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:27.350 02:17:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:27.350 02:17:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:27.350 02:17:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:27.350 02:17:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:27.350 02:17:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:27.350 02:17:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:27.350 02:17:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:27.350 02:17:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:27.350 02:17:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:27.350 02:17:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:27.350 02:17:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:27.350 02:17:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:27.350 02:17:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:27.350 02:17:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:27.350 02:17:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:27.350 02:17:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:27.350 02:17:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:27.350 02:17:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:27.350 02:17:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:27.350 02:17:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:27.350 02:17:30 -- paths/export.sh@5 -- # export PATH 00:12:27.350 02:17:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:27.350 02:17:30 -- nvmf/common.sh@46 -- # : 0 00:12:27.350 02:17:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:27.350 02:17:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:27.350 02:17:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:27.350 02:17:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:27.350 02:17:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:27.350 02:17:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:27.350 02:17:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:27.350 02:17:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:27.350 02:17:30 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:27.350 02:17:30 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:12:27.350 02:17:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:27.350 02:17:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:27.350 02:17:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:27.350 02:17:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:27.350 02:17:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:27.350 02:17:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:27.350 02:17:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:27.350 02:17:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:27.351 02:17:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:27.351 02:17:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:27.351 02:17:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:27.351 02:17:30 -- common/autotest_common.sh@10 -- # set +x 00:12:29.884 02:17:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:29.884 02:17:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:29.884 02:17:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:29.884 02:17:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:29.884 02:17:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:29.884 02:17:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:29.884 02:17:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:29.884 02:17:33 -- nvmf/common.sh@294 -- # net_devs=() 00:12:29.884 02:17:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:29.884 02:17:33 -- nvmf/common.sh@295 -- # e810=() 00:12:29.884 02:17:33 -- nvmf/common.sh@295 -- # local -ga e810 00:12:29.884 02:17:33 -- nvmf/common.sh@296 -- # x722=() 00:12:29.884 02:17:33 -- nvmf/common.sh@296 -- # local -ga x722 00:12:29.884 02:17:33 -- nvmf/common.sh@297 -- # mlx=() 00:12:29.884 02:17:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:29.884 02:17:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:29.884 02:17:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:29.884 02:17:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:29.884 02:17:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:29.884 02:17:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:29.884 02:17:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:29.884 02:17:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:29.884 02:17:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:29.884 02:17:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:29.884 02:17:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:29.884 02:17:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:29.884 02:17:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:29.884 02:17:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:29.884 02:17:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:29.884 02:17:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:29.884 02:17:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:29.884 02:17:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:29.884 02:17:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:29.884 02:17:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:29.884 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:29.884 02:17:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:29.884 02:17:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:29.884 02:17:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:29.884 02:17:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:29.884 02:17:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:29.884 02:17:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:29.884 02:17:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:29.884 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:29.884 02:17:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:29.884 02:17:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:29.884 02:17:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:29.884 02:17:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:29.884 02:17:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:29.884 02:17:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:29.884 02:17:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:29.884 02:17:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:29.884 02:17:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:29.884 02:17:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:29.884 02:17:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:29.884 02:17:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:29.884 02:17:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:29.884 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:29.884 02:17:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:29.884 02:17:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:29.884 02:17:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:29.884 02:17:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:29.884 02:17:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:29.884 02:17:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:29.884 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:29.884 02:17:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:29.884 02:17:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:29.884 02:17:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:29.884 02:17:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:29.884 02:17:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:29.884 02:17:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:29.884 02:17:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:29.884 02:17:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:29.884 02:17:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:29.884 02:17:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:29.884 02:17:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:29.884 02:17:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:29.884 02:17:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:29.884 02:17:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:29.884 02:17:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:29.884 02:17:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:29.884 02:17:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:29.884 02:17:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:29.884 02:17:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:29.884 02:17:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:29.884 02:17:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:29.884 02:17:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:29.884 02:17:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:29.884 02:17:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:29.884 02:17:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:29.884 02:17:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:29.885 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:29.885 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.268 ms 00:12:29.885 00:12:29.885 --- 10.0.0.2 ping statistics --- 00:12:29.885 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:29.885 rtt min/avg/max/mdev = 0.268/0.268/0.268/0.000 ms 00:12:29.885 02:17:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:29.885 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:29.885 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.131 ms 00:12:29.885 00:12:29.885 --- 10.0.0.1 ping statistics --- 00:12:29.885 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:29.885 rtt min/avg/max/mdev = 0.131/0.131/0.131/0.000 ms 00:12:29.885 02:17:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:29.885 02:17:33 -- nvmf/common.sh@410 -- # return 0 00:12:29.885 02:17:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:29.885 02:17:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:29.885 02:17:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:29.885 02:17:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:29.885 02:17:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:29.885 02:17:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:29.885 02:17:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:29.885 02:17:33 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:12:29.885 02:17:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:29.885 02:17:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:29.885 02:17:33 -- common/autotest_common.sh@10 -- # set +x 00:12:29.885 02:17:33 -- nvmf/common.sh@469 -- # nvmfpid=72861 00:12:29.885 02:17:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:29.885 02:17:33 -- nvmf/common.sh@470 -- # waitforlisten 72861 00:12:29.885 02:17:33 -- common/autotest_common.sh@829 -- # '[' -z 72861 ']' 00:12:29.885 02:17:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:29.885 02:17:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:29.885 02:17:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:29.885 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:29.885 02:17:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:29.885 02:17:33 -- common/autotest_common.sh@10 -- # set +x 00:12:29.885 [2024-11-29 02:17:33.423914] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:29.885 [2024-11-29 02:17:33.423993] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:29.885 EAL: No free 2048 kB hugepages reported on node 1 00:12:29.885 [2024-11-29 02:17:33.498851] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:30.143 [2024-11-29 02:17:33.618859] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:30.143 [2024-11-29 02:17:33.619010] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:30.143 [2024-11-29 02:17:33.619028] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:30.143 [2024-11-29 02:17:33.619048] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:30.143 [2024-11-29 02:17:33.619105] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:30.143 [2024-11-29 02:17:33.619167] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:30.143 [2024-11-29 02:17:33.619170] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:31.079 02:17:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:31.079 02:17:34 -- common/autotest_common.sh@862 -- # return 0 00:12:31.079 02:17:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:31.079 02:17:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:31.079 02:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:31.079 02:17:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:31.079 02:17:34 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:12:31.079 02:17:34 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:12:31.079 [2024-11-29 02:17:34.695468] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:31.079 02:17:34 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:31.338 02:17:34 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:31.594 [2024-11-29 02:17:35.198462] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:31.594 02:17:35 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:31.851 02:17:35 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:12:32.109 Malloc0 00:12:32.109 02:17:35 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:32.367 Delay0 00:12:32.367 02:17:36 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:32.626 02:17:36 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:12:32.884 NULL1 00:12:32.884 02:17:36 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:12:33.142 02:17:36 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=73295 00:12:33.142 02:17:36 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:12:33.142 02:17:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:33.142 02:17:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:33.400 EAL: No free 2048 kB hugepages reported on node 1 00:12:33.400 02:17:37 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:33.658 02:17:37 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:12:33.658 02:17:37 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:12:33.915 true 00:12:33.915 02:17:37 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:33.915 02:17:37 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:34.172 02:17:37 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:34.429 02:17:38 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:12:34.429 02:17:38 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:12:34.685 true 00:12:34.685 02:17:38 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:34.685 02:17:38 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:34.941 02:17:38 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:35.198 02:17:38 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:12:35.198 02:17:38 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:12:35.455 true 00:12:35.455 02:17:39 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:35.455 02:17:39 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:36.823 Read completed with error (sct=0, sc=11) 00:12:36.823 02:17:40 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:36.823 02:17:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:12:36.823 02:17:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:12:37.079 true 00:12:37.079 02:17:40 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:37.079 02:17:40 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:37.336 02:17:40 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:37.593 02:17:41 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:12:37.593 02:17:41 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:12:37.850 true 00:12:37.850 02:17:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:37.850 02:17:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:38.107 02:17:41 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:38.365 02:17:41 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:12:38.365 02:17:41 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:12:38.622 true 00:12:38.622 02:17:42 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:38.622 02:17:42 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:39.554 02:17:43 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:39.554 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:39.812 02:17:43 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:12:39.812 02:17:43 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:12:40.069 true 00:12:40.069 02:17:43 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:40.069 02:17:43 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:40.325 02:17:43 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:40.582 02:17:44 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:12:40.582 02:17:44 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:12:40.840 true 00:12:40.840 02:17:44 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:40.840 02:17:44 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:41.791 02:17:45 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:41.791 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:42.056 02:17:45 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:12:42.056 02:17:45 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:12:42.313 true 00:12:42.313 02:17:45 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:42.313 02:17:45 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:42.571 02:17:46 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:42.828 02:17:46 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:12:42.828 02:17:46 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:12:43.086 true 00:12:43.086 02:17:46 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:43.086 02:17:46 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:44.019 02:17:47 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:44.019 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:44.019 02:17:47 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:12:44.020 02:17:47 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:12:44.277 true 00:12:44.277 02:17:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:44.277 02:17:47 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:44.535 02:17:48 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:44.792 02:17:48 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:12:44.792 02:17:48 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:12:45.050 true 00:12:45.050 02:17:48 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:45.050 02:17:48 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:45.982 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:45.983 02:17:49 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:46.240 02:17:49 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:12:46.240 02:17:49 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:12:46.505 true 00:12:46.505 02:17:50 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:46.505 02:17:50 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:46.818 02:17:50 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:47.100 02:17:50 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:12:47.100 02:17:50 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:12:47.357 true 00:12:47.357 02:17:50 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:47.357 02:17:50 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:47.616 02:17:51 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:47.874 02:17:51 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:12:47.874 02:17:51 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:12:48.132 true 00:12:48.132 02:17:51 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:48.132 02:17:51 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:49.064 02:17:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:49.064 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:49.322 02:17:52 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:12:49.322 02:17:52 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:12:49.580 true 00:12:49.580 02:17:53 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:49.580 02:17:53 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:49.838 02:17:53 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:50.096 02:17:53 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:12:50.096 02:17:53 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:12:50.354 true 00:12:50.354 02:17:53 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:50.354 02:17:53 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:51.287 02:17:54 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:51.287 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:51.287 02:17:54 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:12:51.287 02:17:54 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:12:51.545 true 00:12:51.545 02:17:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:51.545 02:17:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:51.802 02:17:55 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:52.058 02:17:55 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:12:52.058 02:17:55 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:12:52.316 true 00:12:52.316 02:17:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:52.316 02:17:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:53.249 02:17:56 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:53.506 02:17:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:12:53.506 02:17:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:12:53.763 true 00:12:53.763 02:17:57 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:53.763 02:17:57 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:54.019 02:17:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:54.276 02:17:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:12:54.276 02:17:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:12:54.533 true 00:12:54.533 02:17:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:54.533 02:17:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:54.790 02:17:58 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:55.047 02:17:58 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:12:55.047 02:17:58 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:12:55.305 true 00:12:55.305 02:17:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:55.305 02:17:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:56.677 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:56.677 02:17:59 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:56.677 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:56.677 02:18:00 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:12:56.677 02:18:00 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:12:56.934 true 00:12:56.934 02:18:00 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:56.934 02:18:00 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:57.192 02:18:00 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:57.450 02:18:01 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:12:57.450 02:18:01 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:12:57.708 true 00:12:57.708 02:18:01 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:57.708 02:18:01 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:57.966 02:18:01 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:58.223 02:18:01 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:12:58.223 02:18:01 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:12:58.481 true 00:12:58.481 02:18:02 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:58.481 02:18:02 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:59.416 02:18:03 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:59.416 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:59.982 02:18:03 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:12:59.982 02:18:03 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:12:59.982 true 00:12:59.982 02:18:03 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:12:59.982 02:18:03 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:00.240 02:18:03 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:00.498 02:18:04 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:13:00.498 02:18:04 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:13:00.756 true 00:13:00.756 02:18:04 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:13:00.756 02:18:04 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:01.690 02:18:05 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:01.947 02:18:05 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:13:01.947 02:18:05 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:13:02.205 true 00:13:02.205 02:18:05 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:13:02.205 02:18:05 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:02.464 02:18:06 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:02.722 02:18:06 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:13:02.722 02:18:06 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:13:02.979 true 00:13:02.979 02:18:06 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:13:02.979 02:18:06 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:03.913 02:18:07 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:03.913 Initializing NVMe Controllers 00:13:03.913 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:03.913 Controller IO queue size 128, less than required. 00:13:03.913 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:03.913 Controller IO queue size 128, less than required. 00:13:03.913 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:03.913 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:13:03.913 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:13:03.913 Initialization complete. Launching workers. 00:13:03.913 ======================================================== 00:13:03.913 Latency(us) 00:13:03.913 Device Information : IOPS MiB/s Average min max 00:13:03.913 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 377.37 0.18 147934.34 2520.69 1054400.98 00:13:03.913 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 9958.77 4.86 12815.59 1591.71 362419.09 00:13:03.913 ======================================================== 00:13:03.913 Total : 10336.13 5.05 17748.70 1591.71 1054400.98 00:13:03.913 00:13:04.171 02:18:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1030 00:13:04.172 02:18:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1030 00:13:04.429 true 00:13:04.429 02:18:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 73295 00:13:04.429 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (73295) - No such process 00:13:04.429 02:18:07 -- target/ns_hotplug_stress.sh@53 -- # wait 73295 00:13:04.429 02:18:07 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:04.687 02:18:08 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:04.945 02:18:08 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:13:04.945 02:18:08 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:13:04.945 02:18:08 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:13:04.945 02:18:08 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:04.945 02:18:08 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:13:05.203 null0 00:13:05.203 02:18:08 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:05.203 02:18:08 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:05.203 02:18:08 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:13:05.461 null1 00:13:05.461 02:18:08 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:05.461 02:18:08 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:05.461 02:18:08 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:13:05.718 null2 00:13:05.718 02:18:09 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:05.718 02:18:09 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:05.718 02:18:09 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:13:05.976 null3 00:13:05.976 02:18:09 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:05.976 02:18:09 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:05.976 02:18:09 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:13:06.234 null4 00:13:06.234 02:18:09 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:06.234 02:18:09 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:06.234 02:18:09 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:13:06.492 null5 00:13:06.492 02:18:09 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:06.492 02:18:09 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:06.492 02:18:09 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:13:06.750 null6 00:13:06.750 02:18:10 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:06.750 02:18:10 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:06.750 02:18:10 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:13:07.009 null7 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@66 -- # wait 78081 78082 78083 78086 78088 78090 78092 78094 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.009 02:18:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:07.267 02:18:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:07.267 02:18:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:07.267 02:18:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:07.267 02:18:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:07.267 02:18:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:07.267 02:18:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:07.267 02:18:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:07.267 02:18:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:07.525 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:07.525 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.525 02:18:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:07.525 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:07.525 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.525 02:18:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:07.525 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:07.525 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.525 02:18:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:07.525 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:07.525 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:07.525 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.525 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.525 02:18:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:07.525 02:18:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:07.526 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:07.526 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.526 02:18:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:07.526 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:07.526 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.526 02:18:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:07.526 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:07.526 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.526 02:18:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:07.783 02:18:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:07.783 02:18:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:07.784 02:18:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:07.784 02:18:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:07.784 02:18:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:07.784 02:18:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:07.784 02:18:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:07.784 02:18:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:08.042 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.042 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.042 02:18:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:08.042 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.042 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.042 02:18:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:08.042 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.042 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.042 02:18:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:08.042 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.042 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.042 02:18:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:08.042 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.042 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.042 02:18:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:08.042 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.042 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.042 02:18:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:08.042 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.042 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.042 02:18:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:08.042 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.042 02:18:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.042 02:18:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:08.300 02:18:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:08.300 02:18:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:08.300 02:18:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:08.300 02:18:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:08.300 02:18:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:08.300 02:18:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:08.300 02:18:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:08.300 02:18:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:08.558 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.558 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.558 02:18:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:08.558 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.558 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.558 02:18:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:08.558 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.558 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.558 02:18:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:08.558 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.558 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.558 02:18:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:08.558 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.558 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.558 02:18:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:08.558 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.558 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.558 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.558 02:18:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:08.558 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.558 02:18:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:08.558 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.558 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.558 02:18:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:08.816 02:18:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:08.816 02:18:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:08.816 02:18:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:08.816 02:18:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:08.816 02:18:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:08.816 02:18:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:08.816 02:18:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:08.816 02:18:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:09.074 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.074 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.074 02:18:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:09.074 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.332 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.332 02:18:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:09.332 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.332 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.332 02:18:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:09.332 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.332 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.332 02:18:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:09.332 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.332 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.332 02:18:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:09.332 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.332 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.332 02:18:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:09.332 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.332 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.332 02:18:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:09.332 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.332 02:18:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.332 02:18:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:09.591 02:18:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:09.591 02:18:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:09.591 02:18:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:09.591 02:18:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:09.591 02:18:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:09.591 02:18:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:09.591 02:18:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:09.591 02:18:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:09.849 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.849 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.849 02:18:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:09.849 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.849 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.849 02:18:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:09.849 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.849 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.849 02:18:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:09.849 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.849 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.849 02:18:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:09.849 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.849 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.849 02:18:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:09.849 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.849 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.849 02:18:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:09.849 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.849 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.849 02:18:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:09.849 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.849 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.849 02:18:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:10.108 02:18:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:10.108 02:18:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:10.108 02:18:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:10.108 02:18:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:10.108 02:18:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:10.108 02:18:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:10.108 02:18:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:10.108 02:18:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:10.366 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.366 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.366 02:18:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:10.366 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.366 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.366 02:18:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:10.366 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.366 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.366 02:18:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:10.366 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.366 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.366 02:18:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:10.366 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.366 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.366 02:18:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:10.366 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.366 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.366 02:18:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:10.366 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.366 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.366 02:18:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:10.366 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.366 02:18:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.366 02:18:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:10.624 02:18:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:10.624 02:18:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:10.624 02:18:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:10.624 02:18:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:10.624 02:18:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:10.624 02:18:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:10.624 02:18:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:10.624 02:18:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:10.882 02:18:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.882 02:18:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.882 02:18:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:10.882 02:18:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.882 02:18:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.882 02:18:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:10.882 02:18:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.882 02:18:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.882 02:18:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:10.882 02:18:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.882 02:18:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.882 02:18:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:10.882 02:18:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.882 02:18:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.882 02:18:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:10.882 02:18:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.882 02:18:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.882 02:18:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.882 02:18:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:10.882 02:18:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.882 02:18:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:10.882 02:18:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.882 02:18:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.882 02:18:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:11.140 02:18:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:11.140 02:18:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:11.140 02:18:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:11.140 02:18:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:11.140 02:18:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:11.140 02:18:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:11.140 02:18:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:11.140 02:18:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:11.398 02:18:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.398 02:18:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.398 02:18:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:11.398 02:18:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.398 02:18:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.398 02:18:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:11.398 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.398 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.398 02:18:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:11.398 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.398 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.398 02:18:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:11.398 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.398 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.398 02:18:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:11.398 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.398 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.398 02:18:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:11.398 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.398 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.398 02:18:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:11.398 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.398 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.399 02:18:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:11.656 02:18:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:11.656 02:18:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:11.656 02:18:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:11.656 02:18:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:11.656 02:18:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:11.656 02:18:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:11.656 02:18:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:11.656 02:18:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:11.914 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.914 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.914 02:18:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:11.914 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.914 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.914 02:18:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:11.914 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.914 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.914 02:18:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:11.914 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.914 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.914 02:18:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:11.914 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.914 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.914 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.914 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.914 02:18:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:11.914 02:18:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:11.914 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.914 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.914 02:18:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:11.914 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.914 02:18:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.914 02:18:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:12.172 02:18:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:12.172 02:18:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:12.172 02:18:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:12.172 02:18:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:12.172 02:18:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:12.172 02:18:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:12.430 02:18:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:12.431 02:18:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:12.431 02:18:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.431 02:18:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.431 02:18:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.431 02:18:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.689 02:18:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.689 02:18:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.689 02:18:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.689 02:18:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.689 02:18:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.689 02:18:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.689 02:18:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.689 02:18:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.689 02:18:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.689 02:18:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.689 02:18:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.689 02:18:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.689 02:18:16 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:12.689 02:18:16 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:13:12.689 02:18:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:12.689 02:18:16 -- nvmf/common.sh@116 -- # sync 00:13:12.689 02:18:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:12.689 02:18:16 -- nvmf/common.sh@119 -- # set +e 00:13:12.689 02:18:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:12.689 02:18:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:12.689 rmmod nvme_tcp 00:13:12.689 rmmod nvme_fabrics 00:13:12.689 rmmod nvme_keyring 00:13:12.689 02:18:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:12.689 02:18:16 -- nvmf/common.sh@123 -- # set -e 00:13:12.689 02:18:16 -- nvmf/common.sh@124 -- # return 0 00:13:12.689 02:18:16 -- nvmf/common.sh@477 -- # '[' -n 72861 ']' 00:13:12.689 02:18:16 -- nvmf/common.sh@478 -- # killprocess 72861 00:13:12.689 02:18:16 -- common/autotest_common.sh@936 -- # '[' -z 72861 ']' 00:13:12.689 02:18:16 -- common/autotest_common.sh@940 -- # kill -0 72861 00:13:12.689 02:18:16 -- common/autotest_common.sh@941 -- # uname 00:13:12.689 02:18:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:12.689 02:18:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 72861 00:13:12.689 02:18:16 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:12.689 02:18:16 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:12.689 02:18:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 72861' 00:13:12.689 killing process with pid 72861 00:13:12.689 02:18:16 -- common/autotest_common.sh@955 -- # kill 72861 00:13:12.689 02:18:16 -- common/autotest_common.sh@960 -- # wait 72861 00:13:12.946 02:18:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:12.947 02:18:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:12.947 02:18:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:12.947 02:18:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:12.947 02:18:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:12.947 02:18:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:12.947 02:18:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:12.947 02:18:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:15.481 02:18:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:15.481 00:13:15.481 real 0m47.746s 00:13:15.481 user 3m37.117s 00:13:15.481 sys 0m15.773s 00:13:15.481 02:18:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:15.481 02:18:18 -- common/autotest_common.sh@10 -- # set +x 00:13:15.481 ************************************ 00:13:15.481 END TEST nvmf_ns_hotplug_stress 00:13:15.481 ************************************ 00:13:15.481 02:18:18 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:15.481 02:18:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:15.481 02:18:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:15.481 02:18:18 -- common/autotest_common.sh@10 -- # set +x 00:13:15.481 ************************************ 00:13:15.481 START TEST nvmf_connect_stress 00:13:15.481 ************************************ 00:13:15.481 02:18:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:15.481 * Looking for test storage... 00:13:15.481 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:15.481 02:18:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:15.481 02:18:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:15.481 02:18:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:15.481 02:18:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:15.481 02:18:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:15.481 02:18:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:15.481 02:18:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:15.481 02:18:18 -- scripts/common.sh@335 -- # IFS=.-: 00:13:15.481 02:18:18 -- scripts/common.sh@335 -- # read -ra ver1 00:13:15.481 02:18:18 -- scripts/common.sh@336 -- # IFS=.-: 00:13:15.481 02:18:18 -- scripts/common.sh@336 -- # read -ra ver2 00:13:15.481 02:18:18 -- scripts/common.sh@337 -- # local 'op=<' 00:13:15.481 02:18:18 -- scripts/common.sh@339 -- # ver1_l=2 00:13:15.481 02:18:18 -- scripts/common.sh@340 -- # ver2_l=1 00:13:15.481 02:18:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:15.481 02:18:18 -- scripts/common.sh@343 -- # case "$op" in 00:13:15.481 02:18:18 -- scripts/common.sh@344 -- # : 1 00:13:15.481 02:18:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:15.481 02:18:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:15.481 02:18:18 -- scripts/common.sh@364 -- # decimal 1 00:13:15.481 02:18:18 -- scripts/common.sh@352 -- # local d=1 00:13:15.481 02:18:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:15.481 02:18:18 -- scripts/common.sh@354 -- # echo 1 00:13:15.481 02:18:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:15.481 02:18:18 -- scripts/common.sh@365 -- # decimal 2 00:13:15.481 02:18:18 -- scripts/common.sh@352 -- # local d=2 00:13:15.481 02:18:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:15.481 02:18:18 -- scripts/common.sh@354 -- # echo 2 00:13:15.481 02:18:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:15.481 02:18:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:15.481 02:18:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:15.481 02:18:18 -- scripts/common.sh@367 -- # return 0 00:13:15.482 02:18:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:15.482 02:18:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:15.482 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:15.482 --rc genhtml_branch_coverage=1 00:13:15.482 --rc genhtml_function_coverage=1 00:13:15.482 --rc genhtml_legend=1 00:13:15.482 --rc geninfo_all_blocks=1 00:13:15.482 --rc geninfo_unexecuted_blocks=1 00:13:15.482 00:13:15.482 ' 00:13:15.482 02:18:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:15.482 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:15.482 --rc genhtml_branch_coverage=1 00:13:15.482 --rc genhtml_function_coverage=1 00:13:15.482 --rc genhtml_legend=1 00:13:15.482 --rc geninfo_all_blocks=1 00:13:15.482 --rc geninfo_unexecuted_blocks=1 00:13:15.482 00:13:15.482 ' 00:13:15.482 02:18:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:15.482 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:15.482 --rc genhtml_branch_coverage=1 00:13:15.482 --rc genhtml_function_coverage=1 00:13:15.482 --rc genhtml_legend=1 00:13:15.482 --rc geninfo_all_blocks=1 00:13:15.482 --rc geninfo_unexecuted_blocks=1 00:13:15.482 00:13:15.482 ' 00:13:15.482 02:18:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:15.482 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:15.482 --rc genhtml_branch_coverage=1 00:13:15.482 --rc genhtml_function_coverage=1 00:13:15.482 --rc genhtml_legend=1 00:13:15.482 --rc geninfo_all_blocks=1 00:13:15.482 --rc geninfo_unexecuted_blocks=1 00:13:15.482 00:13:15.482 ' 00:13:15.482 02:18:18 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:15.482 02:18:18 -- nvmf/common.sh@7 -- # uname -s 00:13:15.482 02:18:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:15.482 02:18:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:15.482 02:18:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:15.482 02:18:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:15.482 02:18:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:15.482 02:18:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:15.482 02:18:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:15.482 02:18:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:15.482 02:18:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:15.482 02:18:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:15.482 02:18:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:15.482 02:18:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:15.482 02:18:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:15.482 02:18:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:15.482 02:18:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:15.482 02:18:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:15.482 02:18:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:15.482 02:18:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:15.482 02:18:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:15.482 02:18:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:15.482 02:18:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:15.482 02:18:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:15.482 02:18:18 -- paths/export.sh@5 -- # export PATH 00:13:15.482 02:18:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:15.482 02:18:18 -- nvmf/common.sh@46 -- # : 0 00:13:15.482 02:18:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:15.482 02:18:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:15.482 02:18:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:15.482 02:18:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:15.482 02:18:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:15.482 02:18:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:15.482 02:18:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:15.482 02:18:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:15.482 02:18:18 -- target/connect_stress.sh@12 -- # nvmftestinit 00:13:15.482 02:18:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:15.482 02:18:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:15.482 02:18:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:15.482 02:18:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:15.482 02:18:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:15.482 02:18:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:15.482 02:18:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:15.482 02:18:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:15.482 02:18:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:15.482 02:18:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:15.482 02:18:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:15.482 02:18:18 -- common/autotest_common.sh@10 -- # set +x 00:13:17.449 02:18:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:17.449 02:18:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:17.449 02:18:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:17.449 02:18:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:17.449 02:18:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:17.449 02:18:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:17.449 02:18:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:17.449 02:18:20 -- nvmf/common.sh@294 -- # net_devs=() 00:13:17.449 02:18:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:17.449 02:18:20 -- nvmf/common.sh@295 -- # e810=() 00:13:17.449 02:18:20 -- nvmf/common.sh@295 -- # local -ga e810 00:13:17.449 02:18:20 -- nvmf/common.sh@296 -- # x722=() 00:13:17.449 02:18:20 -- nvmf/common.sh@296 -- # local -ga x722 00:13:17.449 02:18:20 -- nvmf/common.sh@297 -- # mlx=() 00:13:17.449 02:18:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:17.449 02:18:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:17.449 02:18:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:17.449 02:18:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:17.449 02:18:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:17.449 02:18:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:17.449 02:18:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:17.449 02:18:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:17.449 02:18:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:17.449 02:18:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:17.449 02:18:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:17.449 02:18:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:17.449 02:18:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:17.449 02:18:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:17.449 02:18:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:17.449 02:18:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:17.449 02:18:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:17.449 02:18:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:17.449 02:18:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:17.449 02:18:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:17.449 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:17.449 02:18:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:17.449 02:18:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:17.449 02:18:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:17.449 02:18:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:17.449 02:18:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:17.449 02:18:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:17.449 02:18:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:17.449 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:17.449 02:18:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:17.449 02:18:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:17.449 02:18:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:17.449 02:18:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:17.449 02:18:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:17.449 02:18:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:17.449 02:18:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:17.449 02:18:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:17.449 02:18:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:17.449 02:18:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:17.449 02:18:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:17.449 02:18:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:17.449 02:18:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:17.449 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:17.449 02:18:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:17.449 02:18:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:17.449 02:18:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:17.449 02:18:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:17.449 02:18:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:17.449 02:18:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:17.449 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:17.449 02:18:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:17.449 02:18:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:17.449 02:18:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:17.449 02:18:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:17.449 02:18:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:17.449 02:18:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:17.449 02:18:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:17.449 02:18:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:17.449 02:18:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:17.449 02:18:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:17.449 02:18:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:17.449 02:18:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:17.449 02:18:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:17.449 02:18:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:17.449 02:18:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:17.449 02:18:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:17.449 02:18:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:17.449 02:18:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:17.449 02:18:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:17.449 02:18:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:17.449 02:18:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:17.449 02:18:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:17.449 02:18:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:17.449 02:18:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:17.449 02:18:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:17.449 02:18:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:17.449 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:17.449 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.309 ms 00:13:17.449 00:13:17.449 --- 10.0.0.2 ping statistics --- 00:13:17.449 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:17.449 rtt min/avg/max/mdev = 0.309/0.309/0.309/0.000 ms 00:13:17.449 02:18:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:17.449 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:17.449 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.140 ms 00:13:17.449 00:13:17.449 --- 10.0.0.1 ping statistics --- 00:13:17.449 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:17.449 rtt min/avg/max/mdev = 0.140/0.140/0.140/0.000 ms 00:13:17.449 02:18:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:17.449 02:18:20 -- nvmf/common.sh@410 -- # return 0 00:13:17.449 02:18:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:17.449 02:18:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:17.449 02:18:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:17.449 02:18:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:17.449 02:18:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:17.449 02:18:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:17.449 02:18:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:17.449 02:18:20 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:13:17.449 02:18:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:17.449 02:18:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:17.449 02:18:20 -- common/autotest_common.sh@10 -- # set +x 00:13:17.449 02:18:20 -- nvmf/common.sh@469 -- # nvmfpid=80900 00:13:17.449 02:18:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:17.449 02:18:20 -- nvmf/common.sh@470 -- # waitforlisten 80900 00:13:17.449 02:18:20 -- common/autotest_common.sh@829 -- # '[' -z 80900 ']' 00:13:17.449 02:18:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:17.449 02:18:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:17.449 02:18:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:17.449 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:17.449 02:18:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:17.449 02:18:20 -- common/autotest_common.sh@10 -- # set +x 00:13:17.449 [2024-11-29 02:18:20.951991] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:17.449 [2024-11-29 02:18:20.952065] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:17.450 EAL: No free 2048 kB hugepages reported on node 1 00:13:17.450 [2024-11-29 02:18:21.016996] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:17.450 [2024-11-29 02:18:21.124648] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:17.450 [2024-11-29 02:18:21.124796] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:17.450 [2024-11-29 02:18:21.124813] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:17.450 [2024-11-29 02:18:21.124826] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:17.450 [2024-11-29 02:18:21.124877] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:17.450 [2024-11-29 02:18:21.124912] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:17.450 [2024-11-29 02:18:21.124915] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:18.384 02:18:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:18.384 02:18:21 -- common/autotest_common.sh@862 -- # return 0 00:13:18.384 02:18:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:18.384 02:18:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:18.384 02:18:21 -- common/autotest_common.sh@10 -- # set +x 00:13:18.384 02:18:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:18.384 02:18:21 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:18.384 02:18:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.384 02:18:21 -- common/autotest_common.sh@10 -- # set +x 00:13:18.384 [2024-11-29 02:18:21.950563] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:18.384 02:18:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.384 02:18:21 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:18.384 02:18:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.384 02:18:21 -- common/autotest_common.sh@10 -- # set +x 00:13:18.384 02:18:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.384 02:18:21 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:18.384 02:18:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.384 02:18:21 -- common/autotest_common.sh@10 -- # set +x 00:13:18.384 [2024-11-29 02:18:21.990557] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:18.384 02:18:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.384 02:18:21 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:18.384 02:18:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.384 02:18:21 -- common/autotest_common.sh@10 -- # set +x 00:13:18.384 NULL1 00:13:18.384 02:18:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.384 02:18:22 -- target/connect_stress.sh@21 -- # PERF_PID=81060 00:13:18.384 02:18:22 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:18.384 02:18:22 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:18.384 02:18:22 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:13:18.384 02:18:22 -- target/connect_stress.sh@27 -- # seq 1 20 00:13:18.384 02:18:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.384 02:18:22 -- target/connect_stress.sh@28 -- # cat 00:13:18.384 02:18:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.384 02:18:22 -- target/connect_stress.sh@28 -- # cat 00:13:18.384 02:18:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.384 02:18:22 -- target/connect_stress.sh@28 -- # cat 00:13:18.384 02:18:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.384 02:18:22 -- target/connect_stress.sh@28 -- # cat 00:13:18.384 02:18:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.384 02:18:22 -- target/connect_stress.sh@28 -- # cat 00:13:18.384 02:18:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.384 02:18:22 -- target/connect_stress.sh@28 -- # cat 00:13:18.384 02:18:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.384 02:18:22 -- target/connect_stress.sh@28 -- # cat 00:13:18.384 02:18:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.384 02:18:22 -- target/connect_stress.sh@28 -- # cat 00:13:18.384 02:18:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.384 02:18:22 -- target/connect_stress.sh@28 -- # cat 00:13:18.384 02:18:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.384 02:18:22 -- target/connect_stress.sh@28 -- # cat 00:13:18.384 02:18:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.384 02:18:22 -- target/connect_stress.sh@28 -- # cat 00:13:18.384 EAL: No free 2048 kB hugepages reported on node 1 00:13:18.384 02:18:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.384 02:18:22 -- target/connect_stress.sh@28 -- # cat 00:13:18.384 02:18:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.384 02:18:22 -- target/connect_stress.sh@28 -- # cat 00:13:18.384 02:18:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.384 02:18:22 -- target/connect_stress.sh@28 -- # cat 00:13:18.384 02:18:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.384 02:18:22 -- target/connect_stress.sh@28 -- # cat 00:13:18.384 02:18:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.384 02:18:22 -- target/connect_stress.sh@28 -- # cat 00:13:18.384 02:18:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.384 02:18:22 -- target/connect_stress.sh@28 -- # cat 00:13:18.384 02:18:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.384 02:18:22 -- target/connect_stress.sh@28 -- # cat 00:13:18.384 02:18:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.384 02:18:22 -- target/connect_stress.sh@28 -- # cat 00:13:18.384 02:18:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.384 02:18:22 -- target/connect_stress.sh@28 -- # cat 00:13:18.384 02:18:22 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:18.384 02:18:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:18.384 02:18:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.384 02:18:22 -- common/autotest_common.sh@10 -- # set +x 00:13:18.950 02:18:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.950 02:18:22 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:18.950 02:18:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:18.950 02:18:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.950 02:18:22 -- common/autotest_common.sh@10 -- # set +x 00:13:19.209 02:18:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.209 02:18:22 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:19.209 02:18:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:19.209 02:18:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.209 02:18:22 -- common/autotest_common.sh@10 -- # set +x 00:13:19.469 02:18:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.469 02:18:23 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:19.469 02:18:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:19.469 02:18:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.469 02:18:23 -- common/autotest_common.sh@10 -- # set +x 00:13:19.728 02:18:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.728 02:18:23 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:19.728 02:18:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:19.728 02:18:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.728 02:18:23 -- common/autotest_common.sh@10 -- # set +x 00:13:19.987 02:18:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.987 02:18:23 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:19.987 02:18:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:19.987 02:18:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.987 02:18:23 -- common/autotest_common.sh@10 -- # set +x 00:13:20.556 02:18:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.556 02:18:23 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:20.556 02:18:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:20.556 02:18:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.556 02:18:23 -- common/autotest_common.sh@10 -- # set +x 00:13:20.815 02:18:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.815 02:18:24 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:20.815 02:18:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:20.815 02:18:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.815 02:18:24 -- common/autotest_common.sh@10 -- # set +x 00:13:21.075 02:18:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.075 02:18:24 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:21.075 02:18:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:21.075 02:18:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.075 02:18:24 -- common/autotest_common.sh@10 -- # set +x 00:13:21.335 02:18:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.335 02:18:24 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:21.335 02:18:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:21.335 02:18:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.335 02:18:24 -- common/autotest_common.sh@10 -- # set +x 00:13:21.602 02:18:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.602 02:18:25 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:21.602 02:18:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:21.602 02:18:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.602 02:18:25 -- common/autotest_common.sh@10 -- # set +x 00:13:22.173 02:18:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.174 02:18:25 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:22.174 02:18:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:22.174 02:18:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.174 02:18:25 -- common/autotest_common.sh@10 -- # set +x 00:13:22.434 02:18:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.434 02:18:25 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:22.434 02:18:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:22.434 02:18:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.434 02:18:25 -- common/autotest_common.sh@10 -- # set +x 00:13:22.694 02:18:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.694 02:18:26 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:22.694 02:18:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:22.694 02:18:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.694 02:18:26 -- common/autotest_common.sh@10 -- # set +x 00:13:22.953 02:18:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.953 02:18:26 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:22.953 02:18:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:22.953 02:18:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.953 02:18:26 -- common/autotest_common.sh@10 -- # set +x 00:13:23.223 02:18:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.223 02:18:26 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:23.223 02:18:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:23.223 02:18:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.223 02:18:26 -- common/autotest_common.sh@10 -- # set +x 00:13:23.793 02:18:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.793 02:18:27 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:23.793 02:18:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:23.793 02:18:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.793 02:18:27 -- common/autotest_common.sh@10 -- # set +x 00:13:24.053 02:18:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.053 02:18:27 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:24.053 02:18:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:24.053 02:18:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.053 02:18:27 -- common/autotest_common.sh@10 -- # set +x 00:13:24.312 02:18:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.312 02:18:27 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:24.312 02:18:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:24.312 02:18:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.312 02:18:27 -- common/autotest_common.sh@10 -- # set +x 00:13:24.572 02:18:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.572 02:18:28 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:24.572 02:18:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:24.572 02:18:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.572 02:18:28 -- common/autotest_common.sh@10 -- # set +x 00:13:24.832 02:18:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.832 02:18:28 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:24.832 02:18:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:24.832 02:18:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.832 02:18:28 -- common/autotest_common.sh@10 -- # set +x 00:13:25.401 02:18:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.401 02:18:28 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:25.401 02:18:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:25.401 02:18:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.401 02:18:28 -- common/autotest_common.sh@10 -- # set +x 00:13:25.659 02:18:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.659 02:18:29 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:25.659 02:18:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:25.659 02:18:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.659 02:18:29 -- common/autotest_common.sh@10 -- # set +x 00:13:25.918 02:18:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.918 02:18:29 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:25.918 02:18:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:25.918 02:18:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.918 02:18:29 -- common/autotest_common.sh@10 -- # set +x 00:13:26.177 02:18:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.177 02:18:29 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:26.177 02:18:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:26.177 02:18:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.177 02:18:29 -- common/autotest_common.sh@10 -- # set +x 00:13:26.437 02:18:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.437 02:18:30 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:26.437 02:18:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:26.437 02:18:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.437 02:18:30 -- common/autotest_common.sh@10 -- # set +x 00:13:27.007 02:18:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.007 02:18:30 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:27.007 02:18:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:27.007 02:18:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.007 02:18:30 -- common/autotest_common.sh@10 -- # set +x 00:13:27.267 02:18:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.267 02:18:30 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:27.267 02:18:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:27.267 02:18:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.267 02:18:30 -- common/autotest_common.sh@10 -- # set +x 00:13:27.527 02:18:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.527 02:18:31 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:27.527 02:18:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:27.527 02:18:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.527 02:18:31 -- common/autotest_common.sh@10 -- # set +x 00:13:27.786 02:18:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.786 02:18:31 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:27.786 02:18:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:27.786 02:18:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.786 02:18:31 -- common/autotest_common.sh@10 -- # set +x 00:13:28.047 02:18:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.047 02:18:31 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:28.047 02:18:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:28.047 02:18:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.047 02:18:31 -- common/autotest_common.sh@10 -- # set +x 00:13:28.614 02:18:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.614 02:18:32 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:28.614 02:18:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:28.614 02:18:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.614 02:18:32 -- common/autotest_common.sh@10 -- # set +x 00:13:28.614 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:28.872 02:18:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.872 02:18:32 -- target/connect_stress.sh@34 -- # kill -0 81060 00:13:28.872 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (81060) - No such process 00:13:28.872 02:18:32 -- target/connect_stress.sh@38 -- # wait 81060 00:13:28.872 02:18:32 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:28.872 02:18:32 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:28.872 02:18:32 -- target/connect_stress.sh@43 -- # nvmftestfini 00:13:28.872 02:18:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:28.872 02:18:32 -- nvmf/common.sh@116 -- # sync 00:13:28.872 02:18:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:28.872 02:18:32 -- nvmf/common.sh@119 -- # set +e 00:13:28.872 02:18:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:28.872 02:18:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:28.872 rmmod nvme_tcp 00:13:28.872 rmmod nvme_fabrics 00:13:28.872 rmmod nvme_keyring 00:13:28.873 02:18:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:28.873 02:18:32 -- nvmf/common.sh@123 -- # set -e 00:13:28.873 02:18:32 -- nvmf/common.sh@124 -- # return 0 00:13:28.873 02:18:32 -- nvmf/common.sh@477 -- # '[' -n 80900 ']' 00:13:28.873 02:18:32 -- nvmf/common.sh@478 -- # killprocess 80900 00:13:28.873 02:18:32 -- common/autotest_common.sh@936 -- # '[' -z 80900 ']' 00:13:28.873 02:18:32 -- common/autotest_common.sh@940 -- # kill -0 80900 00:13:28.873 02:18:32 -- common/autotest_common.sh@941 -- # uname 00:13:28.873 02:18:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:28.873 02:18:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 80900 00:13:28.873 02:18:32 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:28.873 02:18:32 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:28.873 02:18:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 80900' 00:13:28.873 killing process with pid 80900 00:13:28.873 02:18:32 -- common/autotest_common.sh@955 -- # kill 80900 00:13:28.873 02:18:32 -- common/autotest_common.sh@960 -- # wait 80900 00:13:29.131 02:18:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:29.131 02:18:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:29.131 02:18:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:29.131 02:18:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:29.131 02:18:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:29.131 02:18:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:29.131 02:18:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:29.131 02:18:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:31.664 02:18:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:31.664 00:13:31.664 real 0m16.159s 00:13:31.664 user 0m40.910s 00:13:31.664 sys 0m5.921s 00:13:31.664 02:18:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:31.664 02:18:34 -- common/autotest_common.sh@10 -- # set +x 00:13:31.664 ************************************ 00:13:31.664 END TEST nvmf_connect_stress 00:13:31.664 ************************************ 00:13:31.664 02:18:34 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:31.664 02:18:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:31.664 02:18:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:31.664 02:18:34 -- common/autotest_common.sh@10 -- # set +x 00:13:31.664 ************************************ 00:13:31.664 START TEST nvmf_fused_ordering 00:13:31.664 ************************************ 00:13:31.664 02:18:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:31.664 * Looking for test storage... 00:13:31.664 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:31.664 02:18:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:31.664 02:18:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:31.664 02:18:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:31.664 02:18:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:31.664 02:18:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:31.664 02:18:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:31.664 02:18:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:31.664 02:18:34 -- scripts/common.sh@335 -- # IFS=.-: 00:13:31.664 02:18:34 -- scripts/common.sh@335 -- # read -ra ver1 00:13:31.664 02:18:34 -- scripts/common.sh@336 -- # IFS=.-: 00:13:31.664 02:18:34 -- scripts/common.sh@336 -- # read -ra ver2 00:13:31.664 02:18:34 -- scripts/common.sh@337 -- # local 'op=<' 00:13:31.664 02:18:34 -- scripts/common.sh@339 -- # ver1_l=2 00:13:31.664 02:18:34 -- scripts/common.sh@340 -- # ver2_l=1 00:13:31.664 02:18:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:31.664 02:18:34 -- scripts/common.sh@343 -- # case "$op" in 00:13:31.664 02:18:34 -- scripts/common.sh@344 -- # : 1 00:13:31.664 02:18:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:31.664 02:18:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:31.664 02:18:34 -- scripts/common.sh@364 -- # decimal 1 00:13:31.664 02:18:34 -- scripts/common.sh@352 -- # local d=1 00:13:31.664 02:18:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:31.664 02:18:34 -- scripts/common.sh@354 -- # echo 1 00:13:31.664 02:18:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:31.664 02:18:34 -- scripts/common.sh@365 -- # decimal 2 00:13:31.664 02:18:34 -- scripts/common.sh@352 -- # local d=2 00:13:31.664 02:18:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:31.664 02:18:34 -- scripts/common.sh@354 -- # echo 2 00:13:31.664 02:18:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:31.664 02:18:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:31.664 02:18:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:31.664 02:18:34 -- scripts/common.sh@367 -- # return 0 00:13:31.664 02:18:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:31.664 02:18:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:31.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:31.664 --rc genhtml_branch_coverage=1 00:13:31.664 --rc genhtml_function_coverage=1 00:13:31.664 --rc genhtml_legend=1 00:13:31.664 --rc geninfo_all_blocks=1 00:13:31.664 --rc geninfo_unexecuted_blocks=1 00:13:31.664 00:13:31.664 ' 00:13:31.664 02:18:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:31.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:31.664 --rc genhtml_branch_coverage=1 00:13:31.664 --rc genhtml_function_coverage=1 00:13:31.664 --rc genhtml_legend=1 00:13:31.664 --rc geninfo_all_blocks=1 00:13:31.664 --rc geninfo_unexecuted_blocks=1 00:13:31.664 00:13:31.664 ' 00:13:31.664 02:18:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:31.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:31.664 --rc genhtml_branch_coverage=1 00:13:31.664 --rc genhtml_function_coverage=1 00:13:31.664 --rc genhtml_legend=1 00:13:31.664 --rc geninfo_all_blocks=1 00:13:31.664 --rc geninfo_unexecuted_blocks=1 00:13:31.664 00:13:31.664 ' 00:13:31.664 02:18:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:31.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:31.664 --rc genhtml_branch_coverage=1 00:13:31.664 --rc genhtml_function_coverage=1 00:13:31.664 --rc genhtml_legend=1 00:13:31.664 --rc geninfo_all_blocks=1 00:13:31.664 --rc geninfo_unexecuted_blocks=1 00:13:31.664 00:13:31.664 ' 00:13:31.664 02:18:34 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:31.664 02:18:34 -- nvmf/common.sh@7 -- # uname -s 00:13:31.664 02:18:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:31.664 02:18:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:31.664 02:18:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:31.664 02:18:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:31.664 02:18:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:31.664 02:18:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:31.664 02:18:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:31.664 02:18:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:31.664 02:18:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:31.664 02:18:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:31.664 02:18:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:31.664 02:18:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:31.664 02:18:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:31.664 02:18:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:31.664 02:18:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:31.664 02:18:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:31.664 02:18:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:31.664 02:18:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:31.664 02:18:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:31.664 02:18:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:31.664 02:18:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:31.664 02:18:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:31.664 02:18:34 -- paths/export.sh@5 -- # export PATH 00:13:31.664 02:18:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:31.664 02:18:34 -- nvmf/common.sh@46 -- # : 0 00:13:31.664 02:18:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:31.665 02:18:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:31.665 02:18:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:31.665 02:18:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:31.665 02:18:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:31.665 02:18:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:31.665 02:18:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:31.665 02:18:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:31.665 02:18:34 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:13:31.665 02:18:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:31.665 02:18:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:31.665 02:18:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:31.665 02:18:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:31.665 02:18:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:31.665 02:18:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:31.665 02:18:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:31.665 02:18:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:31.665 02:18:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:31.665 02:18:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:31.665 02:18:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:31.665 02:18:34 -- common/autotest_common.sh@10 -- # set +x 00:13:33.568 02:18:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:33.568 02:18:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:33.568 02:18:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:33.568 02:18:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:33.568 02:18:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:33.568 02:18:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:33.568 02:18:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:33.568 02:18:36 -- nvmf/common.sh@294 -- # net_devs=() 00:13:33.568 02:18:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:33.568 02:18:36 -- nvmf/common.sh@295 -- # e810=() 00:13:33.568 02:18:36 -- nvmf/common.sh@295 -- # local -ga e810 00:13:33.568 02:18:36 -- nvmf/common.sh@296 -- # x722=() 00:13:33.568 02:18:36 -- nvmf/common.sh@296 -- # local -ga x722 00:13:33.568 02:18:36 -- nvmf/common.sh@297 -- # mlx=() 00:13:33.568 02:18:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:33.568 02:18:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:33.568 02:18:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:33.568 02:18:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:33.568 02:18:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:33.568 02:18:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:33.568 02:18:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:33.568 02:18:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:33.568 02:18:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:33.568 02:18:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:33.568 02:18:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:33.568 02:18:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:33.568 02:18:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:33.568 02:18:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:33.568 02:18:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:33.568 02:18:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:33.568 02:18:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:33.568 02:18:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:33.568 02:18:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:33.568 02:18:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:33.568 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:33.568 02:18:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:33.568 02:18:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:33.568 02:18:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:33.568 02:18:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:33.568 02:18:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:33.568 02:18:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:33.568 02:18:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:33.568 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:33.568 02:18:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:33.568 02:18:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:33.568 02:18:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:33.568 02:18:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:33.569 02:18:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:33.569 02:18:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:33.569 02:18:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:33.569 02:18:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:33.569 02:18:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:33.569 02:18:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:33.569 02:18:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:33.569 02:18:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:33.569 02:18:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:33.569 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:33.569 02:18:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:33.569 02:18:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:33.569 02:18:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:33.569 02:18:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:33.569 02:18:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:33.569 02:18:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:33.569 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:33.569 02:18:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:33.569 02:18:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:33.569 02:18:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:33.569 02:18:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:33.569 02:18:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:33.569 02:18:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:33.569 02:18:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:33.569 02:18:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:33.569 02:18:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:33.569 02:18:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:33.569 02:18:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:33.569 02:18:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:33.569 02:18:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:33.569 02:18:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:33.569 02:18:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:33.569 02:18:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:33.569 02:18:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:33.569 02:18:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:33.569 02:18:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:33.569 02:18:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:33.569 02:18:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:33.569 02:18:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:33.569 02:18:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:33.569 02:18:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:33.569 02:18:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:33.569 02:18:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:33.569 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:33.569 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.219 ms 00:13:33.569 00:13:33.569 --- 10.0.0.2 ping statistics --- 00:13:33.569 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:33.569 rtt min/avg/max/mdev = 0.219/0.219/0.219/0.000 ms 00:13:33.569 02:18:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:33.569 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:33.569 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.057 ms 00:13:33.569 00:13:33.569 --- 10.0.0.1 ping statistics --- 00:13:33.569 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:33.569 rtt min/avg/max/mdev = 0.057/0.057/0.057/0.000 ms 00:13:33.569 02:18:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:33.569 02:18:37 -- nvmf/common.sh@410 -- # return 0 00:13:33.569 02:18:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:33.569 02:18:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:33.569 02:18:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:33.569 02:18:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:33.569 02:18:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:33.569 02:18:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:33.569 02:18:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:33.569 02:18:37 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:13:33.569 02:18:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:33.569 02:18:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:33.569 02:18:37 -- common/autotest_common.sh@10 -- # set +x 00:13:33.569 02:18:37 -- nvmf/common.sh@469 -- # nvmfpid=84335 00:13:33.569 02:18:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:33.569 02:18:37 -- nvmf/common.sh@470 -- # waitforlisten 84335 00:13:33.569 02:18:37 -- common/autotest_common.sh@829 -- # '[' -z 84335 ']' 00:13:33.569 02:18:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:33.569 02:18:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:33.569 02:18:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:33.569 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:33.569 02:18:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:33.569 02:18:37 -- common/autotest_common.sh@10 -- # set +x 00:13:33.569 [2024-11-29 02:18:37.097841] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:33.569 [2024-11-29 02:18:37.097936] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:33.569 EAL: No free 2048 kB hugepages reported on node 1 00:13:33.569 [2024-11-29 02:18:37.164936] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:33.828 [2024-11-29 02:18:37.278980] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:33.828 [2024-11-29 02:18:37.279141] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:33.828 [2024-11-29 02:18:37.279160] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:33.828 [2024-11-29 02:18:37.279183] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:33.828 [2024-11-29 02:18:37.279223] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:34.394 02:18:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:34.394 02:18:38 -- common/autotest_common.sh@862 -- # return 0 00:13:34.394 02:18:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:34.394 02:18:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:34.394 02:18:38 -- common/autotest_common.sh@10 -- # set +x 00:13:34.394 02:18:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:34.394 02:18:38 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:34.394 02:18:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.394 02:18:38 -- common/autotest_common.sh@10 -- # set +x 00:13:34.394 [2024-11-29 02:18:38.073913] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:34.656 02:18:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.656 02:18:38 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:34.656 02:18:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.656 02:18:38 -- common/autotest_common.sh@10 -- # set +x 00:13:34.656 02:18:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.656 02:18:38 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:34.656 02:18:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.656 02:18:38 -- common/autotest_common.sh@10 -- # set +x 00:13:34.656 [2024-11-29 02:18:38.090092] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:34.656 02:18:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.656 02:18:38 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:34.656 02:18:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.656 02:18:38 -- common/autotest_common.sh@10 -- # set +x 00:13:34.656 NULL1 00:13:34.656 02:18:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.656 02:18:38 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:13:34.656 02:18:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.656 02:18:38 -- common/autotest_common.sh@10 -- # set +x 00:13:34.656 02:18:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.656 02:18:38 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:34.656 02:18:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.656 02:18:38 -- common/autotest_common.sh@10 -- # set +x 00:13:34.656 02:18:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.656 02:18:38 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:13:34.656 [2024-11-29 02:18:38.134714] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:34.656 [2024-11-29 02:18:38.134755] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid84435 ] 00:13:34.656 EAL: No free 2048 kB hugepages reported on node 1 00:13:35.227 Attached to nqn.2016-06.io.spdk:cnode1 00:13:35.227 Namespace ID: 1 size: 1GB 00:13:35.227 fused_ordering(0) 00:13:35.227 fused_ordering(1) 00:13:35.227 fused_ordering(2) 00:13:35.227 fused_ordering(3) 00:13:35.227 fused_ordering(4) 00:13:35.227 fused_ordering(5) 00:13:35.227 fused_ordering(6) 00:13:35.227 fused_ordering(7) 00:13:35.227 fused_ordering(8) 00:13:35.227 fused_ordering(9) 00:13:35.227 fused_ordering(10) 00:13:35.227 fused_ordering(11) 00:13:35.227 fused_ordering(12) 00:13:35.227 fused_ordering(13) 00:13:35.227 fused_ordering(14) 00:13:35.227 fused_ordering(15) 00:13:35.227 fused_ordering(16) 00:13:35.227 fused_ordering(17) 00:13:35.227 fused_ordering(18) 00:13:35.227 fused_ordering(19) 00:13:35.227 fused_ordering(20) 00:13:35.227 fused_ordering(21) 00:13:35.227 fused_ordering(22) 00:13:35.227 fused_ordering(23) 00:13:35.227 fused_ordering(24) 00:13:35.227 fused_ordering(25) 00:13:35.227 fused_ordering(26) 00:13:35.227 fused_ordering(27) 00:13:35.227 fused_ordering(28) 00:13:35.227 fused_ordering(29) 00:13:35.227 fused_ordering(30) 00:13:35.227 fused_ordering(31) 00:13:35.227 fused_ordering(32) 00:13:35.227 fused_ordering(33) 00:13:35.227 fused_ordering(34) 00:13:35.227 fused_ordering(35) 00:13:35.227 fused_ordering(36) 00:13:35.227 fused_ordering(37) 00:13:35.227 fused_ordering(38) 00:13:35.227 fused_ordering(39) 00:13:35.227 fused_ordering(40) 00:13:35.227 fused_ordering(41) 00:13:35.227 fused_ordering(42) 00:13:35.227 fused_ordering(43) 00:13:35.227 fused_ordering(44) 00:13:35.227 fused_ordering(45) 00:13:35.227 fused_ordering(46) 00:13:35.227 fused_ordering(47) 00:13:35.227 fused_ordering(48) 00:13:35.227 fused_ordering(49) 00:13:35.227 fused_ordering(50) 00:13:35.227 fused_ordering(51) 00:13:35.227 fused_ordering(52) 00:13:35.227 fused_ordering(53) 00:13:35.227 fused_ordering(54) 00:13:35.227 fused_ordering(55) 00:13:35.227 fused_ordering(56) 00:13:35.227 fused_ordering(57) 00:13:35.227 fused_ordering(58) 00:13:35.227 fused_ordering(59) 00:13:35.227 fused_ordering(60) 00:13:35.227 fused_ordering(61) 00:13:35.227 fused_ordering(62) 00:13:35.227 fused_ordering(63) 00:13:35.227 fused_ordering(64) 00:13:35.227 fused_ordering(65) 00:13:35.227 fused_ordering(66) 00:13:35.227 fused_ordering(67) 00:13:35.227 fused_ordering(68) 00:13:35.227 fused_ordering(69) 00:13:35.227 fused_ordering(70) 00:13:35.227 fused_ordering(71) 00:13:35.227 fused_ordering(72) 00:13:35.227 fused_ordering(73) 00:13:35.227 fused_ordering(74) 00:13:35.227 fused_ordering(75) 00:13:35.227 fused_ordering(76) 00:13:35.227 fused_ordering(77) 00:13:35.227 fused_ordering(78) 00:13:35.227 fused_ordering(79) 00:13:35.227 fused_ordering(80) 00:13:35.227 fused_ordering(81) 00:13:35.227 fused_ordering(82) 00:13:35.227 fused_ordering(83) 00:13:35.227 fused_ordering(84) 00:13:35.227 fused_ordering(85) 00:13:35.227 fused_ordering(86) 00:13:35.227 fused_ordering(87) 00:13:35.227 fused_ordering(88) 00:13:35.227 fused_ordering(89) 00:13:35.227 fused_ordering(90) 00:13:35.227 fused_ordering(91) 00:13:35.227 fused_ordering(92) 00:13:35.227 fused_ordering(93) 00:13:35.227 fused_ordering(94) 00:13:35.227 fused_ordering(95) 00:13:35.227 fused_ordering(96) 00:13:35.227 fused_ordering(97) 00:13:35.227 fused_ordering(98) 00:13:35.227 fused_ordering(99) 00:13:35.227 fused_ordering(100) 00:13:35.227 fused_ordering(101) 00:13:35.227 fused_ordering(102) 00:13:35.227 fused_ordering(103) 00:13:35.227 fused_ordering(104) 00:13:35.227 fused_ordering(105) 00:13:35.227 fused_ordering(106) 00:13:35.227 fused_ordering(107) 00:13:35.227 fused_ordering(108) 00:13:35.227 fused_ordering(109) 00:13:35.227 fused_ordering(110) 00:13:35.227 fused_ordering(111) 00:13:35.227 fused_ordering(112) 00:13:35.227 fused_ordering(113) 00:13:35.227 fused_ordering(114) 00:13:35.227 fused_ordering(115) 00:13:35.227 fused_ordering(116) 00:13:35.227 fused_ordering(117) 00:13:35.227 fused_ordering(118) 00:13:35.227 fused_ordering(119) 00:13:35.227 fused_ordering(120) 00:13:35.227 fused_ordering(121) 00:13:35.227 fused_ordering(122) 00:13:35.227 fused_ordering(123) 00:13:35.227 fused_ordering(124) 00:13:35.227 fused_ordering(125) 00:13:35.227 fused_ordering(126) 00:13:35.227 fused_ordering(127) 00:13:35.227 fused_ordering(128) 00:13:35.227 fused_ordering(129) 00:13:35.227 fused_ordering(130) 00:13:35.227 fused_ordering(131) 00:13:35.227 fused_ordering(132) 00:13:35.227 fused_ordering(133) 00:13:35.227 fused_ordering(134) 00:13:35.227 fused_ordering(135) 00:13:35.227 fused_ordering(136) 00:13:35.227 fused_ordering(137) 00:13:35.227 fused_ordering(138) 00:13:35.227 fused_ordering(139) 00:13:35.227 fused_ordering(140) 00:13:35.227 fused_ordering(141) 00:13:35.227 fused_ordering(142) 00:13:35.227 fused_ordering(143) 00:13:35.227 fused_ordering(144) 00:13:35.227 fused_ordering(145) 00:13:35.227 fused_ordering(146) 00:13:35.227 fused_ordering(147) 00:13:35.227 fused_ordering(148) 00:13:35.227 fused_ordering(149) 00:13:35.227 fused_ordering(150) 00:13:35.227 fused_ordering(151) 00:13:35.227 fused_ordering(152) 00:13:35.227 fused_ordering(153) 00:13:35.227 fused_ordering(154) 00:13:35.227 fused_ordering(155) 00:13:35.227 fused_ordering(156) 00:13:35.227 fused_ordering(157) 00:13:35.227 fused_ordering(158) 00:13:35.227 fused_ordering(159) 00:13:35.227 fused_ordering(160) 00:13:35.227 fused_ordering(161) 00:13:35.227 fused_ordering(162) 00:13:35.227 fused_ordering(163) 00:13:35.227 fused_ordering(164) 00:13:35.227 fused_ordering(165) 00:13:35.227 fused_ordering(166) 00:13:35.227 fused_ordering(167) 00:13:35.227 fused_ordering(168) 00:13:35.227 fused_ordering(169) 00:13:35.227 fused_ordering(170) 00:13:35.227 fused_ordering(171) 00:13:35.227 fused_ordering(172) 00:13:35.227 fused_ordering(173) 00:13:35.227 fused_ordering(174) 00:13:35.227 fused_ordering(175) 00:13:35.227 fused_ordering(176) 00:13:35.227 fused_ordering(177) 00:13:35.227 fused_ordering(178) 00:13:35.227 fused_ordering(179) 00:13:35.227 fused_ordering(180) 00:13:35.227 fused_ordering(181) 00:13:35.227 fused_ordering(182) 00:13:35.227 fused_ordering(183) 00:13:35.227 fused_ordering(184) 00:13:35.227 fused_ordering(185) 00:13:35.227 fused_ordering(186) 00:13:35.227 fused_ordering(187) 00:13:35.227 fused_ordering(188) 00:13:35.227 fused_ordering(189) 00:13:35.227 fused_ordering(190) 00:13:35.227 fused_ordering(191) 00:13:35.227 fused_ordering(192) 00:13:35.227 fused_ordering(193) 00:13:35.227 fused_ordering(194) 00:13:35.227 fused_ordering(195) 00:13:35.227 fused_ordering(196) 00:13:35.227 fused_ordering(197) 00:13:35.227 fused_ordering(198) 00:13:35.227 fused_ordering(199) 00:13:35.227 fused_ordering(200) 00:13:35.227 fused_ordering(201) 00:13:35.227 fused_ordering(202) 00:13:35.227 fused_ordering(203) 00:13:35.227 fused_ordering(204) 00:13:35.227 fused_ordering(205) 00:13:35.485 fused_ordering(206) 00:13:35.485 fused_ordering(207) 00:13:35.485 fused_ordering(208) 00:13:35.485 fused_ordering(209) 00:13:35.485 fused_ordering(210) 00:13:35.485 fused_ordering(211) 00:13:35.485 fused_ordering(212) 00:13:35.485 fused_ordering(213) 00:13:35.485 fused_ordering(214) 00:13:35.485 fused_ordering(215) 00:13:35.485 fused_ordering(216) 00:13:35.485 fused_ordering(217) 00:13:35.485 fused_ordering(218) 00:13:35.485 fused_ordering(219) 00:13:35.486 fused_ordering(220) 00:13:35.486 fused_ordering(221) 00:13:35.486 fused_ordering(222) 00:13:35.486 fused_ordering(223) 00:13:35.486 fused_ordering(224) 00:13:35.486 fused_ordering(225) 00:13:35.486 fused_ordering(226) 00:13:35.486 fused_ordering(227) 00:13:35.486 fused_ordering(228) 00:13:35.486 fused_ordering(229) 00:13:35.486 fused_ordering(230) 00:13:35.486 fused_ordering(231) 00:13:35.486 fused_ordering(232) 00:13:35.486 fused_ordering(233) 00:13:35.486 fused_ordering(234) 00:13:35.486 fused_ordering(235) 00:13:35.486 fused_ordering(236) 00:13:35.486 fused_ordering(237) 00:13:35.486 fused_ordering(238) 00:13:35.486 fused_ordering(239) 00:13:35.486 fused_ordering(240) 00:13:35.486 fused_ordering(241) 00:13:35.486 fused_ordering(242) 00:13:35.486 fused_ordering(243) 00:13:35.486 fused_ordering(244) 00:13:35.486 fused_ordering(245) 00:13:35.486 fused_ordering(246) 00:13:35.486 fused_ordering(247) 00:13:35.486 fused_ordering(248) 00:13:35.486 fused_ordering(249) 00:13:35.486 fused_ordering(250) 00:13:35.486 fused_ordering(251) 00:13:35.486 fused_ordering(252) 00:13:35.486 fused_ordering(253) 00:13:35.486 fused_ordering(254) 00:13:35.486 fused_ordering(255) 00:13:35.486 fused_ordering(256) 00:13:35.486 fused_ordering(257) 00:13:35.486 fused_ordering(258) 00:13:35.486 fused_ordering(259) 00:13:35.486 fused_ordering(260) 00:13:35.486 fused_ordering(261) 00:13:35.486 fused_ordering(262) 00:13:35.486 fused_ordering(263) 00:13:35.486 fused_ordering(264) 00:13:35.486 fused_ordering(265) 00:13:35.486 fused_ordering(266) 00:13:35.486 fused_ordering(267) 00:13:35.486 fused_ordering(268) 00:13:35.486 fused_ordering(269) 00:13:35.486 fused_ordering(270) 00:13:35.486 fused_ordering(271) 00:13:35.486 fused_ordering(272) 00:13:35.486 fused_ordering(273) 00:13:35.486 fused_ordering(274) 00:13:35.486 fused_ordering(275) 00:13:35.486 fused_ordering(276) 00:13:35.486 fused_ordering(277) 00:13:35.486 fused_ordering(278) 00:13:35.486 fused_ordering(279) 00:13:35.486 fused_ordering(280) 00:13:35.486 fused_ordering(281) 00:13:35.486 fused_ordering(282) 00:13:35.486 fused_ordering(283) 00:13:35.486 fused_ordering(284) 00:13:35.486 fused_ordering(285) 00:13:35.486 fused_ordering(286) 00:13:35.486 fused_ordering(287) 00:13:35.486 fused_ordering(288) 00:13:35.486 fused_ordering(289) 00:13:35.486 fused_ordering(290) 00:13:35.486 fused_ordering(291) 00:13:35.486 fused_ordering(292) 00:13:35.486 fused_ordering(293) 00:13:35.486 fused_ordering(294) 00:13:35.486 fused_ordering(295) 00:13:35.486 fused_ordering(296) 00:13:35.486 fused_ordering(297) 00:13:35.486 fused_ordering(298) 00:13:35.486 fused_ordering(299) 00:13:35.486 fused_ordering(300) 00:13:35.486 fused_ordering(301) 00:13:35.486 fused_ordering(302) 00:13:35.486 fused_ordering(303) 00:13:35.486 fused_ordering(304) 00:13:35.486 fused_ordering(305) 00:13:35.486 fused_ordering(306) 00:13:35.486 fused_ordering(307) 00:13:35.486 fused_ordering(308) 00:13:35.486 fused_ordering(309) 00:13:35.486 fused_ordering(310) 00:13:35.486 fused_ordering(311) 00:13:35.486 fused_ordering(312) 00:13:35.486 fused_ordering(313) 00:13:35.486 fused_ordering(314) 00:13:35.486 fused_ordering(315) 00:13:35.486 fused_ordering(316) 00:13:35.486 fused_ordering(317) 00:13:35.486 fused_ordering(318) 00:13:35.486 fused_ordering(319) 00:13:35.486 fused_ordering(320) 00:13:35.486 fused_ordering(321) 00:13:35.486 fused_ordering(322) 00:13:35.486 fused_ordering(323) 00:13:35.486 fused_ordering(324) 00:13:35.486 fused_ordering(325) 00:13:35.486 fused_ordering(326) 00:13:35.486 fused_ordering(327) 00:13:35.486 fused_ordering(328) 00:13:35.486 fused_ordering(329) 00:13:35.486 fused_ordering(330) 00:13:35.486 fused_ordering(331) 00:13:35.486 fused_ordering(332) 00:13:35.486 fused_ordering(333) 00:13:35.486 fused_ordering(334) 00:13:35.486 fused_ordering(335) 00:13:35.486 fused_ordering(336) 00:13:35.486 fused_ordering(337) 00:13:35.486 fused_ordering(338) 00:13:35.486 fused_ordering(339) 00:13:35.486 fused_ordering(340) 00:13:35.486 fused_ordering(341) 00:13:35.486 fused_ordering(342) 00:13:35.486 fused_ordering(343) 00:13:35.486 fused_ordering(344) 00:13:35.486 fused_ordering(345) 00:13:35.486 fused_ordering(346) 00:13:35.486 fused_ordering(347) 00:13:35.486 fused_ordering(348) 00:13:35.486 fused_ordering(349) 00:13:35.486 fused_ordering(350) 00:13:35.486 fused_ordering(351) 00:13:35.486 fused_ordering(352) 00:13:35.486 fused_ordering(353) 00:13:35.486 fused_ordering(354) 00:13:35.486 fused_ordering(355) 00:13:35.486 fused_ordering(356) 00:13:35.486 fused_ordering(357) 00:13:35.486 fused_ordering(358) 00:13:35.486 fused_ordering(359) 00:13:35.486 fused_ordering(360) 00:13:35.486 fused_ordering(361) 00:13:35.486 fused_ordering(362) 00:13:35.486 fused_ordering(363) 00:13:35.486 fused_ordering(364) 00:13:35.486 fused_ordering(365) 00:13:35.486 fused_ordering(366) 00:13:35.486 fused_ordering(367) 00:13:35.486 fused_ordering(368) 00:13:35.486 fused_ordering(369) 00:13:35.486 fused_ordering(370) 00:13:35.486 fused_ordering(371) 00:13:35.486 fused_ordering(372) 00:13:35.486 fused_ordering(373) 00:13:35.486 fused_ordering(374) 00:13:35.486 fused_ordering(375) 00:13:35.486 fused_ordering(376) 00:13:35.486 fused_ordering(377) 00:13:35.486 fused_ordering(378) 00:13:35.486 fused_ordering(379) 00:13:35.486 fused_ordering(380) 00:13:35.486 fused_ordering(381) 00:13:35.486 fused_ordering(382) 00:13:35.486 fused_ordering(383) 00:13:35.486 fused_ordering(384) 00:13:35.486 fused_ordering(385) 00:13:35.486 fused_ordering(386) 00:13:35.486 fused_ordering(387) 00:13:35.486 fused_ordering(388) 00:13:35.486 fused_ordering(389) 00:13:35.486 fused_ordering(390) 00:13:35.486 fused_ordering(391) 00:13:35.486 fused_ordering(392) 00:13:35.486 fused_ordering(393) 00:13:35.486 fused_ordering(394) 00:13:35.486 fused_ordering(395) 00:13:35.486 fused_ordering(396) 00:13:35.486 fused_ordering(397) 00:13:35.486 fused_ordering(398) 00:13:35.486 fused_ordering(399) 00:13:35.486 fused_ordering(400) 00:13:35.486 fused_ordering(401) 00:13:35.486 fused_ordering(402) 00:13:35.486 fused_ordering(403) 00:13:35.486 fused_ordering(404) 00:13:35.486 fused_ordering(405) 00:13:35.486 fused_ordering(406) 00:13:35.486 fused_ordering(407) 00:13:35.486 fused_ordering(408) 00:13:35.486 fused_ordering(409) 00:13:35.486 fused_ordering(410) 00:13:36.055 fused_ordering(411) 00:13:36.055 fused_ordering(412) 00:13:36.055 fused_ordering(413) 00:13:36.055 fused_ordering(414) 00:13:36.055 fused_ordering(415) 00:13:36.055 fused_ordering(416) 00:13:36.055 fused_ordering(417) 00:13:36.055 fused_ordering(418) 00:13:36.055 fused_ordering(419) 00:13:36.055 fused_ordering(420) 00:13:36.055 fused_ordering(421) 00:13:36.055 fused_ordering(422) 00:13:36.055 fused_ordering(423) 00:13:36.055 fused_ordering(424) 00:13:36.055 fused_ordering(425) 00:13:36.055 fused_ordering(426) 00:13:36.055 fused_ordering(427) 00:13:36.055 fused_ordering(428) 00:13:36.055 fused_ordering(429) 00:13:36.055 fused_ordering(430) 00:13:36.055 fused_ordering(431) 00:13:36.055 fused_ordering(432) 00:13:36.055 fused_ordering(433) 00:13:36.056 fused_ordering(434) 00:13:36.056 fused_ordering(435) 00:13:36.056 fused_ordering(436) 00:13:36.056 fused_ordering(437) 00:13:36.056 fused_ordering(438) 00:13:36.056 fused_ordering(439) 00:13:36.056 fused_ordering(440) 00:13:36.056 fused_ordering(441) 00:13:36.056 fused_ordering(442) 00:13:36.056 fused_ordering(443) 00:13:36.056 fused_ordering(444) 00:13:36.056 fused_ordering(445) 00:13:36.056 fused_ordering(446) 00:13:36.056 fused_ordering(447) 00:13:36.056 fused_ordering(448) 00:13:36.056 fused_ordering(449) 00:13:36.056 fused_ordering(450) 00:13:36.056 fused_ordering(451) 00:13:36.056 fused_ordering(452) 00:13:36.056 fused_ordering(453) 00:13:36.056 fused_ordering(454) 00:13:36.056 fused_ordering(455) 00:13:36.056 fused_ordering(456) 00:13:36.056 fused_ordering(457) 00:13:36.056 fused_ordering(458) 00:13:36.056 fused_ordering(459) 00:13:36.056 fused_ordering(460) 00:13:36.056 fused_ordering(461) 00:13:36.056 fused_ordering(462) 00:13:36.056 fused_ordering(463) 00:13:36.056 fused_ordering(464) 00:13:36.056 fused_ordering(465) 00:13:36.056 fused_ordering(466) 00:13:36.056 fused_ordering(467) 00:13:36.056 fused_ordering(468) 00:13:36.056 fused_ordering(469) 00:13:36.056 fused_ordering(470) 00:13:36.056 fused_ordering(471) 00:13:36.056 fused_ordering(472) 00:13:36.056 fused_ordering(473) 00:13:36.056 fused_ordering(474) 00:13:36.056 fused_ordering(475) 00:13:36.056 fused_ordering(476) 00:13:36.056 fused_ordering(477) 00:13:36.056 fused_ordering(478) 00:13:36.056 fused_ordering(479) 00:13:36.056 fused_ordering(480) 00:13:36.056 fused_ordering(481) 00:13:36.056 fused_ordering(482) 00:13:36.056 fused_ordering(483) 00:13:36.056 fused_ordering(484) 00:13:36.056 fused_ordering(485) 00:13:36.056 fused_ordering(486) 00:13:36.056 fused_ordering(487) 00:13:36.056 fused_ordering(488) 00:13:36.056 fused_ordering(489) 00:13:36.056 fused_ordering(490) 00:13:36.056 fused_ordering(491) 00:13:36.056 fused_ordering(492) 00:13:36.056 fused_ordering(493) 00:13:36.056 fused_ordering(494) 00:13:36.056 fused_ordering(495) 00:13:36.056 fused_ordering(496) 00:13:36.056 fused_ordering(497) 00:13:36.056 fused_ordering(498) 00:13:36.056 fused_ordering(499) 00:13:36.056 fused_ordering(500) 00:13:36.056 fused_ordering(501) 00:13:36.056 fused_ordering(502) 00:13:36.056 fused_ordering(503) 00:13:36.056 fused_ordering(504) 00:13:36.056 fused_ordering(505) 00:13:36.056 fused_ordering(506) 00:13:36.056 fused_ordering(507) 00:13:36.056 fused_ordering(508) 00:13:36.056 fused_ordering(509) 00:13:36.056 fused_ordering(510) 00:13:36.056 fused_ordering(511) 00:13:36.056 fused_ordering(512) 00:13:36.056 fused_ordering(513) 00:13:36.056 fused_ordering(514) 00:13:36.056 fused_ordering(515) 00:13:36.056 fused_ordering(516) 00:13:36.056 fused_ordering(517) 00:13:36.056 fused_ordering(518) 00:13:36.056 fused_ordering(519) 00:13:36.056 fused_ordering(520) 00:13:36.056 fused_ordering(521) 00:13:36.056 fused_ordering(522) 00:13:36.056 fused_ordering(523) 00:13:36.056 fused_ordering(524) 00:13:36.056 fused_ordering(525) 00:13:36.056 fused_ordering(526) 00:13:36.056 fused_ordering(527) 00:13:36.056 fused_ordering(528) 00:13:36.056 fused_ordering(529) 00:13:36.056 fused_ordering(530) 00:13:36.056 fused_ordering(531) 00:13:36.056 fused_ordering(532) 00:13:36.056 fused_ordering(533) 00:13:36.056 fused_ordering(534) 00:13:36.056 fused_ordering(535) 00:13:36.056 fused_ordering(536) 00:13:36.056 fused_ordering(537) 00:13:36.056 fused_ordering(538) 00:13:36.056 fused_ordering(539) 00:13:36.056 fused_ordering(540) 00:13:36.056 fused_ordering(541) 00:13:36.056 fused_ordering(542) 00:13:36.056 fused_ordering(543) 00:13:36.056 fused_ordering(544) 00:13:36.056 fused_ordering(545) 00:13:36.056 fused_ordering(546) 00:13:36.056 fused_ordering(547) 00:13:36.056 fused_ordering(548) 00:13:36.056 fused_ordering(549) 00:13:36.056 fused_ordering(550) 00:13:36.056 fused_ordering(551) 00:13:36.056 fused_ordering(552) 00:13:36.056 fused_ordering(553) 00:13:36.056 fused_ordering(554) 00:13:36.056 fused_ordering(555) 00:13:36.056 fused_ordering(556) 00:13:36.056 fused_ordering(557) 00:13:36.056 fused_ordering(558) 00:13:36.056 fused_ordering(559) 00:13:36.056 fused_ordering(560) 00:13:36.056 fused_ordering(561) 00:13:36.056 fused_ordering(562) 00:13:36.056 fused_ordering(563) 00:13:36.056 fused_ordering(564) 00:13:36.056 fused_ordering(565) 00:13:36.056 fused_ordering(566) 00:13:36.056 fused_ordering(567) 00:13:36.056 fused_ordering(568) 00:13:36.056 fused_ordering(569) 00:13:36.056 fused_ordering(570) 00:13:36.056 fused_ordering(571) 00:13:36.056 fused_ordering(572) 00:13:36.056 fused_ordering(573) 00:13:36.056 fused_ordering(574) 00:13:36.056 fused_ordering(575) 00:13:36.056 fused_ordering(576) 00:13:36.056 fused_ordering(577) 00:13:36.056 fused_ordering(578) 00:13:36.056 fused_ordering(579) 00:13:36.056 fused_ordering(580) 00:13:36.056 fused_ordering(581) 00:13:36.056 fused_ordering(582) 00:13:36.056 fused_ordering(583) 00:13:36.056 fused_ordering(584) 00:13:36.056 fused_ordering(585) 00:13:36.056 fused_ordering(586) 00:13:36.056 fused_ordering(587) 00:13:36.056 fused_ordering(588) 00:13:36.056 fused_ordering(589) 00:13:36.056 fused_ordering(590) 00:13:36.056 fused_ordering(591) 00:13:36.056 fused_ordering(592) 00:13:36.056 fused_ordering(593) 00:13:36.056 fused_ordering(594) 00:13:36.056 fused_ordering(595) 00:13:36.056 fused_ordering(596) 00:13:36.056 fused_ordering(597) 00:13:36.056 fused_ordering(598) 00:13:36.056 fused_ordering(599) 00:13:36.056 fused_ordering(600) 00:13:36.056 fused_ordering(601) 00:13:36.056 fused_ordering(602) 00:13:36.056 fused_ordering(603) 00:13:36.056 fused_ordering(604) 00:13:36.056 fused_ordering(605) 00:13:36.056 fused_ordering(606) 00:13:36.056 fused_ordering(607) 00:13:36.056 fused_ordering(608) 00:13:36.056 fused_ordering(609) 00:13:36.056 fused_ordering(610) 00:13:36.056 fused_ordering(611) 00:13:36.056 fused_ordering(612) 00:13:36.056 fused_ordering(613) 00:13:36.056 fused_ordering(614) 00:13:36.056 fused_ordering(615) 00:13:36.626 fused_ordering(616) 00:13:36.626 fused_ordering(617) 00:13:36.626 fused_ordering(618) 00:13:36.626 fused_ordering(619) 00:13:36.626 fused_ordering(620) 00:13:36.626 fused_ordering(621) 00:13:36.626 fused_ordering(622) 00:13:36.626 fused_ordering(623) 00:13:36.626 fused_ordering(624) 00:13:36.626 fused_ordering(625) 00:13:36.626 fused_ordering(626) 00:13:36.626 fused_ordering(627) 00:13:36.626 fused_ordering(628) 00:13:36.626 fused_ordering(629) 00:13:36.626 fused_ordering(630) 00:13:36.626 fused_ordering(631) 00:13:36.626 fused_ordering(632) 00:13:36.626 fused_ordering(633) 00:13:36.626 fused_ordering(634) 00:13:36.626 fused_ordering(635) 00:13:36.626 fused_ordering(636) 00:13:36.626 fused_ordering(637) 00:13:36.626 fused_ordering(638) 00:13:36.626 fused_ordering(639) 00:13:36.626 fused_ordering(640) 00:13:36.626 fused_ordering(641) 00:13:36.626 fused_ordering(642) 00:13:36.626 fused_ordering(643) 00:13:36.626 fused_ordering(644) 00:13:36.626 fused_ordering(645) 00:13:36.626 fused_ordering(646) 00:13:36.626 fused_ordering(647) 00:13:36.626 fused_ordering(648) 00:13:36.626 fused_ordering(649) 00:13:36.626 fused_ordering(650) 00:13:36.626 fused_ordering(651) 00:13:36.626 fused_ordering(652) 00:13:36.626 fused_ordering(653) 00:13:36.626 fused_ordering(654) 00:13:36.626 fused_ordering(655) 00:13:36.626 fused_ordering(656) 00:13:36.626 fused_ordering(657) 00:13:36.626 fused_ordering(658) 00:13:36.626 fused_ordering(659) 00:13:36.626 fused_ordering(660) 00:13:36.626 fused_ordering(661) 00:13:36.626 fused_ordering(662) 00:13:36.626 fused_ordering(663) 00:13:36.626 fused_ordering(664) 00:13:36.626 fused_ordering(665) 00:13:36.626 fused_ordering(666) 00:13:36.626 fused_ordering(667) 00:13:36.626 fused_ordering(668) 00:13:36.626 fused_ordering(669) 00:13:36.626 fused_ordering(670) 00:13:36.626 fused_ordering(671) 00:13:36.626 fused_ordering(672) 00:13:36.626 fused_ordering(673) 00:13:36.626 fused_ordering(674) 00:13:36.626 fused_ordering(675) 00:13:36.626 fused_ordering(676) 00:13:36.626 fused_ordering(677) 00:13:36.626 fused_ordering(678) 00:13:36.626 fused_ordering(679) 00:13:36.626 fused_ordering(680) 00:13:36.626 fused_ordering(681) 00:13:36.626 fused_ordering(682) 00:13:36.626 fused_ordering(683) 00:13:36.626 fused_ordering(684) 00:13:36.626 fused_ordering(685) 00:13:36.626 fused_ordering(686) 00:13:36.626 fused_ordering(687) 00:13:36.626 fused_ordering(688) 00:13:36.626 fused_ordering(689) 00:13:36.626 fused_ordering(690) 00:13:36.626 fused_ordering(691) 00:13:36.626 fused_ordering(692) 00:13:36.626 fused_ordering(693) 00:13:36.626 fused_ordering(694) 00:13:36.626 fused_ordering(695) 00:13:36.626 fused_ordering(696) 00:13:36.626 fused_ordering(697) 00:13:36.626 fused_ordering(698) 00:13:36.626 fused_ordering(699) 00:13:36.626 fused_ordering(700) 00:13:36.626 fused_ordering(701) 00:13:36.626 fused_ordering(702) 00:13:36.626 fused_ordering(703) 00:13:36.626 fused_ordering(704) 00:13:36.626 fused_ordering(705) 00:13:36.626 fused_ordering(706) 00:13:36.626 fused_ordering(707) 00:13:36.626 fused_ordering(708) 00:13:36.626 fused_ordering(709) 00:13:36.626 fused_ordering(710) 00:13:36.626 fused_ordering(711) 00:13:36.626 fused_ordering(712) 00:13:36.626 fused_ordering(713) 00:13:36.626 fused_ordering(714) 00:13:36.626 fused_ordering(715) 00:13:36.626 fused_ordering(716) 00:13:36.626 fused_ordering(717) 00:13:36.626 fused_ordering(718) 00:13:36.626 fused_ordering(719) 00:13:36.626 fused_ordering(720) 00:13:36.626 fused_ordering(721) 00:13:36.626 fused_ordering(722) 00:13:36.626 fused_ordering(723) 00:13:36.626 fused_ordering(724) 00:13:36.626 fused_ordering(725) 00:13:36.626 fused_ordering(726) 00:13:36.626 fused_ordering(727) 00:13:36.626 fused_ordering(728) 00:13:36.626 fused_ordering(729) 00:13:36.626 fused_ordering(730) 00:13:36.626 fused_ordering(731) 00:13:36.626 fused_ordering(732) 00:13:36.626 fused_ordering(733) 00:13:36.626 fused_ordering(734) 00:13:36.626 fused_ordering(735) 00:13:36.626 fused_ordering(736) 00:13:36.626 fused_ordering(737) 00:13:36.626 fused_ordering(738) 00:13:36.626 fused_ordering(739) 00:13:36.626 fused_ordering(740) 00:13:36.626 fused_ordering(741) 00:13:36.626 fused_ordering(742) 00:13:36.626 fused_ordering(743) 00:13:36.626 fused_ordering(744) 00:13:36.626 fused_ordering(745) 00:13:36.626 fused_ordering(746) 00:13:36.626 fused_ordering(747) 00:13:36.626 fused_ordering(748) 00:13:36.626 fused_ordering(749) 00:13:36.626 fused_ordering(750) 00:13:36.626 fused_ordering(751) 00:13:36.626 fused_ordering(752) 00:13:36.626 fused_ordering(753) 00:13:36.626 fused_ordering(754) 00:13:36.626 fused_ordering(755) 00:13:36.626 fused_ordering(756) 00:13:36.626 fused_ordering(757) 00:13:36.626 fused_ordering(758) 00:13:36.626 fused_ordering(759) 00:13:36.626 fused_ordering(760) 00:13:36.626 fused_ordering(761) 00:13:36.626 fused_ordering(762) 00:13:36.626 fused_ordering(763) 00:13:36.626 fused_ordering(764) 00:13:36.626 fused_ordering(765) 00:13:36.626 fused_ordering(766) 00:13:36.626 fused_ordering(767) 00:13:36.626 fused_ordering(768) 00:13:36.626 fused_ordering(769) 00:13:36.626 fused_ordering(770) 00:13:36.626 fused_ordering(771) 00:13:36.626 fused_ordering(772) 00:13:36.626 fused_ordering(773) 00:13:36.626 fused_ordering(774) 00:13:36.626 fused_ordering(775) 00:13:36.626 fused_ordering(776) 00:13:36.626 fused_ordering(777) 00:13:36.626 fused_ordering(778) 00:13:36.626 fused_ordering(779) 00:13:36.626 fused_ordering(780) 00:13:36.626 fused_ordering(781) 00:13:36.626 fused_ordering(782) 00:13:36.626 fused_ordering(783) 00:13:36.626 fused_ordering(784) 00:13:36.626 fused_ordering(785) 00:13:36.626 fused_ordering(786) 00:13:36.626 fused_ordering(787) 00:13:36.626 fused_ordering(788) 00:13:36.626 fused_ordering(789) 00:13:36.626 fused_ordering(790) 00:13:36.626 fused_ordering(791) 00:13:36.626 fused_ordering(792) 00:13:36.627 fused_ordering(793) 00:13:36.627 fused_ordering(794) 00:13:36.627 fused_ordering(795) 00:13:36.627 fused_ordering(796) 00:13:36.627 fused_ordering(797) 00:13:36.627 fused_ordering(798) 00:13:36.627 fused_ordering(799) 00:13:36.627 fused_ordering(800) 00:13:36.627 fused_ordering(801) 00:13:36.627 fused_ordering(802) 00:13:36.627 fused_ordering(803) 00:13:36.627 fused_ordering(804) 00:13:36.627 fused_ordering(805) 00:13:36.627 fused_ordering(806) 00:13:36.627 fused_ordering(807) 00:13:36.627 fused_ordering(808) 00:13:36.627 fused_ordering(809) 00:13:36.627 fused_ordering(810) 00:13:36.627 fused_ordering(811) 00:13:36.627 fused_ordering(812) 00:13:36.627 fused_ordering(813) 00:13:36.627 fused_ordering(814) 00:13:36.627 fused_ordering(815) 00:13:36.627 fused_ordering(816) 00:13:36.627 fused_ordering(817) 00:13:36.627 fused_ordering(818) 00:13:36.627 fused_ordering(819) 00:13:36.627 fused_ordering(820) 00:13:37.195 fused_ordering(821) 00:13:37.195 fused_ordering(822) 00:13:37.195 fused_ordering(823) 00:13:37.195 fused_ordering(824) 00:13:37.195 fused_ordering(825) 00:13:37.195 fused_ordering(826) 00:13:37.195 fused_ordering(827) 00:13:37.195 fused_ordering(828) 00:13:37.195 fused_ordering(829) 00:13:37.195 fused_ordering(830) 00:13:37.195 fused_ordering(831) 00:13:37.195 fused_ordering(832) 00:13:37.195 fused_ordering(833) 00:13:37.195 fused_ordering(834) 00:13:37.195 fused_ordering(835) 00:13:37.195 fused_ordering(836) 00:13:37.195 fused_ordering(837) 00:13:37.195 fused_ordering(838) 00:13:37.195 fused_ordering(839) 00:13:37.195 fused_ordering(840) 00:13:37.195 fused_ordering(841) 00:13:37.195 fused_ordering(842) 00:13:37.195 fused_ordering(843) 00:13:37.195 fused_ordering(844) 00:13:37.195 fused_ordering(845) 00:13:37.195 fused_ordering(846) 00:13:37.195 fused_ordering(847) 00:13:37.195 fused_ordering(848) 00:13:37.195 fused_ordering(849) 00:13:37.195 fused_ordering(850) 00:13:37.195 fused_ordering(851) 00:13:37.195 fused_ordering(852) 00:13:37.195 fused_ordering(853) 00:13:37.195 fused_ordering(854) 00:13:37.195 fused_ordering(855) 00:13:37.195 fused_ordering(856) 00:13:37.195 fused_ordering(857) 00:13:37.195 fused_ordering(858) 00:13:37.195 fused_ordering(859) 00:13:37.195 fused_ordering(860) 00:13:37.195 fused_ordering(861) 00:13:37.196 fused_ordering(862) 00:13:37.196 fused_ordering(863) 00:13:37.196 fused_ordering(864) 00:13:37.196 fused_ordering(865) 00:13:37.196 fused_ordering(866) 00:13:37.196 fused_ordering(867) 00:13:37.196 fused_ordering(868) 00:13:37.196 fused_ordering(869) 00:13:37.196 fused_ordering(870) 00:13:37.196 fused_ordering(871) 00:13:37.196 fused_ordering(872) 00:13:37.196 fused_ordering(873) 00:13:37.196 fused_ordering(874) 00:13:37.196 fused_ordering(875) 00:13:37.196 fused_ordering(876) 00:13:37.196 fused_ordering(877) 00:13:37.196 fused_ordering(878) 00:13:37.196 fused_ordering(879) 00:13:37.196 fused_ordering(880) 00:13:37.196 fused_ordering(881) 00:13:37.196 fused_ordering(882) 00:13:37.196 fused_ordering(883) 00:13:37.196 fused_ordering(884) 00:13:37.196 fused_ordering(885) 00:13:37.196 fused_ordering(886) 00:13:37.196 fused_ordering(887) 00:13:37.196 fused_ordering(888) 00:13:37.196 fused_ordering(889) 00:13:37.196 fused_ordering(890) 00:13:37.196 fused_ordering(891) 00:13:37.196 fused_ordering(892) 00:13:37.196 fused_ordering(893) 00:13:37.196 fused_ordering(894) 00:13:37.196 fused_ordering(895) 00:13:37.196 fused_ordering(896) 00:13:37.196 fused_ordering(897) 00:13:37.196 fused_ordering(898) 00:13:37.196 fused_ordering(899) 00:13:37.196 fused_ordering(900) 00:13:37.196 fused_ordering(901) 00:13:37.196 fused_ordering(902) 00:13:37.196 fused_ordering(903) 00:13:37.196 fused_ordering(904) 00:13:37.196 fused_ordering(905) 00:13:37.196 fused_ordering(906) 00:13:37.196 fused_ordering(907) 00:13:37.196 fused_ordering(908) 00:13:37.196 fused_ordering(909) 00:13:37.196 fused_ordering(910) 00:13:37.196 fused_ordering(911) 00:13:37.196 fused_ordering(912) 00:13:37.196 fused_ordering(913) 00:13:37.196 fused_ordering(914) 00:13:37.196 fused_ordering(915) 00:13:37.196 fused_ordering(916) 00:13:37.196 fused_ordering(917) 00:13:37.196 fused_ordering(918) 00:13:37.196 fused_ordering(919) 00:13:37.196 fused_ordering(920) 00:13:37.196 fused_ordering(921) 00:13:37.196 fused_ordering(922) 00:13:37.196 fused_ordering(923) 00:13:37.196 fused_ordering(924) 00:13:37.196 fused_ordering(925) 00:13:37.196 fused_ordering(926) 00:13:37.196 fused_ordering(927) 00:13:37.196 fused_ordering(928) 00:13:37.196 fused_ordering(929) 00:13:37.196 fused_ordering(930) 00:13:37.196 fused_ordering(931) 00:13:37.196 fused_ordering(932) 00:13:37.196 fused_ordering(933) 00:13:37.196 fused_ordering(934) 00:13:37.196 fused_ordering(935) 00:13:37.196 fused_ordering(936) 00:13:37.196 fused_ordering(937) 00:13:37.196 fused_ordering(938) 00:13:37.196 fused_ordering(939) 00:13:37.196 fused_ordering(940) 00:13:37.196 fused_ordering(941) 00:13:37.196 fused_ordering(942) 00:13:37.196 fused_ordering(943) 00:13:37.196 fused_ordering(944) 00:13:37.196 fused_ordering(945) 00:13:37.196 fused_ordering(946) 00:13:37.196 fused_ordering(947) 00:13:37.196 fused_ordering(948) 00:13:37.196 fused_ordering(949) 00:13:37.196 fused_ordering(950) 00:13:37.196 fused_ordering(951) 00:13:37.196 fused_ordering(952) 00:13:37.196 fused_ordering(953) 00:13:37.196 fused_ordering(954) 00:13:37.196 fused_ordering(955) 00:13:37.196 fused_ordering(956) 00:13:37.196 fused_ordering(957) 00:13:37.196 fused_ordering(958) 00:13:37.196 fused_ordering(959) 00:13:37.196 fused_ordering(960) 00:13:37.196 fused_ordering(961) 00:13:37.196 fused_ordering(962) 00:13:37.196 fused_ordering(963) 00:13:37.196 fused_ordering(964) 00:13:37.196 fused_ordering(965) 00:13:37.196 fused_ordering(966) 00:13:37.196 fused_ordering(967) 00:13:37.196 fused_ordering(968) 00:13:37.196 fused_ordering(969) 00:13:37.196 fused_ordering(970) 00:13:37.196 fused_ordering(971) 00:13:37.196 fused_ordering(972) 00:13:37.196 fused_ordering(973) 00:13:37.196 fused_ordering(974) 00:13:37.196 fused_ordering(975) 00:13:37.196 fused_ordering(976) 00:13:37.196 fused_ordering(977) 00:13:37.196 fused_ordering(978) 00:13:37.196 fused_ordering(979) 00:13:37.196 fused_ordering(980) 00:13:37.196 fused_ordering(981) 00:13:37.196 fused_ordering(982) 00:13:37.196 fused_ordering(983) 00:13:37.196 fused_ordering(984) 00:13:37.196 fused_ordering(985) 00:13:37.196 fused_ordering(986) 00:13:37.196 fused_ordering(987) 00:13:37.196 fused_ordering(988) 00:13:37.196 fused_ordering(989) 00:13:37.196 fused_ordering(990) 00:13:37.196 fused_ordering(991) 00:13:37.196 fused_ordering(992) 00:13:37.196 fused_ordering(993) 00:13:37.196 fused_ordering(994) 00:13:37.196 fused_ordering(995) 00:13:37.196 fused_ordering(996) 00:13:37.196 fused_ordering(997) 00:13:37.196 fused_ordering(998) 00:13:37.196 fused_ordering(999) 00:13:37.196 fused_ordering(1000) 00:13:37.196 fused_ordering(1001) 00:13:37.196 fused_ordering(1002) 00:13:37.196 fused_ordering(1003) 00:13:37.196 fused_ordering(1004) 00:13:37.196 fused_ordering(1005) 00:13:37.196 fused_ordering(1006) 00:13:37.196 fused_ordering(1007) 00:13:37.196 fused_ordering(1008) 00:13:37.196 fused_ordering(1009) 00:13:37.196 fused_ordering(1010) 00:13:37.196 fused_ordering(1011) 00:13:37.196 fused_ordering(1012) 00:13:37.196 fused_ordering(1013) 00:13:37.196 fused_ordering(1014) 00:13:37.196 fused_ordering(1015) 00:13:37.196 fused_ordering(1016) 00:13:37.196 fused_ordering(1017) 00:13:37.196 fused_ordering(1018) 00:13:37.196 fused_ordering(1019) 00:13:37.196 fused_ordering(1020) 00:13:37.196 fused_ordering(1021) 00:13:37.196 fused_ordering(1022) 00:13:37.196 fused_ordering(1023) 00:13:37.196 02:18:40 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:13:37.196 02:18:40 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:13:37.196 02:18:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:37.196 02:18:40 -- nvmf/common.sh@116 -- # sync 00:13:37.196 02:18:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:37.196 02:18:40 -- nvmf/common.sh@119 -- # set +e 00:13:37.196 02:18:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:37.196 02:18:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:37.196 rmmod nvme_tcp 00:13:37.196 rmmod nvme_fabrics 00:13:37.196 rmmod nvme_keyring 00:13:37.196 02:18:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:37.455 02:18:40 -- nvmf/common.sh@123 -- # set -e 00:13:37.455 02:18:40 -- nvmf/common.sh@124 -- # return 0 00:13:37.455 02:18:40 -- nvmf/common.sh@477 -- # '[' -n 84335 ']' 00:13:37.455 02:18:40 -- nvmf/common.sh@478 -- # killprocess 84335 00:13:37.455 02:18:40 -- common/autotest_common.sh@936 -- # '[' -z 84335 ']' 00:13:37.455 02:18:40 -- common/autotest_common.sh@940 -- # kill -0 84335 00:13:37.455 02:18:40 -- common/autotest_common.sh@941 -- # uname 00:13:37.455 02:18:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:37.455 02:18:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 84335 00:13:37.455 02:18:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:37.455 02:18:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:37.455 02:18:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 84335' 00:13:37.455 killing process with pid 84335 00:13:37.455 02:18:40 -- common/autotest_common.sh@955 -- # kill 84335 00:13:37.455 02:18:40 -- common/autotest_common.sh@960 -- # wait 84335 00:13:37.713 02:18:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:37.713 02:18:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:37.713 02:18:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:37.713 02:18:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:37.713 02:18:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:37.713 02:18:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:37.713 02:18:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:37.713 02:18:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:39.617 02:18:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:39.617 00:13:39.617 real 0m8.491s 00:13:39.617 user 0m6.132s 00:13:39.617 sys 0m3.410s 00:13:39.617 02:18:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:39.617 02:18:43 -- common/autotest_common.sh@10 -- # set +x 00:13:39.617 ************************************ 00:13:39.617 END TEST nvmf_fused_ordering 00:13:39.617 ************************************ 00:13:39.617 02:18:43 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:39.617 02:18:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:39.617 02:18:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:39.617 02:18:43 -- common/autotest_common.sh@10 -- # set +x 00:13:39.617 ************************************ 00:13:39.617 START TEST nvmf_delete_subsystem 00:13:39.617 ************************************ 00:13:39.617 02:18:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:39.877 * Looking for test storage... 00:13:39.877 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:39.877 02:18:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:39.877 02:18:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:39.877 02:18:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:39.877 02:18:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:39.877 02:18:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:39.877 02:18:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:39.877 02:18:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:39.877 02:18:43 -- scripts/common.sh@335 -- # IFS=.-: 00:13:39.877 02:18:43 -- scripts/common.sh@335 -- # read -ra ver1 00:13:39.877 02:18:43 -- scripts/common.sh@336 -- # IFS=.-: 00:13:39.877 02:18:43 -- scripts/common.sh@336 -- # read -ra ver2 00:13:39.877 02:18:43 -- scripts/common.sh@337 -- # local 'op=<' 00:13:39.877 02:18:43 -- scripts/common.sh@339 -- # ver1_l=2 00:13:39.877 02:18:43 -- scripts/common.sh@340 -- # ver2_l=1 00:13:39.877 02:18:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:39.877 02:18:43 -- scripts/common.sh@343 -- # case "$op" in 00:13:39.877 02:18:43 -- scripts/common.sh@344 -- # : 1 00:13:39.877 02:18:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:39.877 02:18:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:39.877 02:18:43 -- scripts/common.sh@364 -- # decimal 1 00:13:39.877 02:18:43 -- scripts/common.sh@352 -- # local d=1 00:13:39.877 02:18:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:39.877 02:18:43 -- scripts/common.sh@354 -- # echo 1 00:13:39.877 02:18:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:39.877 02:18:43 -- scripts/common.sh@365 -- # decimal 2 00:13:39.877 02:18:43 -- scripts/common.sh@352 -- # local d=2 00:13:39.877 02:18:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:39.877 02:18:43 -- scripts/common.sh@354 -- # echo 2 00:13:39.877 02:18:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:39.877 02:18:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:39.877 02:18:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:39.877 02:18:43 -- scripts/common.sh@367 -- # return 0 00:13:39.877 02:18:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:39.877 02:18:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:39.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:39.877 --rc genhtml_branch_coverage=1 00:13:39.877 --rc genhtml_function_coverage=1 00:13:39.877 --rc genhtml_legend=1 00:13:39.877 --rc geninfo_all_blocks=1 00:13:39.877 --rc geninfo_unexecuted_blocks=1 00:13:39.877 00:13:39.877 ' 00:13:39.877 02:18:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:39.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:39.877 --rc genhtml_branch_coverage=1 00:13:39.877 --rc genhtml_function_coverage=1 00:13:39.878 --rc genhtml_legend=1 00:13:39.878 --rc geninfo_all_blocks=1 00:13:39.878 --rc geninfo_unexecuted_blocks=1 00:13:39.878 00:13:39.878 ' 00:13:39.878 02:18:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:39.878 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:39.878 --rc genhtml_branch_coverage=1 00:13:39.878 --rc genhtml_function_coverage=1 00:13:39.878 --rc genhtml_legend=1 00:13:39.878 --rc geninfo_all_blocks=1 00:13:39.878 --rc geninfo_unexecuted_blocks=1 00:13:39.878 00:13:39.878 ' 00:13:39.878 02:18:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:39.878 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:39.878 --rc genhtml_branch_coverage=1 00:13:39.878 --rc genhtml_function_coverage=1 00:13:39.878 --rc genhtml_legend=1 00:13:39.878 --rc geninfo_all_blocks=1 00:13:39.878 --rc geninfo_unexecuted_blocks=1 00:13:39.878 00:13:39.878 ' 00:13:39.878 02:18:43 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:39.878 02:18:43 -- nvmf/common.sh@7 -- # uname -s 00:13:39.878 02:18:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:39.878 02:18:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:39.878 02:18:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:39.878 02:18:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:39.878 02:18:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:39.878 02:18:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:39.878 02:18:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:39.878 02:18:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:39.878 02:18:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:39.878 02:18:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:39.878 02:18:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:39.878 02:18:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:39.878 02:18:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:39.878 02:18:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:39.878 02:18:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:39.878 02:18:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:39.878 02:18:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:39.878 02:18:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:39.878 02:18:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:39.878 02:18:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:39.878 02:18:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:39.878 02:18:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:39.878 02:18:43 -- paths/export.sh@5 -- # export PATH 00:13:39.878 02:18:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:39.878 02:18:43 -- nvmf/common.sh@46 -- # : 0 00:13:39.878 02:18:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:39.878 02:18:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:39.878 02:18:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:39.878 02:18:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:39.878 02:18:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:39.878 02:18:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:39.878 02:18:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:39.878 02:18:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:39.878 02:18:43 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:13:39.878 02:18:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:39.878 02:18:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:39.878 02:18:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:39.878 02:18:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:39.878 02:18:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:39.878 02:18:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:39.878 02:18:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:39.878 02:18:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:39.878 02:18:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:39.878 02:18:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:39.878 02:18:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:39.878 02:18:43 -- common/autotest_common.sh@10 -- # set +x 00:13:42.409 02:18:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:42.409 02:18:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:42.409 02:18:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:42.409 02:18:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:42.409 02:18:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:42.409 02:18:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:42.409 02:18:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:42.409 02:18:45 -- nvmf/common.sh@294 -- # net_devs=() 00:13:42.409 02:18:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:42.409 02:18:45 -- nvmf/common.sh@295 -- # e810=() 00:13:42.409 02:18:45 -- nvmf/common.sh@295 -- # local -ga e810 00:13:42.409 02:18:45 -- nvmf/common.sh@296 -- # x722=() 00:13:42.409 02:18:45 -- nvmf/common.sh@296 -- # local -ga x722 00:13:42.409 02:18:45 -- nvmf/common.sh@297 -- # mlx=() 00:13:42.409 02:18:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:42.409 02:18:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:42.409 02:18:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:42.409 02:18:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:42.409 02:18:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:42.409 02:18:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:42.409 02:18:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:42.409 02:18:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:42.409 02:18:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:42.409 02:18:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:42.409 02:18:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:42.409 02:18:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:42.409 02:18:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:42.409 02:18:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:42.409 02:18:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:42.409 02:18:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:42.409 02:18:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:42.409 02:18:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:42.409 02:18:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:42.409 02:18:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:42.409 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:42.409 02:18:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:42.409 02:18:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:42.409 02:18:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:42.409 02:18:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:42.409 02:18:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:42.409 02:18:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:42.409 02:18:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:42.409 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:42.409 02:18:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:42.409 02:18:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:42.409 02:18:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:42.409 02:18:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:42.409 02:18:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:42.409 02:18:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:42.409 02:18:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:42.409 02:18:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:42.409 02:18:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:42.409 02:18:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:42.409 02:18:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:42.409 02:18:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:42.409 02:18:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:42.409 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:42.409 02:18:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:42.409 02:18:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:42.410 02:18:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:42.410 02:18:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:42.410 02:18:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:42.410 02:18:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:42.410 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:42.410 02:18:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:42.410 02:18:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:42.410 02:18:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:42.410 02:18:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:42.410 02:18:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:42.410 02:18:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:42.410 02:18:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:42.410 02:18:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:42.410 02:18:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:42.410 02:18:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:42.410 02:18:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:42.410 02:18:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:42.410 02:18:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:42.410 02:18:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:42.410 02:18:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:42.410 02:18:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:42.410 02:18:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:42.410 02:18:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:42.410 02:18:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:42.410 02:18:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:42.410 02:18:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:42.410 02:18:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:42.410 02:18:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:42.410 02:18:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:42.410 02:18:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:42.410 02:18:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:42.410 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:42.410 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.232 ms 00:13:42.410 00:13:42.410 --- 10.0.0.2 ping statistics --- 00:13:42.410 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:42.410 rtt min/avg/max/mdev = 0.232/0.232/0.232/0.000 ms 00:13:42.410 02:18:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:42.410 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:42.410 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.079 ms 00:13:42.410 00:13:42.410 --- 10.0.0.1 ping statistics --- 00:13:42.410 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:42.410 rtt min/avg/max/mdev = 0.079/0.079/0.079/0.000 ms 00:13:42.410 02:18:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:42.410 02:18:45 -- nvmf/common.sh@410 -- # return 0 00:13:42.410 02:18:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:42.410 02:18:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:42.410 02:18:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:42.410 02:18:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:42.410 02:18:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:42.410 02:18:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:42.410 02:18:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:42.410 02:18:45 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:13:42.410 02:18:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:42.410 02:18:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:42.410 02:18:45 -- common/autotest_common.sh@10 -- # set +x 00:13:42.410 02:18:45 -- nvmf/common.sh@469 -- # nvmfpid=86769 00:13:42.410 02:18:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:13:42.410 02:18:45 -- nvmf/common.sh@470 -- # waitforlisten 86769 00:13:42.410 02:18:45 -- common/autotest_common.sh@829 -- # '[' -z 86769 ']' 00:13:42.410 02:18:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:42.410 02:18:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:42.410 02:18:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:42.410 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:42.410 02:18:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:42.410 02:18:45 -- common/autotest_common.sh@10 -- # set +x 00:13:42.410 [2024-11-29 02:18:45.715469] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:42.410 [2024-11-29 02:18:45.715562] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:42.410 EAL: No free 2048 kB hugepages reported on node 1 00:13:42.410 [2024-11-29 02:18:45.802840] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:13:42.410 [2024-11-29 02:18:45.935515] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:42.410 [2024-11-29 02:18:45.935694] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:42.410 [2024-11-29 02:18:45.935723] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:42.410 [2024-11-29 02:18:45.935747] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:42.410 [2024-11-29 02:18:45.935821] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:42.410 [2024-11-29 02:18:45.935830] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:42.410 02:18:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:42.410 02:18:46 -- common/autotest_common.sh@862 -- # return 0 00:13:42.410 02:18:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:42.410 02:18:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:42.410 02:18:46 -- common/autotest_common.sh@10 -- # set +x 00:13:42.410 02:18:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:42.410 02:18:46 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:42.410 02:18:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.410 02:18:46 -- common/autotest_common.sh@10 -- # set +x 00:13:42.410 [2024-11-29 02:18:46.083195] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:42.410 02:18:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.410 02:18:46 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:42.410 02:18:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.410 02:18:46 -- common/autotest_common.sh@10 -- # set +x 00:13:42.670 02:18:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.670 02:18:46 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:42.670 02:18:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.670 02:18:46 -- common/autotest_common.sh@10 -- # set +x 00:13:42.670 [2024-11-29 02:18:46.099363] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:42.670 02:18:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.670 02:18:46 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:42.670 02:18:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.670 02:18:46 -- common/autotest_common.sh@10 -- # set +x 00:13:42.670 NULL1 00:13:42.670 02:18:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.670 02:18:46 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:42.670 02:18:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.671 02:18:46 -- common/autotest_common.sh@10 -- # set +x 00:13:42.671 Delay0 00:13:42.671 02:18:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.671 02:18:46 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:42.671 02:18:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.671 02:18:46 -- common/autotest_common.sh@10 -- # set +x 00:13:42.671 02:18:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.671 02:18:46 -- target/delete_subsystem.sh@28 -- # perf_pid=86893 00:13:42.671 02:18:46 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:42.671 02:18:46 -- target/delete_subsystem.sh@30 -- # sleep 2 00:13:42.671 EAL: No free 2048 kB hugepages reported on node 1 00:13:42.671 [2024-11-29 02:18:46.174131] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:44.581 02:18:48 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:44.581 02:18:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.581 02:18:48 -- common/autotest_common.sh@10 -- # set +x 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 starting I/O failed: -6 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 starting I/O failed: -6 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 starting I/O failed: -6 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 starting I/O failed: -6 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 starting I/O failed: -6 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 starting I/O failed: -6 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 starting I/O failed: -6 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 starting I/O failed: -6 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 starting I/O failed: -6 00:13:44.842 [2024-11-29 02:18:48.264660] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fa36000c1d0 is same with the state(5) to be set 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 starting I/O failed: -6 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 starting I/O failed: -6 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 starting I/O failed: -6 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 starting I/O failed: -6 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 starting I/O failed: -6 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 starting I/O failed: -6 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 starting I/O failed: -6 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 starting I/O failed: -6 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 starting I/O failed: -6 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 starting I/O failed: -6 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 starting I/O failed: -6 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 Write completed with error (sct=0, sc=8) 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.842 starting I/O failed: -6 00:13:44.842 Read completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Write completed with error (sct=0, sc=8) 00:13:44.843 Write completed with error (sct=0, sc=8) 00:13:44.843 Write completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 Write completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Write completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 Write completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Write completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Write completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 Write completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Write completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 Write completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Write completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Write completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 Write completed with error (sct=0, sc=8) 00:13:44.843 [2024-11-29 02:18:48.265710] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fa360000c00 is same with the state(5) to be set 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Write completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 Write completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Write completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 Write completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Write completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 Write completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 Write completed with error (sct=0, sc=8) 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Write completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Write completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 Write completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 Read completed with error (sct=0, sc=8) 00:13:44.843 starting I/O failed: -6 00:13:44.843 starting I/O failed: -6 00:13:44.843 starting I/O failed: -6 00:13:44.843 starting I/O failed: -6 00:13:44.843 starting I/O failed: -6 00:13:44.843 starting I/O failed: -6 00:13:44.843 starting I/O failed: -6 00:13:45.779 [2024-11-29 02:18:49.234472] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19c1960 is same with the state(5) to be set 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 [2024-11-29 02:18:49.264046] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19a84c0 is same with the state(5) to be set 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 [2024-11-29 02:18:49.264390] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19a8a20 is same with the state(5) to be set 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 [2024-11-29 02:18:49.268411] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fa36000bf20 is same with the state(5) to be set 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Write completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 Read completed with error (sct=0, sc=8) 00:13:45.779 [2024-11-29 02:18:49.268826] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fa36000c480 is same with the state(5) to be set 00:13:45.779 [2024-11-29 02:18:49.269238] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19c1960 (9): Bad file descriptor 00:13:45.779 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:13:45.779 02:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.779 02:18:49 -- target/delete_subsystem.sh@34 -- # delay=0 00:13:45.779 02:18:49 -- target/delete_subsystem.sh@35 -- # kill -0 86893 00:13:45.779 02:18:49 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:13:45.779 Initializing NVMe Controllers 00:13:45.779 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:45.779 Controller IO queue size 128, less than required. 00:13:45.779 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:45.779 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:45.779 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:45.779 Initialization complete. Launching workers. 00:13:45.779 ======================================================== 00:13:45.779 Latency(us) 00:13:45.779 Device Information : IOPS MiB/s Average min max 00:13:45.779 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 182.57 0.09 925778.41 563.19 2000223.88 00:13:45.780 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 145.86 0.07 978684.14 1074.86 2004587.32 00:13:45.780 ======================================================== 00:13:45.780 Total : 328.42 0.16 949274.31 563.19 2004587.32 00:13:45.780 00:13:46.345 02:18:49 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:13:46.345 02:18:49 -- target/delete_subsystem.sh@35 -- # kill -0 86893 00:13:46.345 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (86893) - No such process 00:13:46.345 02:18:49 -- target/delete_subsystem.sh@45 -- # NOT wait 86893 00:13:46.345 02:18:49 -- common/autotest_common.sh@650 -- # local es=0 00:13:46.345 02:18:49 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 86893 00:13:46.345 02:18:49 -- common/autotest_common.sh@638 -- # local arg=wait 00:13:46.345 02:18:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:46.345 02:18:49 -- common/autotest_common.sh@642 -- # type -t wait 00:13:46.345 02:18:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:46.345 02:18:49 -- common/autotest_common.sh@653 -- # wait 86893 00:13:46.345 02:18:49 -- common/autotest_common.sh@653 -- # es=1 00:13:46.345 02:18:49 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:46.345 02:18:49 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:46.345 02:18:49 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:46.345 02:18:49 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:46.345 02:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.345 02:18:49 -- common/autotest_common.sh@10 -- # set +x 00:13:46.345 02:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.345 02:18:49 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:46.345 02:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.345 02:18:49 -- common/autotest_common.sh@10 -- # set +x 00:13:46.345 [2024-11-29 02:18:49.792352] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:46.345 02:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.345 02:18:49 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:46.345 02:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.345 02:18:49 -- common/autotest_common.sh@10 -- # set +x 00:13:46.345 02:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.345 02:18:49 -- target/delete_subsystem.sh@54 -- # perf_pid=87333 00:13:46.345 02:18:49 -- target/delete_subsystem.sh@56 -- # delay=0 00:13:46.345 02:18:49 -- target/delete_subsystem.sh@57 -- # kill -0 87333 00:13:46.345 02:18:49 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:46.345 02:18:49 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:46.345 EAL: No free 2048 kB hugepages reported on node 1 00:13:46.345 [2024-11-29 02:18:49.855273] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:46.908 02:18:50 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:46.908 02:18:50 -- target/delete_subsystem.sh@57 -- # kill -0 87333 00:13:46.908 02:18:50 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:47.164 02:18:50 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:47.164 02:18:50 -- target/delete_subsystem.sh@57 -- # kill -0 87333 00:13:47.164 02:18:50 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:47.727 02:18:51 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:47.727 02:18:51 -- target/delete_subsystem.sh@57 -- # kill -0 87333 00:13:47.727 02:18:51 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:48.290 02:18:51 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:48.290 02:18:51 -- target/delete_subsystem.sh@57 -- # kill -0 87333 00:13:48.290 02:18:51 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:48.854 02:18:52 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:48.854 02:18:52 -- target/delete_subsystem.sh@57 -- # kill -0 87333 00:13:48.854 02:18:52 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:49.518 02:18:52 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:49.518 02:18:52 -- target/delete_subsystem.sh@57 -- # kill -0 87333 00:13:49.518 02:18:52 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:49.518 Initializing NVMe Controllers 00:13:49.518 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:49.518 Controller IO queue size 128, less than required. 00:13:49.518 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:49.518 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:49.518 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:49.518 Initialization complete. Launching workers. 00:13:49.518 ======================================================== 00:13:49.518 Latency(us) 00:13:49.518 Device Information : IOPS MiB/s Average min max 00:13:49.518 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1004851.63 1000153.04 1041923.51 00:13:49.518 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1003611.08 1000177.24 1041049.45 00:13:49.518 ======================================================== 00:13:49.518 Total : 256.00 0.12 1004231.36 1000153.04 1041923.51 00:13:49.518 00:13:49.810 02:18:53 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:49.810 02:18:53 -- target/delete_subsystem.sh@57 -- # kill -0 87333 00:13:49.810 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (87333) - No such process 00:13:49.810 02:18:53 -- target/delete_subsystem.sh@67 -- # wait 87333 00:13:49.810 02:18:53 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:13:49.810 02:18:53 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:13:49.810 02:18:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:49.810 02:18:53 -- nvmf/common.sh@116 -- # sync 00:13:49.810 02:18:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:49.810 02:18:53 -- nvmf/common.sh@119 -- # set +e 00:13:49.810 02:18:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:49.810 02:18:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:49.810 rmmod nvme_tcp 00:13:49.810 rmmod nvme_fabrics 00:13:49.810 rmmod nvme_keyring 00:13:49.810 02:18:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:49.810 02:18:53 -- nvmf/common.sh@123 -- # set -e 00:13:49.810 02:18:53 -- nvmf/common.sh@124 -- # return 0 00:13:49.810 02:18:53 -- nvmf/common.sh@477 -- # '[' -n 86769 ']' 00:13:49.810 02:18:53 -- nvmf/common.sh@478 -- # killprocess 86769 00:13:49.810 02:18:53 -- common/autotest_common.sh@936 -- # '[' -z 86769 ']' 00:13:49.810 02:18:53 -- common/autotest_common.sh@940 -- # kill -0 86769 00:13:49.810 02:18:53 -- common/autotest_common.sh@941 -- # uname 00:13:49.810 02:18:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:49.810 02:18:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 86769 00:13:49.810 02:18:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:49.810 02:18:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:49.810 02:18:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 86769' 00:13:49.810 killing process with pid 86769 00:13:49.810 02:18:53 -- common/autotest_common.sh@955 -- # kill 86769 00:13:49.810 02:18:53 -- common/autotest_common.sh@960 -- # wait 86769 00:13:50.069 02:18:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:50.069 02:18:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:50.069 02:18:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:50.069 02:18:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:50.069 02:18:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:50.069 02:18:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:50.069 02:18:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:50.069 02:18:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:52.603 02:18:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:52.603 00:13:52.603 real 0m12.473s 00:13:52.603 user 0m27.946s 00:13:52.603 sys 0m3.019s 00:13:52.603 02:18:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:52.603 02:18:55 -- common/autotest_common.sh@10 -- # set +x 00:13:52.603 ************************************ 00:13:52.603 END TEST nvmf_delete_subsystem 00:13:52.603 ************************************ 00:13:52.603 02:18:55 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:13:52.603 02:18:55 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:13:52.603 02:18:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:52.603 02:18:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:52.603 02:18:55 -- common/autotest_common.sh@10 -- # set +x 00:13:52.603 ************************************ 00:13:52.603 START TEST nvmf_nvme_cli 00:13:52.603 ************************************ 00:13:52.603 02:18:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:13:52.603 * Looking for test storage... 00:13:52.603 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:52.603 02:18:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:52.603 02:18:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:52.603 02:18:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:52.603 02:18:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:52.603 02:18:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:52.603 02:18:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:52.603 02:18:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:52.603 02:18:55 -- scripts/common.sh@335 -- # IFS=.-: 00:13:52.603 02:18:55 -- scripts/common.sh@335 -- # read -ra ver1 00:13:52.603 02:18:55 -- scripts/common.sh@336 -- # IFS=.-: 00:13:52.603 02:18:55 -- scripts/common.sh@336 -- # read -ra ver2 00:13:52.603 02:18:55 -- scripts/common.sh@337 -- # local 'op=<' 00:13:52.603 02:18:55 -- scripts/common.sh@339 -- # ver1_l=2 00:13:52.603 02:18:55 -- scripts/common.sh@340 -- # ver2_l=1 00:13:52.603 02:18:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:52.603 02:18:55 -- scripts/common.sh@343 -- # case "$op" in 00:13:52.603 02:18:55 -- scripts/common.sh@344 -- # : 1 00:13:52.603 02:18:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:52.603 02:18:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:52.603 02:18:55 -- scripts/common.sh@364 -- # decimal 1 00:13:52.603 02:18:55 -- scripts/common.sh@352 -- # local d=1 00:13:52.603 02:18:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:52.603 02:18:55 -- scripts/common.sh@354 -- # echo 1 00:13:52.603 02:18:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:52.603 02:18:55 -- scripts/common.sh@365 -- # decimal 2 00:13:52.603 02:18:55 -- scripts/common.sh@352 -- # local d=2 00:13:52.603 02:18:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:52.603 02:18:55 -- scripts/common.sh@354 -- # echo 2 00:13:52.603 02:18:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:52.603 02:18:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:52.603 02:18:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:52.603 02:18:55 -- scripts/common.sh@367 -- # return 0 00:13:52.603 02:18:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:52.603 02:18:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:52.603 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:52.603 --rc genhtml_branch_coverage=1 00:13:52.603 --rc genhtml_function_coverage=1 00:13:52.603 --rc genhtml_legend=1 00:13:52.603 --rc geninfo_all_blocks=1 00:13:52.603 --rc geninfo_unexecuted_blocks=1 00:13:52.603 00:13:52.603 ' 00:13:52.603 02:18:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:52.603 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:52.603 --rc genhtml_branch_coverage=1 00:13:52.604 --rc genhtml_function_coverage=1 00:13:52.604 --rc genhtml_legend=1 00:13:52.604 --rc geninfo_all_blocks=1 00:13:52.604 --rc geninfo_unexecuted_blocks=1 00:13:52.604 00:13:52.604 ' 00:13:52.604 02:18:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:52.604 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:52.604 --rc genhtml_branch_coverage=1 00:13:52.604 --rc genhtml_function_coverage=1 00:13:52.604 --rc genhtml_legend=1 00:13:52.604 --rc geninfo_all_blocks=1 00:13:52.604 --rc geninfo_unexecuted_blocks=1 00:13:52.604 00:13:52.604 ' 00:13:52.604 02:18:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:52.604 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:52.604 --rc genhtml_branch_coverage=1 00:13:52.604 --rc genhtml_function_coverage=1 00:13:52.604 --rc genhtml_legend=1 00:13:52.604 --rc geninfo_all_blocks=1 00:13:52.604 --rc geninfo_unexecuted_blocks=1 00:13:52.604 00:13:52.604 ' 00:13:52.604 02:18:55 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:52.604 02:18:55 -- nvmf/common.sh@7 -- # uname -s 00:13:52.604 02:18:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:52.604 02:18:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:52.604 02:18:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:52.604 02:18:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:52.604 02:18:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:52.604 02:18:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:52.604 02:18:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:52.604 02:18:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:52.604 02:18:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:52.604 02:18:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:52.604 02:18:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:52.604 02:18:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:52.604 02:18:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:52.604 02:18:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:52.604 02:18:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:52.604 02:18:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:52.604 02:18:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:52.604 02:18:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:52.604 02:18:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:52.604 02:18:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.604 02:18:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.604 02:18:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.604 02:18:55 -- paths/export.sh@5 -- # export PATH 00:13:52.604 02:18:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.604 02:18:55 -- nvmf/common.sh@46 -- # : 0 00:13:52.604 02:18:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:52.604 02:18:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:52.604 02:18:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:52.604 02:18:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:52.604 02:18:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:52.604 02:18:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:52.604 02:18:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:52.604 02:18:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:52.604 02:18:55 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:52.604 02:18:55 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:52.604 02:18:55 -- target/nvme_cli.sh@14 -- # devs=() 00:13:52.604 02:18:55 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:13:52.604 02:18:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:52.604 02:18:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:52.604 02:18:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:52.604 02:18:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:52.604 02:18:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:52.604 02:18:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:52.604 02:18:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:52.604 02:18:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:52.604 02:18:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:52.604 02:18:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:52.604 02:18:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:52.604 02:18:55 -- common/autotest_common.sh@10 -- # set +x 00:13:54.508 02:18:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:54.508 02:18:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:54.508 02:18:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:54.508 02:18:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:54.508 02:18:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:54.508 02:18:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:54.508 02:18:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:54.508 02:18:57 -- nvmf/common.sh@294 -- # net_devs=() 00:13:54.508 02:18:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:54.508 02:18:57 -- nvmf/common.sh@295 -- # e810=() 00:13:54.508 02:18:57 -- nvmf/common.sh@295 -- # local -ga e810 00:13:54.508 02:18:57 -- nvmf/common.sh@296 -- # x722=() 00:13:54.508 02:18:57 -- nvmf/common.sh@296 -- # local -ga x722 00:13:54.508 02:18:57 -- nvmf/common.sh@297 -- # mlx=() 00:13:54.508 02:18:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:54.508 02:18:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:54.508 02:18:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:54.508 02:18:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:54.508 02:18:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:54.508 02:18:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:54.508 02:18:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:54.508 02:18:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:54.508 02:18:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:54.508 02:18:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:54.508 02:18:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:54.508 02:18:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:54.508 02:18:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:54.508 02:18:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:54.508 02:18:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:54.508 02:18:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:54.508 02:18:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:54.508 02:18:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:54.508 02:18:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:54.508 02:18:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:54.508 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:54.508 02:18:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:54.508 02:18:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:54.508 02:18:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:54.508 02:18:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:54.508 02:18:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:54.508 02:18:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:54.508 02:18:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:54.508 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:54.508 02:18:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:54.508 02:18:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:54.508 02:18:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:54.508 02:18:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:54.508 02:18:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:54.508 02:18:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:54.508 02:18:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:54.508 02:18:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:54.508 02:18:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:54.508 02:18:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:54.508 02:18:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:54.508 02:18:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:54.508 02:18:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:54.508 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:54.508 02:18:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:54.508 02:18:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:54.508 02:18:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:54.508 02:18:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:54.508 02:18:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:54.508 02:18:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:54.508 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:54.508 02:18:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:54.508 02:18:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:54.508 02:18:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:54.508 02:18:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:54.508 02:18:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:54.508 02:18:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:54.508 02:18:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:54.508 02:18:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:54.508 02:18:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:54.508 02:18:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:54.508 02:18:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:54.508 02:18:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:54.508 02:18:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:54.508 02:18:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:54.508 02:18:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:54.508 02:18:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:54.508 02:18:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:54.508 02:18:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:54.508 02:18:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:54.508 02:18:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:54.508 02:18:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:54.508 02:18:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:54.508 02:18:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:54.508 02:18:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:54.508 02:18:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:54.508 02:18:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:54.508 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:54.508 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.292 ms 00:13:54.508 00:13:54.508 --- 10.0.0.2 ping statistics --- 00:13:54.508 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:54.508 rtt min/avg/max/mdev = 0.292/0.292/0.292/0.000 ms 00:13:54.508 02:18:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:54.508 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:54.508 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.089 ms 00:13:54.508 00:13:54.508 --- 10.0.0.1 ping statistics --- 00:13:54.508 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:54.508 rtt min/avg/max/mdev = 0.089/0.089/0.089/0.000 ms 00:13:54.508 02:18:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:54.508 02:18:58 -- nvmf/common.sh@410 -- # return 0 00:13:54.508 02:18:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:54.508 02:18:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:54.508 02:18:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:54.508 02:18:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:54.508 02:18:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:54.508 02:18:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:54.508 02:18:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:54.508 02:18:58 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:13:54.508 02:18:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:54.508 02:18:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:54.509 02:18:58 -- common/autotest_common.sh@10 -- # set +x 00:13:54.509 02:18:58 -- nvmf/common.sh@469 -- # nvmfpid=89705 00:13:54.509 02:18:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:54.509 02:18:58 -- nvmf/common.sh@470 -- # waitforlisten 89705 00:13:54.509 02:18:58 -- common/autotest_common.sh@829 -- # '[' -z 89705 ']' 00:13:54.509 02:18:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:54.509 02:18:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:54.509 02:18:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:54.509 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:54.509 02:18:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:54.509 02:18:58 -- common/autotest_common.sh@10 -- # set +x 00:13:54.767 [2024-11-29 02:18:58.209844] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:54.767 [2024-11-29 02:18:58.209940] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:54.767 EAL: No free 2048 kB hugepages reported on node 1 00:13:54.767 [2024-11-29 02:18:58.276917] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:54.767 [2024-11-29 02:18:58.388216] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:54.767 [2024-11-29 02:18:58.388364] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:54.767 [2024-11-29 02:18:58.388381] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:54.767 [2024-11-29 02:18:58.388401] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:54.767 [2024-11-29 02:18:58.388478] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:54.767 [2024-11-29 02:18:58.388498] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:54.767 [2024-11-29 02:18:58.388550] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:54.767 [2024-11-29 02:18:58.388553] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:55.701 02:18:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:55.701 02:18:59 -- common/autotest_common.sh@862 -- # return 0 00:13:55.701 02:18:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:55.701 02:18:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:55.701 02:18:59 -- common/autotest_common.sh@10 -- # set +x 00:13:55.701 02:18:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:55.701 02:18:59 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:55.701 02:18:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:55.701 02:18:59 -- common/autotest_common.sh@10 -- # set +x 00:13:55.701 [2024-11-29 02:18:59.199957] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:55.701 02:18:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:55.701 02:18:59 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:13:55.701 02:18:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:55.701 02:18:59 -- common/autotest_common.sh@10 -- # set +x 00:13:55.701 Malloc0 00:13:55.701 02:18:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:55.701 02:18:59 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:55.701 02:18:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:55.701 02:18:59 -- common/autotest_common.sh@10 -- # set +x 00:13:55.701 Malloc1 00:13:55.701 02:18:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:55.701 02:18:59 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:13:55.701 02:18:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:55.701 02:18:59 -- common/autotest_common.sh@10 -- # set +x 00:13:55.701 02:18:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:55.701 02:18:59 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:55.701 02:18:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:55.701 02:18:59 -- common/autotest_common.sh@10 -- # set +x 00:13:55.701 02:18:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:55.701 02:18:59 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:55.701 02:18:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:55.701 02:18:59 -- common/autotest_common.sh@10 -- # set +x 00:13:55.701 02:18:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:55.701 02:18:59 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:55.701 02:18:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:55.701 02:18:59 -- common/autotest_common.sh@10 -- # set +x 00:13:55.701 [2024-11-29 02:18:59.285980] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:55.701 02:18:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:55.701 02:18:59 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:55.701 02:18:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:55.701 02:18:59 -- common/autotest_common.sh@10 -- # set +x 00:13:55.701 02:18:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:55.701 02:18:59 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:13:55.959 00:13:55.960 Discovery Log Number of Records 2, Generation counter 2 00:13:55.960 =====Discovery Log Entry 0====== 00:13:55.960 trtype: tcp 00:13:55.960 adrfam: ipv4 00:13:55.960 subtype: current discovery subsystem 00:13:55.960 treq: not required 00:13:55.960 portid: 0 00:13:55.960 trsvcid: 4420 00:13:55.960 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:13:55.960 traddr: 10.0.0.2 00:13:55.960 eflags: explicit discovery connections, duplicate discovery information 00:13:55.960 sectype: none 00:13:55.960 =====Discovery Log Entry 1====== 00:13:55.960 trtype: tcp 00:13:55.960 adrfam: ipv4 00:13:55.960 subtype: nvme subsystem 00:13:55.960 treq: not required 00:13:55.960 portid: 0 00:13:55.960 trsvcid: 4420 00:13:55.960 subnqn: nqn.2016-06.io.spdk:cnode1 00:13:55.960 traddr: 10.0.0.2 00:13:55.960 eflags: none 00:13:55.960 sectype: none 00:13:55.960 02:18:59 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:13:55.960 02:18:59 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:13:55.960 02:18:59 -- nvmf/common.sh@510 -- # local dev _ 00:13:55.960 02:18:59 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:55.960 02:18:59 -- nvmf/common.sh@509 -- # nvme list 00:13:55.960 02:18:59 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:55.960 02:18:59 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:55.960 02:18:59 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:55.960 02:18:59 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:55.960 02:18:59 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:13:55.960 02:18:59 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:56.526 02:19:00 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:13:56.526 02:19:00 -- common/autotest_common.sh@1187 -- # local i=0 00:13:56.526 02:19:00 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:56.526 02:19:00 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:13:56.526 02:19:00 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:13:56.526 02:19:00 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:58.424 02:19:02 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:58.424 02:19:02 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:58.424 02:19:02 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:58.424 02:19:02 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:13:58.424 02:19:02 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:58.424 02:19:02 -- common/autotest_common.sh@1197 -- # return 0 00:13:58.424 02:19:02 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:13:58.424 02:19:02 -- nvmf/common.sh@510 -- # local dev _ 00:13:58.424 02:19:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:58.424 02:19:02 -- nvmf/common.sh@509 -- # nvme list 00:13:58.682 02:19:02 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:58.682 02:19:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:58.682 02:19:02 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:58.682 02:19:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:58.682 02:19:02 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:13:58.682 02:19:02 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:13:58.682 02:19:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:58.682 02:19:02 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:13:58.682 02:19:02 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:13:58.682 02:19:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:58.682 02:19:02 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:13:58.682 /dev/nvme0n2 ]] 00:13:58.682 02:19:02 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:13:58.682 02:19:02 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:13:58.682 02:19:02 -- nvmf/common.sh@510 -- # local dev _ 00:13:58.682 02:19:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:58.682 02:19:02 -- nvmf/common.sh@509 -- # nvme list 00:13:58.682 02:19:02 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:58.682 02:19:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:58.682 02:19:02 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:58.682 02:19:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:58.682 02:19:02 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:13:58.682 02:19:02 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:13:58.682 02:19:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:58.682 02:19:02 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:13:58.682 02:19:02 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:13:58.682 02:19:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:58.682 02:19:02 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:13:58.682 02:19:02 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:58.682 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:58.682 02:19:02 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:58.682 02:19:02 -- common/autotest_common.sh@1208 -- # local i=0 00:13:58.682 02:19:02 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:58.682 02:19:02 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:58.682 02:19:02 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:58.682 02:19:02 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:58.682 02:19:02 -- common/autotest_common.sh@1220 -- # return 0 00:13:58.682 02:19:02 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:13:58.682 02:19:02 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:58.682 02:19:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.682 02:19:02 -- common/autotest_common.sh@10 -- # set +x 00:13:58.682 02:19:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.682 02:19:02 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:58.682 02:19:02 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:13:58.682 02:19:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:58.682 02:19:02 -- nvmf/common.sh@116 -- # sync 00:13:58.682 02:19:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:58.682 02:19:02 -- nvmf/common.sh@119 -- # set +e 00:13:58.682 02:19:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:58.682 02:19:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:58.682 rmmod nvme_tcp 00:13:58.682 rmmod nvme_fabrics 00:13:58.682 rmmod nvme_keyring 00:13:58.682 02:19:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:58.682 02:19:02 -- nvmf/common.sh@123 -- # set -e 00:13:58.682 02:19:02 -- nvmf/common.sh@124 -- # return 0 00:13:58.682 02:19:02 -- nvmf/common.sh@477 -- # '[' -n 89705 ']' 00:13:58.682 02:19:02 -- nvmf/common.sh@478 -- # killprocess 89705 00:13:58.682 02:19:02 -- common/autotest_common.sh@936 -- # '[' -z 89705 ']' 00:13:58.682 02:19:02 -- common/autotest_common.sh@940 -- # kill -0 89705 00:13:58.682 02:19:02 -- common/autotest_common.sh@941 -- # uname 00:13:58.682 02:19:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:58.683 02:19:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 89705 00:13:58.683 02:19:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:58.683 02:19:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:58.683 02:19:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 89705' 00:13:58.683 killing process with pid 89705 00:13:58.683 02:19:02 -- common/autotest_common.sh@955 -- # kill 89705 00:13:58.683 02:19:02 -- common/autotest_common.sh@960 -- # wait 89705 00:13:59.250 02:19:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:59.250 02:19:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:59.250 02:19:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:59.250 02:19:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:59.250 02:19:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:59.250 02:19:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:59.250 02:19:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:59.250 02:19:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:01.153 02:19:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:01.153 00:14:01.153 real 0m8.935s 00:14:01.153 user 0m17.635s 00:14:01.153 sys 0m2.345s 00:14:01.153 02:19:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:01.153 02:19:04 -- common/autotest_common.sh@10 -- # set +x 00:14:01.153 ************************************ 00:14:01.153 END TEST nvmf_nvme_cli 00:14:01.153 ************************************ 00:14:01.153 02:19:04 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:14:01.153 02:19:04 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:01.153 02:19:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:01.153 02:19:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:01.153 02:19:04 -- common/autotest_common.sh@10 -- # set +x 00:14:01.153 ************************************ 00:14:01.153 START TEST nvmf_host_management 00:14:01.153 ************************************ 00:14:01.153 02:19:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:01.153 * Looking for test storage... 00:14:01.153 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:01.153 02:19:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:01.153 02:19:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:01.153 02:19:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:01.412 02:19:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:01.412 02:19:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:01.412 02:19:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:01.412 02:19:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:01.412 02:19:04 -- scripts/common.sh@335 -- # IFS=.-: 00:14:01.412 02:19:04 -- scripts/common.sh@335 -- # read -ra ver1 00:14:01.412 02:19:04 -- scripts/common.sh@336 -- # IFS=.-: 00:14:01.412 02:19:04 -- scripts/common.sh@336 -- # read -ra ver2 00:14:01.412 02:19:04 -- scripts/common.sh@337 -- # local 'op=<' 00:14:01.412 02:19:04 -- scripts/common.sh@339 -- # ver1_l=2 00:14:01.412 02:19:04 -- scripts/common.sh@340 -- # ver2_l=1 00:14:01.412 02:19:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:01.412 02:19:04 -- scripts/common.sh@343 -- # case "$op" in 00:14:01.412 02:19:04 -- scripts/common.sh@344 -- # : 1 00:14:01.412 02:19:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:01.412 02:19:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:01.412 02:19:04 -- scripts/common.sh@364 -- # decimal 1 00:14:01.412 02:19:04 -- scripts/common.sh@352 -- # local d=1 00:14:01.412 02:19:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:01.412 02:19:04 -- scripts/common.sh@354 -- # echo 1 00:14:01.412 02:19:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:01.412 02:19:04 -- scripts/common.sh@365 -- # decimal 2 00:14:01.412 02:19:04 -- scripts/common.sh@352 -- # local d=2 00:14:01.412 02:19:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:01.412 02:19:04 -- scripts/common.sh@354 -- # echo 2 00:14:01.412 02:19:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:01.412 02:19:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:01.412 02:19:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:01.412 02:19:04 -- scripts/common.sh@367 -- # return 0 00:14:01.412 02:19:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:01.412 02:19:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:01.412 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:01.412 --rc genhtml_branch_coverage=1 00:14:01.412 --rc genhtml_function_coverage=1 00:14:01.412 --rc genhtml_legend=1 00:14:01.412 --rc geninfo_all_blocks=1 00:14:01.412 --rc geninfo_unexecuted_blocks=1 00:14:01.412 00:14:01.412 ' 00:14:01.412 02:19:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:01.412 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:01.412 --rc genhtml_branch_coverage=1 00:14:01.412 --rc genhtml_function_coverage=1 00:14:01.412 --rc genhtml_legend=1 00:14:01.412 --rc geninfo_all_blocks=1 00:14:01.412 --rc geninfo_unexecuted_blocks=1 00:14:01.412 00:14:01.412 ' 00:14:01.412 02:19:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:01.412 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:01.412 --rc genhtml_branch_coverage=1 00:14:01.412 --rc genhtml_function_coverage=1 00:14:01.412 --rc genhtml_legend=1 00:14:01.412 --rc geninfo_all_blocks=1 00:14:01.412 --rc geninfo_unexecuted_blocks=1 00:14:01.412 00:14:01.412 ' 00:14:01.412 02:19:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:01.412 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:01.412 --rc genhtml_branch_coverage=1 00:14:01.412 --rc genhtml_function_coverage=1 00:14:01.412 --rc genhtml_legend=1 00:14:01.412 --rc geninfo_all_blocks=1 00:14:01.412 --rc geninfo_unexecuted_blocks=1 00:14:01.412 00:14:01.412 ' 00:14:01.412 02:19:04 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:01.412 02:19:04 -- nvmf/common.sh@7 -- # uname -s 00:14:01.412 02:19:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:01.412 02:19:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:01.412 02:19:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:01.412 02:19:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:01.412 02:19:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:01.412 02:19:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:01.412 02:19:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:01.412 02:19:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:01.412 02:19:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:01.412 02:19:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:01.412 02:19:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:01.412 02:19:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:01.412 02:19:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:01.412 02:19:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:01.412 02:19:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:01.412 02:19:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:01.412 02:19:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:01.412 02:19:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:01.412 02:19:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:01.413 02:19:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:01.413 02:19:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:01.413 02:19:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:01.413 02:19:04 -- paths/export.sh@5 -- # export PATH 00:14:01.413 02:19:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:01.413 02:19:04 -- nvmf/common.sh@46 -- # : 0 00:14:01.413 02:19:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:01.413 02:19:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:01.413 02:19:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:01.413 02:19:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:01.413 02:19:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:01.413 02:19:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:01.413 02:19:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:01.413 02:19:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:01.413 02:19:04 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:01.413 02:19:04 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:01.413 02:19:04 -- target/host_management.sh@104 -- # nvmftestinit 00:14:01.413 02:19:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:01.413 02:19:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:01.413 02:19:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:01.413 02:19:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:01.413 02:19:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:01.413 02:19:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:01.413 02:19:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:01.413 02:19:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:01.413 02:19:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:01.413 02:19:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:01.413 02:19:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:01.413 02:19:04 -- common/autotest_common.sh@10 -- # set +x 00:14:03.316 02:19:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:03.316 02:19:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:03.316 02:19:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:03.316 02:19:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:03.316 02:19:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:03.316 02:19:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:03.316 02:19:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:03.316 02:19:06 -- nvmf/common.sh@294 -- # net_devs=() 00:14:03.316 02:19:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:03.316 02:19:06 -- nvmf/common.sh@295 -- # e810=() 00:14:03.316 02:19:06 -- nvmf/common.sh@295 -- # local -ga e810 00:14:03.316 02:19:06 -- nvmf/common.sh@296 -- # x722=() 00:14:03.316 02:19:06 -- nvmf/common.sh@296 -- # local -ga x722 00:14:03.316 02:19:06 -- nvmf/common.sh@297 -- # mlx=() 00:14:03.316 02:19:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:03.316 02:19:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:03.316 02:19:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:03.316 02:19:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:03.316 02:19:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:03.316 02:19:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:03.316 02:19:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:03.316 02:19:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:03.316 02:19:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:03.316 02:19:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:03.316 02:19:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:03.316 02:19:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:03.316 02:19:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:03.316 02:19:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:03.316 02:19:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:03.316 02:19:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:03.316 02:19:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:03.316 02:19:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:03.316 02:19:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:03.316 02:19:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:03.316 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:03.316 02:19:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:03.316 02:19:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:03.316 02:19:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:03.316 02:19:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:03.316 02:19:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:03.316 02:19:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:03.316 02:19:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:03.316 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:03.316 02:19:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:03.316 02:19:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:03.316 02:19:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:03.316 02:19:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:03.316 02:19:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:03.316 02:19:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:03.316 02:19:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:03.316 02:19:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:03.316 02:19:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:03.316 02:19:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:03.316 02:19:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:03.316 02:19:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:03.316 02:19:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:03.316 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:03.316 02:19:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:03.316 02:19:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:03.316 02:19:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:03.316 02:19:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:03.316 02:19:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:03.316 02:19:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:03.316 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:03.316 02:19:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:03.316 02:19:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:03.316 02:19:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:03.316 02:19:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:03.316 02:19:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:03.316 02:19:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:03.317 02:19:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:03.317 02:19:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:03.317 02:19:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:03.317 02:19:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:03.317 02:19:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:03.317 02:19:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:03.317 02:19:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:03.317 02:19:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:03.317 02:19:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:03.317 02:19:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:03.317 02:19:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:03.317 02:19:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:03.317 02:19:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:03.575 02:19:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:03.575 02:19:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:03.575 02:19:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:03.575 02:19:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:03.575 02:19:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:03.575 02:19:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:03.575 02:19:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:03.575 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:03.575 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.292 ms 00:14:03.575 00:14:03.575 --- 10.0.0.2 ping statistics --- 00:14:03.575 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:03.575 rtt min/avg/max/mdev = 0.292/0.292/0.292/0.000 ms 00:14:03.575 02:19:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:03.575 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:03.575 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.087 ms 00:14:03.575 00:14:03.575 --- 10.0.0.1 ping statistics --- 00:14:03.575 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:03.575 rtt min/avg/max/mdev = 0.087/0.087/0.087/0.000 ms 00:14:03.575 02:19:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:03.575 02:19:07 -- nvmf/common.sh@410 -- # return 0 00:14:03.575 02:19:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:03.575 02:19:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:03.575 02:19:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:03.575 02:19:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:03.575 02:19:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:03.575 02:19:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:03.575 02:19:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:03.575 02:19:07 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:14:03.575 02:19:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:03.575 02:19:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:03.575 02:19:07 -- common/autotest_common.sh@10 -- # set +x 00:14:03.575 ************************************ 00:14:03.575 START TEST nvmf_host_management 00:14:03.575 ************************************ 00:14:03.575 02:19:07 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:14:03.575 02:19:07 -- target/host_management.sh@69 -- # starttarget 00:14:03.575 02:19:07 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:14:03.575 02:19:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:03.575 02:19:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:03.575 02:19:07 -- common/autotest_common.sh@10 -- # set +x 00:14:03.575 02:19:07 -- nvmf/common.sh@469 -- # nvmfpid=92253 00:14:03.575 02:19:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:14:03.575 02:19:07 -- nvmf/common.sh@470 -- # waitforlisten 92253 00:14:03.575 02:19:07 -- common/autotest_common.sh@829 -- # '[' -z 92253 ']' 00:14:03.575 02:19:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:03.575 02:19:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:03.575 02:19:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:03.575 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:03.575 02:19:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:03.575 02:19:07 -- common/autotest_common.sh@10 -- # set +x 00:14:03.575 [2024-11-29 02:19:07.156546] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:03.575 [2024-11-29 02:19:07.156617] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:03.575 EAL: No free 2048 kB hugepages reported on node 1 00:14:03.575 [2024-11-29 02:19:07.225616] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:03.833 [2024-11-29 02:19:07.342615] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:03.833 [2024-11-29 02:19:07.342786] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:03.833 [2024-11-29 02:19:07.342814] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:03.833 [2024-11-29 02:19:07.342830] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:03.833 [2024-11-29 02:19:07.342928] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:03.833 [2024-11-29 02:19:07.343025] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:03.833 [2024-11-29 02:19:07.343074] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:03.833 [2024-11-29 02:19:07.343077] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:04.767 02:19:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:04.767 02:19:08 -- common/autotest_common.sh@862 -- # return 0 00:14:04.767 02:19:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:04.767 02:19:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:04.767 02:19:08 -- common/autotest_common.sh@10 -- # set +x 00:14:04.767 02:19:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:04.767 02:19:08 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:04.767 02:19:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.767 02:19:08 -- common/autotest_common.sh@10 -- # set +x 00:14:04.767 [2024-11-29 02:19:08.144895] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:04.767 02:19:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.767 02:19:08 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:14:04.767 02:19:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:04.767 02:19:08 -- common/autotest_common.sh@10 -- # set +x 00:14:04.767 02:19:08 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:04.767 02:19:08 -- target/host_management.sh@23 -- # cat 00:14:04.767 02:19:08 -- target/host_management.sh@30 -- # rpc_cmd 00:14:04.767 02:19:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.767 02:19:08 -- common/autotest_common.sh@10 -- # set +x 00:14:04.767 Malloc0 00:14:04.767 [2024-11-29 02:19:08.205988] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:04.767 02:19:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.767 02:19:08 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:14:04.767 02:19:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:04.767 02:19:08 -- common/autotest_common.sh@10 -- # set +x 00:14:04.767 02:19:08 -- target/host_management.sh@73 -- # perfpid=92432 00:14:04.767 02:19:08 -- target/host_management.sh@74 -- # waitforlisten 92432 /var/tmp/bdevperf.sock 00:14:04.767 02:19:08 -- common/autotest_common.sh@829 -- # '[' -z 92432 ']' 00:14:04.767 02:19:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:04.767 02:19:08 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:14:04.767 02:19:08 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:14:04.767 02:19:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:04.767 02:19:08 -- nvmf/common.sh@520 -- # config=() 00:14:04.767 02:19:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:04.767 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:04.767 02:19:08 -- nvmf/common.sh@520 -- # local subsystem config 00:14:04.767 02:19:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:04.767 02:19:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:04.767 02:19:08 -- common/autotest_common.sh@10 -- # set +x 00:14:04.767 02:19:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:04.767 { 00:14:04.767 "params": { 00:14:04.767 "name": "Nvme$subsystem", 00:14:04.767 "trtype": "$TEST_TRANSPORT", 00:14:04.767 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:04.767 "adrfam": "ipv4", 00:14:04.767 "trsvcid": "$NVMF_PORT", 00:14:04.767 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:04.767 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:04.767 "hdgst": ${hdgst:-false}, 00:14:04.767 "ddgst": ${ddgst:-false} 00:14:04.767 }, 00:14:04.767 "method": "bdev_nvme_attach_controller" 00:14:04.767 } 00:14:04.767 EOF 00:14:04.767 )") 00:14:04.767 02:19:08 -- nvmf/common.sh@542 -- # cat 00:14:04.767 02:19:08 -- nvmf/common.sh@544 -- # jq . 00:14:04.767 02:19:08 -- nvmf/common.sh@545 -- # IFS=, 00:14:04.767 02:19:08 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:04.767 "params": { 00:14:04.767 "name": "Nvme0", 00:14:04.767 "trtype": "tcp", 00:14:04.767 "traddr": "10.0.0.2", 00:14:04.767 "adrfam": "ipv4", 00:14:04.767 "trsvcid": "4420", 00:14:04.767 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:04.767 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:04.767 "hdgst": false, 00:14:04.767 "ddgst": false 00:14:04.767 }, 00:14:04.767 "method": "bdev_nvme_attach_controller" 00:14:04.767 }' 00:14:04.767 [2024-11-29 02:19:08.283014] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:04.767 [2024-11-29 02:19:08.283087] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid92432 ] 00:14:04.767 EAL: No free 2048 kB hugepages reported on node 1 00:14:04.767 [2024-11-29 02:19:08.343188] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:05.026 [2024-11-29 02:19:08.451508] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:05.317 Running I/O for 10 seconds... 00:14:05.574 02:19:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:05.574 02:19:09 -- common/autotest_common.sh@862 -- # return 0 00:14:05.574 02:19:09 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:14:05.574 02:19:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:05.574 02:19:09 -- common/autotest_common.sh@10 -- # set +x 00:14:05.833 02:19:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:05.833 02:19:09 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:05.833 02:19:09 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:14:05.833 02:19:09 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:14:05.833 02:19:09 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:14:05.833 02:19:09 -- target/host_management.sh@52 -- # local ret=1 00:14:05.833 02:19:09 -- target/host_management.sh@53 -- # local i 00:14:05.833 02:19:09 -- target/host_management.sh@54 -- # (( i = 10 )) 00:14:05.833 02:19:09 -- target/host_management.sh@54 -- # (( i != 0 )) 00:14:05.833 02:19:09 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:14:05.833 02:19:09 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:14:05.833 02:19:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:05.833 02:19:09 -- common/autotest_common.sh@10 -- # set +x 00:14:05.833 02:19:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:05.833 02:19:09 -- target/host_management.sh@55 -- # read_io_count=2018 00:14:05.833 02:19:09 -- target/host_management.sh@58 -- # '[' 2018 -ge 100 ']' 00:14:05.833 02:19:09 -- target/host_management.sh@59 -- # ret=0 00:14:05.833 02:19:09 -- target/host_management.sh@60 -- # break 00:14:05.833 02:19:09 -- target/host_management.sh@64 -- # return 0 00:14:05.833 02:19:09 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:05.833 02:19:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:05.833 02:19:09 -- common/autotest_common.sh@10 -- # set +x 00:14:05.833 [2024-11-29 02:19:09.315327] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5e60 is same with the state(5) to be set 00:14:05.833 [2024-11-29 02:19:09.315469] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5e60 is same with the state(5) to be set 00:14:05.833 [2024-11-29 02:19:09.315485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5e60 is same with the state(5) to be set 00:14:05.833 [2024-11-29 02:19:09.315499] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5e60 is same with the state(5) to be set 00:14:05.833 [2024-11-29 02:19:09.315512] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5e60 is same with the state(5) to be set 00:14:05.833 [2024-11-29 02:19:09.315524] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5e60 is same with the state(5) to be set 00:14:05.833 [2024-11-29 02:19:09.315537] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5e60 is same with the state(5) to be set 00:14:05.833 [2024-11-29 02:19:09.315548] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5e60 is same with the state(5) to be set 00:14:05.833 [2024-11-29 02:19:09.315570] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5e60 is same with the state(5) to be set 00:14:05.833 [2024-11-29 02:19:09.315583] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5e60 is same with the state(5) to be set 00:14:05.833 [2024-11-29 02:19:09.315594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5e60 is same with the state(5) to be set 00:14:05.833 [2024-11-29 02:19:09.317735] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:14:05.833 [2024-11-29 02:19:09.317787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.833 [2024-11-29 02:19:09.317806] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:14:05.833 [2024-11-29 02:19:09.317820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.833 [2024-11-29 02:19:09.317834] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:14:05.833 [2024-11-29 02:19:09.317848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.833 [2024-11-29 02:19:09.317862] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:14:05.833 [2024-11-29 02:19:09.317875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.833 [2024-11-29 02:19:09.317887] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa4160 is same with the state(5) to be set 00:14:05.833 [2024-11-29 02:19:09.317979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.833 [2024-11-29 02:19:09.318002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.833 [2024-11-29 02:19:09.318026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.833 [2024-11-29 02:19:09.318042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.833 [2024-11-29 02:19:09.318058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.833 [2024-11-29 02:19:09.318073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.833 [2024-11-29 02:19:09.318088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.833 [2024-11-29 02:19:09.318102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.833 [2024-11-29 02:19:09.318117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.833 [2024-11-29 02:19:09.318131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.833 [2024-11-29 02:19:09.318146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.833 [2024-11-29 02:19:09.318160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.833 [2024-11-29 02:19:09.318175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.833 [2024-11-29 02:19:09.318195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.833 [2024-11-29 02:19:09.318210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.833 [2024-11-29 02:19:09.318225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.833 [2024-11-29 02:19:09.318241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.833 [2024-11-29 02:19:09.318255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.833 [2024-11-29 02:19:09.318270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.833 02:19:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:05.833 [2024-11-29 02:19:09.318283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.833 [2024-11-29 02:19:09.318299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.833 [2024-11-29 02:19:09.318312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.833 [2024-11-29 02:19:09.318327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.833 [2024-11-29 02:19:09.318341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.833 [2024-11-29 02:19:09.318356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.833 [2024-11-29 02:19:09.318369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.833 [2024-11-29 02:19:09.318383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.833 [2024-11-29 02:19:09.318404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.833 [2024-11-29 02:19:09.318421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.833 [2024-11-29 02:19:09.318435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.833 02:19:09 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:05.833 [2024-11-29 02:19:09.318455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.833 [2024-11-29 02:19:09.318469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.833 [2024-11-29 02:19:09.318484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.833 [2024-11-29 02:19:09.318497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.833 [2024-11-29 02:19:09.318512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:15744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.318525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.318540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:15872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.318558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.318574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:16128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 02:19:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:05.834 [2024-11-29 02:19:09.318587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.318602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.318616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.318630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.318644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.318658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.318672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 02:19:09 -- common/autotest_common.sh@10 -- # set +x 00:14:05.834 [2024-11-29 02:19:09.318688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.318713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.318728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.318741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.318765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.318778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.318794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.318807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.318822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.318835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.318851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.318865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.318879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.318893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.318908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.318925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.318941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.318955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.318970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.318984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.318998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.319012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.319027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.319041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.319056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:18176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.319070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.319085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.319099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.319114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.319128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.319143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.319158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.319174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.319187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.319202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.319216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.319231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:18432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.319245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.319260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.319273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.319291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.319306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.319320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.319334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.319349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.319362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.319377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.319391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.319417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.319432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.319456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.319470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.319484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.319498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.319513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:18816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.319527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.319542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.319555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.319570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.319584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.319599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.319613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.319628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.834 [2024-11-29 02:19:09.319642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.834 [2024-11-29 02:19:09.319657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.835 [2024-11-29 02:19:09.319675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.835 [2024-11-29 02:19:09.319691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.835 [2024-11-29 02:19:09.319705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.835 [2024-11-29 02:19:09.319720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.835 [2024-11-29 02:19:09.319733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.835 [2024-11-29 02:19:09.319749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.835 [2024-11-29 02:19:09.319762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.835 [2024-11-29 02:19:09.319777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.835 [2024-11-29 02:19:09.319791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.835 [2024-11-29 02:19:09.319805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.835 [2024-11-29 02:19:09.319819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.835 [2024-11-29 02:19:09.319834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.835 [2024-11-29 02:19:09.319848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.835 [2024-11-29 02:19:09.319863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.835 [2024-11-29 02:19:09.319876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.835 [2024-11-29 02:19:09.319892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:05.835 [2024-11-29 02:19:09.319906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:05.835 [2024-11-29 02:19:09.319998] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xaa2030 was disconnected and freed. reset controller. 00:14:05.835 [2024-11-29 02:19:09.321127] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:14:05.835 task offset: 20480 on job bdev=Nvme0n1 fails 00:14:05.835 00:14:05.835 Latency(us) 00:14:05.835 [2024-11-29T01:19:09.516Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:05.835 [2024-11-29T01:19:09.516Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:05.835 [2024-11-29T01:19:09.516Z] Job: Nvme0n1 ended in about 0.57 seconds with error 00:14:05.835 Verification LBA range: start 0x0 length 0x400 00:14:05.835 Nvme0n1 : 0.57 3854.65 240.92 112.44 0.00 15879.32 2621.44 23495.87 00:14:05.835 [2024-11-29T01:19:09.516Z] =================================================================================================================== 00:14:05.835 [2024-11-29T01:19:09.516Z] Total : 3854.65 240.92 112.44 0.00 15879.32 2621.44 23495.87 00:14:05.835 [2024-11-29 02:19:09.322994] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:14:05.835 [2024-11-29 02:19:09.323038] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa4160 (9): Bad file descriptor 00:14:05.835 02:19:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:05.835 02:19:09 -- target/host_management.sh@87 -- # sleep 1 00:14:05.835 [2024-11-29 02:19:09.372805] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:14:06.767 02:19:10 -- target/host_management.sh@91 -- # kill -9 92432 00:14:06.767 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (92432) - No such process 00:14:06.767 02:19:10 -- target/host_management.sh@91 -- # true 00:14:06.767 02:19:10 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:14:06.767 02:19:10 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:14:06.767 02:19:10 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:14:06.767 02:19:10 -- nvmf/common.sh@520 -- # config=() 00:14:06.767 02:19:10 -- nvmf/common.sh@520 -- # local subsystem config 00:14:06.767 02:19:10 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:06.767 02:19:10 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:06.767 { 00:14:06.767 "params": { 00:14:06.767 "name": "Nvme$subsystem", 00:14:06.767 "trtype": "$TEST_TRANSPORT", 00:14:06.767 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:06.767 "adrfam": "ipv4", 00:14:06.767 "trsvcid": "$NVMF_PORT", 00:14:06.767 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:06.767 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:06.767 "hdgst": ${hdgst:-false}, 00:14:06.767 "ddgst": ${ddgst:-false} 00:14:06.767 }, 00:14:06.767 "method": "bdev_nvme_attach_controller" 00:14:06.767 } 00:14:06.767 EOF 00:14:06.767 )") 00:14:06.767 02:19:10 -- nvmf/common.sh@542 -- # cat 00:14:06.767 02:19:10 -- nvmf/common.sh@544 -- # jq . 00:14:06.767 02:19:10 -- nvmf/common.sh@545 -- # IFS=, 00:14:06.767 02:19:10 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:06.767 "params": { 00:14:06.767 "name": "Nvme0", 00:14:06.767 "trtype": "tcp", 00:14:06.767 "traddr": "10.0.0.2", 00:14:06.767 "adrfam": "ipv4", 00:14:06.767 "trsvcid": "4420", 00:14:06.767 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:06.768 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:06.768 "hdgst": false, 00:14:06.768 "ddgst": false 00:14:06.768 }, 00:14:06.768 "method": "bdev_nvme_attach_controller" 00:14:06.768 }' 00:14:06.768 [2024-11-29 02:19:10.367749] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:06.768 [2024-11-29 02:19:10.367827] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid92720 ] 00:14:06.768 EAL: No free 2048 kB hugepages reported on node 1 00:14:06.768 [2024-11-29 02:19:10.430358] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:07.026 [2024-11-29 02:19:10.540928] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:07.284 Running I/O for 1 seconds... 00:14:08.658 00:14:08.658 Latency(us) 00:14:08.658 [2024-11-29T01:19:12.339Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:08.658 [2024-11-29T01:19:12.339Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:08.658 Verification LBA range: start 0x0 length 0x400 00:14:08.658 Nvme0n1 : 1.01 4130.11 258.13 0.00 0.00 15243.84 1140.81 22330.79 00:14:08.658 [2024-11-29T01:19:12.339Z] =================================================================================================================== 00:14:08.658 [2024-11-29T01:19:12.339Z] Total : 4130.11 258.13 0.00 0.00 15243.84 1140.81 22330.79 00:14:08.658 02:19:12 -- target/host_management.sh@101 -- # stoptarget 00:14:08.658 02:19:12 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:14:08.658 02:19:12 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:14:08.658 02:19:12 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:08.658 02:19:12 -- target/host_management.sh@40 -- # nvmftestfini 00:14:08.658 02:19:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:08.658 02:19:12 -- nvmf/common.sh@116 -- # sync 00:14:08.658 02:19:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:08.658 02:19:12 -- nvmf/common.sh@119 -- # set +e 00:14:08.658 02:19:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:08.658 02:19:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:08.658 rmmod nvme_tcp 00:14:08.658 rmmod nvme_fabrics 00:14:08.658 rmmod nvme_keyring 00:14:08.658 02:19:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:08.658 02:19:12 -- nvmf/common.sh@123 -- # set -e 00:14:08.658 02:19:12 -- nvmf/common.sh@124 -- # return 0 00:14:08.658 02:19:12 -- nvmf/common.sh@477 -- # '[' -n 92253 ']' 00:14:08.658 02:19:12 -- nvmf/common.sh@478 -- # killprocess 92253 00:14:08.658 02:19:12 -- common/autotest_common.sh@936 -- # '[' -z 92253 ']' 00:14:08.658 02:19:12 -- common/autotest_common.sh@940 -- # kill -0 92253 00:14:08.658 02:19:12 -- common/autotest_common.sh@941 -- # uname 00:14:08.658 02:19:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:08.658 02:19:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 92253 00:14:08.658 02:19:12 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:08.658 02:19:12 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:08.658 02:19:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 92253' 00:14:08.658 killing process with pid 92253 00:14:08.658 02:19:12 -- common/autotest_common.sh@955 -- # kill 92253 00:14:08.658 02:19:12 -- common/autotest_common.sh@960 -- # wait 92253 00:14:08.917 [2024-11-29 02:19:12.547747] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:14:08.917 02:19:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:08.917 02:19:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:08.917 02:19:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:08.917 02:19:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:08.917 02:19:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:08.917 02:19:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:08.917 02:19:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:08.917 02:19:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:11.450 02:19:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:11.450 00:14:11.450 real 0m7.508s 00:14:11.450 user 0m23.652s 00:14:11.450 sys 0m1.356s 00:14:11.450 02:19:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:11.450 02:19:14 -- common/autotest_common.sh@10 -- # set +x 00:14:11.450 ************************************ 00:14:11.450 END TEST nvmf_host_management 00:14:11.450 ************************************ 00:14:11.450 02:19:14 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:14:11.450 00:14:11.450 real 0m9.905s 00:14:11.450 user 0m24.563s 00:14:11.450 sys 0m2.876s 00:14:11.450 02:19:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:11.450 02:19:14 -- common/autotest_common.sh@10 -- # set +x 00:14:11.450 ************************************ 00:14:11.450 END TEST nvmf_host_management 00:14:11.450 ************************************ 00:14:11.450 02:19:14 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:11.450 02:19:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:11.450 02:19:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:11.450 02:19:14 -- common/autotest_common.sh@10 -- # set +x 00:14:11.450 ************************************ 00:14:11.450 START TEST nvmf_lvol 00:14:11.450 ************************************ 00:14:11.450 02:19:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:11.450 * Looking for test storage... 00:14:11.450 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:11.450 02:19:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:11.450 02:19:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:11.450 02:19:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:11.450 02:19:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:11.450 02:19:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:11.450 02:19:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:11.450 02:19:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:11.450 02:19:14 -- scripts/common.sh@335 -- # IFS=.-: 00:14:11.451 02:19:14 -- scripts/common.sh@335 -- # read -ra ver1 00:14:11.451 02:19:14 -- scripts/common.sh@336 -- # IFS=.-: 00:14:11.451 02:19:14 -- scripts/common.sh@336 -- # read -ra ver2 00:14:11.451 02:19:14 -- scripts/common.sh@337 -- # local 'op=<' 00:14:11.451 02:19:14 -- scripts/common.sh@339 -- # ver1_l=2 00:14:11.451 02:19:14 -- scripts/common.sh@340 -- # ver2_l=1 00:14:11.451 02:19:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:11.451 02:19:14 -- scripts/common.sh@343 -- # case "$op" in 00:14:11.451 02:19:14 -- scripts/common.sh@344 -- # : 1 00:14:11.451 02:19:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:11.451 02:19:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:11.451 02:19:14 -- scripts/common.sh@364 -- # decimal 1 00:14:11.451 02:19:14 -- scripts/common.sh@352 -- # local d=1 00:14:11.451 02:19:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:11.451 02:19:14 -- scripts/common.sh@354 -- # echo 1 00:14:11.451 02:19:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:11.451 02:19:14 -- scripts/common.sh@365 -- # decimal 2 00:14:11.451 02:19:14 -- scripts/common.sh@352 -- # local d=2 00:14:11.451 02:19:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:11.451 02:19:14 -- scripts/common.sh@354 -- # echo 2 00:14:11.451 02:19:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:11.451 02:19:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:11.451 02:19:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:11.451 02:19:14 -- scripts/common.sh@367 -- # return 0 00:14:11.451 02:19:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:11.451 02:19:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:11.451 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:11.451 --rc genhtml_branch_coverage=1 00:14:11.451 --rc genhtml_function_coverage=1 00:14:11.451 --rc genhtml_legend=1 00:14:11.451 --rc geninfo_all_blocks=1 00:14:11.451 --rc geninfo_unexecuted_blocks=1 00:14:11.451 00:14:11.451 ' 00:14:11.451 02:19:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:11.451 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:11.451 --rc genhtml_branch_coverage=1 00:14:11.451 --rc genhtml_function_coverage=1 00:14:11.451 --rc genhtml_legend=1 00:14:11.451 --rc geninfo_all_blocks=1 00:14:11.451 --rc geninfo_unexecuted_blocks=1 00:14:11.451 00:14:11.451 ' 00:14:11.451 02:19:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:11.451 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:11.451 --rc genhtml_branch_coverage=1 00:14:11.451 --rc genhtml_function_coverage=1 00:14:11.451 --rc genhtml_legend=1 00:14:11.451 --rc geninfo_all_blocks=1 00:14:11.451 --rc geninfo_unexecuted_blocks=1 00:14:11.451 00:14:11.451 ' 00:14:11.451 02:19:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:11.451 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:11.451 --rc genhtml_branch_coverage=1 00:14:11.451 --rc genhtml_function_coverage=1 00:14:11.451 --rc genhtml_legend=1 00:14:11.451 --rc geninfo_all_blocks=1 00:14:11.451 --rc geninfo_unexecuted_blocks=1 00:14:11.451 00:14:11.451 ' 00:14:11.451 02:19:14 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:11.451 02:19:14 -- nvmf/common.sh@7 -- # uname -s 00:14:11.451 02:19:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:11.451 02:19:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:11.451 02:19:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:11.451 02:19:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:11.451 02:19:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:11.451 02:19:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:11.451 02:19:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:11.451 02:19:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:11.451 02:19:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:11.451 02:19:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:11.451 02:19:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:11.451 02:19:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:11.451 02:19:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:11.451 02:19:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:11.451 02:19:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:11.451 02:19:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:11.451 02:19:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:11.451 02:19:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:11.451 02:19:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:11.451 02:19:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:11.451 02:19:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:11.451 02:19:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:11.451 02:19:14 -- paths/export.sh@5 -- # export PATH 00:14:11.451 02:19:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:11.451 02:19:14 -- nvmf/common.sh@46 -- # : 0 00:14:11.451 02:19:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:11.451 02:19:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:11.451 02:19:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:11.451 02:19:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:11.451 02:19:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:11.451 02:19:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:11.451 02:19:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:11.451 02:19:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:11.451 02:19:14 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:11.451 02:19:14 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:11.451 02:19:14 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:14:11.451 02:19:14 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:14:11.451 02:19:14 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:11.451 02:19:14 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:14:11.451 02:19:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:11.451 02:19:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:11.451 02:19:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:11.451 02:19:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:11.451 02:19:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:11.451 02:19:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:11.451 02:19:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:11.451 02:19:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:11.451 02:19:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:11.451 02:19:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:11.451 02:19:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:11.451 02:19:14 -- common/autotest_common.sh@10 -- # set +x 00:14:13.353 02:19:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:13.353 02:19:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:13.353 02:19:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:13.353 02:19:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:13.353 02:19:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:13.353 02:19:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:13.353 02:19:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:13.353 02:19:16 -- nvmf/common.sh@294 -- # net_devs=() 00:14:13.353 02:19:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:13.353 02:19:16 -- nvmf/common.sh@295 -- # e810=() 00:14:13.353 02:19:16 -- nvmf/common.sh@295 -- # local -ga e810 00:14:13.353 02:19:16 -- nvmf/common.sh@296 -- # x722=() 00:14:13.353 02:19:16 -- nvmf/common.sh@296 -- # local -ga x722 00:14:13.353 02:19:16 -- nvmf/common.sh@297 -- # mlx=() 00:14:13.353 02:19:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:13.353 02:19:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:13.353 02:19:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:13.353 02:19:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:13.353 02:19:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:13.353 02:19:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:13.353 02:19:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:13.353 02:19:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:13.353 02:19:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:13.353 02:19:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:13.353 02:19:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:13.353 02:19:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:13.353 02:19:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:13.353 02:19:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:13.353 02:19:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:13.353 02:19:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:13.353 02:19:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:13.353 02:19:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:13.353 02:19:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:13.353 02:19:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:13.353 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:13.353 02:19:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:13.353 02:19:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:13.353 02:19:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:13.353 02:19:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:13.353 02:19:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:13.353 02:19:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:13.353 02:19:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:13.353 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:13.353 02:19:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:13.353 02:19:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:13.353 02:19:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:13.353 02:19:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:13.353 02:19:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:13.353 02:19:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:13.353 02:19:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:13.353 02:19:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:13.353 02:19:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:13.353 02:19:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:13.353 02:19:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:13.353 02:19:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:13.353 02:19:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:13.353 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:13.353 02:19:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:13.353 02:19:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:13.353 02:19:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:13.353 02:19:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:13.353 02:19:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:13.353 02:19:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:13.353 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:13.353 02:19:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:13.353 02:19:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:13.353 02:19:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:13.353 02:19:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:13.353 02:19:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:13.353 02:19:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:13.353 02:19:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:13.353 02:19:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:13.353 02:19:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:13.353 02:19:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:13.353 02:19:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:13.353 02:19:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:13.353 02:19:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:13.353 02:19:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:13.353 02:19:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:13.353 02:19:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:13.353 02:19:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:13.353 02:19:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:13.353 02:19:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:13.353 02:19:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:13.353 02:19:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:13.353 02:19:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:13.353 02:19:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:13.612 02:19:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:13.612 02:19:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:13.612 02:19:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:13.612 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:13.612 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.242 ms 00:14:13.612 00:14:13.612 --- 10.0.0.2 ping statistics --- 00:14:13.612 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:13.612 rtt min/avg/max/mdev = 0.242/0.242/0.242/0.000 ms 00:14:13.612 02:19:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:13.612 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:13.612 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.067 ms 00:14:13.612 00:14:13.612 --- 10.0.0.1 ping statistics --- 00:14:13.612 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:13.612 rtt min/avg/max/mdev = 0.067/0.067/0.067/0.000 ms 00:14:13.612 02:19:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:13.612 02:19:17 -- nvmf/common.sh@410 -- # return 0 00:14:13.612 02:19:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:13.612 02:19:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:13.612 02:19:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:13.612 02:19:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:13.612 02:19:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:13.612 02:19:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:13.612 02:19:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:13.612 02:19:17 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:14:13.612 02:19:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:13.612 02:19:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:13.612 02:19:17 -- common/autotest_common.sh@10 -- # set +x 00:14:13.612 02:19:17 -- nvmf/common.sh@469 -- # nvmfpid=94957 00:14:13.612 02:19:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:14:13.612 02:19:17 -- nvmf/common.sh@470 -- # waitforlisten 94957 00:14:13.612 02:19:17 -- common/autotest_common.sh@829 -- # '[' -z 94957 ']' 00:14:13.612 02:19:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:13.612 02:19:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:13.612 02:19:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:13.612 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:13.612 02:19:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:13.612 02:19:17 -- common/autotest_common.sh@10 -- # set +x 00:14:13.612 [2024-11-29 02:19:17.125193] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:13.612 [2024-11-29 02:19:17.125265] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:13.612 EAL: No free 2048 kB hugepages reported on node 1 00:14:13.612 [2024-11-29 02:19:17.192634] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:13.870 [2024-11-29 02:19:17.306697] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:13.870 [2024-11-29 02:19:17.306851] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:13.870 [2024-11-29 02:19:17.306870] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:13.870 [2024-11-29 02:19:17.306892] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:13.870 [2024-11-29 02:19:17.306973] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:13.870 [2024-11-29 02:19:17.307028] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:13.870 [2024-11-29 02:19:17.307031] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:14.803 02:19:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:14.803 02:19:18 -- common/autotest_common.sh@862 -- # return 0 00:14:14.803 02:19:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:14.803 02:19:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:14.803 02:19:18 -- common/autotest_common.sh@10 -- # set +x 00:14:14.803 02:19:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:14.803 02:19:18 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:14.803 [2024-11-29 02:19:18.392313] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:14.803 02:19:18 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:15.062 02:19:18 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:14:15.062 02:19:18 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:15.320 02:19:18 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:14:15.320 02:19:18 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:14:15.578 02:19:19 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:14:15.837 02:19:19 -- target/nvmf_lvol.sh@29 -- # lvs=cb96767b-c0ab-497a-9024-8207fc6b989e 00:14:15.837 02:19:19 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u cb96767b-c0ab-497a-9024-8207fc6b989e lvol 20 00:14:16.094 02:19:19 -- target/nvmf_lvol.sh@32 -- # lvol=9a970e75-e6aa-4504-a6f7-219d976b6364 00:14:16.094 02:19:19 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:16.352 02:19:19 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 9a970e75-e6aa-4504-a6f7-219d976b6364 00:14:16.609 02:19:20 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:16.867 [2024-11-29 02:19:20.509024] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:16.867 02:19:20 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:17.125 02:19:20 -- target/nvmf_lvol.sh@42 -- # perf_pid=95410 00:14:17.125 02:19:20 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:14:17.125 02:19:20 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:14:17.383 EAL: No free 2048 kB hugepages reported on node 1 00:14:18.317 02:19:21 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 9a970e75-e6aa-4504-a6f7-219d976b6364 MY_SNAPSHOT 00:14:18.575 02:19:22 -- target/nvmf_lvol.sh@47 -- # snapshot=61bf7a4a-6383-423d-af2a-1851d29deabe 00:14:18.575 02:19:22 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 9a970e75-e6aa-4504-a6f7-219d976b6364 30 00:14:18.832 02:19:22 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 61bf7a4a-6383-423d-af2a-1851d29deabe MY_CLONE 00:14:19.090 02:19:22 -- target/nvmf_lvol.sh@49 -- # clone=f5f3b965-9014-4112-a788-60d8e76ce78a 00:14:19.090 02:19:22 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate f5f3b965-9014-4112-a788-60d8e76ce78a 00:14:19.657 02:19:23 -- target/nvmf_lvol.sh@53 -- # wait 95410 00:14:27.772 Initializing NVMe Controllers 00:14:27.772 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:27.772 Controller IO queue size 128, less than required. 00:14:27.772 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:27.772 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:14:27.772 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:14:27.772 Initialization complete. Launching workers. 00:14:27.772 ======================================================== 00:14:27.772 Latency(us) 00:14:27.772 Device Information : IOPS MiB/s Average min max 00:14:27.772 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10776.40 42.10 11882.49 2254.94 100222.67 00:14:27.772 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10765.60 42.05 11890.74 1851.80 52642.41 00:14:27.772 ======================================================== 00:14:27.772 Total : 21542.00 84.15 11886.62 1851.80 100222.67 00:14:27.772 00:14:27.772 02:19:31 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:28.031 02:19:31 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 9a970e75-e6aa-4504-a6f7-219d976b6364 00:14:28.353 02:19:31 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u cb96767b-c0ab-497a-9024-8207fc6b989e 00:14:28.641 02:19:32 -- target/nvmf_lvol.sh@60 -- # rm -f 00:14:28.641 02:19:32 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:14:28.641 02:19:32 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:14:28.641 02:19:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:28.641 02:19:32 -- nvmf/common.sh@116 -- # sync 00:14:28.641 02:19:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:28.641 02:19:32 -- nvmf/common.sh@119 -- # set +e 00:14:28.641 02:19:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:28.641 02:19:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:28.641 rmmod nvme_tcp 00:14:28.641 rmmod nvme_fabrics 00:14:28.641 rmmod nvme_keyring 00:14:28.641 02:19:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:28.641 02:19:32 -- nvmf/common.sh@123 -- # set -e 00:14:28.641 02:19:32 -- nvmf/common.sh@124 -- # return 0 00:14:28.641 02:19:32 -- nvmf/common.sh@477 -- # '[' -n 94957 ']' 00:14:28.641 02:19:32 -- nvmf/common.sh@478 -- # killprocess 94957 00:14:28.641 02:19:32 -- common/autotest_common.sh@936 -- # '[' -z 94957 ']' 00:14:28.641 02:19:32 -- common/autotest_common.sh@940 -- # kill -0 94957 00:14:28.641 02:19:32 -- common/autotest_common.sh@941 -- # uname 00:14:28.641 02:19:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:28.641 02:19:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 94957 00:14:28.641 02:19:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:28.641 02:19:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:28.641 02:19:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 94957' 00:14:28.641 killing process with pid 94957 00:14:28.641 02:19:32 -- common/autotest_common.sh@955 -- # kill 94957 00:14:28.641 02:19:32 -- common/autotest_common.sh@960 -- # wait 94957 00:14:28.900 02:19:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:28.900 02:19:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:28.900 02:19:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:28.900 02:19:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:28.900 02:19:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:28.900 02:19:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:28.900 02:19:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:28.900 02:19:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:31.436 02:19:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:31.436 00:14:31.436 real 0m19.917s 00:14:31.436 user 1m7.426s 00:14:31.436 sys 0m5.525s 00:14:31.436 02:19:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:31.436 02:19:34 -- common/autotest_common.sh@10 -- # set +x 00:14:31.436 ************************************ 00:14:31.436 END TEST nvmf_lvol 00:14:31.436 ************************************ 00:14:31.436 02:19:34 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:31.436 02:19:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:31.436 02:19:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:31.436 02:19:34 -- common/autotest_common.sh@10 -- # set +x 00:14:31.436 ************************************ 00:14:31.436 START TEST nvmf_lvs_grow 00:14:31.436 ************************************ 00:14:31.436 02:19:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:31.436 * Looking for test storage... 00:14:31.436 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:31.436 02:19:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:31.436 02:19:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:31.436 02:19:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:31.436 02:19:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:31.436 02:19:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:31.436 02:19:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:31.436 02:19:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:31.436 02:19:34 -- scripts/common.sh@335 -- # IFS=.-: 00:14:31.436 02:19:34 -- scripts/common.sh@335 -- # read -ra ver1 00:14:31.436 02:19:34 -- scripts/common.sh@336 -- # IFS=.-: 00:14:31.436 02:19:34 -- scripts/common.sh@336 -- # read -ra ver2 00:14:31.436 02:19:34 -- scripts/common.sh@337 -- # local 'op=<' 00:14:31.436 02:19:34 -- scripts/common.sh@339 -- # ver1_l=2 00:14:31.436 02:19:34 -- scripts/common.sh@340 -- # ver2_l=1 00:14:31.436 02:19:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:31.436 02:19:34 -- scripts/common.sh@343 -- # case "$op" in 00:14:31.436 02:19:34 -- scripts/common.sh@344 -- # : 1 00:14:31.436 02:19:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:31.436 02:19:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:31.436 02:19:34 -- scripts/common.sh@364 -- # decimal 1 00:14:31.436 02:19:34 -- scripts/common.sh@352 -- # local d=1 00:14:31.436 02:19:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:31.436 02:19:34 -- scripts/common.sh@354 -- # echo 1 00:14:31.436 02:19:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:31.436 02:19:34 -- scripts/common.sh@365 -- # decimal 2 00:14:31.436 02:19:34 -- scripts/common.sh@352 -- # local d=2 00:14:31.436 02:19:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:31.436 02:19:34 -- scripts/common.sh@354 -- # echo 2 00:14:31.436 02:19:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:31.436 02:19:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:31.436 02:19:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:31.436 02:19:34 -- scripts/common.sh@367 -- # return 0 00:14:31.436 02:19:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:31.436 02:19:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:31.436 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:31.436 --rc genhtml_branch_coverage=1 00:14:31.436 --rc genhtml_function_coverage=1 00:14:31.436 --rc genhtml_legend=1 00:14:31.436 --rc geninfo_all_blocks=1 00:14:31.436 --rc geninfo_unexecuted_blocks=1 00:14:31.436 00:14:31.436 ' 00:14:31.436 02:19:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:31.436 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:31.436 --rc genhtml_branch_coverage=1 00:14:31.436 --rc genhtml_function_coverage=1 00:14:31.436 --rc genhtml_legend=1 00:14:31.436 --rc geninfo_all_blocks=1 00:14:31.436 --rc geninfo_unexecuted_blocks=1 00:14:31.436 00:14:31.436 ' 00:14:31.436 02:19:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:31.436 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:31.436 --rc genhtml_branch_coverage=1 00:14:31.436 --rc genhtml_function_coverage=1 00:14:31.436 --rc genhtml_legend=1 00:14:31.436 --rc geninfo_all_blocks=1 00:14:31.436 --rc geninfo_unexecuted_blocks=1 00:14:31.436 00:14:31.436 ' 00:14:31.436 02:19:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:31.436 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:31.436 --rc genhtml_branch_coverage=1 00:14:31.436 --rc genhtml_function_coverage=1 00:14:31.436 --rc genhtml_legend=1 00:14:31.436 --rc geninfo_all_blocks=1 00:14:31.436 --rc geninfo_unexecuted_blocks=1 00:14:31.436 00:14:31.436 ' 00:14:31.436 02:19:34 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:31.436 02:19:34 -- nvmf/common.sh@7 -- # uname -s 00:14:31.436 02:19:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:31.436 02:19:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:31.436 02:19:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:31.436 02:19:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:31.436 02:19:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:31.436 02:19:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:31.436 02:19:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:31.436 02:19:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:31.436 02:19:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:31.436 02:19:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:31.436 02:19:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:31.436 02:19:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:31.436 02:19:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:31.436 02:19:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:31.436 02:19:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:31.436 02:19:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:31.436 02:19:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:31.436 02:19:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:31.436 02:19:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:31.436 02:19:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:31.436 02:19:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:31.436 02:19:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:31.436 02:19:34 -- paths/export.sh@5 -- # export PATH 00:14:31.436 02:19:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:31.436 02:19:34 -- nvmf/common.sh@46 -- # : 0 00:14:31.436 02:19:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:31.436 02:19:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:31.436 02:19:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:31.436 02:19:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:31.436 02:19:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:31.436 02:19:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:31.436 02:19:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:31.436 02:19:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:31.436 02:19:34 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:31.436 02:19:34 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:31.437 02:19:34 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:14:31.437 02:19:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:31.437 02:19:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:31.437 02:19:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:31.437 02:19:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:31.437 02:19:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:31.437 02:19:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:31.437 02:19:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:31.437 02:19:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:31.437 02:19:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:31.437 02:19:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:31.437 02:19:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:31.437 02:19:34 -- common/autotest_common.sh@10 -- # set +x 00:14:33.344 02:19:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:33.344 02:19:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:33.344 02:19:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:33.344 02:19:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:33.344 02:19:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:33.344 02:19:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:33.344 02:19:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:33.344 02:19:36 -- nvmf/common.sh@294 -- # net_devs=() 00:14:33.344 02:19:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:33.344 02:19:36 -- nvmf/common.sh@295 -- # e810=() 00:14:33.344 02:19:36 -- nvmf/common.sh@295 -- # local -ga e810 00:14:33.344 02:19:36 -- nvmf/common.sh@296 -- # x722=() 00:14:33.344 02:19:36 -- nvmf/common.sh@296 -- # local -ga x722 00:14:33.344 02:19:36 -- nvmf/common.sh@297 -- # mlx=() 00:14:33.344 02:19:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:33.344 02:19:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:33.344 02:19:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:33.344 02:19:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:33.344 02:19:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:33.344 02:19:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:33.344 02:19:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:33.344 02:19:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:33.344 02:19:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:33.344 02:19:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:33.344 02:19:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:33.344 02:19:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:33.344 02:19:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:33.344 02:19:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:33.344 02:19:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:33.344 02:19:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:33.344 02:19:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:33.345 02:19:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:33.345 02:19:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:33.345 02:19:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:33.345 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:33.345 02:19:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:33.345 02:19:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:33.345 02:19:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:33.345 02:19:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:33.345 02:19:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:33.345 02:19:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:33.345 02:19:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:33.345 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:33.345 02:19:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:33.345 02:19:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:33.345 02:19:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:33.345 02:19:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:33.345 02:19:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:33.345 02:19:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:33.345 02:19:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:33.345 02:19:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:33.345 02:19:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:33.345 02:19:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:33.345 02:19:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:33.345 02:19:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:33.345 02:19:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:33.345 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:33.345 02:19:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:33.345 02:19:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:33.345 02:19:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:33.345 02:19:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:33.345 02:19:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:33.345 02:19:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:33.345 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:33.345 02:19:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:33.345 02:19:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:33.345 02:19:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:33.345 02:19:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:33.345 02:19:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:33.345 02:19:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:33.345 02:19:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:33.345 02:19:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:33.345 02:19:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:33.345 02:19:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:33.345 02:19:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:33.345 02:19:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:33.345 02:19:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:33.345 02:19:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:33.345 02:19:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:33.345 02:19:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:33.345 02:19:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:33.345 02:19:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:33.345 02:19:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:33.345 02:19:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:33.345 02:19:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:33.345 02:19:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:33.345 02:19:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:33.345 02:19:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:33.345 02:19:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:33.345 02:19:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:33.345 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:33.345 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.229 ms 00:14:33.345 00:14:33.345 --- 10.0.0.2 ping statistics --- 00:14:33.345 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:33.345 rtt min/avg/max/mdev = 0.229/0.229/0.229/0.000 ms 00:14:33.345 02:19:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:33.345 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:33.345 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.092 ms 00:14:33.345 00:14:33.345 --- 10.0.0.1 ping statistics --- 00:14:33.345 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:33.345 rtt min/avg/max/mdev = 0.092/0.092/0.092/0.000 ms 00:14:33.345 02:19:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:33.345 02:19:36 -- nvmf/common.sh@410 -- # return 0 00:14:33.345 02:19:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:33.345 02:19:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:33.345 02:19:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:33.345 02:19:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:33.345 02:19:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:33.345 02:19:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:33.345 02:19:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:33.345 02:19:36 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:14:33.345 02:19:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:33.345 02:19:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:33.345 02:19:36 -- common/autotest_common.sh@10 -- # set +x 00:14:33.345 02:19:36 -- nvmf/common.sh@469 -- # nvmfpid=98727 00:14:33.345 02:19:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:33.345 02:19:36 -- nvmf/common.sh@470 -- # waitforlisten 98727 00:14:33.345 02:19:36 -- common/autotest_common.sh@829 -- # '[' -z 98727 ']' 00:14:33.345 02:19:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:33.345 02:19:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:33.345 02:19:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:33.345 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:33.345 02:19:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:33.345 02:19:36 -- common/autotest_common.sh@10 -- # set +x 00:14:33.345 [2024-11-29 02:19:36.819519] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:33.345 [2024-11-29 02:19:36.819594] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:33.345 EAL: No free 2048 kB hugepages reported on node 1 00:14:33.345 [2024-11-29 02:19:36.888503] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:33.345 [2024-11-29 02:19:37.001809] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:33.345 [2024-11-29 02:19:37.001975] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:33.345 [2024-11-29 02:19:37.001995] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:33.345 [2024-11-29 02:19:37.002010] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:33.345 [2024-11-29 02:19:37.002043] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:34.281 02:19:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:34.281 02:19:37 -- common/autotest_common.sh@862 -- # return 0 00:14:34.281 02:19:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:34.281 02:19:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:34.281 02:19:37 -- common/autotest_common.sh@10 -- # set +x 00:14:34.281 02:19:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:34.281 02:19:37 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:34.539 [2024-11-29 02:19:38.033426] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:34.539 02:19:38 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:14:34.539 02:19:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:34.539 02:19:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:34.539 02:19:38 -- common/autotest_common.sh@10 -- # set +x 00:14:34.539 ************************************ 00:14:34.539 START TEST lvs_grow_clean 00:14:34.539 ************************************ 00:14:34.539 02:19:38 -- common/autotest_common.sh@1114 -- # lvs_grow 00:14:34.539 02:19:38 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:34.539 02:19:38 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:34.539 02:19:38 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:34.539 02:19:38 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:34.539 02:19:38 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:34.539 02:19:38 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:34.539 02:19:38 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:34.539 02:19:38 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:34.539 02:19:38 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:34.798 02:19:38 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:34.798 02:19:38 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:35.056 02:19:38 -- target/nvmf_lvs_grow.sh@28 -- # lvs=c451b675-3a8b-4606-adba-fd1de4fd6e04 00:14:35.056 02:19:38 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c451b675-3a8b-4606-adba-fd1de4fd6e04 00:14:35.056 02:19:38 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:35.314 02:19:38 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:35.314 02:19:38 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:35.314 02:19:38 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u c451b675-3a8b-4606-adba-fd1de4fd6e04 lvol 150 00:14:35.572 02:19:39 -- target/nvmf_lvs_grow.sh@33 -- # lvol=5c9ff743-f207-4b16-8def-5cbc08dc3dbc 00:14:35.572 02:19:39 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:35.572 02:19:39 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:35.830 [2024-11-29 02:19:39.463875] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:35.830 [2024-11-29 02:19:39.463989] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:35.830 true 00:14:35.830 02:19:39 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c451b675-3a8b-4606-adba-fd1de4fd6e04 00:14:35.830 02:19:39 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:36.088 02:19:39 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:36.088 02:19:39 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:36.346 02:19:39 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 5c9ff743-f207-4b16-8def-5cbc08dc3dbc 00:14:36.604 02:19:40 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:36.862 [2024-11-29 02:19:40.487039] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:36.862 02:19:40 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:37.121 02:19:40 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=99303 00:14:37.121 02:19:40 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:37.121 02:19:40 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:37.121 02:19:40 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 99303 /var/tmp/bdevperf.sock 00:14:37.121 02:19:40 -- common/autotest_common.sh@829 -- # '[' -z 99303 ']' 00:14:37.121 02:19:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:37.121 02:19:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:37.121 02:19:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:37.121 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:37.121 02:19:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:37.121 02:19:40 -- common/autotest_common.sh@10 -- # set +x 00:14:37.121 [2024-11-29 02:19:40.791348] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:37.121 [2024-11-29 02:19:40.791453] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid99303 ] 00:14:37.380 EAL: No free 2048 kB hugepages reported on node 1 00:14:37.380 [2024-11-29 02:19:40.853520] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:37.380 [2024-11-29 02:19:40.969060] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:38.313 02:19:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:38.313 02:19:41 -- common/autotest_common.sh@862 -- # return 0 00:14:38.313 02:19:41 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:38.570 Nvme0n1 00:14:38.570 02:19:42 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:38.827 [ 00:14:38.827 { 00:14:38.827 "name": "Nvme0n1", 00:14:38.827 "aliases": [ 00:14:38.827 "5c9ff743-f207-4b16-8def-5cbc08dc3dbc" 00:14:38.827 ], 00:14:38.827 "product_name": "NVMe disk", 00:14:38.827 "block_size": 4096, 00:14:38.827 "num_blocks": 38912, 00:14:38.827 "uuid": "5c9ff743-f207-4b16-8def-5cbc08dc3dbc", 00:14:38.827 "assigned_rate_limits": { 00:14:38.827 "rw_ios_per_sec": 0, 00:14:38.827 "rw_mbytes_per_sec": 0, 00:14:38.827 "r_mbytes_per_sec": 0, 00:14:38.827 "w_mbytes_per_sec": 0 00:14:38.827 }, 00:14:38.827 "claimed": false, 00:14:38.827 "zoned": false, 00:14:38.827 "supported_io_types": { 00:14:38.827 "read": true, 00:14:38.827 "write": true, 00:14:38.827 "unmap": true, 00:14:38.827 "write_zeroes": true, 00:14:38.827 "flush": true, 00:14:38.827 "reset": true, 00:14:38.827 "compare": true, 00:14:38.827 "compare_and_write": true, 00:14:38.827 "abort": true, 00:14:38.827 "nvme_admin": true, 00:14:38.827 "nvme_io": true 00:14:38.827 }, 00:14:38.827 "driver_specific": { 00:14:38.827 "nvme": [ 00:14:38.827 { 00:14:38.827 "trid": { 00:14:38.827 "trtype": "TCP", 00:14:38.827 "adrfam": "IPv4", 00:14:38.827 "traddr": "10.0.0.2", 00:14:38.827 "trsvcid": "4420", 00:14:38.827 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:38.827 }, 00:14:38.827 "ctrlr_data": { 00:14:38.827 "cntlid": 1, 00:14:38.827 "vendor_id": "0x8086", 00:14:38.827 "model_number": "SPDK bdev Controller", 00:14:38.827 "serial_number": "SPDK0", 00:14:38.827 "firmware_revision": "24.01.1", 00:14:38.827 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:38.827 "oacs": { 00:14:38.827 "security": 0, 00:14:38.827 "format": 0, 00:14:38.827 "firmware": 0, 00:14:38.827 "ns_manage": 0 00:14:38.827 }, 00:14:38.827 "multi_ctrlr": true, 00:14:38.827 "ana_reporting": false 00:14:38.827 }, 00:14:38.827 "vs": { 00:14:38.827 "nvme_version": "1.3" 00:14:38.827 }, 00:14:38.827 "ns_data": { 00:14:38.827 "id": 1, 00:14:38.827 "can_share": true 00:14:38.827 } 00:14:38.827 } 00:14:38.827 ], 00:14:38.827 "mp_policy": "active_passive" 00:14:38.827 } 00:14:38.827 } 00:14:38.827 ] 00:14:38.827 02:19:42 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=99458 00:14:38.827 02:19:42 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:38.827 02:19:42 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:39.084 Running I/O for 10 seconds... 00:14:40.016 Latency(us) 00:14:40.016 [2024-11-29T01:19:43.697Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:40.016 [2024-11-29T01:19:43.697Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:40.016 Nvme0n1 : 1.00 14800.00 57.81 0.00 0.00 0.00 0.00 0.00 00:14:40.016 [2024-11-29T01:19:43.697Z] =================================================================================================================== 00:14:40.016 [2024-11-29T01:19:43.697Z] Total : 14800.00 57.81 0.00 0.00 0.00 0.00 0.00 00:14:40.016 00:14:40.950 02:19:44 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u c451b675-3a8b-4606-adba-fd1de4fd6e04 00:14:40.950 [2024-11-29T01:19:44.631Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:40.950 Nvme0n1 : 2.00 14989.00 58.55 0.00 0.00 0.00 0.00 0.00 00:14:40.950 [2024-11-29T01:19:44.631Z] =================================================================================================================== 00:14:40.950 [2024-11-29T01:19:44.631Z] Total : 14989.00 58.55 0.00 0.00 0.00 0.00 0.00 00:14:40.950 00:14:41.208 true 00:14:41.208 02:19:44 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c451b675-3a8b-4606-adba-fd1de4fd6e04 00:14:41.208 02:19:44 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:41.466 02:19:45 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:41.466 02:19:45 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:41.466 02:19:45 -- target/nvmf_lvs_grow.sh@65 -- # wait 99458 00:14:42.030 [2024-11-29T01:19:45.711Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:42.030 Nvme0n1 : 3.00 15097.33 58.97 0.00 0.00 0.00 0.00 0.00 00:14:42.030 [2024-11-29T01:19:45.711Z] =================================================================================================================== 00:14:42.030 [2024-11-29T01:19:45.711Z] Total : 15097.33 58.97 0.00 0.00 0.00 0.00 0.00 00:14:42.030 00:14:42.964 [2024-11-29T01:19:46.645Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:42.964 Nvme0n1 : 4.00 15174.75 59.28 0.00 0.00 0.00 0.00 0.00 00:14:42.964 [2024-11-29T01:19:46.645Z] =================================================================================================================== 00:14:42.964 [2024-11-29T01:19:46.645Z] Total : 15174.75 59.28 0.00 0.00 0.00 0.00 0.00 00:14:42.964 00:14:43.897 [2024-11-29T01:19:47.578Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:43.897 Nvme0n1 : 5.00 15254.80 59.59 0.00 0.00 0.00 0.00 0.00 00:14:43.897 [2024-11-29T01:19:47.578Z] =================================================================================================================== 00:14:43.897 [2024-11-29T01:19:47.578Z] Total : 15254.80 59.59 0.00 0.00 0.00 0.00 0.00 00:14:43.897 00:14:45.271 [2024-11-29T01:19:48.952Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:45.271 Nvme0n1 : 6.00 15316.50 59.83 0.00 0.00 0.00 0.00 0.00 00:14:45.271 [2024-11-29T01:19:48.952Z] =================================================================================================================== 00:14:45.271 [2024-11-29T01:19:48.952Z] Total : 15316.50 59.83 0.00 0.00 0.00 0.00 0.00 00:14:45.271 00:14:46.206 [2024-11-29T01:19:49.887Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:46.206 Nvme0n1 : 7.00 15361.57 60.01 0.00 0.00 0.00 0.00 0.00 00:14:46.206 [2024-11-29T01:19:49.887Z] =================================================================================================================== 00:14:46.206 [2024-11-29T01:19:49.887Z] Total : 15361.57 60.01 0.00 0.00 0.00 0.00 0.00 00:14:46.206 00:14:47.140 [2024-11-29T01:19:50.821Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:47.140 Nvme0n1 : 8.00 15396.00 60.14 0.00 0.00 0.00 0.00 0.00 00:14:47.140 [2024-11-29T01:19:50.821Z] =================================================================================================================== 00:14:47.140 [2024-11-29T01:19:50.821Z] Total : 15396.00 60.14 0.00 0.00 0.00 0.00 0.00 00:14:47.140 00:14:48.074 [2024-11-29T01:19:51.755Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:48.074 Nvme0n1 : 9.00 15406.00 60.18 0.00 0.00 0.00 0.00 0.00 00:14:48.074 [2024-11-29T01:19:51.755Z] =================================================================================================================== 00:14:48.074 [2024-11-29T01:19:51.755Z] Total : 15406.00 60.18 0.00 0.00 0.00 0.00 0.00 00:14:48.074 00:14:49.007 00:14:49.008 Latency(us) 00:14:49.008 [2024-11-29T01:19:52.689Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:49.008 [2024-11-29T01:19:52.689Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:49.008 Nvme0n1 : 10.00 15433.33 60.29 0.00 0.00 8289.28 3276.80 19223.89 00:14:49.008 [2024-11-29T01:19:52.689Z] =================================================================================================================== 00:14:49.008 [2024-11-29T01:19:52.689Z] Total : 15433.33 60.29 0.00 0.00 8289.28 3276.80 19223.89 00:14:49.008 0 00:14:49.008 02:19:52 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 99303 00:14:49.008 02:19:52 -- common/autotest_common.sh@936 -- # '[' -z 99303 ']' 00:14:49.008 02:19:52 -- common/autotest_common.sh@940 -- # kill -0 99303 00:14:49.008 02:19:52 -- common/autotest_common.sh@941 -- # uname 00:14:49.008 02:19:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:49.008 02:19:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 99303 00:14:49.008 02:19:52 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:49.008 02:19:52 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:49.008 02:19:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 99303' 00:14:49.008 killing process with pid 99303 00:14:49.008 02:19:52 -- common/autotest_common.sh@955 -- # kill 99303 00:14:49.008 Received shutdown signal, test time was about 10.000000 seconds 00:14:49.008 00:14:49.008 Latency(us) 00:14:49.008 [2024-11-29T01:19:52.689Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:49.008 [2024-11-29T01:19:52.689Z] =================================================================================================================== 00:14:49.008 [2024-11-29T01:19:52.689Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:49.008 02:19:52 -- common/autotest_common.sh@960 -- # wait 99303 00:14:49.265 02:19:52 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:49.831 02:19:53 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c451b675-3a8b-4606-adba-fd1de4fd6e04 00:14:49.831 02:19:53 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:14:49.831 02:19:53 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:14:49.831 02:19:53 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:14:49.831 02:19:53 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:50.089 [2024-11-29 02:19:53.738444] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:14:50.347 02:19:53 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c451b675-3a8b-4606-adba-fd1de4fd6e04 00:14:50.347 02:19:53 -- common/autotest_common.sh@650 -- # local es=0 00:14:50.347 02:19:53 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c451b675-3a8b-4606-adba-fd1de4fd6e04 00:14:50.347 02:19:53 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:50.347 02:19:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:50.347 02:19:53 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:50.347 02:19:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:50.347 02:19:53 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:50.347 02:19:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:50.347 02:19:53 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:50.347 02:19:53 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:14:50.347 02:19:53 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c451b675-3a8b-4606-adba-fd1de4fd6e04 00:14:50.347 request: 00:14:50.347 { 00:14:50.347 "uuid": "c451b675-3a8b-4606-adba-fd1de4fd6e04", 00:14:50.347 "method": "bdev_lvol_get_lvstores", 00:14:50.347 "req_id": 1 00:14:50.347 } 00:14:50.347 Got JSON-RPC error response 00:14:50.347 response: 00:14:50.347 { 00:14:50.347 "code": -19, 00:14:50.347 "message": "No such device" 00:14:50.347 } 00:14:50.605 02:19:54 -- common/autotest_common.sh@653 -- # es=1 00:14:50.605 02:19:54 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:50.605 02:19:54 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:50.605 02:19:54 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:50.605 02:19:54 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:50.605 aio_bdev 00:14:50.862 02:19:54 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 5c9ff743-f207-4b16-8def-5cbc08dc3dbc 00:14:50.862 02:19:54 -- common/autotest_common.sh@897 -- # local bdev_name=5c9ff743-f207-4b16-8def-5cbc08dc3dbc 00:14:50.862 02:19:54 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:14:50.862 02:19:54 -- common/autotest_common.sh@899 -- # local i 00:14:50.862 02:19:54 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:14:50.863 02:19:54 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:14:50.863 02:19:54 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:51.120 02:19:54 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 5c9ff743-f207-4b16-8def-5cbc08dc3dbc -t 2000 00:14:51.377 [ 00:14:51.377 { 00:14:51.377 "name": "5c9ff743-f207-4b16-8def-5cbc08dc3dbc", 00:14:51.377 "aliases": [ 00:14:51.377 "lvs/lvol" 00:14:51.377 ], 00:14:51.377 "product_name": "Logical Volume", 00:14:51.377 "block_size": 4096, 00:14:51.377 "num_blocks": 38912, 00:14:51.377 "uuid": "5c9ff743-f207-4b16-8def-5cbc08dc3dbc", 00:14:51.377 "assigned_rate_limits": { 00:14:51.377 "rw_ios_per_sec": 0, 00:14:51.377 "rw_mbytes_per_sec": 0, 00:14:51.378 "r_mbytes_per_sec": 0, 00:14:51.378 "w_mbytes_per_sec": 0 00:14:51.378 }, 00:14:51.378 "claimed": false, 00:14:51.378 "zoned": false, 00:14:51.378 "supported_io_types": { 00:14:51.378 "read": true, 00:14:51.378 "write": true, 00:14:51.378 "unmap": true, 00:14:51.378 "write_zeroes": true, 00:14:51.378 "flush": false, 00:14:51.378 "reset": true, 00:14:51.378 "compare": false, 00:14:51.378 "compare_and_write": false, 00:14:51.378 "abort": false, 00:14:51.378 "nvme_admin": false, 00:14:51.378 "nvme_io": false 00:14:51.378 }, 00:14:51.378 "driver_specific": { 00:14:51.378 "lvol": { 00:14:51.378 "lvol_store_uuid": "c451b675-3a8b-4606-adba-fd1de4fd6e04", 00:14:51.378 "base_bdev": "aio_bdev", 00:14:51.378 "thin_provision": false, 00:14:51.378 "snapshot": false, 00:14:51.378 "clone": false, 00:14:51.378 "esnap_clone": false 00:14:51.378 } 00:14:51.378 } 00:14:51.378 } 00:14:51.378 ] 00:14:51.378 02:19:54 -- common/autotest_common.sh@905 -- # return 0 00:14:51.378 02:19:54 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c451b675-3a8b-4606-adba-fd1de4fd6e04 00:14:51.378 02:19:54 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:14:51.635 02:19:55 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:14:51.635 02:19:55 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c451b675-3a8b-4606-adba-fd1de4fd6e04 00:14:51.635 02:19:55 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:14:51.891 02:19:55 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:14:51.891 02:19:55 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 5c9ff743-f207-4b16-8def-5cbc08dc3dbc 00:14:52.149 02:19:55 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u c451b675-3a8b-4606-adba-fd1de4fd6e04 00:14:52.407 02:19:55 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:52.665 02:19:56 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:52.665 00:14:52.665 real 0m18.135s 00:14:52.665 user 0m18.039s 00:14:52.665 sys 0m1.772s 00:14:52.665 02:19:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:52.665 02:19:56 -- common/autotest_common.sh@10 -- # set +x 00:14:52.665 ************************************ 00:14:52.665 END TEST lvs_grow_clean 00:14:52.665 ************************************ 00:14:52.665 02:19:56 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:14:52.665 02:19:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:52.665 02:19:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:52.665 02:19:56 -- common/autotest_common.sh@10 -- # set +x 00:14:52.665 ************************************ 00:14:52.665 START TEST lvs_grow_dirty 00:14:52.665 ************************************ 00:14:52.665 02:19:56 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:14:52.665 02:19:56 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:52.665 02:19:56 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:52.665 02:19:56 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:52.665 02:19:56 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:52.665 02:19:56 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:52.665 02:19:56 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:52.665 02:19:56 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:52.665 02:19:56 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:52.665 02:19:56 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:52.923 02:19:56 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:52.923 02:19:56 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:53.182 02:19:56 -- target/nvmf_lvs_grow.sh@28 -- # lvs=94b0480f-7e0a-4797-b6d7-a05281ef47d8 00:14:53.182 02:19:56 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 94b0480f-7e0a-4797-b6d7-a05281ef47d8 00:14:53.182 02:19:56 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:53.441 02:19:57 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:53.441 02:19:57 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:53.441 02:19:57 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 94b0480f-7e0a-4797-b6d7-a05281ef47d8 lvol 150 00:14:53.700 02:19:57 -- target/nvmf_lvs_grow.sh@33 -- # lvol=a27fd577-fcec-4667-ab18-672988e5aee1 00:14:53.700 02:19:57 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:53.700 02:19:57 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:53.958 [2024-11-29 02:19:57.522844] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:53.958 [2024-11-29 02:19:57.522953] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:53.958 true 00:14:53.958 02:19:57 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 94b0480f-7e0a-4797-b6d7-a05281ef47d8 00:14:53.958 02:19:57 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:54.217 02:19:57 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:54.217 02:19:57 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:54.475 02:19:58 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 a27fd577-fcec-4667-ab18-672988e5aee1 00:14:54.732 02:19:58 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:55.296 02:19:58 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:55.296 02:19:58 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=101544 00:14:55.296 02:19:58 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:55.296 02:19:58 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:55.296 02:19:58 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 101544 /var/tmp/bdevperf.sock 00:14:55.296 02:19:58 -- common/autotest_common.sh@829 -- # '[' -z 101544 ']' 00:14:55.296 02:19:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:55.296 02:19:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:55.296 02:19:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:55.296 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:55.296 02:19:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:55.296 02:19:58 -- common/autotest_common.sh@10 -- # set +x 00:14:55.553 [2024-11-29 02:19:59.014558] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:55.553 [2024-11-29 02:19:59.014646] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid101544 ] 00:14:55.553 EAL: No free 2048 kB hugepages reported on node 1 00:14:55.553 [2024-11-29 02:19:59.098137] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:55.810 [2024-11-29 02:19:59.233510] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:55.810 02:19:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:55.810 02:19:59 -- common/autotest_common.sh@862 -- # return 0 00:14:55.810 02:19:59 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:56.067 Nvme0n1 00:14:56.067 02:19:59 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:56.324 [ 00:14:56.324 { 00:14:56.324 "name": "Nvme0n1", 00:14:56.324 "aliases": [ 00:14:56.324 "a27fd577-fcec-4667-ab18-672988e5aee1" 00:14:56.324 ], 00:14:56.324 "product_name": "NVMe disk", 00:14:56.324 "block_size": 4096, 00:14:56.324 "num_blocks": 38912, 00:14:56.324 "uuid": "a27fd577-fcec-4667-ab18-672988e5aee1", 00:14:56.324 "assigned_rate_limits": { 00:14:56.324 "rw_ios_per_sec": 0, 00:14:56.324 "rw_mbytes_per_sec": 0, 00:14:56.324 "r_mbytes_per_sec": 0, 00:14:56.324 "w_mbytes_per_sec": 0 00:14:56.324 }, 00:14:56.324 "claimed": false, 00:14:56.324 "zoned": false, 00:14:56.324 "supported_io_types": { 00:14:56.324 "read": true, 00:14:56.324 "write": true, 00:14:56.324 "unmap": true, 00:14:56.324 "write_zeroes": true, 00:14:56.324 "flush": true, 00:14:56.324 "reset": true, 00:14:56.324 "compare": true, 00:14:56.324 "compare_and_write": true, 00:14:56.324 "abort": true, 00:14:56.324 "nvme_admin": true, 00:14:56.324 "nvme_io": true 00:14:56.324 }, 00:14:56.324 "driver_specific": { 00:14:56.324 "nvme": [ 00:14:56.324 { 00:14:56.324 "trid": { 00:14:56.324 "trtype": "TCP", 00:14:56.324 "adrfam": "IPv4", 00:14:56.324 "traddr": "10.0.0.2", 00:14:56.324 "trsvcid": "4420", 00:14:56.324 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:56.324 }, 00:14:56.324 "ctrlr_data": { 00:14:56.324 "cntlid": 1, 00:14:56.324 "vendor_id": "0x8086", 00:14:56.324 "model_number": "SPDK bdev Controller", 00:14:56.324 "serial_number": "SPDK0", 00:14:56.324 "firmware_revision": "24.01.1", 00:14:56.324 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:56.324 "oacs": { 00:14:56.324 "security": 0, 00:14:56.324 "format": 0, 00:14:56.324 "firmware": 0, 00:14:56.324 "ns_manage": 0 00:14:56.324 }, 00:14:56.324 "multi_ctrlr": true, 00:14:56.324 "ana_reporting": false 00:14:56.324 }, 00:14:56.324 "vs": { 00:14:56.324 "nvme_version": "1.3" 00:14:56.324 }, 00:14:56.324 "ns_data": { 00:14:56.324 "id": 1, 00:14:56.324 "can_share": true 00:14:56.324 } 00:14:56.324 } 00:14:56.324 ], 00:14:56.324 "mp_policy": "active_passive" 00:14:56.324 } 00:14:56.324 } 00:14:56.324 ] 00:14:56.324 02:19:59 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=101640 00:14:56.324 02:19:59 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:56.324 02:19:59 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:56.581 Running I/O for 10 seconds... 00:14:57.512 Latency(us) 00:14:57.512 [2024-11-29T01:20:01.193Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:57.512 [2024-11-29T01:20:01.193Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:57.512 Nvme0n1 : 1.00 14748.00 57.61 0.00 0.00 0.00 0.00 0.00 00:14:57.512 [2024-11-29T01:20:01.193Z] =================================================================================================================== 00:14:57.512 [2024-11-29T01:20:01.193Z] Total : 14748.00 57.61 0.00 0.00 0.00 0.00 0.00 00:14:57.512 00:14:58.444 02:20:01 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 94b0480f-7e0a-4797-b6d7-a05281ef47d8 00:14:58.444 [2024-11-29T01:20:02.125Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:58.444 Nvme0n1 : 2.00 14938.00 58.35 0.00 0.00 0.00 0.00 0.00 00:14:58.444 [2024-11-29T01:20:02.125Z] =================================================================================================================== 00:14:58.444 [2024-11-29T01:20:02.125Z] Total : 14938.00 58.35 0.00 0.00 0.00 0.00 0.00 00:14:58.444 00:14:58.702 true 00:14:58.702 02:20:02 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 94b0480f-7e0a-4797-b6d7-a05281ef47d8 00:14:58.702 02:20:02 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:58.959 02:20:02 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:58.959 02:20:02 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:58.959 02:20:02 -- target/nvmf_lvs_grow.sh@65 -- # wait 101640 00:14:59.535 [2024-11-29T01:20:03.216Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:59.535 Nvme0n1 : 3.00 15018.00 58.66 0.00 0.00 0.00 0.00 0.00 00:14:59.535 [2024-11-29T01:20:03.216Z] =================================================================================================================== 00:14:59.535 [2024-11-29T01:20:03.216Z] Total : 15018.00 58.66 0.00 0.00 0.00 0.00 0.00 00:14:59.535 00:15:00.544 [2024-11-29T01:20:04.225Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:00.544 Nvme0n1 : 4.00 15112.00 59.03 0.00 0.00 0.00 0.00 0.00 00:15:00.544 [2024-11-29T01:20:04.225Z] =================================================================================================================== 00:15:00.544 [2024-11-29T01:20:04.225Z] Total : 15112.00 59.03 0.00 0.00 0.00 0.00 0.00 00:15:00.544 00:15:01.492 [2024-11-29T01:20:05.173Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:01.492 Nvme0n1 : 5.00 15172.00 59.27 0.00 0.00 0.00 0.00 0.00 00:15:01.492 [2024-11-29T01:20:05.173Z] =================================================================================================================== 00:15:01.492 [2024-11-29T01:20:05.173Z] Total : 15172.00 59.27 0.00 0.00 0.00 0.00 0.00 00:15:01.492 00:15:02.428 [2024-11-29T01:20:06.109Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:02.428 Nvme0n1 : 6.00 15223.50 59.47 0.00 0.00 0.00 0.00 0.00 00:15:02.428 [2024-11-29T01:20:06.109Z] =================================================================================================================== 00:15:02.428 [2024-11-29T01:20:06.109Z] Total : 15223.50 59.47 0.00 0.00 0.00 0.00 0.00 00:15:02.428 00:15:03.807 [2024-11-29T01:20:07.488Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:03.807 Nvme0n1 : 7.00 15266.86 59.64 0.00 0.00 0.00 0.00 0.00 00:15:03.807 [2024-11-29T01:20:07.488Z] =================================================================================================================== 00:15:03.807 [2024-11-29T01:20:07.488Z] Total : 15266.86 59.64 0.00 0.00 0.00 0.00 0.00 00:15:03.807 00:15:04.743 [2024-11-29T01:20:08.424Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:04.743 Nvme0n1 : 8.00 15306.50 59.79 0.00 0.00 0.00 0.00 0.00 00:15:04.743 [2024-11-29T01:20:08.424Z] =================================================================================================================== 00:15:04.743 [2024-11-29T01:20:08.424Z] Total : 15306.50 59.79 0.00 0.00 0.00 0.00 0.00 00:15:04.743 00:15:05.678 [2024-11-29T01:20:09.359Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:05.678 Nvme0n1 : 9.00 15343.11 59.93 0.00 0.00 0.00 0.00 0.00 00:15:05.678 [2024-11-29T01:20:09.359Z] =================================================================================================================== 00:15:05.678 [2024-11-29T01:20:09.359Z] Total : 15343.11 59.93 0.00 0.00 0.00 0.00 0.00 00:15:05.678 00:15:06.615 [2024-11-29T01:20:10.296Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:06.615 Nvme0n1 : 10.00 15377.70 60.07 0.00 0.00 0.00 0.00 0.00 00:15:06.615 [2024-11-29T01:20:10.296Z] =================================================================================================================== 00:15:06.615 [2024-11-29T01:20:10.296Z] Total : 15377.70 60.07 0.00 0.00 0.00 0.00 0.00 00:15:06.615 00:15:06.615 00:15:06.615 Latency(us) 00:15:06.615 [2024-11-29T01:20:10.296Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:06.615 [2024-11-29T01:20:10.296Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:06.615 Nvme0n1 : 10.01 15378.15 60.07 0.00 0.00 8318.95 4538.97 16602.45 00:15:06.615 [2024-11-29T01:20:10.296Z] =================================================================================================================== 00:15:06.615 [2024-11-29T01:20:10.296Z] Total : 15378.15 60.07 0.00 0.00 8318.95 4538.97 16602.45 00:15:06.615 0 00:15:06.615 02:20:10 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 101544 00:15:06.615 02:20:10 -- common/autotest_common.sh@936 -- # '[' -z 101544 ']' 00:15:06.615 02:20:10 -- common/autotest_common.sh@940 -- # kill -0 101544 00:15:06.615 02:20:10 -- common/autotest_common.sh@941 -- # uname 00:15:06.615 02:20:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:06.615 02:20:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 101544 00:15:06.615 02:20:10 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:06.615 02:20:10 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:06.615 02:20:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 101544' 00:15:06.615 killing process with pid 101544 00:15:06.615 02:20:10 -- common/autotest_common.sh@955 -- # kill 101544 00:15:06.615 Received shutdown signal, test time was about 10.000000 seconds 00:15:06.615 00:15:06.615 Latency(us) 00:15:06.615 [2024-11-29T01:20:10.296Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:06.615 [2024-11-29T01:20:10.296Z] =================================================================================================================== 00:15:06.615 [2024-11-29T01:20:10.296Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:06.615 02:20:10 -- common/autotest_common.sh@960 -- # wait 101544 00:15:06.874 02:20:10 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:07.132 02:20:10 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 94b0480f-7e0a-4797-b6d7-a05281ef47d8 00:15:07.132 02:20:10 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:07.391 02:20:10 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:07.391 02:20:10 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:15:07.391 02:20:10 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 98727 00:15:07.391 02:20:10 -- target/nvmf_lvs_grow.sh@74 -- # wait 98727 00:15:07.391 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 98727 Killed "${NVMF_APP[@]}" "$@" 00:15:07.391 02:20:10 -- target/nvmf_lvs_grow.sh@74 -- # true 00:15:07.391 02:20:10 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:15:07.391 02:20:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:07.391 02:20:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:07.391 02:20:10 -- common/autotest_common.sh@10 -- # set +x 00:15:07.391 02:20:10 -- nvmf/common.sh@469 -- # nvmfpid=102929 00:15:07.391 02:20:10 -- nvmf/common.sh@470 -- # waitforlisten 102929 00:15:07.391 02:20:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:15:07.391 02:20:10 -- common/autotest_common.sh@829 -- # '[' -z 102929 ']' 00:15:07.391 02:20:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:07.391 02:20:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:07.391 02:20:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:07.391 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:07.391 02:20:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:07.391 02:20:10 -- common/autotest_common.sh@10 -- # set +x 00:15:07.391 [2024-11-29 02:20:11.011849] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:07.391 [2024-11-29 02:20:11.011946] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:07.391 EAL: No free 2048 kB hugepages reported on node 1 00:15:07.649 [2024-11-29 02:20:11.083579] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:07.649 [2024-11-29 02:20:11.200621] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:07.649 [2024-11-29 02:20:11.200782] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:07.649 [2024-11-29 02:20:11.200802] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:07.649 [2024-11-29 02:20:11.200817] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:07.649 [2024-11-29 02:20:11.200854] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:08.579 02:20:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:08.579 02:20:12 -- common/autotest_common.sh@862 -- # return 0 00:15:08.579 02:20:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:08.579 02:20:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:08.579 02:20:12 -- common/autotest_common.sh@10 -- # set +x 00:15:08.579 02:20:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:08.579 02:20:12 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:08.837 [2024-11-29 02:20:12.342616] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:15:08.837 [2024-11-29 02:20:12.342782] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:15:08.837 [2024-11-29 02:20:12.342838] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:15:08.837 02:20:12 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:15:08.837 02:20:12 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev a27fd577-fcec-4667-ab18-672988e5aee1 00:15:08.837 02:20:12 -- common/autotest_common.sh@897 -- # local bdev_name=a27fd577-fcec-4667-ab18-672988e5aee1 00:15:08.837 02:20:12 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:08.837 02:20:12 -- common/autotest_common.sh@899 -- # local i 00:15:08.837 02:20:12 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:08.837 02:20:12 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:08.837 02:20:12 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:09.096 02:20:12 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b a27fd577-fcec-4667-ab18-672988e5aee1 -t 2000 00:15:09.354 [ 00:15:09.354 { 00:15:09.354 "name": "a27fd577-fcec-4667-ab18-672988e5aee1", 00:15:09.354 "aliases": [ 00:15:09.354 "lvs/lvol" 00:15:09.354 ], 00:15:09.354 "product_name": "Logical Volume", 00:15:09.354 "block_size": 4096, 00:15:09.354 "num_blocks": 38912, 00:15:09.354 "uuid": "a27fd577-fcec-4667-ab18-672988e5aee1", 00:15:09.354 "assigned_rate_limits": { 00:15:09.354 "rw_ios_per_sec": 0, 00:15:09.354 "rw_mbytes_per_sec": 0, 00:15:09.354 "r_mbytes_per_sec": 0, 00:15:09.354 "w_mbytes_per_sec": 0 00:15:09.354 }, 00:15:09.354 "claimed": false, 00:15:09.354 "zoned": false, 00:15:09.354 "supported_io_types": { 00:15:09.354 "read": true, 00:15:09.354 "write": true, 00:15:09.354 "unmap": true, 00:15:09.354 "write_zeroes": true, 00:15:09.354 "flush": false, 00:15:09.354 "reset": true, 00:15:09.354 "compare": false, 00:15:09.354 "compare_and_write": false, 00:15:09.354 "abort": false, 00:15:09.354 "nvme_admin": false, 00:15:09.354 "nvme_io": false 00:15:09.354 }, 00:15:09.354 "driver_specific": { 00:15:09.354 "lvol": { 00:15:09.354 "lvol_store_uuid": "94b0480f-7e0a-4797-b6d7-a05281ef47d8", 00:15:09.354 "base_bdev": "aio_bdev", 00:15:09.354 "thin_provision": false, 00:15:09.354 "snapshot": false, 00:15:09.354 "clone": false, 00:15:09.354 "esnap_clone": false 00:15:09.354 } 00:15:09.354 } 00:15:09.354 } 00:15:09.354 ] 00:15:09.354 02:20:12 -- common/autotest_common.sh@905 -- # return 0 00:15:09.354 02:20:12 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 94b0480f-7e0a-4797-b6d7-a05281ef47d8 00:15:09.354 02:20:12 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:15:09.613 02:20:13 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:15:09.613 02:20:13 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 94b0480f-7e0a-4797-b6d7-a05281ef47d8 00:15:09.613 02:20:13 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:15:09.871 02:20:13 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:15:09.871 02:20:13 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:10.129 [2024-11-29 02:20:13.743944] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:10.129 02:20:13 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 94b0480f-7e0a-4797-b6d7-a05281ef47d8 00:15:10.129 02:20:13 -- common/autotest_common.sh@650 -- # local es=0 00:15:10.129 02:20:13 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 94b0480f-7e0a-4797-b6d7-a05281ef47d8 00:15:10.129 02:20:13 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:10.129 02:20:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:10.129 02:20:13 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:10.129 02:20:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:10.129 02:20:13 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:10.129 02:20:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:10.129 02:20:13 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:10.129 02:20:13 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:10.129 02:20:13 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 94b0480f-7e0a-4797-b6d7-a05281ef47d8 00:15:10.388 request: 00:15:10.388 { 00:15:10.388 "uuid": "94b0480f-7e0a-4797-b6d7-a05281ef47d8", 00:15:10.388 "method": "bdev_lvol_get_lvstores", 00:15:10.388 "req_id": 1 00:15:10.388 } 00:15:10.388 Got JSON-RPC error response 00:15:10.388 response: 00:15:10.388 { 00:15:10.388 "code": -19, 00:15:10.388 "message": "No such device" 00:15:10.388 } 00:15:10.647 02:20:14 -- common/autotest_common.sh@653 -- # es=1 00:15:10.647 02:20:14 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:10.647 02:20:14 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:10.647 02:20:14 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:10.647 02:20:14 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:10.647 aio_bdev 00:15:10.647 02:20:14 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev a27fd577-fcec-4667-ab18-672988e5aee1 00:15:10.647 02:20:14 -- common/autotest_common.sh@897 -- # local bdev_name=a27fd577-fcec-4667-ab18-672988e5aee1 00:15:10.647 02:20:14 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:10.647 02:20:14 -- common/autotest_common.sh@899 -- # local i 00:15:10.647 02:20:14 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:10.647 02:20:14 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:10.647 02:20:14 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:10.905 02:20:14 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b a27fd577-fcec-4667-ab18-672988e5aee1 -t 2000 00:15:11.163 [ 00:15:11.163 { 00:15:11.163 "name": "a27fd577-fcec-4667-ab18-672988e5aee1", 00:15:11.163 "aliases": [ 00:15:11.163 "lvs/lvol" 00:15:11.163 ], 00:15:11.163 "product_name": "Logical Volume", 00:15:11.163 "block_size": 4096, 00:15:11.163 "num_blocks": 38912, 00:15:11.163 "uuid": "a27fd577-fcec-4667-ab18-672988e5aee1", 00:15:11.163 "assigned_rate_limits": { 00:15:11.163 "rw_ios_per_sec": 0, 00:15:11.163 "rw_mbytes_per_sec": 0, 00:15:11.163 "r_mbytes_per_sec": 0, 00:15:11.163 "w_mbytes_per_sec": 0 00:15:11.163 }, 00:15:11.163 "claimed": false, 00:15:11.163 "zoned": false, 00:15:11.163 "supported_io_types": { 00:15:11.163 "read": true, 00:15:11.163 "write": true, 00:15:11.163 "unmap": true, 00:15:11.163 "write_zeroes": true, 00:15:11.163 "flush": false, 00:15:11.163 "reset": true, 00:15:11.163 "compare": false, 00:15:11.163 "compare_and_write": false, 00:15:11.163 "abort": false, 00:15:11.163 "nvme_admin": false, 00:15:11.163 "nvme_io": false 00:15:11.163 }, 00:15:11.163 "driver_specific": { 00:15:11.163 "lvol": { 00:15:11.163 "lvol_store_uuid": "94b0480f-7e0a-4797-b6d7-a05281ef47d8", 00:15:11.163 "base_bdev": "aio_bdev", 00:15:11.163 "thin_provision": false, 00:15:11.163 "snapshot": false, 00:15:11.163 "clone": false, 00:15:11.163 "esnap_clone": false 00:15:11.163 } 00:15:11.163 } 00:15:11.163 } 00:15:11.163 ] 00:15:11.163 02:20:14 -- common/autotest_common.sh@905 -- # return 0 00:15:11.163 02:20:14 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 94b0480f-7e0a-4797-b6d7-a05281ef47d8 00:15:11.163 02:20:14 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:11.420 02:20:15 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:11.420 02:20:15 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 94b0480f-7e0a-4797-b6d7-a05281ef47d8 00:15:11.420 02:20:15 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:11.676 02:20:15 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:11.676 02:20:15 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete a27fd577-fcec-4667-ab18-672988e5aee1 00:15:11.933 02:20:15 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 94b0480f-7e0a-4797-b6d7-a05281ef47d8 00:15:12.190 02:20:15 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:12.447 02:20:16 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:12.447 00:15:12.447 real 0m19.909s 00:15:12.447 user 0m50.058s 00:15:12.447 sys 0m4.644s 00:15:12.447 02:20:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:12.447 02:20:16 -- common/autotest_common.sh@10 -- # set +x 00:15:12.447 ************************************ 00:15:12.447 END TEST lvs_grow_dirty 00:15:12.447 ************************************ 00:15:12.704 02:20:16 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:15:12.705 02:20:16 -- common/autotest_common.sh@806 -- # type=--id 00:15:12.705 02:20:16 -- common/autotest_common.sh@807 -- # id=0 00:15:12.705 02:20:16 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:15:12.705 02:20:16 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:15:12.705 02:20:16 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:15:12.705 02:20:16 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:15:12.705 02:20:16 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:15:12.705 02:20:16 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:15:12.705 nvmf_trace.0 00:15:12.705 02:20:16 -- common/autotest_common.sh@821 -- # return 0 00:15:12.705 02:20:16 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:15:12.705 02:20:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:12.705 02:20:16 -- nvmf/common.sh@116 -- # sync 00:15:12.705 02:20:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:12.705 02:20:16 -- nvmf/common.sh@119 -- # set +e 00:15:12.705 02:20:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:12.705 02:20:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:12.705 rmmod nvme_tcp 00:15:12.705 rmmod nvme_fabrics 00:15:12.705 rmmod nvme_keyring 00:15:12.705 02:20:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:12.705 02:20:16 -- nvmf/common.sh@123 -- # set -e 00:15:12.705 02:20:16 -- nvmf/common.sh@124 -- # return 0 00:15:12.705 02:20:16 -- nvmf/common.sh@477 -- # '[' -n 102929 ']' 00:15:12.705 02:20:16 -- nvmf/common.sh@478 -- # killprocess 102929 00:15:12.705 02:20:16 -- common/autotest_common.sh@936 -- # '[' -z 102929 ']' 00:15:12.705 02:20:16 -- common/autotest_common.sh@940 -- # kill -0 102929 00:15:12.705 02:20:16 -- common/autotest_common.sh@941 -- # uname 00:15:12.705 02:20:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:12.705 02:20:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 102929 00:15:12.705 02:20:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:12.705 02:20:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:12.705 02:20:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 102929' 00:15:12.705 killing process with pid 102929 00:15:12.705 02:20:16 -- common/autotest_common.sh@955 -- # kill 102929 00:15:12.705 02:20:16 -- common/autotest_common.sh@960 -- # wait 102929 00:15:12.963 02:20:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:12.964 02:20:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:12.964 02:20:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:12.964 02:20:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:12.964 02:20:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:12.964 02:20:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:12.964 02:20:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:12.964 02:20:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:15.499 02:20:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:15.499 00:15:15.499 real 0m43.992s 00:15:15.499 user 1m14.973s 00:15:15.499 sys 0m8.220s 00:15:15.499 02:20:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:15.499 02:20:18 -- common/autotest_common.sh@10 -- # set +x 00:15:15.499 ************************************ 00:15:15.499 END TEST nvmf_lvs_grow 00:15:15.499 ************************************ 00:15:15.499 02:20:18 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:15.499 02:20:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:15.499 02:20:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:15.499 02:20:18 -- common/autotest_common.sh@10 -- # set +x 00:15:15.499 ************************************ 00:15:15.499 START TEST nvmf_bdev_io_wait 00:15:15.500 ************************************ 00:15:15.500 02:20:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:15.500 * Looking for test storage... 00:15:15.500 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:15.500 02:20:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:15.500 02:20:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:15.500 02:20:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:15.500 02:20:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:15.500 02:20:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:15.500 02:20:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:15.500 02:20:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:15.500 02:20:18 -- scripts/common.sh@335 -- # IFS=.-: 00:15:15.500 02:20:18 -- scripts/common.sh@335 -- # read -ra ver1 00:15:15.500 02:20:18 -- scripts/common.sh@336 -- # IFS=.-: 00:15:15.500 02:20:18 -- scripts/common.sh@336 -- # read -ra ver2 00:15:15.500 02:20:18 -- scripts/common.sh@337 -- # local 'op=<' 00:15:15.500 02:20:18 -- scripts/common.sh@339 -- # ver1_l=2 00:15:15.500 02:20:18 -- scripts/common.sh@340 -- # ver2_l=1 00:15:15.500 02:20:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:15.500 02:20:18 -- scripts/common.sh@343 -- # case "$op" in 00:15:15.500 02:20:18 -- scripts/common.sh@344 -- # : 1 00:15:15.500 02:20:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:15.500 02:20:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:15.500 02:20:18 -- scripts/common.sh@364 -- # decimal 1 00:15:15.500 02:20:18 -- scripts/common.sh@352 -- # local d=1 00:15:15.500 02:20:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:15.500 02:20:18 -- scripts/common.sh@354 -- # echo 1 00:15:15.500 02:20:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:15.500 02:20:18 -- scripts/common.sh@365 -- # decimal 2 00:15:15.500 02:20:18 -- scripts/common.sh@352 -- # local d=2 00:15:15.500 02:20:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:15.500 02:20:18 -- scripts/common.sh@354 -- # echo 2 00:15:15.500 02:20:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:15.500 02:20:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:15.500 02:20:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:15.500 02:20:18 -- scripts/common.sh@367 -- # return 0 00:15:15.500 02:20:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:15.500 02:20:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:15.500 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:15.500 --rc genhtml_branch_coverage=1 00:15:15.500 --rc genhtml_function_coverage=1 00:15:15.500 --rc genhtml_legend=1 00:15:15.500 --rc geninfo_all_blocks=1 00:15:15.500 --rc geninfo_unexecuted_blocks=1 00:15:15.500 00:15:15.500 ' 00:15:15.500 02:20:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:15.500 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:15.500 --rc genhtml_branch_coverage=1 00:15:15.500 --rc genhtml_function_coverage=1 00:15:15.500 --rc genhtml_legend=1 00:15:15.500 --rc geninfo_all_blocks=1 00:15:15.500 --rc geninfo_unexecuted_blocks=1 00:15:15.500 00:15:15.500 ' 00:15:15.500 02:20:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:15.500 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:15.500 --rc genhtml_branch_coverage=1 00:15:15.500 --rc genhtml_function_coverage=1 00:15:15.500 --rc genhtml_legend=1 00:15:15.500 --rc geninfo_all_blocks=1 00:15:15.500 --rc geninfo_unexecuted_blocks=1 00:15:15.500 00:15:15.500 ' 00:15:15.500 02:20:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:15.500 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:15.500 --rc genhtml_branch_coverage=1 00:15:15.500 --rc genhtml_function_coverage=1 00:15:15.500 --rc genhtml_legend=1 00:15:15.500 --rc geninfo_all_blocks=1 00:15:15.500 --rc geninfo_unexecuted_blocks=1 00:15:15.500 00:15:15.500 ' 00:15:15.500 02:20:18 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:15.500 02:20:18 -- nvmf/common.sh@7 -- # uname -s 00:15:15.500 02:20:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:15.500 02:20:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:15.500 02:20:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:15.500 02:20:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:15.500 02:20:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:15.500 02:20:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:15.500 02:20:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:15.500 02:20:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:15.500 02:20:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:15.500 02:20:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:15.500 02:20:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:15.500 02:20:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:15.500 02:20:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:15.500 02:20:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:15.500 02:20:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:15.500 02:20:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:15.500 02:20:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:15.500 02:20:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:15.500 02:20:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:15.500 02:20:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:15.500 02:20:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:15.500 02:20:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:15.500 02:20:18 -- paths/export.sh@5 -- # export PATH 00:15:15.500 02:20:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:15.500 02:20:18 -- nvmf/common.sh@46 -- # : 0 00:15:15.501 02:20:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:15.501 02:20:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:15.501 02:20:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:15.501 02:20:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:15.501 02:20:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:15.501 02:20:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:15.501 02:20:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:15.501 02:20:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:15.501 02:20:18 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:15.501 02:20:18 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:15.501 02:20:18 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:15:15.501 02:20:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:15.501 02:20:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:15.501 02:20:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:15.501 02:20:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:15.501 02:20:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:15.501 02:20:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:15.501 02:20:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:15.501 02:20:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:15.501 02:20:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:15.501 02:20:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:15.501 02:20:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:15.501 02:20:18 -- common/autotest_common.sh@10 -- # set +x 00:15:17.406 02:20:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:17.406 02:20:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:17.406 02:20:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:17.406 02:20:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:17.406 02:20:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:17.406 02:20:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:17.406 02:20:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:17.406 02:20:20 -- nvmf/common.sh@294 -- # net_devs=() 00:15:17.406 02:20:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:17.406 02:20:20 -- nvmf/common.sh@295 -- # e810=() 00:15:17.406 02:20:20 -- nvmf/common.sh@295 -- # local -ga e810 00:15:17.406 02:20:20 -- nvmf/common.sh@296 -- # x722=() 00:15:17.406 02:20:20 -- nvmf/common.sh@296 -- # local -ga x722 00:15:17.406 02:20:20 -- nvmf/common.sh@297 -- # mlx=() 00:15:17.406 02:20:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:17.406 02:20:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:17.406 02:20:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:17.406 02:20:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:17.406 02:20:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:17.406 02:20:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:17.406 02:20:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:17.406 02:20:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:17.406 02:20:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:17.406 02:20:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:17.406 02:20:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:17.406 02:20:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:17.406 02:20:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:17.406 02:20:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:17.406 02:20:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:17.406 02:20:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:17.406 02:20:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:17.406 02:20:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:17.406 02:20:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:17.406 02:20:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:17.406 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:17.406 02:20:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:17.406 02:20:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:17.406 02:20:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:17.406 02:20:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:17.406 02:20:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:17.406 02:20:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:17.406 02:20:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:17.406 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:17.406 02:20:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:17.406 02:20:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:17.406 02:20:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:17.406 02:20:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:17.406 02:20:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:17.406 02:20:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:17.406 02:20:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:17.406 02:20:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:17.406 02:20:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:17.406 02:20:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:17.406 02:20:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:17.406 02:20:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:17.406 02:20:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:17.406 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:17.406 02:20:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:17.406 02:20:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:17.406 02:20:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:17.406 02:20:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:17.406 02:20:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:17.406 02:20:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:17.406 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:17.406 02:20:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:17.406 02:20:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:17.406 02:20:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:17.406 02:20:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:17.406 02:20:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:17.406 02:20:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:17.406 02:20:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:17.406 02:20:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:17.406 02:20:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:17.406 02:20:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:17.406 02:20:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:17.406 02:20:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:17.406 02:20:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:17.406 02:20:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:17.406 02:20:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:17.406 02:20:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:17.406 02:20:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:17.406 02:20:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:17.406 02:20:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:17.406 02:20:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:17.406 02:20:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:17.406 02:20:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:17.406 02:20:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:17.406 02:20:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:17.406 02:20:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:17.406 02:20:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:17.406 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:17.406 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.306 ms 00:15:17.406 00:15:17.406 --- 10.0.0.2 ping statistics --- 00:15:17.406 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:17.406 rtt min/avg/max/mdev = 0.306/0.306/0.306/0.000 ms 00:15:17.406 02:20:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:17.406 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:17.406 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.139 ms 00:15:17.406 00:15:17.406 --- 10.0.0.1 ping statistics --- 00:15:17.406 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:17.406 rtt min/avg/max/mdev = 0.139/0.139/0.139/0.000 ms 00:15:17.406 02:20:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:17.406 02:20:20 -- nvmf/common.sh@410 -- # return 0 00:15:17.406 02:20:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:17.406 02:20:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:17.406 02:20:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:17.406 02:20:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:17.406 02:20:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:17.406 02:20:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:17.406 02:20:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:17.406 02:20:20 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:15:17.406 02:20:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:17.406 02:20:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:17.406 02:20:20 -- common/autotest_common.sh@10 -- # set +x 00:15:17.406 02:20:20 -- nvmf/common.sh@469 -- # nvmfpid=105620 00:15:17.406 02:20:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:15:17.406 02:20:20 -- nvmf/common.sh@470 -- # waitforlisten 105620 00:15:17.406 02:20:20 -- common/autotest_common.sh@829 -- # '[' -z 105620 ']' 00:15:17.406 02:20:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:17.406 02:20:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:17.406 02:20:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:17.406 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:17.406 02:20:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:17.406 02:20:20 -- common/autotest_common.sh@10 -- # set +x 00:15:17.406 [2024-11-29 02:20:20.891350] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:17.406 [2024-11-29 02:20:20.891460] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:17.407 EAL: No free 2048 kB hugepages reported on node 1 00:15:17.407 [2024-11-29 02:20:20.970124] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:17.664 [2024-11-29 02:20:21.095819] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:17.664 [2024-11-29 02:20:21.095977] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:17.664 [2024-11-29 02:20:21.095997] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:17.664 [2024-11-29 02:20:21.096012] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:17.664 [2024-11-29 02:20:21.096096] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:17.664 [2024-11-29 02:20:21.096150] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:17.664 [2024-11-29 02:20:21.096178] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:17.664 [2024-11-29 02:20:21.096181] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:17.664 02:20:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:17.665 02:20:21 -- common/autotest_common.sh@862 -- # return 0 00:15:17.665 02:20:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:17.665 02:20:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:17.665 02:20:21 -- common/autotest_common.sh@10 -- # set +x 00:15:17.665 02:20:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:17.665 02:20:21 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:15:17.665 02:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.665 02:20:21 -- common/autotest_common.sh@10 -- # set +x 00:15:17.665 02:20:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.665 02:20:21 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:15:17.665 02:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.665 02:20:21 -- common/autotest_common.sh@10 -- # set +x 00:15:17.665 02:20:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.665 02:20:21 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:17.665 02:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.665 02:20:21 -- common/autotest_common.sh@10 -- # set +x 00:15:17.665 [2024-11-29 02:20:21.277911] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:17.665 02:20:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.665 02:20:21 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:17.665 02:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.665 02:20:21 -- common/autotest_common.sh@10 -- # set +x 00:15:17.665 Malloc0 00:15:17.665 02:20:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.665 02:20:21 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:17.665 02:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.665 02:20:21 -- common/autotest_common.sh@10 -- # set +x 00:15:17.665 02:20:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.665 02:20:21 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:17.665 02:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.665 02:20:21 -- common/autotest_common.sh@10 -- # set +x 00:15:17.665 02:20:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.665 02:20:21 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:17.665 02:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.665 02:20:21 -- common/autotest_common.sh@10 -- # set +x 00:15:17.665 [2024-11-29 02:20:21.339026] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:17.665 02:20:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.665 02:20:21 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=105645 00:15:17.923 02:20:21 -- target/bdev_io_wait.sh@30 -- # READ_PID=105646 00:15:17.923 02:20:21 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:15:17.923 02:20:21 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:15:17.923 02:20:21 -- nvmf/common.sh@520 -- # config=() 00:15:17.923 02:20:21 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=105649 00:15:17.923 02:20:21 -- nvmf/common.sh@520 -- # local subsystem config 00:15:17.923 02:20:21 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:15:17.923 02:20:21 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:15:17.923 02:20:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:17.923 02:20:21 -- nvmf/common.sh@520 -- # config=() 00:15:17.923 02:20:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:17.923 { 00:15:17.923 "params": { 00:15:17.923 "name": "Nvme$subsystem", 00:15:17.923 "trtype": "$TEST_TRANSPORT", 00:15:17.923 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:17.923 "adrfam": "ipv4", 00:15:17.923 "trsvcid": "$NVMF_PORT", 00:15:17.923 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:17.923 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:17.923 "hdgst": ${hdgst:-false}, 00:15:17.923 "ddgst": ${ddgst:-false} 00:15:17.923 }, 00:15:17.923 "method": "bdev_nvme_attach_controller" 00:15:17.923 } 00:15:17.923 EOF 00:15:17.923 )") 00:15:17.923 02:20:21 -- nvmf/common.sh@520 -- # local subsystem config 00:15:17.923 02:20:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:17.924 02:20:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:17.924 { 00:15:17.924 "params": { 00:15:17.924 "name": "Nvme$subsystem", 00:15:17.924 "trtype": "$TEST_TRANSPORT", 00:15:17.924 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:17.924 "adrfam": "ipv4", 00:15:17.924 "trsvcid": "$NVMF_PORT", 00:15:17.924 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:17.924 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:17.924 "hdgst": ${hdgst:-false}, 00:15:17.924 "ddgst": ${ddgst:-false} 00:15:17.924 }, 00:15:17.924 "method": "bdev_nvme_attach_controller" 00:15:17.924 } 00:15:17.924 EOF 00:15:17.924 )") 00:15:17.924 02:20:21 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=105651 00:15:17.924 02:20:21 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:15:17.924 02:20:21 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:15:17.924 02:20:21 -- target/bdev_io_wait.sh@35 -- # sync 00:15:17.924 02:20:21 -- nvmf/common.sh@520 -- # config=() 00:15:17.924 02:20:21 -- nvmf/common.sh@520 -- # local subsystem config 00:15:17.924 02:20:21 -- nvmf/common.sh@542 -- # cat 00:15:17.924 02:20:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:17.924 02:20:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:17.924 { 00:15:17.924 "params": { 00:15:17.924 "name": "Nvme$subsystem", 00:15:17.924 "trtype": "$TEST_TRANSPORT", 00:15:17.924 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:17.924 "adrfam": "ipv4", 00:15:17.924 "trsvcid": "$NVMF_PORT", 00:15:17.924 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:17.924 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:17.924 "hdgst": ${hdgst:-false}, 00:15:17.924 "ddgst": ${ddgst:-false} 00:15:17.924 }, 00:15:17.924 "method": "bdev_nvme_attach_controller" 00:15:17.924 } 00:15:17.924 EOF 00:15:17.924 )") 00:15:17.924 02:20:21 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:15:17.924 02:20:21 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:15:17.924 02:20:21 -- nvmf/common.sh@520 -- # config=() 00:15:17.924 02:20:21 -- nvmf/common.sh@542 -- # cat 00:15:17.924 02:20:21 -- nvmf/common.sh@520 -- # local subsystem config 00:15:17.924 02:20:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:17.924 02:20:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:17.924 { 00:15:17.924 "params": { 00:15:17.924 "name": "Nvme$subsystem", 00:15:17.924 "trtype": "$TEST_TRANSPORT", 00:15:17.924 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:17.924 "adrfam": "ipv4", 00:15:17.924 "trsvcid": "$NVMF_PORT", 00:15:17.924 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:17.924 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:17.924 "hdgst": ${hdgst:-false}, 00:15:17.924 "ddgst": ${ddgst:-false} 00:15:17.924 }, 00:15:17.924 "method": "bdev_nvme_attach_controller" 00:15:17.924 } 00:15:17.924 EOF 00:15:17.924 )") 00:15:17.924 02:20:21 -- nvmf/common.sh@542 -- # cat 00:15:17.924 02:20:21 -- target/bdev_io_wait.sh@37 -- # wait 105645 00:15:17.924 02:20:21 -- nvmf/common.sh@542 -- # cat 00:15:17.924 02:20:21 -- nvmf/common.sh@544 -- # jq . 00:15:17.924 02:20:21 -- nvmf/common.sh@544 -- # jq . 00:15:17.924 02:20:21 -- nvmf/common.sh@544 -- # jq . 00:15:17.924 02:20:21 -- nvmf/common.sh@545 -- # IFS=, 00:15:17.924 02:20:21 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:17.924 "params": { 00:15:17.924 "name": "Nvme1", 00:15:17.924 "trtype": "tcp", 00:15:17.924 "traddr": "10.0.0.2", 00:15:17.924 "adrfam": "ipv4", 00:15:17.924 "trsvcid": "4420", 00:15:17.924 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:17.924 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:17.924 "hdgst": false, 00:15:17.924 "ddgst": false 00:15:17.924 }, 00:15:17.924 "method": "bdev_nvme_attach_controller" 00:15:17.924 }' 00:15:17.924 02:20:21 -- nvmf/common.sh@544 -- # jq . 00:15:17.924 02:20:21 -- nvmf/common.sh@545 -- # IFS=, 00:15:17.924 02:20:21 -- nvmf/common.sh@545 -- # IFS=, 00:15:17.924 02:20:21 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:17.924 "params": { 00:15:17.924 "name": "Nvme1", 00:15:17.924 "trtype": "tcp", 00:15:17.924 "traddr": "10.0.0.2", 00:15:17.924 "adrfam": "ipv4", 00:15:17.924 "trsvcid": "4420", 00:15:17.924 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:17.924 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:17.924 "hdgst": false, 00:15:17.924 "ddgst": false 00:15:17.924 }, 00:15:17.924 "method": "bdev_nvme_attach_controller" 00:15:17.924 }' 00:15:17.924 02:20:21 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:17.924 "params": { 00:15:17.924 "name": "Nvme1", 00:15:17.924 "trtype": "tcp", 00:15:17.924 "traddr": "10.0.0.2", 00:15:17.924 "adrfam": "ipv4", 00:15:17.924 "trsvcid": "4420", 00:15:17.924 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:17.924 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:17.924 "hdgst": false, 00:15:17.924 "ddgst": false 00:15:17.924 }, 00:15:17.924 "method": "bdev_nvme_attach_controller" 00:15:17.924 }' 00:15:17.924 02:20:21 -- nvmf/common.sh@545 -- # IFS=, 00:15:17.924 02:20:21 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:17.924 "params": { 00:15:17.924 "name": "Nvme1", 00:15:17.924 "trtype": "tcp", 00:15:17.924 "traddr": "10.0.0.2", 00:15:17.924 "adrfam": "ipv4", 00:15:17.924 "trsvcid": "4420", 00:15:17.924 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:17.924 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:17.924 "hdgst": false, 00:15:17.924 "ddgst": false 00:15:17.924 }, 00:15:17.924 "method": "bdev_nvme_attach_controller" 00:15:17.924 }' 00:15:17.924 [2024-11-29 02:20:21.385073] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:17.924 [2024-11-29 02:20:21.385074] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:17.924 [2024-11-29 02:20:21.385073] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:17.924 [2024-11-29 02:20:21.385073] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:17.924 [2024-11-29 02:20:21.385148] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-29 02:20:21.385148] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-29 02:20:21.385149] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-29 02:20:21.385149] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:15:17.924 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:15:17.924 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:15:17.924 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:15:17.924 EAL: No free 2048 kB hugepages reported on node 1 00:15:17.924 EAL: No free 2048 kB hugepages reported on node 1 00:15:17.924 [2024-11-29 02:20:21.558807] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:18.182 EAL: No free 2048 kB hugepages reported on node 1 00:15:18.182 [2024-11-29 02:20:21.652976] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:15:18.182 [2024-11-29 02:20:21.655491] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:18.182 EAL: No free 2048 kB hugepages reported on node 1 00:15:18.182 [2024-11-29 02:20:21.749113] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:15:18.182 [2024-11-29 02:20:21.751440] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:18.182 [2024-11-29 02:20:21.846486] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:15:18.182 [2024-11-29 02:20:21.852669] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:18.440 [2024-11-29 02:20:21.952800] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:15:18.440 Running I/O for 1 seconds... 00:15:18.699 Running I/O for 1 seconds... 00:15:18.699 Running I/O for 1 seconds... 00:15:18.699 Running I/O for 1 seconds... 00:15:19.634 00:15:19.634 Latency(us) 00:15:19.634 [2024-11-29T01:20:23.315Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:19.634 [2024-11-29T01:20:23.315Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:15:19.634 Nvme1n1 : 1.01 11017.10 43.04 0.00 0.00 11572.02 7233.23 20291.89 00:15:19.634 [2024-11-29T01:20:23.315Z] =================================================================================================================== 00:15:19.634 [2024-11-29T01:20:23.315Z] Total : 11017.10 43.04 0.00 0.00 11572.02 7233.23 20291.89 00:15:19.634 00:15:19.634 Latency(us) 00:15:19.634 [2024-11-29T01:20:23.315Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:19.634 [2024-11-29T01:20:23.315Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:15:19.634 Nvme1n1 : 1.01 8951.08 34.97 0.00 0.00 14236.41 7864.32 26408.58 00:15:19.634 [2024-11-29T01:20:23.315Z] =================================================================================================================== 00:15:19.634 [2024-11-29T01:20:23.315Z] Total : 8951.08 34.97 0.00 0.00 14236.41 7864.32 26408.58 00:15:19.634 00:15:19.634 Latency(us) 00:15:19.634 [2024-11-29T01:20:23.315Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:19.634 [2024-11-29T01:20:23.315Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:15:19.634 Nvme1n1 : 1.01 9694.81 37.87 0.00 0.00 13158.46 5801.15 26408.58 00:15:19.634 [2024-11-29T01:20:23.315Z] =================================================================================================================== 00:15:19.634 [2024-11-29T01:20:23.315Z] Total : 9694.81 37.87 0.00 0.00 13158.46 5801.15 26408.58 00:15:19.634 00:15:19.634 Latency(us) 00:15:19.634 [2024-11-29T01:20:23.315Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:19.634 [2024-11-29T01:20:23.315Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:15:19.634 Nvme1n1 : 1.00 194842.62 761.10 0.00 0.00 654.44 251.83 855.61 00:15:19.634 [2024-11-29T01:20:23.315Z] =================================================================================================================== 00:15:19.634 [2024-11-29T01:20:23.315Z] Total : 194842.62 761.10 0.00 0.00 654.44 251.83 855.61 00:15:19.893 02:20:23 -- target/bdev_io_wait.sh@38 -- # wait 105646 00:15:19.893 02:20:23 -- target/bdev_io_wait.sh@39 -- # wait 105649 00:15:19.893 02:20:23 -- target/bdev_io_wait.sh@40 -- # wait 105651 00:15:19.893 02:20:23 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:19.893 02:20:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:19.893 02:20:23 -- common/autotest_common.sh@10 -- # set +x 00:15:19.893 02:20:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:19.893 02:20:23 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:15:19.893 02:20:23 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:15:19.893 02:20:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:19.893 02:20:23 -- nvmf/common.sh@116 -- # sync 00:15:19.893 02:20:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:19.893 02:20:23 -- nvmf/common.sh@119 -- # set +e 00:15:19.893 02:20:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:19.893 02:20:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:19.893 rmmod nvme_tcp 00:15:19.893 rmmod nvme_fabrics 00:15:20.152 rmmod nvme_keyring 00:15:20.152 02:20:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:20.152 02:20:23 -- nvmf/common.sh@123 -- # set -e 00:15:20.152 02:20:23 -- nvmf/common.sh@124 -- # return 0 00:15:20.152 02:20:23 -- nvmf/common.sh@477 -- # '[' -n 105620 ']' 00:15:20.152 02:20:23 -- nvmf/common.sh@478 -- # killprocess 105620 00:15:20.152 02:20:23 -- common/autotest_common.sh@936 -- # '[' -z 105620 ']' 00:15:20.152 02:20:23 -- common/autotest_common.sh@940 -- # kill -0 105620 00:15:20.152 02:20:23 -- common/autotest_common.sh@941 -- # uname 00:15:20.152 02:20:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:20.152 02:20:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 105620 00:15:20.152 02:20:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:20.152 02:20:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:20.152 02:20:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 105620' 00:15:20.152 killing process with pid 105620 00:15:20.152 02:20:23 -- common/autotest_common.sh@955 -- # kill 105620 00:15:20.152 02:20:23 -- common/autotest_common.sh@960 -- # wait 105620 00:15:20.412 02:20:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:20.412 02:20:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:20.412 02:20:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:20.412 02:20:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:20.412 02:20:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:20.412 02:20:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:20.412 02:20:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:20.412 02:20:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:22.315 02:20:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:22.315 00:15:22.315 real 0m7.306s 00:15:22.315 user 0m17.378s 00:15:22.315 sys 0m3.486s 00:15:22.316 02:20:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:22.316 02:20:25 -- common/autotest_common.sh@10 -- # set +x 00:15:22.316 ************************************ 00:15:22.316 END TEST nvmf_bdev_io_wait 00:15:22.316 ************************************ 00:15:22.316 02:20:25 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:22.316 02:20:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:22.316 02:20:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:22.316 02:20:25 -- common/autotest_common.sh@10 -- # set +x 00:15:22.316 ************************************ 00:15:22.316 START TEST nvmf_queue_depth 00:15:22.316 ************************************ 00:15:22.316 02:20:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:22.574 * Looking for test storage... 00:15:22.574 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:22.574 02:20:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:22.574 02:20:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:22.574 02:20:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:22.574 02:20:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:22.574 02:20:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:22.574 02:20:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:22.574 02:20:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:22.574 02:20:26 -- scripts/common.sh@335 -- # IFS=.-: 00:15:22.574 02:20:26 -- scripts/common.sh@335 -- # read -ra ver1 00:15:22.574 02:20:26 -- scripts/common.sh@336 -- # IFS=.-: 00:15:22.574 02:20:26 -- scripts/common.sh@336 -- # read -ra ver2 00:15:22.574 02:20:26 -- scripts/common.sh@337 -- # local 'op=<' 00:15:22.574 02:20:26 -- scripts/common.sh@339 -- # ver1_l=2 00:15:22.574 02:20:26 -- scripts/common.sh@340 -- # ver2_l=1 00:15:22.574 02:20:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:22.574 02:20:26 -- scripts/common.sh@343 -- # case "$op" in 00:15:22.574 02:20:26 -- scripts/common.sh@344 -- # : 1 00:15:22.574 02:20:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:22.574 02:20:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:22.574 02:20:26 -- scripts/common.sh@364 -- # decimal 1 00:15:22.574 02:20:26 -- scripts/common.sh@352 -- # local d=1 00:15:22.574 02:20:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:22.574 02:20:26 -- scripts/common.sh@354 -- # echo 1 00:15:22.574 02:20:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:22.574 02:20:26 -- scripts/common.sh@365 -- # decimal 2 00:15:22.574 02:20:26 -- scripts/common.sh@352 -- # local d=2 00:15:22.574 02:20:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:22.574 02:20:26 -- scripts/common.sh@354 -- # echo 2 00:15:22.574 02:20:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:22.574 02:20:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:22.574 02:20:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:22.574 02:20:26 -- scripts/common.sh@367 -- # return 0 00:15:22.574 02:20:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:22.574 02:20:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:22.574 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:22.574 --rc genhtml_branch_coverage=1 00:15:22.574 --rc genhtml_function_coverage=1 00:15:22.574 --rc genhtml_legend=1 00:15:22.574 --rc geninfo_all_blocks=1 00:15:22.574 --rc geninfo_unexecuted_blocks=1 00:15:22.574 00:15:22.574 ' 00:15:22.574 02:20:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:22.575 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:22.575 --rc genhtml_branch_coverage=1 00:15:22.575 --rc genhtml_function_coverage=1 00:15:22.575 --rc genhtml_legend=1 00:15:22.575 --rc geninfo_all_blocks=1 00:15:22.575 --rc geninfo_unexecuted_blocks=1 00:15:22.575 00:15:22.575 ' 00:15:22.575 02:20:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:22.575 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:22.575 --rc genhtml_branch_coverage=1 00:15:22.575 --rc genhtml_function_coverage=1 00:15:22.575 --rc genhtml_legend=1 00:15:22.575 --rc geninfo_all_blocks=1 00:15:22.575 --rc geninfo_unexecuted_blocks=1 00:15:22.575 00:15:22.575 ' 00:15:22.575 02:20:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:22.575 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:22.575 --rc genhtml_branch_coverage=1 00:15:22.575 --rc genhtml_function_coverage=1 00:15:22.575 --rc genhtml_legend=1 00:15:22.575 --rc geninfo_all_blocks=1 00:15:22.575 --rc geninfo_unexecuted_blocks=1 00:15:22.575 00:15:22.575 ' 00:15:22.575 02:20:26 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:22.575 02:20:26 -- nvmf/common.sh@7 -- # uname -s 00:15:22.575 02:20:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:22.575 02:20:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:22.575 02:20:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:22.575 02:20:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:22.575 02:20:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:22.575 02:20:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:22.575 02:20:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:22.575 02:20:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:22.575 02:20:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:22.575 02:20:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:22.575 02:20:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:22.575 02:20:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:22.575 02:20:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:22.575 02:20:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:22.575 02:20:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:22.575 02:20:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:22.575 02:20:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:22.575 02:20:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:22.575 02:20:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:22.575 02:20:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:22.575 02:20:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:22.575 02:20:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:22.575 02:20:26 -- paths/export.sh@5 -- # export PATH 00:15:22.575 02:20:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:22.575 02:20:26 -- nvmf/common.sh@46 -- # : 0 00:15:22.575 02:20:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:22.575 02:20:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:22.575 02:20:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:22.575 02:20:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:22.575 02:20:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:22.575 02:20:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:22.575 02:20:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:22.575 02:20:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:22.575 02:20:26 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:15:22.575 02:20:26 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:15:22.575 02:20:26 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:22.575 02:20:26 -- target/queue_depth.sh@19 -- # nvmftestinit 00:15:22.575 02:20:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:22.575 02:20:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:22.575 02:20:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:22.575 02:20:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:22.575 02:20:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:22.575 02:20:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:22.575 02:20:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:22.575 02:20:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:22.575 02:20:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:22.575 02:20:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:22.575 02:20:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:22.575 02:20:26 -- common/autotest_common.sh@10 -- # set +x 00:15:24.477 02:20:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:24.477 02:20:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:24.477 02:20:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:24.477 02:20:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:24.477 02:20:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:24.477 02:20:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:24.477 02:20:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:24.477 02:20:28 -- nvmf/common.sh@294 -- # net_devs=() 00:15:24.477 02:20:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:24.477 02:20:28 -- nvmf/common.sh@295 -- # e810=() 00:15:24.477 02:20:28 -- nvmf/common.sh@295 -- # local -ga e810 00:15:24.477 02:20:28 -- nvmf/common.sh@296 -- # x722=() 00:15:24.477 02:20:28 -- nvmf/common.sh@296 -- # local -ga x722 00:15:24.477 02:20:28 -- nvmf/common.sh@297 -- # mlx=() 00:15:24.477 02:20:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:24.477 02:20:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:24.477 02:20:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:24.477 02:20:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:24.477 02:20:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:24.477 02:20:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:24.477 02:20:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:24.477 02:20:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:24.477 02:20:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:24.477 02:20:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:24.477 02:20:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:24.477 02:20:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:24.477 02:20:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:24.477 02:20:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:24.477 02:20:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:24.477 02:20:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:24.477 02:20:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:24.477 02:20:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:24.477 02:20:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:24.477 02:20:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:24.477 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:24.477 02:20:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:24.477 02:20:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:24.477 02:20:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:24.477 02:20:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:24.477 02:20:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:24.477 02:20:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:24.477 02:20:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:24.477 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:24.477 02:20:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:24.477 02:20:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:24.477 02:20:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:24.477 02:20:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:24.477 02:20:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:24.477 02:20:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:24.477 02:20:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:24.477 02:20:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:24.477 02:20:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:24.477 02:20:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:24.477 02:20:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:24.477 02:20:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:24.477 02:20:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:24.477 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:24.477 02:20:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:24.477 02:20:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:24.477 02:20:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:24.477 02:20:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:24.477 02:20:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:24.477 02:20:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:24.477 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:24.477 02:20:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:24.477 02:20:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:24.477 02:20:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:24.477 02:20:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:24.477 02:20:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:24.477 02:20:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:24.477 02:20:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:24.477 02:20:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:24.477 02:20:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:24.477 02:20:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:24.477 02:20:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:24.477 02:20:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:24.477 02:20:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:24.477 02:20:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:24.477 02:20:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:24.477 02:20:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:24.477 02:20:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:24.477 02:20:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:24.477 02:20:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:24.477 02:20:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:24.477 02:20:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:24.477 02:20:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:24.735 02:20:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:24.735 02:20:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:24.735 02:20:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:24.735 02:20:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:24.735 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:24.735 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.195 ms 00:15:24.735 00:15:24.735 --- 10.0.0.2 ping statistics --- 00:15:24.735 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:24.735 rtt min/avg/max/mdev = 0.195/0.195/0.195/0.000 ms 00:15:24.735 02:20:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:24.735 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:24.735 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.075 ms 00:15:24.735 00:15:24.735 --- 10.0.0.1 ping statistics --- 00:15:24.735 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:24.735 rtt min/avg/max/mdev = 0.075/0.075/0.075/0.000 ms 00:15:24.735 02:20:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:24.735 02:20:28 -- nvmf/common.sh@410 -- # return 0 00:15:24.735 02:20:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:24.735 02:20:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:24.735 02:20:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:24.735 02:20:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:24.735 02:20:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:24.735 02:20:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:24.735 02:20:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:24.735 02:20:28 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:15:24.735 02:20:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:24.735 02:20:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:24.735 02:20:28 -- common/autotest_common.sh@10 -- # set +x 00:15:24.735 02:20:28 -- nvmf/common.sh@469 -- # nvmfpid=107963 00:15:24.735 02:20:28 -- nvmf/common.sh@470 -- # waitforlisten 107963 00:15:24.735 02:20:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:24.735 02:20:28 -- common/autotest_common.sh@829 -- # '[' -z 107963 ']' 00:15:24.735 02:20:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:24.735 02:20:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:24.735 02:20:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:24.735 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:24.735 02:20:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:24.735 02:20:28 -- common/autotest_common.sh@10 -- # set +x 00:15:24.735 [2024-11-29 02:20:28.279421] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:24.735 [2024-11-29 02:20:28.279502] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:24.735 EAL: No free 2048 kB hugepages reported on node 1 00:15:24.735 [2024-11-29 02:20:28.343937] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:24.993 [2024-11-29 02:20:28.453312] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:24.993 [2024-11-29 02:20:28.453503] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:24.993 [2024-11-29 02:20:28.453523] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:24.993 [2024-11-29 02:20:28.453535] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:24.993 [2024-11-29 02:20:28.453567] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:25.928 02:20:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:25.928 02:20:29 -- common/autotest_common.sh@862 -- # return 0 00:15:25.928 02:20:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:25.928 02:20:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:25.928 02:20:29 -- common/autotest_common.sh@10 -- # set +x 00:15:25.928 02:20:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:25.928 02:20:29 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:25.928 02:20:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.928 02:20:29 -- common/autotest_common.sh@10 -- # set +x 00:15:25.928 [2024-11-29 02:20:29.268703] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:25.928 02:20:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.928 02:20:29 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:25.928 02:20:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.928 02:20:29 -- common/autotest_common.sh@10 -- # set +x 00:15:25.928 Malloc0 00:15:25.928 02:20:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.928 02:20:29 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:25.928 02:20:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.928 02:20:29 -- common/autotest_common.sh@10 -- # set +x 00:15:25.928 02:20:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.928 02:20:29 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:25.928 02:20:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.928 02:20:29 -- common/autotest_common.sh@10 -- # set +x 00:15:25.928 02:20:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.928 02:20:29 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:25.928 02:20:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.928 02:20:29 -- common/autotest_common.sh@10 -- # set +x 00:15:25.928 [2024-11-29 02:20:29.333325] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:25.928 02:20:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.928 02:20:29 -- target/queue_depth.sh@30 -- # bdevperf_pid=108099 00:15:25.928 02:20:29 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:15:25.928 02:20:29 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:25.928 02:20:29 -- target/queue_depth.sh@33 -- # waitforlisten 108099 /var/tmp/bdevperf.sock 00:15:25.928 02:20:29 -- common/autotest_common.sh@829 -- # '[' -z 108099 ']' 00:15:25.928 02:20:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:25.928 02:20:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:25.928 02:20:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:25.928 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:25.928 02:20:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:25.928 02:20:29 -- common/autotest_common.sh@10 -- # set +x 00:15:25.928 [2024-11-29 02:20:29.377018] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:25.928 [2024-11-29 02:20:29.377096] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid108099 ] 00:15:25.928 EAL: No free 2048 kB hugepages reported on node 1 00:15:25.928 [2024-11-29 02:20:29.442702] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:25.928 [2024-11-29 02:20:29.558942] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:26.862 02:20:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:26.862 02:20:30 -- common/autotest_common.sh@862 -- # return 0 00:15:26.862 02:20:30 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:15:26.862 02:20:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:26.862 02:20:30 -- common/autotest_common.sh@10 -- # set +x 00:15:27.120 NVMe0n1 00:15:27.120 02:20:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.120 02:20:30 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:27.120 Running I/O for 10 seconds... 00:15:39.324 00:15:39.324 Latency(us) 00:15:39.324 [2024-11-29T01:20:43.005Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:39.324 [2024-11-29T01:20:43.005Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:15:39.324 Verification LBA range: start 0x0 length 0x4000 00:15:39.324 NVMe0n1 : 10.07 12416.39 48.50 0.00 0.00 82152.20 13592.65 59419.31 00:15:39.324 [2024-11-29T01:20:43.005Z] =================================================================================================================== 00:15:39.324 [2024-11-29T01:20:43.005Z] Total : 12416.39 48.50 0.00 0.00 82152.20 13592.65 59419.31 00:15:39.324 0 00:15:39.324 02:20:40 -- target/queue_depth.sh@39 -- # killprocess 108099 00:15:39.324 02:20:40 -- common/autotest_common.sh@936 -- # '[' -z 108099 ']' 00:15:39.324 02:20:40 -- common/autotest_common.sh@940 -- # kill -0 108099 00:15:39.324 02:20:40 -- common/autotest_common.sh@941 -- # uname 00:15:39.324 02:20:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:39.324 02:20:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 108099 00:15:39.324 02:20:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:39.324 02:20:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:39.324 02:20:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 108099' 00:15:39.324 killing process with pid 108099 00:15:39.324 02:20:40 -- common/autotest_common.sh@955 -- # kill 108099 00:15:39.324 Received shutdown signal, test time was about 10.000000 seconds 00:15:39.324 00:15:39.324 Latency(us) 00:15:39.324 [2024-11-29T01:20:43.005Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:39.324 [2024-11-29T01:20:43.005Z] =================================================================================================================== 00:15:39.324 [2024-11-29T01:20:43.005Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:39.324 02:20:40 -- common/autotest_common.sh@960 -- # wait 108099 00:15:39.324 02:20:41 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:39.324 02:20:41 -- target/queue_depth.sh@43 -- # nvmftestfini 00:15:39.324 02:20:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:39.324 02:20:41 -- nvmf/common.sh@116 -- # sync 00:15:39.324 02:20:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:39.324 02:20:41 -- nvmf/common.sh@119 -- # set +e 00:15:39.324 02:20:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:39.324 02:20:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:39.324 rmmod nvme_tcp 00:15:39.324 rmmod nvme_fabrics 00:15:39.324 rmmod nvme_keyring 00:15:39.324 02:20:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:39.324 02:20:41 -- nvmf/common.sh@123 -- # set -e 00:15:39.324 02:20:41 -- nvmf/common.sh@124 -- # return 0 00:15:39.324 02:20:41 -- nvmf/common.sh@477 -- # '[' -n 107963 ']' 00:15:39.324 02:20:41 -- nvmf/common.sh@478 -- # killprocess 107963 00:15:39.324 02:20:41 -- common/autotest_common.sh@936 -- # '[' -z 107963 ']' 00:15:39.324 02:20:41 -- common/autotest_common.sh@940 -- # kill -0 107963 00:15:39.324 02:20:41 -- common/autotest_common.sh@941 -- # uname 00:15:39.324 02:20:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:39.324 02:20:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 107963 00:15:39.324 02:20:41 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:39.324 02:20:41 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:39.324 02:20:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 107963' 00:15:39.324 killing process with pid 107963 00:15:39.324 02:20:41 -- common/autotest_common.sh@955 -- # kill 107963 00:15:39.324 02:20:41 -- common/autotest_common.sh@960 -- # wait 107963 00:15:39.324 02:20:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:39.324 02:20:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:39.324 02:20:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:39.324 02:20:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:39.324 02:20:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:39.324 02:20:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:39.324 02:20:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:39.324 02:20:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:40.263 02:20:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:40.263 00:15:40.263 real 0m17.632s 00:15:40.263 user 0m25.463s 00:15:40.263 sys 0m3.116s 00:15:40.263 02:20:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:40.263 02:20:43 -- common/autotest_common.sh@10 -- # set +x 00:15:40.263 ************************************ 00:15:40.263 END TEST nvmf_queue_depth 00:15:40.263 ************************************ 00:15:40.263 02:20:43 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:40.263 02:20:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:40.263 02:20:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:40.263 02:20:43 -- common/autotest_common.sh@10 -- # set +x 00:15:40.263 ************************************ 00:15:40.263 START TEST nvmf_multipath 00:15:40.263 ************************************ 00:15:40.263 02:20:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:40.263 * Looking for test storage... 00:15:40.263 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:40.263 02:20:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:40.263 02:20:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:40.263 02:20:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:40.263 02:20:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:40.263 02:20:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:40.263 02:20:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:40.263 02:20:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:40.263 02:20:43 -- scripts/common.sh@335 -- # IFS=.-: 00:15:40.263 02:20:43 -- scripts/common.sh@335 -- # read -ra ver1 00:15:40.263 02:20:43 -- scripts/common.sh@336 -- # IFS=.-: 00:15:40.263 02:20:43 -- scripts/common.sh@336 -- # read -ra ver2 00:15:40.263 02:20:43 -- scripts/common.sh@337 -- # local 'op=<' 00:15:40.263 02:20:43 -- scripts/common.sh@339 -- # ver1_l=2 00:15:40.263 02:20:43 -- scripts/common.sh@340 -- # ver2_l=1 00:15:40.263 02:20:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:40.263 02:20:43 -- scripts/common.sh@343 -- # case "$op" in 00:15:40.263 02:20:43 -- scripts/common.sh@344 -- # : 1 00:15:40.263 02:20:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:40.263 02:20:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:40.263 02:20:43 -- scripts/common.sh@364 -- # decimal 1 00:15:40.263 02:20:43 -- scripts/common.sh@352 -- # local d=1 00:15:40.263 02:20:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:40.263 02:20:43 -- scripts/common.sh@354 -- # echo 1 00:15:40.263 02:20:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:40.263 02:20:43 -- scripts/common.sh@365 -- # decimal 2 00:15:40.263 02:20:43 -- scripts/common.sh@352 -- # local d=2 00:15:40.263 02:20:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:40.263 02:20:43 -- scripts/common.sh@354 -- # echo 2 00:15:40.264 02:20:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:40.264 02:20:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:40.264 02:20:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:40.264 02:20:43 -- scripts/common.sh@367 -- # return 0 00:15:40.264 02:20:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:40.264 02:20:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:40.264 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:40.264 --rc genhtml_branch_coverage=1 00:15:40.264 --rc genhtml_function_coverage=1 00:15:40.264 --rc genhtml_legend=1 00:15:40.264 --rc geninfo_all_blocks=1 00:15:40.264 --rc geninfo_unexecuted_blocks=1 00:15:40.264 00:15:40.264 ' 00:15:40.264 02:20:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:40.264 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:40.264 --rc genhtml_branch_coverage=1 00:15:40.264 --rc genhtml_function_coverage=1 00:15:40.264 --rc genhtml_legend=1 00:15:40.264 --rc geninfo_all_blocks=1 00:15:40.264 --rc geninfo_unexecuted_blocks=1 00:15:40.264 00:15:40.264 ' 00:15:40.264 02:20:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:40.264 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:40.264 --rc genhtml_branch_coverage=1 00:15:40.264 --rc genhtml_function_coverage=1 00:15:40.264 --rc genhtml_legend=1 00:15:40.264 --rc geninfo_all_blocks=1 00:15:40.264 --rc geninfo_unexecuted_blocks=1 00:15:40.264 00:15:40.264 ' 00:15:40.264 02:20:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:40.264 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:40.264 --rc genhtml_branch_coverage=1 00:15:40.264 --rc genhtml_function_coverage=1 00:15:40.264 --rc genhtml_legend=1 00:15:40.264 --rc geninfo_all_blocks=1 00:15:40.264 --rc geninfo_unexecuted_blocks=1 00:15:40.264 00:15:40.264 ' 00:15:40.264 02:20:43 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:40.264 02:20:43 -- nvmf/common.sh@7 -- # uname -s 00:15:40.264 02:20:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:40.264 02:20:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:40.264 02:20:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:40.264 02:20:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:40.264 02:20:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:40.264 02:20:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:40.264 02:20:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:40.264 02:20:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:40.264 02:20:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:40.264 02:20:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:40.264 02:20:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:40.264 02:20:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:40.264 02:20:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:40.264 02:20:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:40.264 02:20:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:40.264 02:20:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:40.264 02:20:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:40.264 02:20:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:40.264 02:20:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:40.264 02:20:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:40.264 02:20:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:40.264 02:20:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:40.264 02:20:43 -- paths/export.sh@5 -- # export PATH 00:15:40.264 02:20:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:40.264 02:20:43 -- nvmf/common.sh@46 -- # : 0 00:15:40.264 02:20:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:40.264 02:20:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:40.264 02:20:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:40.264 02:20:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:40.264 02:20:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:40.264 02:20:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:40.264 02:20:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:40.264 02:20:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:40.264 02:20:43 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:40.264 02:20:43 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:40.264 02:20:43 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:15:40.264 02:20:43 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:40.264 02:20:43 -- target/multipath.sh@43 -- # nvmftestinit 00:15:40.264 02:20:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:40.264 02:20:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:40.264 02:20:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:40.264 02:20:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:40.264 02:20:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:40.264 02:20:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:40.264 02:20:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:40.264 02:20:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:40.264 02:20:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:40.264 02:20:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:40.264 02:20:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:40.264 02:20:43 -- common/autotest_common.sh@10 -- # set +x 00:15:42.249 02:20:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:42.249 02:20:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:42.249 02:20:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:42.249 02:20:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:42.249 02:20:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:42.249 02:20:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:42.249 02:20:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:42.249 02:20:45 -- nvmf/common.sh@294 -- # net_devs=() 00:15:42.249 02:20:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:42.249 02:20:45 -- nvmf/common.sh@295 -- # e810=() 00:15:42.249 02:20:45 -- nvmf/common.sh@295 -- # local -ga e810 00:15:42.249 02:20:45 -- nvmf/common.sh@296 -- # x722=() 00:15:42.249 02:20:45 -- nvmf/common.sh@296 -- # local -ga x722 00:15:42.249 02:20:45 -- nvmf/common.sh@297 -- # mlx=() 00:15:42.249 02:20:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:42.249 02:20:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:42.249 02:20:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:42.249 02:20:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:42.249 02:20:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:42.249 02:20:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:42.249 02:20:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:42.249 02:20:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:42.249 02:20:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:42.249 02:20:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:42.249 02:20:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:42.249 02:20:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:42.249 02:20:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:42.249 02:20:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:42.249 02:20:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:42.249 02:20:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:42.249 02:20:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:42.249 02:20:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:42.249 02:20:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:42.249 02:20:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:42.249 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:42.249 02:20:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:42.249 02:20:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:42.249 02:20:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:42.249 02:20:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:42.249 02:20:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:42.249 02:20:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:42.249 02:20:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:42.249 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:42.249 02:20:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:42.249 02:20:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:42.249 02:20:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:42.249 02:20:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:42.249 02:20:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:42.249 02:20:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:42.249 02:20:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:42.249 02:20:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:42.249 02:20:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:42.249 02:20:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:42.249 02:20:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:42.249 02:20:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:42.249 02:20:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:42.249 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:42.249 02:20:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:42.249 02:20:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:42.249 02:20:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:42.249 02:20:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:42.249 02:20:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:42.249 02:20:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:42.249 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:42.249 02:20:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:42.249 02:20:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:42.249 02:20:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:42.249 02:20:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:42.249 02:20:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:42.249 02:20:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:42.249 02:20:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:42.249 02:20:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:42.249 02:20:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:42.249 02:20:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:42.249 02:20:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:42.249 02:20:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:42.249 02:20:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:42.249 02:20:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:42.249 02:20:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:42.249 02:20:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:42.249 02:20:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:42.249 02:20:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:42.249 02:20:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:42.249 02:20:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:42.249 02:20:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:42.249 02:20:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:42.249 02:20:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:42.249 02:20:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:42.249 02:20:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:42.249 02:20:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:42.249 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:42.249 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.368 ms 00:15:42.249 00:15:42.249 --- 10.0.0.2 ping statistics --- 00:15:42.249 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:42.249 rtt min/avg/max/mdev = 0.368/0.368/0.368/0.000 ms 00:15:42.249 02:20:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:42.249 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:42.249 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.079 ms 00:15:42.249 00:15:42.249 --- 10.0.0.1 ping statistics --- 00:15:42.249 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:42.249 rtt min/avg/max/mdev = 0.079/0.079/0.079/0.000 ms 00:15:42.249 02:20:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:42.249 02:20:45 -- nvmf/common.sh@410 -- # return 0 00:15:42.249 02:20:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:42.249 02:20:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:42.249 02:20:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:42.249 02:20:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:42.249 02:20:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:42.249 02:20:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:42.249 02:20:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:42.249 02:20:45 -- target/multipath.sh@45 -- # '[' -z ']' 00:15:42.250 02:20:45 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:15:42.250 only one NIC for nvmf test 00:15:42.250 02:20:45 -- target/multipath.sh@47 -- # nvmftestfini 00:15:42.250 02:20:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:42.250 02:20:45 -- nvmf/common.sh@116 -- # sync 00:15:42.250 02:20:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:42.250 02:20:45 -- nvmf/common.sh@119 -- # set +e 00:15:42.250 02:20:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:42.250 02:20:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:42.250 rmmod nvme_tcp 00:15:42.250 rmmod nvme_fabrics 00:15:42.510 rmmod nvme_keyring 00:15:42.510 02:20:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:42.510 02:20:45 -- nvmf/common.sh@123 -- # set -e 00:15:42.510 02:20:45 -- nvmf/common.sh@124 -- # return 0 00:15:42.510 02:20:45 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:42.510 02:20:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:42.510 02:20:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:42.510 02:20:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:42.510 02:20:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:42.510 02:20:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:42.510 02:20:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:42.510 02:20:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:42.510 02:20:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:44.420 02:20:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:44.420 02:20:47 -- target/multipath.sh@48 -- # exit 0 00:15:44.420 02:20:47 -- target/multipath.sh@1 -- # nvmftestfini 00:15:44.420 02:20:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:44.420 02:20:47 -- nvmf/common.sh@116 -- # sync 00:15:44.420 02:20:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:44.420 02:20:48 -- nvmf/common.sh@119 -- # set +e 00:15:44.420 02:20:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:44.420 02:20:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:44.420 02:20:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:44.420 02:20:48 -- nvmf/common.sh@123 -- # set -e 00:15:44.420 02:20:48 -- nvmf/common.sh@124 -- # return 0 00:15:44.420 02:20:48 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:44.420 02:20:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:44.420 02:20:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:44.420 02:20:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:44.420 02:20:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:44.420 02:20:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:44.420 02:20:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:44.420 02:20:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:44.420 02:20:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:44.420 02:20:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:44.420 00:15:44.420 real 0m4.400s 00:15:44.420 user 0m0.873s 00:15:44.420 sys 0m1.488s 00:15:44.420 02:20:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:44.420 02:20:48 -- common/autotest_common.sh@10 -- # set +x 00:15:44.420 ************************************ 00:15:44.420 END TEST nvmf_multipath 00:15:44.420 ************************************ 00:15:44.420 02:20:48 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:44.420 02:20:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:44.420 02:20:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:44.420 02:20:48 -- common/autotest_common.sh@10 -- # set +x 00:15:44.420 ************************************ 00:15:44.420 START TEST nvmf_zcopy 00:15:44.420 ************************************ 00:15:44.420 02:20:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:44.420 * Looking for test storage... 00:15:44.680 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:44.680 02:20:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:44.680 02:20:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:44.680 02:20:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:44.680 02:20:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:44.680 02:20:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:44.680 02:20:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:44.680 02:20:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:44.680 02:20:48 -- scripts/common.sh@335 -- # IFS=.-: 00:15:44.680 02:20:48 -- scripts/common.sh@335 -- # read -ra ver1 00:15:44.680 02:20:48 -- scripts/common.sh@336 -- # IFS=.-: 00:15:44.680 02:20:48 -- scripts/common.sh@336 -- # read -ra ver2 00:15:44.680 02:20:48 -- scripts/common.sh@337 -- # local 'op=<' 00:15:44.680 02:20:48 -- scripts/common.sh@339 -- # ver1_l=2 00:15:44.680 02:20:48 -- scripts/common.sh@340 -- # ver2_l=1 00:15:44.680 02:20:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:44.680 02:20:48 -- scripts/common.sh@343 -- # case "$op" in 00:15:44.680 02:20:48 -- scripts/common.sh@344 -- # : 1 00:15:44.680 02:20:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:44.680 02:20:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:44.680 02:20:48 -- scripts/common.sh@364 -- # decimal 1 00:15:44.680 02:20:48 -- scripts/common.sh@352 -- # local d=1 00:15:44.680 02:20:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:44.680 02:20:48 -- scripts/common.sh@354 -- # echo 1 00:15:44.680 02:20:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:44.680 02:20:48 -- scripts/common.sh@365 -- # decimal 2 00:15:44.680 02:20:48 -- scripts/common.sh@352 -- # local d=2 00:15:44.680 02:20:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:44.680 02:20:48 -- scripts/common.sh@354 -- # echo 2 00:15:44.680 02:20:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:44.680 02:20:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:44.680 02:20:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:44.680 02:20:48 -- scripts/common.sh@367 -- # return 0 00:15:44.680 02:20:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:44.680 02:20:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:44.680 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:44.680 --rc genhtml_branch_coverage=1 00:15:44.680 --rc genhtml_function_coverage=1 00:15:44.680 --rc genhtml_legend=1 00:15:44.680 --rc geninfo_all_blocks=1 00:15:44.680 --rc geninfo_unexecuted_blocks=1 00:15:44.680 00:15:44.680 ' 00:15:44.680 02:20:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:44.680 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:44.680 --rc genhtml_branch_coverage=1 00:15:44.680 --rc genhtml_function_coverage=1 00:15:44.680 --rc genhtml_legend=1 00:15:44.680 --rc geninfo_all_blocks=1 00:15:44.680 --rc geninfo_unexecuted_blocks=1 00:15:44.680 00:15:44.680 ' 00:15:44.680 02:20:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:44.680 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:44.680 --rc genhtml_branch_coverage=1 00:15:44.680 --rc genhtml_function_coverage=1 00:15:44.680 --rc genhtml_legend=1 00:15:44.680 --rc geninfo_all_blocks=1 00:15:44.680 --rc geninfo_unexecuted_blocks=1 00:15:44.680 00:15:44.680 ' 00:15:44.680 02:20:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:44.680 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:44.680 --rc genhtml_branch_coverage=1 00:15:44.680 --rc genhtml_function_coverage=1 00:15:44.680 --rc genhtml_legend=1 00:15:44.680 --rc geninfo_all_blocks=1 00:15:44.680 --rc geninfo_unexecuted_blocks=1 00:15:44.680 00:15:44.680 ' 00:15:44.680 02:20:48 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:44.680 02:20:48 -- nvmf/common.sh@7 -- # uname -s 00:15:44.680 02:20:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:44.680 02:20:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:44.680 02:20:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:44.680 02:20:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:44.680 02:20:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:44.680 02:20:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:44.680 02:20:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:44.680 02:20:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:44.680 02:20:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:44.680 02:20:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:44.680 02:20:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:44.680 02:20:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:44.680 02:20:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:44.680 02:20:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:44.680 02:20:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:44.680 02:20:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:44.680 02:20:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:44.680 02:20:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:44.680 02:20:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:44.680 02:20:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:44.680 02:20:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:44.680 02:20:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:44.680 02:20:48 -- paths/export.sh@5 -- # export PATH 00:15:44.681 02:20:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:44.681 02:20:48 -- nvmf/common.sh@46 -- # : 0 00:15:44.681 02:20:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:44.681 02:20:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:44.681 02:20:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:44.681 02:20:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:44.681 02:20:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:44.681 02:20:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:44.681 02:20:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:44.681 02:20:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:44.681 02:20:48 -- target/zcopy.sh@12 -- # nvmftestinit 00:15:44.681 02:20:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:44.681 02:20:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:44.681 02:20:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:44.681 02:20:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:44.681 02:20:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:44.681 02:20:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:44.681 02:20:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:44.681 02:20:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:44.681 02:20:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:44.681 02:20:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:44.681 02:20:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:44.681 02:20:48 -- common/autotest_common.sh@10 -- # set +x 00:15:47.219 02:20:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:47.219 02:20:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:47.219 02:20:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:47.219 02:20:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:47.219 02:20:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:47.219 02:20:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:47.219 02:20:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:47.219 02:20:50 -- nvmf/common.sh@294 -- # net_devs=() 00:15:47.219 02:20:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:47.219 02:20:50 -- nvmf/common.sh@295 -- # e810=() 00:15:47.219 02:20:50 -- nvmf/common.sh@295 -- # local -ga e810 00:15:47.219 02:20:50 -- nvmf/common.sh@296 -- # x722=() 00:15:47.219 02:20:50 -- nvmf/common.sh@296 -- # local -ga x722 00:15:47.219 02:20:50 -- nvmf/common.sh@297 -- # mlx=() 00:15:47.219 02:20:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:47.219 02:20:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:47.219 02:20:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:47.219 02:20:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:47.219 02:20:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:47.219 02:20:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:47.219 02:20:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:47.219 02:20:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:47.219 02:20:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:47.219 02:20:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:47.219 02:20:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:47.219 02:20:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:47.219 02:20:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:47.219 02:20:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:47.219 02:20:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:47.219 02:20:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:47.219 02:20:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:47.219 02:20:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:47.219 02:20:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:47.219 02:20:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:47.219 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:47.219 02:20:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:47.219 02:20:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:47.219 02:20:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:47.219 02:20:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:47.219 02:20:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:47.219 02:20:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:47.219 02:20:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:47.219 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:47.219 02:20:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:47.219 02:20:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:47.219 02:20:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:47.219 02:20:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:47.219 02:20:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:47.219 02:20:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:47.219 02:20:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:47.219 02:20:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:47.219 02:20:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:47.219 02:20:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:47.219 02:20:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:47.219 02:20:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:47.219 02:20:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:47.219 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:47.219 02:20:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:47.219 02:20:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:47.219 02:20:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:47.219 02:20:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:47.219 02:20:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:47.219 02:20:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:47.219 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:47.219 02:20:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:47.219 02:20:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:47.219 02:20:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:47.219 02:20:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:47.220 02:20:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:47.220 02:20:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:47.220 02:20:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:47.220 02:20:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:47.220 02:20:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:47.220 02:20:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:47.220 02:20:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:47.220 02:20:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:47.220 02:20:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:47.220 02:20:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:47.220 02:20:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:47.220 02:20:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:47.220 02:20:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:47.220 02:20:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:47.220 02:20:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:47.220 02:20:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:47.220 02:20:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:47.220 02:20:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:47.220 02:20:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:47.220 02:20:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:47.220 02:20:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:47.220 02:20:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:47.220 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:47.220 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.252 ms 00:15:47.220 00:15:47.220 --- 10.0.0.2 ping statistics --- 00:15:47.220 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:47.220 rtt min/avg/max/mdev = 0.252/0.252/0.252/0.000 ms 00:15:47.220 02:20:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:47.220 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:47.220 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.139 ms 00:15:47.220 00:15:47.220 --- 10.0.0.1 ping statistics --- 00:15:47.220 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:47.220 rtt min/avg/max/mdev = 0.139/0.139/0.139/0.000 ms 00:15:47.220 02:20:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:47.220 02:20:50 -- nvmf/common.sh@410 -- # return 0 00:15:47.220 02:20:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:47.220 02:20:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:47.220 02:20:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:47.220 02:20:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:47.220 02:20:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:47.220 02:20:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:47.220 02:20:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:47.220 02:20:50 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:15:47.220 02:20:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:47.220 02:20:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:47.220 02:20:50 -- common/autotest_common.sh@10 -- # set +x 00:15:47.220 02:20:50 -- nvmf/common.sh@469 -- # nvmfpid=113445 00:15:47.220 02:20:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:47.220 02:20:50 -- nvmf/common.sh@470 -- # waitforlisten 113445 00:15:47.220 02:20:50 -- common/autotest_common.sh@829 -- # '[' -z 113445 ']' 00:15:47.220 02:20:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:47.220 02:20:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:47.220 02:20:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:47.220 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:47.220 02:20:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:47.220 02:20:50 -- common/autotest_common.sh@10 -- # set +x 00:15:47.220 [2024-11-29 02:20:50.545285] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:47.220 [2024-11-29 02:20:50.545365] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:47.220 EAL: No free 2048 kB hugepages reported on node 1 00:15:47.220 [2024-11-29 02:20:50.614730] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:47.220 [2024-11-29 02:20:50.728758] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:47.220 [2024-11-29 02:20:50.728927] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:47.220 [2024-11-29 02:20:50.728946] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:47.220 [2024-11-29 02:20:50.728961] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:47.220 [2024-11-29 02:20:50.729004] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:48.158 02:20:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:48.158 02:20:51 -- common/autotest_common.sh@862 -- # return 0 00:15:48.158 02:20:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:48.158 02:20:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:48.158 02:20:51 -- common/autotest_common.sh@10 -- # set +x 00:15:48.158 02:20:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:48.158 02:20:51 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:15:48.158 02:20:51 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:15:48.158 02:20:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:48.158 02:20:51 -- common/autotest_common.sh@10 -- # set +x 00:15:48.158 [2024-11-29 02:20:51.529354] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:48.158 02:20:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:48.158 02:20:51 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:48.158 02:20:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:48.158 02:20:51 -- common/autotest_common.sh@10 -- # set +x 00:15:48.158 02:20:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:48.158 02:20:51 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:48.158 02:20:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:48.158 02:20:51 -- common/autotest_common.sh@10 -- # set +x 00:15:48.158 [2024-11-29 02:20:51.545537] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:48.158 02:20:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:48.158 02:20:51 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:48.158 02:20:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:48.158 02:20:51 -- common/autotest_common.sh@10 -- # set +x 00:15:48.158 02:20:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:48.158 02:20:51 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:15:48.158 02:20:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:48.158 02:20:51 -- common/autotest_common.sh@10 -- # set +x 00:15:48.158 malloc0 00:15:48.158 02:20:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:48.158 02:20:51 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:15:48.158 02:20:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:48.158 02:20:51 -- common/autotest_common.sh@10 -- # set +x 00:15:48.158 02:20:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:48.158 02:20:51 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:15:48.158 02:20:51 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:15:48.158 02:20:51 -- nvmf/common.sh@520 -- # config=() 00:15:48.158 02:20:51 -- nvmf/common.sh@520 -- # local subsystem config 00:15:48.158 02:20:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:48.158 02:20:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:48.158 { 00:15:48.158 "params": { 00:15:48.158 "name": "Nvme$subsystem", 00:15:48.158 "trtype": "$TEST_TRANSPORT", 00:15:48.158 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:48.158 "adrfam": "ipv4", 00:15:48.158 "trsvcid": "$NVMF_PORT", 00:15:48.158 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:48.158 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:48.158 "hdgst": ${hdgst:-false}, 00:15:48.158 "ddgst": ${ddgst:-false} 00:15:48.158 }, 00:15:48.158 "method": "bdev_nvme_attach_controller" 00:15:48.158 } 00:15:48.158 EOF 00:15:48.158 )") 00:15:48.158 02:20:51 -- nvmf/common.sh@542 -- # cat 00:15:48.158 02:20:51 -- nvmf/common.sh@544 -- # jq . 00:15:48.158 02:20:51 -- nvmf/common.sh@545 -- # IFS=, 00:15:48.158 02:20:51 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:48.158 "params": { 00:15:48.158 "name": "Nvme1", 00:15:48.158 "trtype": "tcp", 00:15:48.158 "traddr": "10.0.0.2", 00:15:48.158 "adrfam": "ipv4", 00:15:48.158 "trsvcid": "4420", 00:15:48.158 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:48.158 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:48.158 "hdgst": false, 00:15:48.158 "ddgst": false 00:15:48.158 }, 00:15:48.158 "method": "bdev_nvme_attach_controller" 00:15:48.158 }' 00:15:48.158 [2024-11-29 02:20:51.621532] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:48.158 [2024-11-29 02:20:51.621606] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid113605 ] 00:15:48.158 EAL: No free 2048 kB hugepages reported on node 1 00:15:48.158 [2024-11-29 02:20:51.682944] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:48.158 [2024-11-29 02:20:51.800389] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:48.417 Running I/O for 10 seconds... 00:15:58.402 00:15:58.402 Latency(us) 00:15:58.402 [2024-11-29T01:21:02.083Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:58.402 [2024-11-29T01:21:02.083Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:15:58.402 Verification LBA range: start 0x0 length 0x1000 00:15:58.402 Nvme1n1 : 10.01 8504.47 66.44 0.00 0.00 15014.90 1474.56 23204.60 00:15:58.402 [2024-11-29T01:21:02.083Z] =================================================================================================================== 00:15:58.402 [2024-11-29T01:21:02.083Z] Total : 8504.47 66.44 0.00 0.00 15014.90 1474.56 23204.60 00:15:58.661 02:21:02 -- target/zcopy.sh@39 -- # perfpid=114976 00:15:58.661 02:21:02 -- target/zcopy.sh@41 -- # xtrace_disable 00:15:58.661 02:21:02 -- common/autotest_common.sh@10 -- # set +x 00:15:58.661 02:21:02 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:15:58.661 02:21:02 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:15:58.661 02:21:02 -- nvmf/common.sh@520 -- # config=() 00:15:58.661 02:21:02 -- nvmf/common.sh@520 -- # local subsystem config 00:15:58.661 02:21:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:58.661 02:21:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:58.661 { 00:15:58.661 "params": { 00:15:58.661 "name": "Nvme$subsystem", 00:15:58.661 "trtype": "$TEST_TRANSPORT", 00:15:58.661 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:58.661 "adrfam": "ipv4", 00:15:58.661 "trsvcid": "$NVMF_PORT", 00:15:58.661 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:58.661 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:58.661 "hdgst": ${hdgst:-false}, 00:15:58.661 "ddgst": ${ddgst:-false} 00:15:58.661 }, 00:15:58.661 "method": "bdev_nvme_attach_controller" 00:15:58.661 } 00:15:58.661 EOF 00:15:58.661 )") 00:15:58.661 02:21:02 -- nvmf/common.sh@542 -- # cat 00:15:58.661 [2024-11-29 02:21:02.324435] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.661 [2024-11-29 02:21:02.324483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.661 02:21:02 -- nvmf/common.sh@544 -- # jq . 00:15:58.661 02:21:02 -- nvmf/common.sh@545 -- # IFS=, 00:15:58.661 02:21:02 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:58.661 "params": { 00:15:58.661 "name": "Nvme1", 00:15:58.661 "trtype": "tcp", 00:15:58.661 "traddr": "10.0.0.2", 00:15:58.661 "adrfam": "ipv4", 00:15:58.661 "trsvcid": "4420", 00:15:58.661 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:58.661 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:58.661 "hdgst": false, 00:15:58.661 "ddgst": false 00:15:58.661 }, 00:15:58.661 "method": "bdev_nvme_attach_controller" 00:15:58.661 }' 00:15:58.661 [2024-11-29 02:21:02.332362] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.661 [2024-11-29 02:21:02.332406] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.661 [2024-11-29 02:21:02.340382] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.661 [2024-11-29 02:21:02.340415] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.348422] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.348445] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.356454] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.356476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.361305] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:58.920 [2024-11-29 02:21:02.361367] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid114976 ] 00:15:58.920 [2024-11-29 02:21:02.364465] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.364488] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.372484] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.372506] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.380506] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.380528] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.388526] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.388548] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 EAL: No free 2048 kB hugepages reported on node 1 00:15:58.920 [2024-11-29 02:21:02.396549] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.396572] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.404571] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.404593] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.412586] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.412607] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.420611] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.420632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.426029] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:58.920 [2024-11-29 02:21:02.428634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.428655] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.436717] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.436758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.444700] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.444737] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.452719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.452744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.460745] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.460770] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.468771] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.468795] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.476780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.476804] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.484800] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.484824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.492856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.492895] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.500849] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.500876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.508866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.508891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.516889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.516913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.524916] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.524942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.532933] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.532958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.540767] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:58.920 [2024-11-29 02:21:02.540961] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.540985] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.548975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.548999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.557029] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.557067] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.565058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.565100] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.573075] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.573119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.581097] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.581141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.589122] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.589164] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:58.920 [2024-11-29 02:21:02.597149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:58.920 [2024-11-29 02:21:02.597192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.180 [2024-11-29 02:21:02.605133] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.180 [2024-11-29 02:21:02.605158] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.180 [2024-11-29 02:21:02.613190] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.180 [2024-11-29 02:21:02.613229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.180 [2024-11-29 02:21:02.621205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.180 [2024-11-29 02:21:02.621246] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.180 [2024-11-29 02:21:02.629237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.180 [2024-11-29 02:21:02.629288] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.180 [2024-11-29 02:21:02.637222] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.180 [2024-11-29 02:21:02.637247] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.180 [2024-11-29 02:21:02.645243] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.180 [2024-11-29 02:21:02.645267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.180 [2024-11-29 02:21:02.653285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.180 [2024-11-29 02:21:02.653316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.180 [2024-11-29 02:21:02.661294] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.180 [2024-11-29 02:21:02.661322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.180 [2024-11-29 02:21:02.669316] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.180 [2024-11-29 02:21:02.669342] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.180 [2024-11-29 02:21:02.677341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.180 [2024-11-29 02:21:02.677375] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.180 [2024-11-29 02:21:02.685363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.181 [2024-11-29 02:21:02.685390] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.181 [2024-11-29 02:21:02.693383] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.181 [2024-11-29 02:21:02.693418] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.181 [2024-11-29 02:21:02.701411] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.181 [2024-11-29 02:21:02.701458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.181 [2024-11-29 02:21:02.709448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.181 [2024-11-29 02:21:02.709469] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.181 [2024-11-29 02:21:02.717471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.181 [2024-11-29 02:21:02.717491] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.181 [2024-11-29 02:21:02.725488] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.181 [2024-11-29 02:21:02.725508] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.181 [2024-11-29 02:21:02.733514] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.181 [2024-11-29 02:21:02.733537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.181 [2024-11-29 02:21:02.741527] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.181 [2024-11-29 02:21:02.741548] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.181 [2024-11-29 02:21:02.749547] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.181 [2024-11-29 02:21:02.749568] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.181 [2024-11-29 02:21:02.757568] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.181 [2024-11-29 02:21:02.757589] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.181 [2024-11-29 02:21:02.765601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.181 [2024-11-29 02:21:02.765623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.181 [2024-11-29 02:21:02.773627] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.181 [2024-11-29 02:21:02.773649] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.181 [2024-11-29 02:21:02.781647] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.181 [2024-11-29 02:21:02.781685] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.181 [2024-11-29 02:21:02.789686] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.181 [2024-11-29 02:21:02.789711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.181 [2024-11-29 02:21:02.797715] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.181 [2024-11-29 02:21:02.797740] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.181 [2024-11-29 02:21:02.805716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.181 [2024-11-29 02:21:02.805755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.181 [2024-11-29 02:21:02.813762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.181 [2024-11-29 02:21:02.813786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.181 [2024-11-29 02:21:02.821787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.181 [2024-11-29 02:21:02.821812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.181 [2024-11-29 02:21:02.829812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.181 [2024-11-29 02:21:02.829837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.181 [2024-11-29 02:21:02.837849] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.181 [2024-11-29 02:21:02.837878] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.181 Running I/O for 5 seconds... 00:15:59.181 [2024-11-29 02:21:02.845869] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.181 [2024-11-29 02:21:02.845895] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.441 [2024-11-29 02:21:02.860779] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.441 [2024-11-29 02:21:02.860812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.441 [2024-11-29 02:21:02.872058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.441 [2024-11-29 02:21:02.872090] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.441 [2024-11-29 02:21:02.885573] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.441 [2024-11-29 02:21:02.885602] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.441 [2024-11-29 02:21:02.896287] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.441 [2024-11-29 02:21:02.896318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.441 [2024-11-29 02:21:02.907625] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.441 [2024-11-29 02:21:02.907653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.441 [2024-11-29 02:21:02.918826] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.441 [2024-11-29 02:21:02.918864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.441 [2024-11-29 02:21:02.930263] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.441 [2024-11-29 02:21:02.930293] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.441 [2024-11-29 02:21:02.941570] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.441 [2024-11-29 02:21:02.941597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.441 [2024-11-29 02:21:02.952365] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.441 [2024-11-29 02:21:02.952407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.441 [2024-11-29 02:21:02.963896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.441 [2024-11-29 02:21:02.963926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.441 [2024-11-29 02:21:02.977039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.441 [2024-11-29 02:21:02.977069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.441 [2024-11-29 02:21:02.987732] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.441 [2024-11-29 02:21:02.987763] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.441 [2024-11-29 02:21:02.999307] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.441 [2024-11-29 02:21:02.999338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.441 [2024-11-29 02:21:03.010232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.441 [2024-11-29 02:21:03.010263] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.441 [2024-11-29 02:21:03.021589] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.441 [2024-11-29 02:21:03.021617] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.441 [2024-11-29 02:21:03.032698] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.441 [2024-11-29 02:21:03.032729] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.441 [2024-11-29 02:21:03.043671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.441 [2024-11-29 02:21:03.043698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.441 [2024-11-29 02:21:03.056813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.441 [2024-11-29 02:21:03.056843] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.441 [2024-11-29 02:21:03.066739] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.441 [2024-11-29 02:21:03.066770] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.442 [2024-11-29 02:21:03.077660] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.442 [2024-11-29 02:21:03.077705] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.442 [2024-11-29 02:21:03.090576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.442 [2024-11-29 02:21:03.090604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.442 [2024-11-29 02:21:03.100699] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.442 [2024-11-29 02:21:03.100730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.442 [2024-11-29 02:21:03.111156] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.442 [2024-11-29 02:21:03.111187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.703 [2024-11-29 02:21:03.122551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.703 [2024-11-29 02:21:03.122580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.703 [2024-11-29 02:21:03.133950] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.703 [2024-11-29 02:21:03.133989] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.703 [2024-11-29 02:21:03.147514] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.703 [2024-11-29 02:21:03.147542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.703 [2024-11-29 02:21:03.158417] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.703 [2024-11-29 02:21:03.158461] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.703 [2024-11-29 02:21:03.169551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.703 [2024-11-29 02:21:03.169578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.703 [2024-11-29 02:21:03.180855] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.703 [2024-11-29 02:21:03.180885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.703 [2024-11-29 02:21:03.192168] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.703 [2024-11-29 02:21:03.192199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.703 [2024-11-29 02:21:03.203646] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.703 [2024-11-29 02:21:03.203674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.703 [2024-11-29 02:21:03.214141] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.703 [2024-11-29 02:21:03.214172] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.703 [2024-11-29 02:21:03.225457] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.703 [2024-11-29 02:21:03.225485] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.703 [2024-11-29 02:21:03.236313] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.703 [2024-11-29 02:21:03.236344] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.704 [2024-11-29 02:21:03.247958] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.704 [2024-11-29 02:21:03.247988] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.704 [2024-11-29 02:21:03.258951] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.704 [2024-11-29 02:21:03.258982] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.704 [2024-11-29 02:21:03.270454] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.704 [2024-11-29 02:21:03.270482] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.704 [2024-11-29 02:21:03.283546] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.704 [2024-11-29 02:21:03.283574] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.704 [2024-11-29 02:21:03.293857] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.704 [2024-11-29 02:21:03.293888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.704 [2024-11-29 02:21:03.304941] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.704 [2024-11-29 02:21:03.304972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.704 [2024-11-29 02:21:03.316457] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.704 [2024-11-29 02:21:03.316485] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.704 [2024-11-29 02:21:03.327526] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.704 [2024-11-29 02:21:03.327554] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.704 [2024-11-29 02:21:03.338906] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.704 [2024-11-29 02:21:03.338947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.704 [2024-11-29 02:21:03.350087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.704 [2024-11-29 02:21:03.350135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.704 [2024-11-29 02:21:03.360665] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.704 [2024-11-29 02:21:03.360713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.704 [2024-11-29 02:21:03.371769] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.704 [2024-11-29 02:21:03.371800] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.963 [2024-11-29 02:21:03.383365] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.963 [2024-11-29 02:21:03.383407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.963 [2024-11-29 02:21:03.394934] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.963 [2024-11-29 02:21:03.394965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.963 [2024-11-29 02:21:03.405925] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.963 [2024-11-29 02:21:03.405957] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.963 [2024-11-29 02:21:03.417163] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.963 [2024-11-29 02:21:03.417193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.963 [2024-11-29 02:21:03.430539] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.963 [2024-11-29 02:21:03.430568] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.963 [2024-11-29 02:21:03.440994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.963 [2024-11-29 02:21:03.441026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.963 [2024-11-29 02:21:03.452388] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.963 [2024-11-29 02:21:03.452454] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.963 [2024-11-29 02:21:03.465609] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.963 [2024-11-29 02:21:03.465637] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.963 [2024-11-29 02:21:03.476237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.963 [2024-11-29 02:21:03.476267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.963 [2024-11-29 02:21:03.487157] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.963 [2024-11-29 02:21:03.487188] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.963 [2024-11-29 02:21:03.498578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.963 [2024-11-29 02:21:03.498607] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.963 [2024-11-29 02:21:03.509852] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.963 [2024-11-29 02:21:03.509883] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.963 [2024-11-29 02:21:03.522864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.963 [2024-11-29 02:21:03.522894] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.963 [2024-11-29 02:21:03.533212] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.963 [2024-11-29 02:21:03.533243] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.963 [2024-11-29 02:21:03.544253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.963 [2024-11-29 02:21:03.544284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.963 [2024-11-29 02:21:03.557201] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.963 [2024-11-29 02:21:03.557232] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.963 [2024-11-29 02:21:03.567805] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.963 [2024-11-29 02:21:03.567845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.963 [2024-11-29 02:21:03.579481] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.963 [2024-11-29 02:21:03.579508] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.963 [2024-11-29 02:21:03.590421] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.963 [2024-11-29 02:21:03.590464] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.963 [2024-11-29 02:21:03.601839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.963 [2024-11-29 02:21:03.601869] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.963 [2024-11-29 02:21:03.612794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.963 [2024-11-29 02:21:03.612825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.963 [2024-11-29 02:21:03.624233] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.963 [2024-11-29 02:21:03.624264] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:59.963 [2024-11-29 02:21:03.635696] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:59.963 [2024-11-29 02:21:03.635727] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.222 [2024-11-29 02:21:03.646875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.222 [2024-11-29 02:21:03.646906] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.222 [2024-11-29 02:21:03.657888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.222 [2024-11-29 02:21:03.657919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.222 [2024-11-29 02:21:03.668809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.222 [2024-11-29 02:21:03.668839] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.222 [2024-11-29 02:21:03.680053] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.222 [2024-11-29 02:21:03.680084] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.222 [2024-11-29 02:21:03.690610] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.222 [2024-11-29 02:21:03.690638] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.222 [2024-11-29 02:21:03.701909] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.222 [2024-11-29 02:21:03.701940] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.222 [2024-11-29 02:21:03.712971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.222 [2024-11-29 02:21:03.713002] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.222 [2024-11-29 02:21:03.723889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.222 [2024-11-29 02:21:03.723920] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.222 [2024-11-29 02:21:03.735071] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.222 [2024-11-29 02:21:03.735102] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.222 [2024-11-29 02:21:03.748129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.222 [2024-11-29 02:21:03.748160] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.222 [2024-11-29 02:21:03.758534] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.222 [2024-11-29 02:21:03.758562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.222 [2024-11-29 02:21:03.769878] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.222 [2024-11-29 02:21:03.769908] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.222 [2024-11-29 02:21:03.780914] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.222 [2024-11-29 02:21:03.780945] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.222 [2024-11-29 02:21:03.792271] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.222 [2024-11-29 02:21:03.792302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.223 [2024-11-29 02:21:03.803238] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.223 [2024-11-29 02:21:03.803268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.223 [2024-11-29 02:21:03.814426] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.223 [2024-11-29 02:21:03.814470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.223 [2024-11-29 02:21:03.826023] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.223 [2024-11-29 02:21:03.826054] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.223 [2024-11-29 02:21:03.837926] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.223 [2024-11-29 02:21:03.837956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.223 [2024-11-29 02:21:03.851030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.223 [2024-11-29 02:21:03.851061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.223 [2024-11-29 02:21:03.860640] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.223 [2024-11-29 02:21:03.860683] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.223 [2024-11-29 02:21:03.872165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.223 [2024-11-29 02:21:03.872194] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.223 [2024-11-29 02:21:03.883242] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.223 [2024-11-29 02:21:03.883273] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.223 [2024-11-29 02:21:03.894058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.223 [2024-11-29 02:21:03.894088] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.484 [2024-11-29 02:21:03.907254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.484 [2024-11-29 02:21:03.907286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.484 [2024-11-29 02:21:03.917929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.484 [2024-11-29 02:21:03.917959] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.484 [2024-11-29 02:21:03.929501] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.484 [2024-11-29 02:21:03.929529] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.484 [2024-11-29 02:21:03.940615] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.484 [2024-11-29 02:21:03.940643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.484 [2024-11-29 02:21:03.953855] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.484 [2024-11-29 02:21:03.953886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.484 [2024-11-29 02:21:03.964338] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.484 [2024-11-29 02:21:03.964369] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.484 [2024-11-29 02:21:03.975515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.484 [2024-11-29 02:21:03.975543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.484 [2024-11-29 02:21:03.988335] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.484 [2024-11-29 02:21:03.988365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.484 [2024-11-29 02:21:03.998378] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.484 [2024-11-29 02:21:03.998419] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.484 [2024-11-29 02:21:04.009785] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.484 [2024-11-29 02:21:04.009816] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.484 [2024-11-29 02:21:04.021314] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.484 [2024-11-29 02:21:04.021346] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.484 [2024-11-29 02:21:04.032744] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.484 [2024-11-29 02:21:04.032775] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.484 [2024-11-29 02:21:04.044199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.484 [2024-11-29 02:21:04.044229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.484 [2024-11-29 02:21:04.055007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.484 [2024-11-29 02:21:04.055038] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.484 [2024-11-29 02:21:04.066415] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.484 [2024-11-29 02:21:04.066458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.484 [2024-11-29 02:21:04.077278] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.484 [2024-11-29 02:21:04.077309] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.484 [2024-11-29 02:21:04.087974] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.484 [2024-11-29 02:21:04.088004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.485 [2024-11-29 02:21:04.098969] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.485 [2024-11-29 02:21:04.099001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.485 [2024-11-29 02:21:04.112245] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.485 [2024-11-29 02:21:04.112275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.485 [2024-11-29 02:21:04.123003] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.485 [2024-11-29 02:21:04.123034] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.485 [2024-11-29 02:21:04.133811] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.485 [2024-11-29 02:21:04.133841] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.485 [2024-11-29 02:21:04.145264] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.485 [2024-11-29 02:21:04.145294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.485 [2024-11-29 02:21:04.156725] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.485 [2024-11-29 02:21:04.156752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.745 [2024-11-29 02:21:04.168546] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.745 [2024-11-29 02:21:04.168575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.745 [2024-11-29 02:21:04.180243] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.745 [2024-11-29 02:21:04.180274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.745 [2024-11-29 02:21:04.191831] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.745 [2024-11-29 02:21:04.191861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.745 [2024-11-29 02:21:04.204773] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.745 [2024-11-29 02:21:04.204805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.745 [2024-11-29 02:21:04.215140] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.745 [2024-11-29 02:21:04.215171] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.745 [2024-11-29 02:21:04.226304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.745 [2024-11-29 02:21:04.226334] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.745 [2024-11-29 02:21:04.237676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.745 [2024-11-29 02:21:04.237719] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.745 [2024-11-29 02:21:04.248783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.745 [2024-11-29 02:21:04.248814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.745 [2024-11-29 02:21:04.261732] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.745 [2024-11-29 02:21:04.261763] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.745 [2024-11-29 02:21:04.271586] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.745 [2024-11-29 02:21:04.271614] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.745 [2024-11-29 02:21:04.283066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.745 [2024-11-29 02:21:04.283097] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.745 [2024-11-29 02:21:04.296443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.745 [2024-11-29 02:21:04.296471] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.745 [2024-11-29 02:21:04.307940] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.745 [2024-11-29 02:21:04.307971] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.745 [2024-11-29 02:21:04.321488] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.745 [2024-11-29 02:21:04.321516] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.745 [2024-11-29 02:21:04.332335] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.745 [2024-11-29 02:21:04.332366] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.745 [2024-11-29 02:21:04.343761] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.745 [2024-11-29 02:21:04.343792] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.745 [2024-11-29 02:21:04.357256] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.745 [2024-11-29 02:21:04.357288] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.745 [2024-11-29 02:21:04.367938] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.745 [2024-11-29 02:21:04.367968] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.745 [2024-11-29 02:21:04.379092] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.745 [2024-11-29 02:21:04.379123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.745 [2024-11-29 02:21:04.392770] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.745 [2024-11-29 02:21:04.392800] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.745 [2024-11-29 02:21:04.403597] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.745 [2024-11-29 02:21:04.403624] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.745 [2024-11-29 02:21:04.414796] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.745 [2024-11-29 02:21:04.414826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.005 [2024-11-29 02:21:04.425695] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.005 [2024-11-29 02:21:04.425727] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.005 [2024-11-29 02:21:04.436477] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.005 [2024-11-29 02:21:04.436505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.005 [2024-11-29 02:21:04.447479] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.005 [2024-11-29 02:21:04.447507] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.005 [2024-11-29 02:21:04.461285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.005 [2024-11-29 02:21:04.461315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.005 [2024-11-29 02:21:04.472015] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.005 [2024-11-29 02:21:04.472045] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.005 [2024-11-29 02:21:04.483204] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.005 [2024-11-29 02:21:04.483234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.005 [2024-11-29 02:21:04.494249] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.005 [2024-11-29 02:21:04.494280] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.005 [2024-11-29 02:21:04.505207] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.005 [2024-11-29 02:21:04.505237] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.005 [2024-11-29 02:21:04.516166] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.005 [2024-11-29 02:21:04.516196] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.005 [2024-11-29 02:21:04.527087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.005 [2024-11-29 02:21:04.527117] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.005 [2024-11-29 02:21:04.539952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.005 [2024-11-29 02:21:04.539982] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.005 [2024-11-29 02:21:04.549790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.005 [2024-11-29 02:21:04.549821] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.005 [2024-11-29 02:21:04.561636] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.005 [2024-11-29 02:21:04.561664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.005 [2024-11-29 02:21:04.574593] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.005 [2024-11-29 02:21:04.574636] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.005 [2024-11-29 02:21:04.584289] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.005 [2024-11-29 02:21:04.584320] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.005 [2024-11-29 02:21:04.596327] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.005 [2024-11-29 02:21:04.596358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.005 [2024-11-29 02:21:04.607431] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.005 [2024-11-29 02:21:04.607476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.005 [2024-11-29 02:21:04.620514] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.005 [2024-11-29 02:21:04.620542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.005 [2024-11-29 02:21:04.631165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.005 [2024-11-29 02:21:04.631195] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.005 [2024-11-29 02:21:04.642574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.005 [2024-11-29 02:21:04.642611] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.005 [2024-11-29 02:21:04.655634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.005 [2024-11-29 02:21:04.655661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.005 [2024-11-29 02:21:04.665833] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.005 [2024-11-29 02:21:04.665864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.005 [2024-11-29 02:21:04.677314] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.005 [2024-11-29 02:21:04.677351] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.265 [2024-11-29 02:21:04.688204] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.265 [2024-11-29 02:21:04.688234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.265 [2024-11-29 02:21:04.699160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.265 [2024-11-29 02:21:04.699191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.265 [2024-11-29 02:21:04.710588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.265 [2024-11-29 02:21:04.710615] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.265 [2024-11-29 02:21:04.721795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.265 [2024-11-29 02:21:04.721826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.265 [2024-11-29 02:21:04.732917] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.265 [2024-11-29 02:21:04.732948] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.265 [2024-11-29 02:21:04.743762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.265 [2024-11-29 02:21:04.743793] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.265 [2024-11-29 02:21:04.755205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.265 [2024-11-29 02:21:04.755236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.265 [2024-11-29 02:21:04.765866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.265 [2024-11-29 02:21:04.765897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.265 [2024-11-29 02:21:04.777133] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.265 [2024-11-29 02:21:04.777164] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.265 [2024-11-29 02:21:04.790055] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.265 [2024-11-29 02:21:04.790085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.265 [2024-11-29 02:21:04.800021] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.265 [2024-11-29 02:21:04.800052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.265 [2024-11-29 02:21:04.811588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.265 [2024-11-29 02:21:04.811616] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.265 [2024-11-29 02:21:04.825038] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.265 [2024-11-29 02:21:04.825069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.265 [2024-11-29 02:21:04.835985] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.265 [2024-11-29 02:21:04.836015] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.265 [2024-11-29 02:21:04.847403] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.265 [2024-11-29 02:21:04.847434] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.265 [2024-11-29 02:21:04.860538] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.265 [2024-11-29 02:21:04.860588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.265 [2024-11-29 02:21:04.870614] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.265 [2024-11-29 02:21:04.870641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.265 [2024-11-29 02:21:04.881584] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.265 [2024-11-29 02:21:04.881612] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.265 [2024-11-29 02:21:04.894676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.265 [2024-11-29 02:21:04.894719] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.265 [2024-11-29 02:21:04.905060] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.265 [2024-11-29 02:21:04.905090] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.265 [2024-11-29 02:21:04.915798] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.265 [2024-11-29 02:21:04.915829] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.265 [2024-11-29 02:21:04.928903] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.265 [2024-11-29 02:21:04.928933] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.265 [2024-11-29 02:21:04.939301] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.265 [2024-11-29 02:21:04.939331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.525 [2024-11-29 02:21:04.950631] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.525 [2024-11-29 02:21:04.950659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.525 [2024-11-29 02:21:04.963560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.525 [2024-11-29 02:21:04.963603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.525 [2024-11-29 02:21:04.973653] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.525 [2024-11-29 02:21:04.973682] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.525 [2024-11-29 02:21:04.984724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.525 [2024-11-29 02:21:04.984755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.525 [2024-11-29 02:21:04.995853] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.525 [2024-11-29 02:21:04.995884] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.525 [2024-11-29 02:21:05.007087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.525 [2024-11-29 02:21:05.007118] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.525 [2024-11-29 02:21:05.018668] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.525 [2024-11-29 02:21:05.018711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.525 [2024-11-29 02:21:05.030285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.525 [2024-11-29 02:21:05.030316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.525 [2024-11-29 02:21:05.041673] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.525 [2024-11-29 02:21:05.041700] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.525 [2024-11-29 02:21:05.055004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.525 [2024-11-29 02:21:05.055034] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.525 [2024-11-29 02:21:05.065469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.525 [2024-11-29 02:21:05.065499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.525 [2024-11-29 02:21:05.076064] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.525 [2024-11-29 02:21:05.076103] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.525 [2024-11-29 02:21:05.087181] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.525 [2024-11-29 02:21:05.087212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.525 [2024-11-29 02:21:05.100074] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.525 [2024-11-29 02:21:05.100105] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.525 [2024-11-29 02:21:05.110962] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.525 [2024-11-29 02:21:05.110992] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.525 [2024-11-29 02:21:05.121751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.525 [2024-11-29 02:21:05.121782] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.525 [2024-11-29 02:21:05.132759] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.525 [2024-11-29 02:21:05.132790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.525 [2024-11-29 02:21:05.144524] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.525 [2024-11-29 02:21:05.144556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.525 [2024-11-29 02:21:05.155752] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.525 [2024-11-29 02:21:05.155782] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.525 [2024-11-29 02:21:05.168429] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.525 [2024-11-29 02:21:05.168459] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.525 [2024-11-29 02:21:05.179192] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.525 [2024-11-29 02:21:05.179223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.525 [2024-11-29 02:21:05.190284] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.525 [2024-11-29 02:21:05.190314] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.525 [2024-11-29 02:21:05.203291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.525 [2024-11-29 02:21:05.203321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.783 [2024-11-29 02:21:05.213680] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.783 [2024-11-29 02:21:05.213711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.783 [2024-11-29 02:21:05.224984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.783 [2024-11-29 02:21:05.225014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.783 [2024-11-29 02:21:05.236357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.783 [2024-11-29 02:21:05.236407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.783 [2024-11-29 02:21:05.247363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.784 [2024-11-29 02:21:05.247406] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.784 [2024-11-29 02:21:05.260269] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.784 [2024-11-29 02:21:05.260299] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.784 [2024-11-29 02:21:05.270946] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.784 [2024-11-29 02:21:05.270976] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.784 [2024-11-29 02:21:05.282541] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.784 [2024-11-29 02:21:05.282571] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.784 [2024-11-29 02:21:05.293630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.784 [2024-11-29 02:21:05.293670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.784 [2024-11-29 02:21:05.304743] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.784 [2024-11-29 02:21:05.304773] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.784 [2024-11-29 02:21:05.317894] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.784 [2024-11-29 02:21:05.317925] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.784 [2024-11-29 02:21:05.328746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.784 [2024-11-29 02:21:05.328776] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.784 [2024-11-29 02:21:05.339830] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.784 [2024-11-29 02:21:05.339860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.784 [2024-11-29 02:21:05.350944] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.784 [2024-11-29 02:21:05.350974] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.784 [2024-11-29 02:21:05.361904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.784 [2024-11-29 02:21:05.361934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.784 [2024-11-29 02:21:05.373343] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.784 [2024-11-29 02:21:05.373372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.784 [2024-11-29 02:21:05.384772] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.784 [2024-11-29 02:21:05.384802] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.784 [2024-11-29 02:21:05.395784] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.784 [2024-11-29 02:21:05.395814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.784 [2024-11-29 02:21:05.406833] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.784 [2024-11-29 02:21:05.406863] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.784 [2024-11-29 02:21:05.419963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.784 [2024-11-29 02:21:05.419993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.784 [2024-11-29 02:21:05.430401] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.784 [2024-11-29 02:21:05.430431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.784 [2024-11-29 02:21:05.441707] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.784 [2024-11-29 02:21:05.441737] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.784 [2024-11-29 02:21:05.455165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.784 [2024-11-29 02:21:05.455195] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.042 [2024-11-29 02:21:05.466049] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.042 [2024-11-29 02:21:05.466080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.042 [2024-11-29 02:21:05.476893] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.042 [2024-11-29 02:21:05.476923] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.042 [2024-11-29 02:21:05.487751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.042 [2024-11-29 02:21:05.487782] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.042 [2024-11-29 02:21:05.498957] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.042 [2024-11-29 02:21:05.498987] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.042 [2024-11-29 02:21:05.512211] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.042 [2024-11-29 02:21:05.512241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.042 [2024-11-29 02:21:05.522705] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.042 [2024-11-29 02:21:05.522736] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.042 [2024-11-29 02:21:05.533808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.042 [2024-11-29 02:21:05.533838] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.042 [2024-11-29 02:21:05.546500] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.042 [2024-11-29 02:21:05.546531] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.042 [2024-11-29 02:21:05.556001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.042 [2024-11-29 02:21:05.556031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.042 [2024-11-29 02:21:05.567876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.042 [2024-11-29 02:21:05.567907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.042 [2024-11-29 02:21:05.579153] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.042 [2024-11-29 02:21:05.579184] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.042 [2024-11-29 02:21:05.590682] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.042 [2024-11-29 02:21:05.590713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.042 [2024-11-29 02:21:05.601978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.042 [2024-11-29 02:21:05.602009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.042 [2024-11-29 02:21:05.612703] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.042 [2024-11-29 02:21:05.612734] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.042 [2024-11-29 02:21:05.623812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.042 [2024-11-29 02:21:05.623842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.042 [2024-11-29 02:21:05.635523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.042 [2024-11-29 02:21:05.635553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.042 [2024-11-29 02:21:05.647145] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.042 [2024-11-29 02:21:05.647175] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.042 [2024-11-29 02:21:05.658577] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.042 [2024-11-29 02:21:05.658607] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.042 [2024-11-29 02:21:05.671628] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.042 [2024-11-29 02:21:05.671658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.042 [2024-11-29 02:21:05.681533] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.042 [2024-11-29 02:21:05.681564] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.042 [2024-11-29 02:21:05.692357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.042 [2024-11-29 02:21:05.692387] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.042 [2024-11-29 02:21:05.705537] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.042 [2024-11-29 02:21:05.705568] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.042 [2024-11-29 02:21:05.715342] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.042 [2024-11-29 02:21:05.715372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.302 [2024-11-29 02:21:05.727066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.302 [2024-11-29 02:21:05.727099] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.302 [2024-11-29 02:21:05.737792] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.302 [2024-11-29 02:21:05.737824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.302 [2024-11-29 02:21:05.750789] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.302 [2024-11-29 02:21:05.750820] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.302 [2024-11-29 02:21:05.760943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.302 [2024-11-29 02:21:05.760974] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.302 [2024-11-29 02:21:05.772292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.302 [2024-11-29 02:21:05.772324] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.302 [2024-11-29 02:21:05.783369] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.302 [2024-11-29 02:21:05.783409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.302 [2024-11-29 02:21:05.794912] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.302 [2024-11-29 02:21:05.794943] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.302 [2024-11-29 02:21:05.806031] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.302 [2024-11-29 02:21:05.806061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.302 [2024-11-29 02:21:05.817011] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.302 [2024-11-29 02:21:05.817041] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.302 [2024-11-29 02:21:05.828085] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.302 [2024-11-29 02:21:05.828115] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.302 [2024-11-29 02:21:05.839180] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.302 [2024-11-29 02:21:05.839212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.302 [2024-11-29 02:21:05.850355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.302 [2024-11-29 02:21:05.850385] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.302 [2024-11-29 02:21:05.863134] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.302 [2024-11-29 02:21:05.863175] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.302 [2024-11-29 02:21:05.873876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.302 [2024-11-29 02:21:05.873907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.302 [2024-11-29 02:21:05.884696] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.302 [2024-11-29 02:21:05.884727] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.302 [2024-11-29 02:21:05.897721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.302 [2024-11-29 02:21:05.897752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.302 [2024-11-29 02:21:05.908142] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.302 [2024-11-29 02:21:05.908172] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.302 [2024-11-29 02:21:05.919449] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.302 [2024-11-29 02:21:05.919480] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.302 [2024-11-29 02:21:05.931108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.302 [2024-11-29 02:21:05.931139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.302 [2024-11-29 02:21:05.942517] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.302 [2024-11-29 02:21:05.942547] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.302 [2024-11-29 02:21:05.955240] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.302 [2024-11-29 02:21:05.955270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.302 [2024-11-29 02:21:05.965591] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.302 [2024-11-29 02:21:05.965622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.302 [2024-11-29 02:21:05.976929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.302 [2024-11-29 02:21:05.976959] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-29 02:21:05.988620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-29 02:21:05.988652] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-29 02:21:05.999898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-29 02:21:05.999928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-29 02:21:06.012692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-29 02:21:06.012723] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-29 02:21:06.022619] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-29 02:21:06.022650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-29 02:21:06.034447] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-29 02:21:06.034477] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-29 02:21:06.045315] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-29 02:21:06.045346] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-29 02:21:06.056237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-29 02:21:06.056267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-29 02:21:06.067095] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-29 02:21:06.067126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-29 02:21:06.077912] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-29 02:21:06.077943] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-29 02:21:06.088889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-29 02:21:06.088921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-29 02:21:06.099891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-29 02:21:06.099922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-29 02:21:06.111153] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-29 02:21:06.111184] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-29 02:21:06.121888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-29 02:21:06.121919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-29 02:21:06.132877] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-29 02:21:06.132909] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-29 02:21:06.145633] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-29 02:21:06.145664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-29 02:21:06.155732] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-29 02:21:06.155763] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-29 02:21:06.167011] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-29 02:21:06.167042] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-29 02:21:06.180317] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-29 02:21:06.180347] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-29 02:21:06.190334] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-29 02:21:06.190365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-29 02:21:06.201122] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-29 02:21:06.201152] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-29 02:21:06.214050] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-29 02:21:06.214081] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-29 02:21:06.224949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-29 02:21:06.224979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-29 02:21:06.236326] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-29 02:21:06.236357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-29 02:21:06.249315] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-29 02:21:06.249346] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-29 02:21:06.259740] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-29 02:21:06.259770] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-29 02:21:06.270973] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-29 02:21:06.271004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-29 02:21:06.284119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-29 02:21:06.284149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-29 02:21:06.294897] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-29 02:21:06.294934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-29 02:21:06.305833] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-29 02:21:06.305864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-29 02:21:06.318627] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-29 02:21:06.318658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-29 02:21:06.328363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-29 02:21:06.328413] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-29 02:21:06.340443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-29 02:21:06.340473] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-29 02:21:06.351723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-29 02:21:06.351753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-29 02:21:06.362795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-29 02:21:06.362835] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-29 02:21:06.374004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-29 02:21:06.374034] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-29 02:21:06.386998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-29 02:21:06.387029] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-29 02:21:06.397433] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-29 02:21:06.397464] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-29 02:21:06.408285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-29 02:21:06.408316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-29 02:21:06.421795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-29 02:21:06.421827] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-29 02:21:06.432676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-29 02:21:06.432707] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-29 02:21:06.443494] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-29 02:21:06.443524] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-29 02:21:06.456858] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-29 02:21:06.456889] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-29 02:21:06.467412] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-29 02:21:06.467451] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-29 02:21:06.478992] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-29 02:21:06.479023] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-29 02:21:06.489897] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-29 02:21:06.489928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-29 02:21:06.501408] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-29 02:21:06.501438] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.083 [2024-11-29 02:21:06.512987] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.083 [2024-11-29 02:21:06.513017] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.083 [2024-11-29 02:21:06.524391] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.083 [2024-11-29 02:21:06.524441] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.083 [2024-11-29 02:21:06.537462] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.083 [2024-11-29 02:21:06.537492] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.083 [2024-11-29 02:21:06.547923] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.083 [2024-11-29 02:21:06.547954] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.083 [2024-11-29 02:21:06.559074] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.083 [2024-11-29 02:21:06.559105] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.083 [2024-11-29 02:21:06.572098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.083 [2024-11-29 02:21:06.572128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.083 [2024-11-29 02:21:06.582238] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.083 [2024-11-29 02:21:06.582278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.083 [2024-11-29 02:21:06.593899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.083 [2024-11-29 02:21:06.593929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.083 [2024-11-29 02:21:06.605485] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.083 [2024-11-29 02:21:06.605516] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.083 [2024-11-29 02:21:06.619055] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.083 [2024-11-29 02:21:06.619085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.083 [2024-11-29 02:21:06.629553] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.083 [2024-11-29 02:21:06.629583] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.083 [2024-11-29 02:21:06.640763] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.083 [2024-11-29 02:21:06.640795] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.083 [2024-11-29 02:21:06.653676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.083 [2024-11-29 02:21:06.653708] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.083 [2024-11-29 02:21:06.663896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.083 [2024-11-29 02:21:06.663927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.083 [2024-11-29 02:21:06.675521] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.083 [2024-11-29 02:21:06.675549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.083 [2024-11-29 02:21:06.685791] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.083 [2024-11-29 02:21:06.685820] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.083 [2024-11-29 02:21:06.696581] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.083 [2024-11-29 02:21:06.696609] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.083 [2024-11-29 02:21:06.709108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.083 [2024-11-29 02:21:06.709135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.084 [2024-11-29 02:21:06.720452] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.084 [2024-11-29 02:21:06.720481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.084 [2024-11-29 02:21:06.729295] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.084 [2024-11-29 02:21:06.729323] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.084 [2024-11-29 02:21:06.740986] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.084 [2024-11-29 02:21:06.741013] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.084 [2024-11-29 02:21:06.751353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.084 [2024-11-29 02:21:06.751381] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.084 [2024-11-29 02:21:06.761870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.084 [2024-11-29 02:21:06.761897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.344 [2024-11-29 02:21:06.774450] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.344 [2024-11-29 02:21:06.774478] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.344 [2024-11-29 02:21:06.784544] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.344 [2024-11-29 02:21:06.784572] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.344 [2024-11-29 02:21:06.795296] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.344 [2024-11-29 02:21:06.795349] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.344 [2024-11-29 02:21:06.807312] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.344 [2024-11-29 02:21:06.807340] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.344 [2024-11-29 02:21:06.818725] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.344 [2024-11-29 02:21:06.818753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.344 [2024-11-29 02:21:06.827993] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.344 [2024-11-29 02:21:06.828021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.344 [2024-11-29 02:21:06.839169] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.344 [2024-11-29 02:21:06.839197] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.344 [2024-11-29 02:21:06.851375] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.344 [2024-11-29 02:21:06.851412] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.344 [2024-11-29 02:21:06.862629] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.344 [2024-11-29 02:21:06.862659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.344 [2024-11-29 02:21:06.871184] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.344 [2024-11-29 02:21:06.871212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.344 [2024-11-29 02:21:06.882564] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.344 [2024-11-29 02:21:06.882591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.344 [2024-11-29 02:21:06.894918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.344 [2024-11-29 02:21:06.894946] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.345 [2024-11-29 02:21:06.904635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.345 [2024-11-29 02:21:06.904663] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.345 [2024-11-29 02:21:06.915127] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.345 [2024-11-29 02:21:06.915156] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.345 [2024-11-29 02:21:06.925808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.345 [2024-11-29 02:21:06.925837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.345 [2024-11-29 02:21:06.937942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.345 [2024-11-29 02:21:06.937971] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.345 [2024-11-29 02:21:06.949462] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.345 [2024-11-29 02:21:06.949493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.345 [2024-11-29 02:21:06.958222] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.345 [2024-11-29 02:21:06.958250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.345 [2024-11-29 02:21:06.969752] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.345 [2024-11-29 02:21:06.969781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.345 [2024-11-29 02:21:06.980120] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.345 [2024-11-29 02:21:06.980147] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.345 [2024-11-29 02:21:06.990746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.345 [2024-11-29 02:21:06.990775] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.345 [2024-11-29 02:21:07.003183] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.345 [2024-11-29 02:21:07.003217] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.345 [2024-11-29 02:21:07.014958] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.345 [2024-11-29 02:21:07.014986] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.345 [2024-11-29 02:21:07.023629] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.345 [2024-11-29 02:21:07.023657] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.603 [2024-11-29 02:21:07.034838] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.603 [2024-11-29 02:21:07.034866] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.603 [2024-11-29 02:21:07.046756] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.603 [2024-11-29 02:21:07.046784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.603 [2024-11-29 02:21:07.055424] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.603 [2024-11-29 02:21:07.055460] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.603 [2024-11-29 02:21:07.066668] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.603 [2024-11-29 02:21:07.066695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.603 [2024-11-29 02:21:07.079105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.603 [2024-11-29 02:21:07.079132] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.603 [2024-11-29 02:21:07.088738] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.603 [2024-11-29 02:21:07.088765] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.603 [2024-11-29 02:21:07.098836] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.603 [2024-11-29 02:21:07.098864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.603 [2024-11-29 02:21:07.109648] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.603 [2024-11-29 02:21:07.109675] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.603 [2024-11-29 02:21:07.122137] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.603 [2024-11-29 02:21:07.122163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.603 [2024-11-29 02:21:07.133712] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.603 [2024-11-29 02:21:07.133740] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.603 [2024-11-29 02:21:07.142381] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.603 [2024-11-29 02:21:07.142424] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.603 [2024-11-29 02:21:07.153708] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.603 [2024-11-29 02:21:07.153735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.603 [2024-11-29 02:21:07.166522] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.603 [2024-11-29 02:21:07.166550] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.603 [2024-11-29 02:21:07.176493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.603 [2024-11-29 02:21:07.176521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.603 [2024-11-29 02:21:07.188135] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.603 [2024-11-29 02:21:07.188167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.603 [2024-11-29 02:21:07.201940] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.603 [2024-11-29 02:21:07.201969] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.603 [2024-11-29 02:21:07.212705] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.603 [2024-11-29 02:21:07.212736] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.603 [2024-11-29 02:21:07.223960] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.603 [2024-11-29 02:21:07.223990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.603 [2024-11-29 02:21:07.237066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.603 [2024-11-29 02:21:07.237096] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.603 [2024-11-29 02:21:07.247519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.603 [2024-11-29 02:21:07.247547] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.603 [2024-11-29 02:21:07.258901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.603 [2024-11-29 02:21:07.258932] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.603 [2024-11-29 02:21:07.271811] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.603 [2024-11-29 02:21:07.271843] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.603 [2024-11-29 02:21:07.282514] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.603 [2024-11-29 02:21:07.282542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.870 [2024-11-29 02:21:07.293591] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.870 [2024-11-29 02:21:07.293620] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.870 [2024-11-29 02:21:07.306785] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.870 [2024-11-29 02:21:07.306817] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.870 [2024-11-29 02:21:07.317406] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.870 [2024-11-29 02:21:07.317449] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.870 [2024-11-29 02:21:07.327914] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.870 [2024-11-29 02:21:07.327945] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.870 [2024-11-29 02:21:07.339227] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.870 [2024-11-29 02:21:07.339259] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.870 [2024-11-29 02:21:07.352376] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.870 [2024-11-29 02:21:07.352417] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.870 [2024-11-29 02:21:07.362708] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.870 [2024-11-29 02:21:07.362740] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.870 [2024-11-29 02:21:07.373762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.870 [2024-11-29 02:21:07.373794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.870 [2024-11-29 02:21:07.386940] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.870 [2024-11-29 02:21:07.386970] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.870 [2024-11-29 02:21:07.397848] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.870 [2024-11-29 02:21:07.397879] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.870 [2024-11-29 02:21:07.408980] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.870 [2024-11-29 02:21:07.409010] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.870 [2024-11-29 02:21:07.420030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.870 [2024-11-29 02:21:07.420060] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.870 [2024-11-29 02:21:07.431551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.870 [2024-11-29 02:21:07.431579] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.870 [2024-11-29 02:21:07.444776] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.870 [2024-11-29 02:21:07.444806] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.870 [2024-11-29 02:21:07.455151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.870 [2024-11-29 02:21:07.455181] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.870 [2024-11-29 02:21:07.466504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.870 [2024-11-29 02:21:07.466532] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.870 [2024-11-29 02:21:07.477924] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.870 [2024-11-29 02:21:07.477955] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.870 [2024-11-29 02:21:07.491010] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.870 [2024-11-29 02:21:07.491040] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.870 [2024-11-29 02:21:07.501650] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.870 [2024-11-29 02:21:07.501695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.870 [2024-11-29 02:21:07.513165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.870 [2024-11-29 02:21:07.513195] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.870 [2024-11-29 02:21:07.524103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.870 [2024-11-29 02:21:07.524133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.870 [2024-11-29 02:21:07.534993] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.870 [2024-11-29 02:21:07.535023] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.870 [2024-11-29 02:21:07.547875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.870 [2024-11-29 02:21:07.547905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.128 [2024-11-29 02:21:07.557630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.128 [2024-11-29 02:21:07.557678] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.128 [2024-11-29 02:21:07.569316] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.128 [2024-11-29 02:21:07.569346] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.128 [2024-11-29 02:21:07.580943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.128 [2024-11-29 02:21:07.580973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.128 [2024-11-29 02:21:07.592493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.128 [2024-11-29 02:21:07.592521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.129 [2024-11-29 02:21:07.603756] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.129 [2024-11-29 02:21:07.603787] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.129 [2024-11-29 02:21:07.614875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.129 [2024-11-29 02:21:07.614905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.129 [2024-11-29 02:21:07.626137] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.129 [2024-11-29 02:21:07.626167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.129 [2024-11-29 02:21:07.637273] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.129 [2024-11-29 02:21:07.637303] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.129 [2024-11-29 02:21:07.648471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.129 [2024-11-29 02:21:07.648499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.129 [2024-11-29 02:21:07.660199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.129 [2024-11-29 02:21:07.660229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.129 [2024-11-29 02:21:07.671167] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.129 [2024-11-29 02:21:07.671196] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.129 [2024-11-29 02:21:07.682068] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.129 [2024-11-29 02:21:07.682099] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.129 [2024-11-29 02:21:07.693280] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.129 [2024-11-29 02:21:07.693310] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.129 [2024-11-29 02:21:07.706315] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.129 [2024-11-29 02:21:07.706345] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.129 [2024-11-29 02:21:07.716812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.129 [2024-11-29 02:21:07.716855] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.129 [2024-11-29 02:21:07.728527] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.129 [2024-11-29 02:21:07.728555] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.129 [2024-11-29 02:21:07.739821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.129 [2024-11-29 02:21:07.739852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.129 [2024-11-29 02:21:07.753119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.129 [2024-11-29 02:21:07.753150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.129 [2024-11-29 02:21:07.763370] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.129 [2024-11-29 02:21:07.763414] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.129 [2024-11-29 02:21:07.775338] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.129 [2024-11-29 02:21:07.775370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.129 [2024-11-29 02:21:07.790524] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.129 [2024-11-29 02:21:07.790554] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.129 [2024-11-29 02:21:07.801087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.129 [2024-11-29 02:21:07.801118] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:07.812322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:07.812353] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:07.823780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:07.823811] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:07.835231] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:07.835262] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:07.846659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:07.846704] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:07.857772] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:07.857803] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:07.866966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:07.866996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 00:16:04.387 Latency(us) 00:16:04.387 [2024-11-29T01:21:08.068Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:04.387 [2024-11-29T01:21:08.068Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:16:04.387 Nvme1n1 : 5.01 11449.04 89.45 0.00 0.00 11164.64 4344.79 22622.06 00:16:04.387 [2024-11-29T01:21:08.068Z] =================================================================================================================== 00:16:04.387 [2024-11-29T01:21:08.068Z] Total : 11449.04 89.45 0.00 0.00 11164.64 4344.79 22622.06 00:16:04.387 [2024-11-29 02:21:07.871767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:07.871795] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:07.879780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:07.879806] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:07.887806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:07.887832] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:07.895889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:07.895942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:07.903919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:07.903976] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:07.911930] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:07.911981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:07.919949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:07.919998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:07.927972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:07.928022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:07.936002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:07.936055] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:07.944037] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:07.944089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:07.952039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:07.952090] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:07.960088] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:07.960150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:07.968101] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:07.968172] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:07.976126] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:07.976186] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:07.984126] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:07.984203] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:07.992144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:07.992194] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:08.000190] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:08.000242] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:08.008164] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:08.008201] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:08.016161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:08.016186] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:08.024179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:08.024204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:08.032203] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:08.032238] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:08.040225] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:08.040249] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:08.048323] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:08.048371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:08.056347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:08.056405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.387 [2024-11-29 02:21:08.064338] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.387 [2024-11-29 02:21:08.064377] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.645 [2024-11-29 02:21:08.072325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.645 [2024-11-29 02:21:08.072350] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.646 [2024-11-29 02:21:08.080343] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.646 [2024-11-29 02:21:08.080368] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.646 [2024-11-29 02:21:08.088369] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.646 [2024-11-29 02:21:08.088404] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.646 [2024-11-29 02:21:08.096389] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.646 [2024-11-29 02:21:08.096424] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.646 [2024-11-29 02:21:08.104479] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.646 [2024-11-29 02:21:08.104523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.646 [2024-11-29 02:21:08.112506] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.646 [2024-11-29 02:21:08.112551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.646 [2024-11-29 02:21:08.120488] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.646 [2024-11-29 02:21:08.120514] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.646 [2024-11-29 02:21:08.128508] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.646 [2024-11-29 02:21:08.128530] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.646 [2024-11-29 02:21:08.136547] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.646 [2024-11-29 02:21:08.136578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.646 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (114976) - No such process 00:16:04.646 02:21:08 -- target/zcopy.sh@49 -- # wait 114976 00:16:04.646 02:21:08 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:16:04.646 02:21:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.646 02:21:08 -- common/autotest_common.sh@10 -- # set +x 00:16:04.646 02:21:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.646 02:21:08 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:16:04.646 02:21:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.646 02:21:08 -- common/autotest_common.sh@10 -- # set +x 00:16:04.646 delay0 00:16:04.646 02:21:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.646 02:21:08 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:16:04.646 02:21:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.646 02:21:08 -- common/autotest_common.sh@10 -- # set +x 00:16:04.646 02:21:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.646 02:21:08 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:16:04.646 EAL: No free 2048 kB hugepages reported on node 1 00:16:04.646 [2024-11-29 02:21:08.214034] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:16:12.763 Initializing NVMe Controllers 00:16:12.763 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:16:12.763 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:16:12.763 Initialization complete. Launching workers. 00:16:12.763 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 234, failed: 21628 00:16:12.763 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 21731, failed to submit 131 00:16:12.763 success 21667, unsuccess 64, failed 0 00:16:12.763 02:21:15 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:16:12.763 02:21:15 -- target/zcopy.sh@60 -- # nvmftestfini 00:16:12.763 02:21:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:12.763 02:21:15 -- nvmf/common.sh@116 -- # sync 00:16:12.763 02:21:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:12.763 02:21:15 -- nvmf/common.sh@119 -- # set +e 00:16:12.763 02:21:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:12.763 02:21:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:12.763 rmmod nvme_tcp 00:16:12.763 rmmod nvme_fabrics 00:16:12.763 rmmod nvme_keyring 00:16:12.763 02:21:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:12.763 02:21:15 -- nvmf/common.sh@123 -- # set -e 00:16:12.763 02:21:15 -- nvmf/common.sh@124 -- # return 0 00:16:12.763 02:21:15 -- nvmf/common.sh@477 -- # '[' -n 113445 ']' 00:16:12.763 02:21:15 -- nvmf/common.sh@478 -- # killprocess 113445 00:16:12.763 02:21:15 -- common/autotest_common.sh@936 -- # '[' -z 113445 ']' 00:16:12.763 02:21:15 -- common/autotest_common.sh@940 -- # kill -0 113445 00:16:12.763 02:21:15 -- common/autotest_common.sh@941 -- # uname 00:16:12.763 02:21:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:12.763 02:21:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 113445 00:16:12.763 02:21:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:12.763 02:21:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:12.763 02:21:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 113445' 00:16:12.763 killing process with pid 113445 00:16:12.763 02:21:15 -- common/autotest_common.sh@955 -- # kill 113445 00:16:12.763 02:21:15 -- common/autotest_common.sh@960 -- # wait 113445 00:16:12.763 02:21:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:12.763 02:21:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:12.763 02:21:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:12.763 02:21:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:12.763 02:21:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:12.763 02:21:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:12.763 02:21:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:12.763 02:21:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:14.146 02:21:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:14.146 00:16:14.146 real 0m29.724s 00:16:14.146 user 0m43.070s 00:16:14.146 sys 0m9.275s 00:16:14.146 02:21:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:14.146 02:21:17 -- common/autotest_common.sh@10 -- # set +x 00:16:14.146 ************************************ 00:16:14.146 END TEST nvmf_zcopy 00:16:14.146 ************************************ 00:16:14.146 02:21:17 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:14.146 02:21:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:14.146 02:21:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:14.146 02:21:17 -- common/autotest_common.sh@10 -- # set +x 00:16:14.146 ************************************ 00:16:14.146 START TEST nvmf_nmic 00:16:14.146 ************************************ 00:16:14.146 02:21:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:14.408 * Looking for test storage... 00:16:14.408 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:14.408 02:21:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:14.408 02:21:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:14.408 02:21:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:14.408 02:21:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:14.408 02:21:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:14.408 02:21:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:14.408 02:21:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:14.408 02:21:17 -- scripts/common.sh@335 -- # IFS=.-: 00:16:14.408 02:21:17 -- scripts/common.sh@335 -- # read -ra ver1 00:16:14.408 02:21:17 -- scripts/common.sh@336 -- # IFS=.-: 00:16:14.408 02:21:17 -- scripts/common.sh@336 -- # read -ra ver2 00:16:14.408 02:21:17 -- scripts/common.sh@337 -- # local 'op=<' 00:16:14.408 02:21:17 -- scripts/common.sh@339 -- # ver1_l=2 00:16:14.408 02:21:17 -- scripts/common.sh@340 -- # ver2_l=1 00:16:14.408 02:21:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:14.408 02:21:17 -- scripts/common.sh@343 -- # case "$op" in 00:16:14.408 02:21:17 -- scripts/common.sh@344 -- # : 1 00:16:14.408 02:21:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:14.408 02:21:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:14.408 02:21:17 -- scripts/common.sh@364 -- # decimal 1 00:16:14.408 02:21:17 -- scripts/common.sh@352 -- # local d=1 00:16:14.408 02:21:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:14.408 02:21:17 -- scripts/common.sh@354 -- # echo 1 00:16:14.408 02:21:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:14.408 02:21:17 -- scripts/common.sh@365 -- # decimal 2 00:16:14.408 02:21:17 -- scripts/common.sh@352 -- # local d=2 00:16:14.408 02:21:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:14.408 02:21:17 -- scripts/common.sh@354 -- # echo 2 00:16:14.408 02:21:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:14.408 02:21:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:14.408 02:21:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:14.408 02:21:17 -- scripts/common.sh@367 -- # return 0 00:16:14.408 02:21:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:14.408 02:21:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:14.408 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:14.408 --rc genhtml_branch_coverage=1 00:16:14.408 --rc genhtml_function_coverage=1 00:16:14.408 --rc genhtml_legend=1 00:16:14.408 --rc geninfo_all_blocks=1 00:16:14.408 --rc geninfo_unexecuted_blocks=1 00:16:14.408 00:16:14.408 ' 00:16:14.408 02:21:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:14.408 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:14.408 --rc genhtml_branch_coverage=1 00:16:14.408 --rc genhtml_function_coverage=1 00:16:14.408 --rc genhtml_legend=1 00:16:14.408 --rc geninfo_all_blocks=1 00:16:14.408 --rc geninfo_unexecuted_blocks=1 00:16:14.408 00:16:14.408 ' 00:16:14.408 02:21:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:14.408 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:14.408 --rc genhtml_branch_coverage=1 00:16:14.408 --rc genhtml_function_coverage=1 00:16:14.408 --rc genhtml_legend=1 00:16:14.408 --rc geninfo_all_blocks=1 00:16:14.408 --rc geninfo_unexecuted_blocks=1 00:16:14.408 00:16:14.408 ' 00:16:14.408 02:21:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:14.408 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:14.408 --rc genhtml_branch_coverage=1 00:16:14.408 --rc genhtml_function_coverage=1 00:16:14.408 --rc genhtml_legend=1 00:16:14.408 --rc geninfo_all_blocks=1 00:16:14.408 --rc geninfo_unexecuted_blocks=1 00:16:14.408 00:16:14.408 ' 00:16:14.408 02:21:17 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:14.408 02:21:17 -- nvmf/common.sh@7 -- # uname -s 00:16:14.408 02:21:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:14.408 02:21:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:14.408 02:21:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:14.408 02:21:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:14.408 02:21:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:14.408 02:21:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:14.408 02:21:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:14.408 02:21:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:14.408 02:21:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:14.408 02:21:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:14.408 02:21:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:14.408 02:21:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:14.408 02:21:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:14.408 02:21:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:14.408 02:21:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:14.408 02:21:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:14.408 02:21:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:14.408 02:21:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:14.408 02:21:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:14.408 02:21:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:14.409 02:21:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:14.409 02:21:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:14.409 02:21:17 -- paths/export.sh@5 -- # export PATH 00:16:14.409 02:21:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:14.409 02:21:17 -- nvmf/common.sh@46 -- # : 0 00:16:14.409 02:21:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:14.409 02:21:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:14.409 02:21:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:14.409 02:21:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:14.409 02:21:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:14.409 02:21:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:14.409 02:21:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:14.409 02:21:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:14.409 02:21:17 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:14.409 02:21:17 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:14.409 02:21:17 -- target/nmic.sh@14 -- # nvmftestinit 00:16:14.409 02:21:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:14.409 02:21:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:14.409 02:21:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:14.409 02:21:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:14.409 02:21:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:14.409 02:21:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:14.409 02:21:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:14.409 02:21:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:14.409 02:21:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:14.409 02:21:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:14.409 02:21:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:14.409 02:21:17 -- common/autotest_common.sh@10 -- # set +x 00:16:16.949 02:21:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:16.949 02:21:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:16.949 02:21:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:16.949 02:21:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:16.949 02:21:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:16.949 02:21:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:16.949 02:21:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:16.949 02:21:20 -- nvmf/common.sh@294 -- # net_devs=() 00:16:16.949 02:21:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:16.949 02:21:20 -- nvmf/common.sh@295 -- # e810=() 00:16:16.949 02:21:20 -- nvmf/common.sh@295 -- # local -ga e810 00:16:16.949 02:21:20 -- nvmf/common.sh@296 -- # x722=() 00:16:16.949 02:21:20 -- nvmf/common.sh@296 -- # local -ga x722 00:16:16.949 02:21:20 -- nvmf/common.sh@297 -- # mlx=() 00:16:16.949 02:21:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:16.949 02:21:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:16.949 02:21:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:16.949 02:21:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:16.949 02:21:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:16.949 02:21:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:16.949 02:21:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:16.949 02:21:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:16.949 02:21:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:16.949 02:21:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:16.949 02:21:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:16.949 02:21:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:16.949 02:21:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:16.949 02:21:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:16.949 02:21:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:16.949 02:21:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:16.950 02:21:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:16.950 02:21:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:16.950 02:21:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:16.950 02:21:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:16.950 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:16.950 02:21:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:16.950 02:21:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:16.950 02:21:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:16.950 02:21:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:16.950 02:21:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:16.950 02:21:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:16.950 02:21:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:16.950 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:16.950 02:21:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:16.950 02:21:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:16.950 02:21:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:16.950 02:21:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:16.950 02:21:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:16.950 02:21:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:16.950 02:21:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:16.950 02:21:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:16.950 02:21:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:16.950 02:21:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:16.950 02:21:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:16.950 02:21:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:16.950 02:21:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:16.950 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:16.950 02:21:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:16.950 02:21:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:16.950 02:21:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:16.950 02:21:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:16.950 02:21:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:16.950 02:21:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:16.950 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:16.950 02:21:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:16.950 02:21:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:16.950 02:21:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:16.950 02:21:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:16.950 02:21:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:16.950 02:21:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:16.950 02:21:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:16.950 02:21:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:16.950 02:21:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:16.950 02:21:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:16.950 02:21:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:16.950 02:21:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:16.950 02:21:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:16.950 02:21:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:16.950 02:21:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:16.950 02:21:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:16.950 02:21:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:16.950 02:21:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:16.950 02:21:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:16.950 02:21:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:16.950 02:21:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:16.950 02:21:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:16.950 02:21:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:16.950 02:21:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:16.950 02:21:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:16.950 02:21:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:16.950 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:16.950 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.314 ms 00:16:16.950 00:16:16.950 --- 10.0.0.2 ping statistics --- 00:16:16.950 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:16.950 rtt min/avg/max/mdev = 0.314/0.314/0.314/0.000 ms 00:16:16.950 02:21:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:16.950 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:16.950 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.155 ms 00:16:16.950 00:16:16.950 --- 10.0.0.1 ping statistics --- 00:16:16.950 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:16.950 rtt min/avg/max/mdev = 0.155/0.155/0.155/0.000 ms 00:16:16.950 02:21:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:16.950 02:21:20 -- nvmf/common.sh@410 -- # return 0 00:16:16.950 02:21:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:16.950 02:21:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:16.950 02:21:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:16.950 02:21:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:16.950 02:21:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:16.950 02:21:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:16.950 02:21:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:16.950 02:21:20 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:16:16.950 02:21:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:16.950 02:21:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:16.950 02:21:20 -- common/autotest_common.sh@10 -- # set +x 00:16:16.950 02:21:20 -- nvmf/common.sh@469 -- # nvmfpid=119018 00:16:16.950 02:21:20 -- nvmf/common.sh@470 -- # waitforlisten 119018 00:16:16.950 02:21:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:16.950 02:21:20 -- common/autotest_common.sh@829 -- # '[' -z 119018 ']' 00:16:16.950 02:21:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:16.950 02:21:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:16.950 02:21:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:16.950 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:16.950 02:21:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:16.950 02:21:20 -- common/autotest_common.sh@10 -- # set +x 00:16:16.950 [2024-11-29 02:21:20.229765] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:16.950 [2024-11-29 02:21:20.229856] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:16.950 EAL: No free 2048 kB hugepages reported on node 1 00:16:16.950 [2024-11-29 02:21:20.311861] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:16.950 [2024-11-29 02:21:20.435918] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:16.950 [2024-11-29 02:21:20.436077] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:16.950 [2024-11-29 02:21:20.436096] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:16.950 [2024-11-29 02:21:20.436111] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:16.950 [2024-11-29 02:21:20.436170] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:16.950 [2024-11-29 02:21:20.436203] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:16.950 [2024-11-29 02:21:20.436255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:16.950 [2024-11-29 02:21:20.436258] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:17.948 02:21:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:17.948 02:21:21 -- common/autotest_common.sh@862 -- # return 0 00:16:17.948 02:21:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:17.948 02:21:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:17.948 02:21:21 -- common/autotest_common.sh@10 -- # set +x 00:16:17.948 02:21:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:17.948 02:21:21 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:17.948 02:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:17.948 02:21:21 -- common/autotest_common.sh@10 -- # set +x 00:16:17.948 [2024-11-29 02:21:21.257057] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:17.948 02:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:17.948 02:21:21 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:17.948 02:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:17.948 02:21:21 -- common/autotest_common.sh@10 -- # set +x 00:16:17.948 Malloc0 00:16:17.948 02:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:17.948 02:21:21 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:17.948 02:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:17.948 02:21:21 -- common/autotest_common.sh@10 -- # set +x 00:16:17.948 02:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:17.948 02:21:21 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:17.948 02:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:17.948 02:21:21 -- common/autotest_common.sh@10 -- # set +x 00:16:17.948 02:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:17.948 02:21:21 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:17.948 02:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:17.948 02:21:21 -- common/autotest_common.sh@10 -- # set +x 00:16:17.948 [2024-11-29 02:21:21.310696] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:17.948 02:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:17.948 02:21:21 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:16:17.948 test case1: single bdev can't be used in multiple subsystems 00:16:17.948 02:21:21 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:16:17.948 02:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:17.948 02:21:21 -- common/autotest_common.sh@10 -- # set +x 00:16:17.948 02:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:17.948 02:21:21 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:16:17.948 02:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:17.948 02:21:21 -- common/autotest_common.sh@10 -- # set +x 00:16:17.948 02:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:17.948 02:21:21 -- target/nmic.sh@28 -- # nmic_status=0 00:16:17.948 02:21:21 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:16:17.948 02:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:17.948 02:21:21 -- common/autotest_common.sh@10 -- # set +x 00:16:17.948 [2024-11-29 02:21:21.334513] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:16:17.948 [2024-11-29 02:21:21.334544] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:16:17.948 [2024-11-29 02:21:21.334560] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.948 request: 00:16:17.948 { 00:16:17.948 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:16:17.948 "namespace": { 00:16:17.948 "bdev_name": "Malloc0" 00:16:17.948 }, 00:16:17.948 "method": "nvmf_subsystem_add_ns", 00:16:17.948 "req_id": 1 00:16:17.948 } 00:16:17.948 Got JSON-RPC error response 00:16:17.948 response: 00:16:17.948 { 00:16:17.948 "code": -32602, 00:16:17.948 "message": "Invalid parameters" 00:16:17.948 } 00:16:17.948 02:21:21 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:16:17.948 02:21:21 -- target/nmic.sh@29 -- # nmic_status=1 00:16:17.948 02:21:21 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:16:17.948 02:21:21 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:16:17.948 Adding namespace failed - expected result. 00:16:17.948 02:21:21 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:16:17.948 test case2: host connect to nvmf target in multiple paths 00:16:17.948 02:21:21 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:16:17.948 02:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:17.948 02:21:21 -- common/autotest_common.sh@10 -- # set +x 00:16:17.948 [2024-11-29 02:21:21.342634] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:16:17.948 02:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:17.948 02:21:21 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:18.516 02:21:21 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:16:19.085 02:21:22 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:16:19.085 02:21:22 -- common/autotest_common.sh@1187 -- # local i=0 00:16:19.085 02:21:22 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:19.085 02:21:22 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:16:19.085 02:21:22 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:20.997 02:21:24 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:20.997 02:21:24 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:20.997 02:21:24 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:20.997 02:21:24 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:16:20.997 02:21:24 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:20.997 02:21:24 -- common/autotest_common.sh@1197 -- # return 0 00:16:20.997 02:21:24 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:20.997 [global] 00:16:20.997 thread=1 00:16:20.997 invalidate=1 00:16:20.997 rw=write 00:16:20.997 time_based=1 00:16:20.997 runtime=1 00:16:20.997 ioengine=libaio 00:16:20.997 direct=1 00:16:20.997 bs=4096 00:16:20.998 iodepth=1 00:16:20.998 norandommap=0 00:16:20.998 numjobs=1 00:16:20.998 00:16:20.998 verify_dump=1 00:16:20.998 verify_backlog=512 00:16:20.998 verify_state_save=0 00:16:20.998 do_verify=1 00:16:20.998 verify=crc32c-intel 00:16:20.998 [job0] 00:16:20.998 filename=/dev/nvme0n1 00:16:20.998 Could not set queue depth (nvme0n1) 00:16:21.255 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:21.255 fio-3.35 00:16:21.255 Starting 1 thread 00:16:22.638 00:16:22.638 job0: (groupid=0, jobs=1): err= 0: pid=119683: Fri Nov 29 02:21:25 2024 00:16:22.638 read: IOPS=2253, BW=9015KiB/s (9231kB/s)(9024KiB/1001msec) 00:16:22.638 slat (nsec): min=4541, max=55516, avg=11448.59, stdev=6584.08 00:16:22.638 clat (usec): min=171, max=981, avg=227.44, stdev=63.45 00:16:22.638 lat (usec): min=178, max=988, avg=238.89, stdev=65.29 00:16:22.638 clat percentiles (usec): 00:16:22.638 | 1.00th=[ 182], 5.00th=[ 190], 10.00th=[ 192], 20.00th=[ 196], 00:16:22.638 | 30.00th=[ 200], 40.00th=[ 202], 50.00th=[ 206], 60.00th=[ 208], 00:16:22.638 | 70.00th=[ 215], 80.00th=[ 245], 90.00th=[ 285], 95.00th=[ 363], 00:16:22.638 | 99.00th=[ 519], 99.50th=[ 545], 99.90th=[ 611], 99.95th=[ 619], 00:16:22.638 | 99.99th=[ 979] 00:16:22.638 write: IOPS=2557, BW=9.99MiB/s (10.5MB/s)(10.0MiB/1001msec); 0 zone resets 00:16:22.638 slat (usec): min=6, max=29472, avg=24.25, stdev=582.28 00:16:22.638 clat (usec): min=123, max=3781, avg=149.57, stdev=72.69 00:16:22.638 lat (usec): min=130, max=29690, avg=173.82, stdev=588.13 00:16:22.638 clat percentiles (usec): 00:16:22.638 | 1.00th=[ 130], 5.00th=[ 135], 10.00th=[ 137], 20.00th=[ 141], 00:16:22.638 | 30.00th=[ 143], 40.00th=[ 145], 50.00th=[ 147], 60.00th=[ 149], 00:16:22.638 | 70.00th=[ 153], 80.00th=[ 155], 90.00th=[ 161], 95.00th=[ 165], 00:16:22.638 | 99.00th=[ 188], 99.50th=[ 204], 99.90th=[ 239], 99.95th=[ 258], 00:16:22.638 | 99.99th=[ 3785] 00:16:22.638 bw ( KiB/s): min=10928, max=10928, per=100.00%, avg=10928.00, stdev= 0.00, samples=1 00:16:22.638 iops : min= 2732, max= 2732, avg=2732.00, stdev= 0.00, samples=1 00:16:22.638 lat (usec) : 250=91.13%, 500=8.28%, 750=0.54%, 1000=0.02% 00:16:22.638 lat (msec) : 4=0.02% 00:16:22.638 cpu : usr=2.90%, sys=6.40%, ctx=4819, majf=0, minf=1 00:16:22.638 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:22.638 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:22.638 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:22.638 issued rwts: total=2256,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:22.638 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:22.638 00:16:22.639 Run status group 0 (all jobs): 00:16:22.639 READ: bw=9015KiB/s (9231kB/s), 9015KiB/s-9015KiB/s (9231kB/s-9231kB/s), io=9024KiB (9241kB), run=1001-1001msec 00:16:22.639 WRITE: bw=9.99MiB/s (10.5MB/s), 9.99MiB/s-9.99MiB/s (10.5MB/s-10.5MB/s), io=10.0MiB (10.5MB), run=1001-1001msec 00:16:22.639 00:16:22.639 Disk stats (read/write): 00:16:22.639 nvme0n1: ios=2073/2267, merge=0/0, ticks=1393/326, in_queue=1719, util=98.70% 00:16:22.639 02:21:25 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:22.639 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:16:22.639 02:21:26 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:22.639 02:21:26 -- common/autotest_common.sh@1208 -- # local i=0 00:16:22.639 02:21:26 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:22.639 02:21:26 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:22.639 02:21:26 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:22.639 02:21:26 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:22.639 02:21:26 -- common/autotest_common.sh@1220 -- # return 0 00:16:22.639 02:21:26 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:16:22.639 02:21:26 -- target/nmic.sh@53 -- # nvmftestfini 00:16:22.639 02:21:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:22.639 02:21:26 -- nvmf/common.sh@116 -- # sync 00:16:22.639 02:21:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:22.639 02:21:26 -- nvmf/common.sh@119 -- # set +e 00:16:22.639 02:21:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:22.639 02:21:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:22.639 rmmod nvme_tcp 00:16:22.639 rmmod nvme_fabrics 00:16:22.639 rmmod nvme_keyring 00:16:22.639 02:21:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:22.639 02:21:26 -- nvmf/common.sh@123 -- # set -e 00:16:22.639 02:21:26 -- nvmf/common.sh@124 -- # return 0 00:16:22.639 02:21:26 -- nvmf/common.sh@477 -- # '[' -n 119018 ']' 00:16:22.639 02:21:26 -- nvmf/common.sh@478 -- # killprocess 119018 00:16:22.639 02:21:26 -- common/autotest_common.sh@936 -- # '[' -z 119018 ']' 00:16:22.639 02:21:26 -- common/autotest_common.sh@940 -- # kill -0 119018 00:16:22.639 02:21:26 -- common/autotest_common.sh@941 -- # uname 00:16:22.639 02:21:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:22.639 02:21:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 119018 00:16:22.639 02:21:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:22.639 02:21:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:22.639 02:21:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 119018' 00:16:22.639 killing process with pid 119018 00:16:22.639 02:21:26 -- common/autotest_common.sh@955 -- # kill 119018 00:16:22.639 02:21:26 -- common/autotest_common.sh@960 -- # wait 119018 00:16:22.898 02:21:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:22.898 02:21:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:22.898 02:21:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:22.898 02:21:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:22.898 02:21:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:22.898 02:21:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:22.898 02:21:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:22.898 02:21:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:25.441 02:21:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:25.441 00:16:25.441 real 0m10.733s 00:16:25.441 user 0m25.128s 00:16:25.441 sys 0m2.587s 00:16:25.441 02:21:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:25.441 02:21:28 -- common/autotest_common.sh@10 -- # set +x 00:16:25.441 ************************************ 00:16:25.441 END TEST nvmf_nmic 00:16:25.441 ************************************ 00:16:25.441 02:21:28 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:25.441 02:21:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:25.441 02:21:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:25.441 02:21:28 -- common/autotest_common.sh@10 -- # set +x 00:16:25.441 ************************************ 00:16:25.441 START TEST nvmf_fio_target 00:16:25.441 ************************************ 00:16:25.441 02:21:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:25.441 * Looking for test storage... 00:16:25.441 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:25.441 02:21:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:25.441 02:21:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:25.441 02:21:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:25.441 02:21:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:25.441 02:21:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:25.441 02:21:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:25.441 02:21:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:25.441 02:21:28 -- scripts/common.sh@335 -- # IFS=.-: 00:16:25.441 02:21:28 -- scripts/common.sh@335 -- # read -ra ver1 00:16:25.441 02:21:28 -- scripts/common.sh@336 -- # IFS=.-: 00:16:25.441 02:21:28 -- scripts/common.sh@336 -- # read -ra ver2 00:16:25.441 02:21:28 -- scripts/common.sh@337 -- # local 'op=<' 00:16:25.441 02:21:28 -- scripts/common.sh@339 -- # ver1_l=2 00:16:25.441 02:21:28 -- scripts/common.sh@340 -- # ver2_l=1 00:16:25.441 02:21:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:25.441 02:21:28 -- scripts/common.sh@343 -- # case "$op" in 00:16:25.441 02:21:28 -- scripts/common.sh@344 -- # : 1 00:16:25.441 02:21:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:25.441 02:21:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:25.441 02:21:28 -- scripts/common.sh@364 -- # decimal 1 00:16:25.441 02:21:28 -- scripts/common.sh@352 -- # local d=1 00:16:25.441 02:21:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:25.441 02:21:28 -- scripts/common.sh@354 -- # echo 1 00:16:25.441 02:21:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:25.441 02:21:28 -- scripts/common.sh@365 -- # decimal 2 00:16:25.441 02:21:28 -- scripts/common.sh@352 -- # local d=2 00:16:25.441 02:21:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:25.441 02:21:28 -- scripts/common.sh@354 -- # echo 2 00:16:25.441 02:21:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:25.441 02:21:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:25.441 02:21:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:25.441 02:21:28 -- scripts/common.sh@367 -- # return 0 00:16:25.441 02:21:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:25.441 02:21:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:25.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:25.441 --rc genhtml_branch_coverage=1 00:16:25.441 --rc genhtml_function_coverage=1 00:16:25.441 --rc genhtml_legend=1 00:16:25.441 --rc geninfo_all_blocks=1 00:16:25.441 --rc geninfo_unexecuted_blocks=1 00:16:25.441 00:16:25.441 ' 00:16:25.441 02:21:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:25.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:25.441 --rc genhtml_branch_coverage=1 00:16:25.441 --rc genhtml_function_coverage=1 00:16:25.441 --rc genhtml_legend=1 00:16:25.441 --rc geninfo_all_blocks=1 00:16:25.441 --rc geninfo_unexecuted_blocks=1 00:16:25.441 00:16:25.441 ' 00:16:25.441 02:21:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:25.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:25.441 --rc genhtml_branch_coverage=1 00:16:25.441 --rc genhtml_function_coverage=1 00:16:25.441 --rc genhtml_legend=1 00:16:25.441 --rc geninfo_all_blocks=1 00:16:25.441 --rc geninfo_unexecuted_blocks=1 00:16:25.441 00:16:25.441 ' 00:16:25.441 02:21:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:25.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:25.441 --rc genhtml_branch_coverage=1 00:16:25.441 --rc genhtml_function_coverage=1 00:16:25.441 --rc genhtml_legend=1 00:16:25.441 --rc geninfo_all_blocks=1 00:16:25.441 --rc geninfo_unexecuted_blocks=1 00:16:25.441 00:16:25.441 ' 00:16:25.441 02:21:28 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:25.441 02:21:28 -- nvmf/common.sh@7 -- # uname -s 00:16:25.441 02:21:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:25.441 02:21:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:25.441 02:21:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:25.441 02:21:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:25.441 02:21:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:25.441 02:21:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:25.441 02:21:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:25.441 02:21:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:25.441 02:21:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:25.441 02:21:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:25.441 02:21:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:25.441 02:21:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:25.441 02:21:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:25.441 02:21:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:25.441 02:21:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:25.441 02:21:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:25.441 02:21:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:25.441 02:21:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:25.441 02:21:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:25.441 02:21:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:25.441 02:21:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:25.441 02:21:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:25.441 02:21:28 -- paths/export.sh@5 -- # export PATH 00:16:25.441 02:21:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:25.441 02:21:28 -- nvmf/common.sh@46 -- # : 0 00:16:25.441 02:21:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:25.441 02:21:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:25.441 02:21:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:25.441 02:21:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:25.441 02:21:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:25.441 02:21:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:25.441 02:21:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:25.441 02:21:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:25.441 02:21:28 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:25.441 02:21:28 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:25.441 02:21:28 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:25.441 02:21:28 -- target/fio.sh@16 -- # nvmftestinit 00:16:25.441 02:21:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:25.441 02:21:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:25.441 02:21:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:25.441 02:21:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:25.441 02:21:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:25.441 02:21:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:25.441 02:21:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:25.441 02:21:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:25.441 02:21:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:25.441 02:21:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:25.441 02:21:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:25.442 02:21:28 -- common/autotest_common.sh@10 -- # set +x 00:16:27.354 02:21:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:27.354 02:21:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:27.354 02:21:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:27.354 02:21:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:27.355 02:21:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:27.355 02:21:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:27.355 02:21:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:27.355 02:21:30 -- nvmf/common.sh@294 -- # net_devs=() 00:16:27.355 02:21:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:27.355 02:21:30 -- nvmf/common.sh@295 -- # e810=() 00:16:27.355 02:21:30 -- nvmf/common.sh@295 -- # local -ga e810 00:16:27.355 02:21:30 -- nvmf/common.sh@296 -- # x722=() 00:16:27.355 02:21:30 -- nvmf/common.sh@296 -- # local -ga x722 00:16:27.355 02:21:30 -- nvmf/common.sh@297 -- # mlx=() 00:16:27.355 02:21:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:27.355 02:21:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:27.355 02:21:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:27.355 02:21:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:27.355 02:21:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:27.355 02:21:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:27.355 02:21:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:27.355 02:21:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:27.355 02:21:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:27.355 02:21:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:27.355 02:21:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:27.355 02:21:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:27.355 02:21:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:27.355 02:21:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:27.355 02:21:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:27.355 02:21:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:27.355 02:21:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:27.355 02:21:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:27.355 02:21:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:27.355 02:21:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:27.355 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:27.355 02:21:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:27.355 02:21:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:27.355 02:21:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:27.355 02:21:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:27.355 02:21:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:27.355 02:21:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:27.355 02:21:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:27.355 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:27.355 02:21:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:27.355 02:21:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:27.355 02:21:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:27.355 02:21:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:27.355 02:21:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:27.355 02:21:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:27.355 02:21:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:27.355 02:21:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:27.355 02:21:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:27.355 02:21:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:27.355 02:21:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:27.355 02:21:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:27.355 02:21:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:27.355 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:27.355 02:21:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:27.355 02:21:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:27.355 02:21:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:27.355 02:21:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:27.355 02:21:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:27.355 02:21:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:27.355 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:27.355 02:21:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:27.355 02:21:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:27.355 02:21:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:27.355 02:21:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:27.355 02:21:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:27.355 02:21:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:27.355 02:21:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:27.355 02:21:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:27.355 02:21:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:27.355 02:21:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:27.355 02:21:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:27.355 02:21:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:27.355 02:21:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:27.355 02:21:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:27.355 02:21:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:27.355 02:21:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:27.355 02:21:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:27.355 02:21:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:27.355 02:21:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:27.355 02:21:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:27.355 02:21:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:27.355 02:21:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:27.355 02:21:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:27.355 02:21:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:27.355 02:21:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:27.355 02:21:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:27.355 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:27.355 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.223 ms 00:16:27.355 00:16:27.355 --- 10.0.0.2 ping statistics --- 00:16:27.355 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:27.355 rtt min/avg/max/mdev = 0.223/0.223/0.223/0.000 ms 00:16:27.355 02:21:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:27.355 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:27.355 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.092 ms 00:16:27.355 00:16:27.355 --- 10.0.0.1 ping statistics --- 00:16:27.355 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:27.355 rtt min/avg/max/mdev = 0.092/0.092/0.092/0.000 ms 00:16:27.355 02:21:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:27.355 02:21:30 -- nvmf/common.sh@410 -- # return 0 00:16:27.355 02:21:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:27.355 02:21:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:27.355 02:21:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:27.355 02:21:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:27.355 02:21:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:27.355 02:21:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:27.355 02:21:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:27.355 02:21:30 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:16:27.355 02:21:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:27.355 02:21:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:27.355 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:16:27.355 02:21:30 -- nvmf/common.sh@469 -- # nvmfpid=121900 00:16:27.355 02:21:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:27.355 02:21:30 -- nvmf/common.sh@470 -- # waitforlisten 121900 00:16:27.355 02:21:30 -- common/autotest_common.sh@829 -- # '[' -z 121900 ']' 00:16:27.355 02:21:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:27.355 02:21:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:27.355 02:21:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:27.355 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:27.355 02:21:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:27.355 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:16:27.355 [2024-11-29 02:21:30.878320] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:27.355 [2024-11-29 02:21:30.878427] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:27.355 EAL: No free 2048 kB hugepages reported on node 1 00:16:27.355 [2024-11-29 02:21:30.945165] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:27.614 [2024-11-29 02:21:31.052730] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:27.614 [2024-11-29 02:21:31.052887] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:27.614 [2024-11-29 02:21:31.052920] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:27.614 [2024-11-29 02:21:31.052932] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:27.614 [2024-11-29 02:21:31.052992] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:27.614 [2024-11-29 02:21:31.053053] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:27.614 [2024-11-29 02:21:31.053101] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:27.614 [2024-11-29 02:21:31.053103] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:28.554 02:21:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:28.554 02:21:31 -- common/autotest_common.sh@862 -- # return 0 00:16:28.554 02:21:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:28.554 02:21:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:28.554 02:21:31 -- common/autotest_common.sh@10 -- # set +x 00:16:28.554 02:21:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:28.554 02:21:31 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:28.554 [2024-11-29 02:21:32.148909] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:28.554 02:21:32 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:28.813 02:21:32 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:16:28.813 02:21:32 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:29.072 02:21:32 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:16:29.072 02:21:32 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:29.331 02:21:32 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:16:29.331 02:21:32 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:29.902 02:21:33 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:16:29.902 02:21:33 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:16:29.902 02:21:33 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:30.160 02:21:33 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:16:30.160 02:21:33 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:30.417 02:21:34 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:16:30.417 02:21:34 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:30.675 02:21:34 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:16:30.675 02:21:34 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:16:30.933 02:21:34 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:31.192 02:21:34 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:31.192 02:21:34 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:31.451 02:21:35 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:31.451 02:21:35 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:31.709 02:21:35 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:31.966 [2024-11-29 02:21:35.580532] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:31.966 02:21:35 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:16:32.225 02:21:35 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:16:32.484 02:21:36 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:33.422 02:21:36 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:16:33.422 02:21:36 -- common/autotest_common.sh@1187 -- # local i=0 00:16:33.422 02:21:36 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:33.422 02:21:36 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:16:33.422 02:21:36 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:16:33.422 02:21:36 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:35.338 02:21:38 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:35.338 02:21:38 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:35.338 02:21:38 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:35.338 02:21:38 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:16:35.338 02:21:38 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:35.338 02:21:38 -- common/autotest_common.sh@1197 -- # return 0 00:16:35.338 02:21:38 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:35.338 [global] 00:16:35.338 thread=1 00:16:35.338 invalidate=1 00:16:35.338 rw=write 00:16:35.338 time_based=1 00:16:35.338 runtime=1 00:16:35.338 ioengine=libaio 00:16:35.338 direct=1 00:16:35.338 bs=4096 00:16:35.338 iodepth=1 00:16:35.338 norandommap=0 00:16:35.338 numjobs=1 00:16:35.338 00:16:35.338 verify_dump=1 00:16:35.338 verify_backlog=512 00:16:35.338 verify_state_save=0 00:16:35.338 do_verify=1 00:16:35.338 verify=crc32c-intel 00:16:35.338 [job0] 00:16:35.338 filename=/dev/nvme0n1 00:16:35.338 [job1] 00:16:35.338 filename=/dev/nvme0n2 00:16:35.338 [job2] 00:16:35.338 filename=/dev/nvme0n3 00:16:35.338 [job3] 00:16:35.338 filename=/dev/nvme0n4 00:16:35.338 Could not set queue depth (nvme0n1) 00:16:35.338 Could not set queue depth (nvme0n2) 00:16:35.338 Could not set queue depth (nvme0n3) 00:16:35.338 Could not set queue depth (nvme0n4) 00:16:35.597 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:35.597 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:35.597 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:35.597 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:35.597 fio-3.35 00:16:35.597 Starting 4 threads 00:16:36.973 00:16:36.973 job0: (groupid=0, jobs=1): err= 0: pid=123012: Fri Nov 29 02:21:40 2024 00:16:36.973 read: IOPS=21, BW=87.7KiB/s (89.8kB/s)(88.0KiB/1003msec) 00:16:36.973 slat (nsec): min=6926, max=28080, avg=13981.23, stdev=3795.45 00:16:36.973 clat (usec): min=19743, max=41062, avg=40004.74, stdev=4525.74 00:16:36.973 lat (usec): min=19755, max=41079, avg=40018.72, stdev=4526.18 00:16:36.973 clat percentiles (usec): 00:16:36.973 | 1.00th=[19792], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:16:36.973 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:36.973 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:36.973 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:36.973 | 99.99th=[41157] 00:16:36.973 write: IOPS=510, BW=2042KiB/s (2091kB/s)(2048KiB/1003msec); 0 zone resets 00:16:36.973 slat (nsec): min=7385, max=56983, avg=15557.82, stdev=7664.20 00:16:36.973 clat (usec): min=150, max=480, avg=215.73, stdev=42.34 00:16:36.973 lat (usec): min=159, max=500, avg=231.29, stdev=43.71 00:16:36.973 clat percentiles (usec): 00:16:36.973 | 1.00th=[ 159], 5.00th=[ 169], 10.00th=[ 176], 20.00th=[ 186], 00:16:36.973 | 30.00th=[ 196], 40.00th=[ 204], 50.00th=[ 208], 60.00th=[ 215], 00:16:36.973 | 70.00th=[ 227], 80.00th=[ 237], 90.00th=[ 249], 95.00th=[ 269], 00:16:36.973 | 99.00th=[ 412], 99.50th=[ 441], 99.90th=[ 482], 99.95th=[ 482], 00:16:36.973 | 99.99th=[ 482] 00:16:36.973 bw ( KiB/s): min= 4096, max= 4096, per=20.50%, avg=4096.00, stdev= 0.00, samples=1 00:16:36.973 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:36.973 lat (usec) : 250=86.33%, 500=9.55% 00:16:36.973 lat (msec) : 20=0.19%, 50=3.93% 00:16:36.973 cpu : usr=0.60%, sys=1.00%, ctx=536, majf=0, minf=1 00:16:36.973 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:36.973 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:36.973 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:36.973 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:36.973 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:36.973 job1: (groupid=0, jobs=1): err= 0: pid=123013: Fri Nov 29 02:21:40 2024 00:16:36.973 read: IOPS=1537, BW=6152KiB/s (6299kB/s)(6164KiB/1002msec) 00:16:36.973 slat (nsec): min=5395, max=52536, avg=8046.98, stdev=4368.48 00:16:36.973 clat (usec): min=174, max=42990, avg=392.15, stdev=2344.71 00:16:36.973 lat (usec): min=180, max=43012, avg=400.20, stdev=2345.13 00:16:36.973 clat percentiles (usec): 00:16:36.973 | 1.00th=[ 182], 5.00th=[ 188], 10.00th=[ 192], 20.00th=[ 202], 00:16:36.973 | 30.00th=[ 223], 40.00th=[ 241], 50.00th=[ 249], 60.00th=[ 262], 00:16:36.973 | 70.00th=[ 277], 80.00th=[ 289], 90.00th=[ 318], 95.00th=[ 379], 00:16:36.973 | 99.00th=[ 486], 99.50th=[ 1045], 99.90th=[41157], 99.95th=[42730], 00:16:36.973 | 99.99th=[42730] 00:16:36.973 write: IOPS=2043, BW=8176KiB/s (8372kB/s)(8192KiB/1002msec); 0 zone resets 00:16:36.973 slat (usec): min=7, max=1057, avg=11.35, stdev=23.97 00:16:36.973 clat (usec): min=124, max=468, avg=171.35, stdev=40.49 00:16:36.973 lat (usec): min=131, max=1320, avg=182.70, stdev=50.37 00:16:36.973 clat percentiles (usec): 00:16:36.973 | 1.00th=[ 129], 5.00th=[ 133], 10.00th=[ 137], 20.00th=[ 141], 00:16:36.973 | 30.00th=[ 145], 40.00th=[ 149], 50.00th=[ 155], 60.00th=[ 161], 00:16:36.973 | 70.00th=[ 186], 80.00th=[ 208], 90.00th=[ 231], 95.00th=[ 247], 00:16:36.973 | 99.00th=[ 293], 99.50th=[ 326], 99.90th=[ 408], 99.95th=[ 429], 00:16:36.973 | 99.99th=[ 469] 00:16:36.973 bw ( KiB/s): min= 6800, max= 9584, per=41.00%, avg=8192.00, stdev=1968.59, samples=2 00:16:36.973 iops : min= 1700, max= 2396, avg=2048.00, stdev=492.15, samples=2 00:16:36.973 lat (usec) : 250=76.65%, 500=22.96%, 750=0.14% 00:16:36.973 lat (msec) : 2=0.11%, 50=0.14% 00:16:36.973 cpu : usr=2.20%, sys=4.90%, ctx=3591, majf=0, minf=1 00:16:36.973 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:36.973 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:36.973 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:36.973 issued rwts: total=1541,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:36.973 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:36.973 job2: (groupid=0, jobs=1): err= 0: pid=123014: Fri Nov 29 02:21:40 2024 00:16:36.973 read: IOPS=506, BW=2025KiB/s (2074kB/s)(2076KiB/1025msec) 00:16:36.973 slat (nsec): min=6044, max=53567, avg=10534.52, stdev=5361.62 00:16:36.973 clat (usec): min=210, max=41064, avg=1515.39, stdev=6823.81 00:16:36.973 lat (usec): min=216, max=41083, avg=1525.92, stdev=6824.57 00:16:36.973 clat percentiles (usec): 00:16:36.973 | 1.00th=[ 223], 5.00th=[ 247], 10.00th=[ 262], 20.00th=[ 273], 00:16:36.973 | 30.00th=[ 281], 40.00th=[ 285], 50.00th=[ 293], 60.00th=[ 297], 00:16:36.973 | 70.00th=[ 314], 80.00th=[ 334], 90.00th=[ 441], 95.00th=[ 816], 00:16:36.973 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:36.973 | 99.99th=[41157] 00:16:36.973 write: IOPS=999, BW=3996KiB/s (4092kB/s)(4096KiB/1025msec); 0 zone resets 00:16:36.973 slat (nsec): min=6419, max=60477, avg=14015.87, stdev=7603.55 00:16:36.973 clat (usec): min=136, max=476, avg=207.33, stdev=41.23 00:16:36.973 lat (usec): min=144, max=493, avg=221.35, stdev=43.07 00:16:36.973 clat percentiles (usec): 00:16:36.973 | 1.00th=[ 143], 5.00th=[ 151], 10.00th=[ 155], 20.00th=[ 167], 00:16:36.973 | 30.00th=[ 186], 40.00th=[ 198], 50.00th=[ 208], 60.00th=[ 215], 00:16:36.973 | 70.00th=[ 227], 80.00th=[ 239], 90.00th=[ 253], 95.00th=[ 273], 00:16:36.973 | 99.00th=[ 318], 99.50th=[ 396], 99.90th=[ 474], 99.95th=[ 478], 00:16:36.973 | 99.99th=[ 478] 00:16:36.973 bw ( KiB/s): min= 4096, max= 4096, per=20.50%, avg=4096.00, stdev= 0.00, samples=2 00:16:36.973 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=2 00:16:36.973 lat (usec) : 250=60.92%, 500=36.68%, 750=0.52%, 1000=0.65% 00:16:36.973 lat (msec) : 2=0.13%, 4=0.06%, 10=0.06%, 50=0.97% 00:16:36.973 cpu : usr=1.37%, sys=2.25%, ctx=1545, majf=0, minf=1 00:16:36.973 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:36.973 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:36.973 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:36.973 issued rwts: total=519,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:36.973 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:36.973 job3: (groupid=0, jobs=1): err= 0: pid=123015: Fri Nov 29 02:21:40 2024 00:16:36.973 read: IOPS=1031, BW=4127KiB/s (4226kB/s)(4148KiB/1005msec) 00:16:36.973 slat (nsec): min=4228, max=36123, avg=7711.33, stdev=7032.68 00:16:36.973 clat (usec): min=193, max=40998, avg=664.59, stdev=4024.28 00:16:36.973 lat (usec): min=205, max=41015, avg=672.30, stdev=4024.93 00:16:36.973 clat percentiles (usec): 00:16:36.973 | 1.00th=[ 208], 5.00th=[ 215], 10.00th=[ 217], 20.00th=[ 221], 00:16:36.973 | 30.00th=[ 227], 40.00th=[ 231], 50.00th=[ 237], 60.00th=[ 243], 00:16:36.973 | 70.00th=[ 249], 80.00th=[ 258], 90.00th=[ 293], 95.00th=[ 457], 00:16:36.973 | 99.00th=[20579], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:36.973 | 99.99th=[41157] 00:16:36.973 write: IOPS=1528, BW=6113KiB/s (6260kB/s)(6144KiB/1005msec); 0 zone resets 00:16:36.973 slat (nsec): min=5575, max=43757, avg=8780.20, stdev=4514.33 00:16:36.973 clat (usec): min=150, max=640, avg=186.83, stdev=28.69 00:16:36.973 lat (usec): min=157, max=653, avg=195.61, stdev=30.86 00:16:36.973 clat percentiles (usec): 00:16:36.973 | 1.00th=[ 157], 5.00th=[ 159], 10.00th=[ 163], 20.00th=[ 165], 00:16:36.973 | 30.00th=[ 169], 40.00th=[ 174], 50.00th=[ 178], 60.00th=[ 184], 00:16:36.973 | 70.00th=[ 194], 80.00th=[ 208], 90.00th=[ 227], 95.00th=[ 241], 00:16:36.973 | 99.00th=[ 269], 99.50th=[ 277], 99.90th=[ 334], 99.95th=[ 644], 00:16:36.973 | 99.99th=[ 644] 00:16:36.973 bw ( KiB/s): min= 3296, max= 8992, per=30.75%, avg=6144.00, stdev=4027.68, samples=2 00:16:36.973 iops : min= 824, max= 2248, avg=1536.00, stdev=1006.92, samples=2 00:16:36.973 lat (usec) : 250=86.94%, 500=12.55%, 750=0.08% 00:16:36.973 lat (msec) : 50=0.43% 00:16:36.973 cpu : usr=1.39%, sys=1.89%, ctx=2574, majf=0, minf=1 00:16:36.973 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:36.973 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:36.973 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:36.973 issued rwts: total=1037,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:36.973 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:36.973 00:16:36.973 Run status group 0 (all jobs): 00:16:36.973 READ: bw=11.9MiB/s (12.5MB/s), 87.7KiB/s-6152KiB/s (89.8kB/s-6299kB/s), io=12.2MiB (12.8MB), run=1002-1025msec 00:16:36.973 WRITE: bw=19.5MiB/s (20.5MB/s), 2042KiB/s-8176KiB/s (2091kB/s-8372kB/s), io=20.0MiB (21.0MB), run=1002-1025msec 00:16:36.973 00:16:36.973 Disk stats (read/write): 00:16:36.973 nvme0n1: ios=67/512, merge=0/0, ticks=723/103, in_queue=826, util=86.87% 00:16:36.973 nvme0n2: ios=1586/2048, merge=0/0, ticks=507/321, in_queue=828, util=89.84% 00:16:36.973 nvme0n3: ios=571/1024, merge=0/0, ticks=726/203, in_queue=929, util=93.65% 00:16:36.973 nvme0n4: ios=1089/1536, merge=0/0, ticks=576/279, in_queue=855, util=95.38% 00:16:36.973 02:21:40 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:16:36.973 [global] 00:16:36.973 thread=1 00:16:36.973 invalidate=1 00:16:36.973 rw=randwrite 00:16:36.973 time_based=1 00:16:36.973 runtime=1 00:16:36.973 ioengine=libaio 00:16:36.973 direct=1 00:16:36.973 bs=4096 00:16:36.973 iodepth=1 00:16:36.973 norandommap=0 00:16:36.973 numjobs=1 00:16:36.973 00:16:36.973 verify_dump=1 00:16:36.973 verify_backlog=512 00:16:36.973 verify_state_save=0 00:16:36.973 do_verify=1 00:16:36.973 verify=crc32c-intel 00:16:36.973 [job0] 00:16:36.973 filename=/dev/nvme0n1 00:16:36.973 [job1] 00:16:36.973 filename=/dev/nvme0n2 00:16:36.973 [job2] 00:16:36.973 filename=/dev/nvme0n3 00:16:36.973 [job3] 00:16:36.974 filename=/dev/nvme0n4 00:16:36.974 Could not set queue depth (nvme0n1) 00:16:36.974 Could not set queue depth (nvme0n2) 00:16:36.974 Could not set queue depth (nvme0n3) 00:16:36.974 Could not set queue depth (nvme0n4) 00:16:36.974 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:36.974 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:36.974 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:36.974 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:36.974 fio-3.35 00:16:36.974 Starting 4 threads 00:16:38.352 00:16:38.352 job0: (groupid=0, jobs=1): err= 0: pid=123245: Fri Nov 29 02:21:41 2024 00:16:38.352 read: IOPS=21, BW=86.8KiB/s (88.9kB/s)(88.0KiB/1014msec) 00:16:38.352 slat (nsec): min=14224, max=38925, avg=23141.27, stdev=9433.79 00:16:38.352 clat (usec): min=40924, max=42025, avg=41575.27, stdev=503.25 00:16:38.352 lat (usec): min=40941, max=42042, avg=41598.41, stdev=504.15 00:16:38.352 clat percentiles (usec): 00:16:38.352 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:38.352 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41681], 60.00th=[42206], 00:16:38.352 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:16:38.352 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:38.352 | 99.99th=[42206] 00:16:38.352 write: IOPS=504, BW=2020KiB/s (2068kB/s)(2048KiB/1014msec); 0 zone resets 00:16:38.352 slat (nsec): min=5953, max=55780, avg=13108.87, stdev=5850.94 00:16:38.352 clat (usec): min=144, max=506, avg=175.82, stdev=22.91 00:16:38.352 lat (usec): min=151, max=521, avg=188.93, stdev=23.41 00:16:38.352 clat percentiles (usec): 00:16:38.352 | 1.00th=[ 153], 5.00th=[ 159], 10.00th=[ 161], 20.00th=[ 163], 00:16:38.352 | 30.00th=[ 167], 40.00th=[ 169], 50.00th=[ 174], 60.00th=[ 176], 00:16:38.352 | 70.00th=[ 180], 80.00th=[ 184], 90.00th=[ 192], 95.00th=[ 200], 00:16:38.352 | 99.00th=[ 215], 99.50th=[ 306], 99.90th=[ 506], 99.95th=[ 506], 00:16:38.352 | 99.99th=[ 506] 00:16:38.352 bw ( KiB/s): min= 4096, max= 4096, per=41.56%, avg=4096.00, stdev= 0.00, samples=1 00:16:38.352 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:38.352 lat (usec) : 250=95.13%, 500=0.56%, 750=0.19% 00:16:38.352 lat (msec) : 50=4.12% 00:16:38.352 cpu : usr=0.30%, sys=0.69%, ctx=535, majf=0, minf=1 00:16:38.352 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:38.352 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.352 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.352 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:38.352 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:38.352 job1: (groupid=0, jobs=1): err= 0: pid=123252: Fri Nov 29 02:21:41 2024 00:16:38.352 read: IOPS=521, BW=2086KiB/s (2136kB/s)(2136KiB/1024msec) 00:16:38.352 slat (nsec): min=5946, max=49353, avg=12128.79, stdev=6295.21 00:16:38.352 clat (usec): min=196, max=41446, avg=1551.91, stdev=7175.94 00:16:38.352 lat (usec): min=208, max=41478, avg=1564.03, stdev=7177.83 00:16:38.352 clat percentiles (usec): 00:16:38.352 | 1.00th=[ 204], 5.00th=[ 215], 10.00th=[ 225], 20.00th=[ 231], 00:16:38.352 | 30.00th=[ 235], 40.00th=[ 239], 50.00th=[ 243], 60.00th=[ 247], 00:16:38.353 | 70.00th=[ 253], 80.00th=[ 260], 90.00th=[ 285], 95.00th=[ 465], 00:16:38.353 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41681], 99.95th=[41681], 00:16:38.353 | 99.99th=[41681] 00:16:38.353 write: IOPS=1000, BW=4000KiB/s (4096kB/s)(4096KiB/1024msec); 0 zone resets 00:16:38.353 slat (nsec): min=6231, max=49609, avg=12341.20, stdev=5136.29 00:16:38.353 clat (usec): min=129, max=323, avg=166.38, stdev=24.00 00:16:38.353 lat (usec): min=139, max=351, avg=178.72, stdev=25.66 00:16:38.353 clat percentiles (usec): 00:16:38.353 | 1.00th=[ 135], 5.00th=[ 137], 10.00th=[ 141], 20.00th=[ 145], 00:16:38.353 | 30.00th=[ 153], 40.00th=[ 159], 50.00th=[ 163], 60.00th=[ 169], 00:16:38.353 | 70.00th=[ 174], 80.00th=[ 182], 90.00th=[ 196], 95.00th=[ 210], 00:16:38.353 | 99.00th=[ 243], 99.50th=[ 251], 99.90th=[ 269], 99.95th=[ 322], 00:16:38.353 | 99.99th=[ 322] 00:16:38.353 bw ( KiB/s): min= 8192, max= 8192, per=83.12%, avg=8192.00, stdev= 0.00, samples=1 00:16:38.353 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:38.353 lat (usec) : 250=87.74%, 500=10.98%, 750=0.19% 00:16:38.353 lat (msec) : 50=1.09% 00:16:38.353 cpu : usr=0.98%, sys=1.96%, ctx=1559, majf=0, minf=1 00:16:38.353 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:38.353 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.353 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.353 issued rwts: total=534,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:38.353 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:38.353 job2: (groupid=0, jobs=1): err= 0: pid=123253: Fri Nov 29 02:21:41 2024 00:16:38.353 read: IOPS=92, BW=370KiB/s (379kB/s)(384KiB/1038msec) 00:16:38.353 slat (nsec): min=8580, max=44211, avg=20768.40, stdev=8029.36 00:16:38.353 clat (usec): min=322, max=41134, avg=9283.87, stdev=16819.21 00:16:38.353 lat (usec): min=359, max=41149, avg=9304.64, stdev=16820.43 00:16:38.353 clat percentiles (usec): 00:16:38.353 | 1.00th=[ 322], 5.00th=[ 375], 10.00th=[ 416], 20.00th=[ 429], 00:16:38.353 | 30.00th=[ 433], 40.00th=[ 437], 50.00th=[ 441], 60.00th=[ 445], 00:16:38.353 | 70.00th=[ 457], 80.00th=[40633], 90.00th=[41157], 95.00th=[41157], 00:16:38.353 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:38.353 | 99.99th=[41157] 00:16:38.353 write: IOPS=493, BW=1973KiB/s (2020kB/s)(2048KiB/1038msec); 0 zone resets 00:16:38.353 slat (nsec): min=7930, max=58083, avg=19575.37, stdev=8291.04 00:16:38.353 clat (usec): min=183, max=555, avg=256.19, stdev=40.22 00:16:38.353 lat (usec): min=204, max=580, avg=275.77, stdev=37.80 00:16:38.353 clat percentiles (usec): 00:16:38.353 | 1.00th=[ 192], 5.00th=[ 212], 10.00th=[ 219], 20.00th=[ 229], 00:16:38.353 | 30.00th=[ 237], 40.00th=[ 243], 50.00th=[ 249], 60.00th=[ 255], 00:16:38.353 | 70.00th=[ 265], 80.00th=[ 281], 90.00th=[ 297], 95.00th=[ 318], 00:16:38.353 | 99.00th=[ 400], 99.50th=[ 445], 99.90th=[ 553], 99.95th=[ 553], 00:16:38.353 | 99.99th=[ 553] 00:16:38.353 bw ( KiB/s): min= 4096, max= 4096, per=41.56%, avg=4096.00, stdev= 0.00, samples=1 00:16:38.353 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:38.353 lat (usec) : 250=43.91%, 500=52.47%, 750=0.16% 00:16:38.353 lat (msec) : 50=3.45% 00:16:38.353 cpu : usr=1.25%, sys=0.96%, ctx=609, majf=0, minf=2 00:16:38.353 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:38.353 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.353 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.353 issued rwts: total=96,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:38.353 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:38.353 job3: (groupid=0, jobs=1): err= 0: pid=123254: Fri Nov 29 02:21:41 2024 00:16:38.353 read: IOPS=21, BW=84.7KiB/s (86.7kB/s)(88.0KiB/1039msec) 00:16:38.353 slat (nsec): min=10688, max=37094, avg=22236.64, stdev=9114.63 00:16:38.353 clat (usec): min=40887, max=41258, avg=40984.91, stdev=72.78 00:16:38.353 lat (usec): min=40923, max=41269, avg=41007.15, stdev=68.69 00:16:38.353 clat percentiles (usec): 00:16:38.353 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:38.353 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:38.353 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:38.353 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:38.353 | 99.99th=[41157] 00:16:38.353 write: IOPS=492, BW=1971KiB/s (2018kB/s)(2048KiB/1039msec); 0 zone resets 00:16:38.353 slat (nsec): min=8287, max=59617, avg=21318.88, stdev=9260.63 00:16:38.353 clat (usec): min=149, max=629, avg=239.12, stdev=53.79 00:16:38.353 lat (usec): min=160, max=641, avg=260.44, stdev=53.13 00:16:38.353 clat percentiles (usec): 00:16:38.353 | 1.00th=[ 159], 5.00th=[ 169], 10.00th=[ 176], 20.00th=[ 186], 00:16:38.353 | 30.00th=[ 198], 40.00th=[ 229], 50.00th=[ 245], 60.00th=[ 253], 00:16:38.353 | 70.00th=[ 265], 80.00th=[ 277], 90.00th=[ 293], 95.00th=[ 326], 00:16:38.353 | 99.00th=[ 392], 99.50th=[ 412], 99.90th=[ 627], 99.95th=[ 627], 00:16:38.353 | 99.99th=[ 627] 00:16:38.353 bw ( KiB/s): min= 4096, max= 4096, per=41.56%, avg=4096.00, stdev= 0.00, samples=1 00:16:38.353 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:38.353 lat (usec) : 250=53.93%, 500=41.76%, 750=0.19% 00:16:38.353 lat (msec) : 50=4.12% 00:16:38.353 cpu : usr=0.58%, sys=1.25%, ctx=535, majf=0, minf=1 00:16:38.353 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:38.353 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.353 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.353 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:38.353 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:38.353 00:16:38.353 Run status group 0 (all jobs): 00:16:38.353 READ: bw=2595KiB/s (2657kB/s), 84.7KiB/s-2086KiB/s (86.7kB/s-2136kB/s), io=2696KiB (2761kB), run=1014-1039msec 00:16:38.353 WRITE: bw=9856KiB/s (10.1MB/s), 1971KiB/s-4000KiB/s (2018kB/s-4096kB/s), io=10.0MiB (10.5MB), run=1014-1039msec 00:16:38.353 00:16:38.353 Disk stats (read/write): 00:16:38.353 nvme0n1: ios=45/512, merge=0/0, ticks=1250/84, in_queue=1334, util=98.30% 00:16:38.353 nvme0n2: ios=560/1024, merge=0/0, ticks=1699/166, in_queue=1865, util=97.87% 00:16:38.353 nvme0n3: ios=115/512, merge=0/0, ticks=1671/125, in_queue=1796, util=98.23% 00:16:38.353 nvme0n4: ios=41/512, merge=0/0, ticks=1650/115, in_queue=1765, util=98.21% 00:16:38.353 02:21:41 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:16:38.353 [global] 00:16:38.353 thread=1 00:16:38.353 invalidate=1 00:16:38.353 rw=write 00:16:38.353 time_based=1 00:16:38.353 runtime=1 00:16:38.353 ioengine=libaio 00:16:38.353 direct=1 00:16:38.353 bs=4096 00:16:38.353 iodepth=128 00:16:38.353 norandommap=0 00:16:38.353 numjobs=1 00:16:38.353 00:16:38.353 verify_dump=1 00:16:38.353 verify_backlog=512 00:16:38.353 verify_state_save=0 00:16:38.353 do_verify=1 00:16:38.353 verify=crc32c-intel 00:16:38.353 [job0] 00:16:38.353 filename=/dev/nvme0n1 00:16:38.353 [job1] 00:16:38.353 filename=/dev/nvme0n2 00:16:38.353 [job2] 00:16:38.353 filename=/dev/nvme0n3 00:16:38.353 [job3] 00:16:38.353 filename=/dev/nvme0n4 00:16:38.353 Could not set queue depth (nvme0n1) 00:16:38.353 Could not set queue depth (nvme0n2) 00:16:38.353 Could not set queue depth (nvme0n3) 00:16:38.353 Could not set queue depth (nvme0n4) 00:16:38.353 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:38.353 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:38.353 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:38.353 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:38.353 fio-3.35 00:16:38.353 Starting 4 threads 00:16:39.734 00:16:39.734 job0: (groupid=0, jobs=1): err= 0: pid=123481: Fri Nov 29 02:21:43 2024 00:16:39.734 read: IOPS=3562, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1006msec) 00:16:39.734 slat (usec): min=3, max=11233, avg=143.43, stdev=801.67 00:16:39.734 clat (usec): min=10680, max=30045, avg=18820.20, stdev=3639.51 00:16:39.734 lat (usec): min=10691, max=30068, avg=18963.63, stdev=3700.46 00:16:39.734 clat percentiles (usec): 00:16:39.734 | 1.00th=[11207], 5.00th=[12649], 10.00th=[13566], 20.00th=[15401], 00:16:39.734 | 30.00th=[16581], 40.00th=[17957], 50.00th=[19006], 60.00th=[19792], 00:16:39.734 | 70.00th=[21365], 80.00th=[22152], 90.00th=[23200], 95.00th=[23987], 00:16:39.734 | 99.00th=[26870], 99.50th=[27919], 99.90th=[29754], 99.95th=[30016], 00:16:39.734 | 99.99th=[30016] 00:16:39.734 write: IOPS=3658, BW=14.3MiB/s (15.0MB/s)(14.4MiB/1006msec); 0 zone resets 00:16:39.734 slat (usec): min=4, max=8054, avg=121.68, stdev=662.66 00:16:39.734 clat (usec): min=2382, max=30476, avg=16237.14, stdev=4869.10 00:16:39.734 lat (usec): min=5551, max=30502, avg=16358.82, stdev=4916.83 00:16:39.734 clat percentiles (usec): 00:16:39.734 | 1.00th=[ 9503], 5.00th=[10159], 10.00th=[11469], 20.00th=[12125], 00:16:39.734 | 30.00th=[12649], 40.00th=[13566], 50.00th=[14615], 60.00th=[15401], 00:16:39.734 | 70.00th=[17957], 80.00th=[22676], 90.00th=[23725], 95.00th=[24249], 00:16:39.734 | 99.00th=[27132], 99.50th=[27657], 99.90th=[30540], 99.95th=[30540], 00:16:39.734 | 99.99th=[30540] 00:16:39.734 bw ( KiB/s): min=12808, max=15864, per=22.02%, avg=14336.00, stdev=2160.92, samples=2 00:16:39.734 iops : min= 3202, max= 3966, avg=3584.00, stdev=540.23, samples=2 00:16:39.734 lat (msec) : 4=0.01%, 10=1.75%, 20=65.47%, 50=32.76% 00:16:39.735 cpu : usr=4.18%, sys=9.35%, ctx=307, majf=0, minf=2 00:16:39.735 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:16:39.735 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:39.735 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:39.735 issued rwts: total=3584,3680,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:39.735 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:39.735 job1: (groupid=0, jobs=1): err= 0: pid=123482: Fri Nov 29 02:21:43 2024 00:16:39.735 read: IOPS=6125, BW=23.9MiB/s (25.1MB/s)(24.0MiB/1003msec) 00:16:39.735 slat (usec): min=2, max=9309, avg=67.49, stdev=502.72 00:16:39.735 clat (usec): min=3295, max=25982, avg=10092.48, stdev=2065.59 00:16:39.735 lat (usec): min=3301, max=25986, avg=10159.97, stdev=2100.55 00:16:39.735 clat percentiles (usec): 00:16:39.735 | 1.00th=[ 6325], 5.00th=[ 7570], 10.00th=[ 8225], 20.00th=[ 8717], 00:16:39.735 | 30.00th=[ 9110], 40.00th=[ 9372], 50.00th=[ 9634], 60.00th=[10028], 00:16:39.735 | 70.00th=[10683], 80.00th=[11207], 90.00th=[12649], 95.00th=[13960], 00:16:39.735 | 99.00th=[17957], 99.50th=[18744], 99.90th=[19530], 99.95th=[22414], 00:16:39.735 | 99.99th=[26084] 00:16:39.735 write: IOPS=6244, BW=24.4MiB/s (25.6MB/s)(24.5MiB/1003msec); 0 zone resets 00:16:39.735 slat (usec): min=3, max=21913, avg=73.69, stdev=554.87 00:16:39.735 clat (usec): min=1358, max=35572, avg=10001.83, stdev=2412.66 00:16:39.735 lat (usec): min=2750, max=35577, avg=10075.52, stdev=2454.73 00:16:39.735 clat percentiles (usec): 00:16:39.735 | 1.00th=[ 3752], 5.00th=[ 5800], 10.00th=[ 7439], 20.00th=[ 8717], 00:16:39.735 | 30.00th=[ 9503], 40.00th=[ 9765], 50.00th=[10028], 60.00th=[10683], 00:16:39.735 | 70.00th=[10945], 80.00th=[11207], 90.00th=[11731], 95.00th=[13042], 00:16:39.735 | 99.00th=[17433], 99.50th=[21627], 99.90th=[27395], 99.95th=[27395], 00:16:39.735 | 99.99th=[35390] 00:16:39.735 bw ( KiB/s): min=24576, max=24632, per=37.80%, avg=24604.00, stdev=39.60, samples=2 00:16:39.735 iops : min= 6144, max= 6158, avg=6151.00, stdev= 9.90, samples=2 00:16:39.735 lat (msec) : 2=0.01%, 4=0.96%, 10=53.07%, 20=45.65%, 50=0.31% 00:16:39.735 cpu : usr=4.59%, sys=9.18%, ctx=468, majf=0, minf=1 00:16:39.735 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:16:39.735 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:39.735 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:39.735 issued rwts: total=6144,6263,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:39.735 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:39.735 job2: (groupid=0, jobs=1): err= 0: pid=123484: Fri Nov 29 02:21:43 2024 00:16:39.735 read: IOPS=2035, BW=8143KiB/s (8339kB/s)(8192KiB/1006msec) 00:16:39.735 slat (usec): min=3, max=14815, avg=239.16, stdev=1119.55 00:16:39.735 clat (usec): min=18222, max=56797, avg=31435.82, stdev=9191.88 00:16:39.735 lat (usec): min=20400, max=56814, avg=31674.98, stdev=9196.39 00:16:39.735 clat percentiles (usec): 00:16:39.735 | 1.00th=[20317], 5.00th=[22414], 10.00th=[22938], 20.00th=[23462], 00:16:39.735 | 30.00th=[23987], 40.00th=[24511], 50.00th=[27657], 60.00th=[32113], 00:16:39.735 | 70.00th=[36963], 80.00th=[41157], 90.00th=[44827], 95.00th=[48497], 00:16:39.735 | 99.00th=[53740], 99.50th=[56361], 99.90th=[56886], 99.95th=[56886], 00:16:39.735 | 99.99th=[56886] 00:16:39.735 write: IOPS=2391, BW=9567KiB/s (9796kB/s)(9624KiB/1006msec); 0 zone resets 00:16:39.735 slat (usec): min=4, max=20834, avg=202.58, stdev=1101.30 00:16:39.735 clat (usec): min=301, max=44609, avg=24943.22, stdev=5153.81 00:16:39.735 lat (usec): min=6733, max=44630, avg=25145.80, stdev=5100.18 00:16:39.735 clat percentiles (usec): 00:16:39.735 | 1.00th=[ 6980], 5.00th=[19792], 10.00th=[21365], 20.00th=[21890], 00:16:39.735 | 30.00th=[22676], 40.00th=[23200], 50.00th=[23987], 60.00th=[25560], 00:16:39.735 | 70.00th=[26346], 80.00th=[27657], 90.00th=[30278], 95.00th=[33162], 00:16:39.735 | 99.00th=[43254], 99.50th=[44827], 99.90th=[44827], 99.95th=[44827], 00:16:39.735 | 99.99th=[44827] 00:16:39.735 bw ( KiB/s): min= 8192, max=10032, per=14.00%, avg=9112.00, stdev=1301.08, samples=2 00:16:39.735 iops : min= 2048, max= 2508, avg=2278.00, stdev=325.27, samples=2 00:16:39.735 lat (usec) : 500=0.02% 00:16:39.735 lat (msec) : 10=0.72%, 20=2.25%, 50=95.26%, 100=1.75% 00:16:39.735 cpu : usr=3.28%, sys=6.27%, ctx=198, majf=0, minf=1 00:16:39.735 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:16:39.735 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:39.735 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:39.735 issued rwts: total=2048,2406,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:39.735 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:39.735 job3: (groupid=0, jobs=1): err= 0: pid=123485: Fri Nov 29 02:21:43 2024 00:16:39.735 read: IOPS=4312, BW=16.8MiB/s (17.7MB/s)(17.6MiB/1042msec) 00:16:39.735 slat (usec): min=3, max=5087, avg=106.64, stdev=561.39 00:16:39.735 clat (usec): min=9562, max=55006, avg=15020.67, stdev=6041.98 00:16:39.735 lat (usec): min=9580, max=58632, avg=15127.31, stdev=6058.94 00:16:39.735 clat percentiles (usec): 00:16:39.735 | 1.00th=[10159], 5.00th=[11731], 10.00th=[12387], 20.00th=[13173], 00:16:39.735 | 30.00th=[13566], 40.00th=[13698], 50.00th=[13960], 60.00th=[14222], 00:16:39.735 | 70.00th=[14746], 80.00th=[15139], 90.00th=[15926], 95.00th=[17695], 00:16:39.735 | 99.00th=[49546], 99.50th=[52691], 99.90th=[54789], 99.95th=[54789], 00:16:39.735 | 99.99th=[54789] 00:16:39.735 write: IOPS=4422, BW=17.3MiB/s (18.1MB/s)(18.0MiB/1042msec); 0 zone resets 00:16:39.735 slat (usec): min=4, max=9316, avg=101.60, stdev=516.02 00:16:39.735 clat (usec): min=813, max=21861, avg=14037.55, stdev=1707.45 00:16:39.735 lat (usec): min=832, max=21880, avg=14139.15, stdev=1701.97 00:16:39.735 clat percentiles (usec): 00:16:39.735 | 1.00th=[10159], 5.00th=[10814], 10.00th=[11469], 20.00th=[13042], 00:16:39.735 | 30.00th=[13435], 40.00th=[13829], 50.00th=[14091], 60.00th=[14353], 00:16:39.735 | 70.00th=[14746], 80.00th=[15139], 90.00th=[15926], 95.00th=[16909], 00:16:39.735 | 99.00th=[18482], 99.50th=[18482], 99.90th=[19792], 99.95th=[20055], 00:16:39.735 | 99.99th=[21890] 00:16:39.735 bw ( KiB/s): min=18200, max=18664, per=28.32%, avg=18432.00, stdev=328.10, samples=2 00:16:39.735 iops : min= 4550, max= 4666, avg=4608.00, stdev=82.02, samples=2 00:16:39.735 lat (usec) : 1000=0.02% 00:16:39.735 lat (msec) : 10=0.66%, 20=97.87%, 50=0.99%, 100=0.46% 00:16:39.735 cpu : usr=7.11%, sys=10.09%, ctx=431, majf=0, minf=1 00:16:39.735 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:16:39.735 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:39.735 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:39.735 issued rwts: total=4494,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:39.735 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:39.735 00:16:39.735 Run status group 0 (all jobs): 00:16:39.735 READ: bw=61.0MiB/s (64.0MB/s), 8143KiB/s-23.9MiB/s (8339kB/s-25.1MB/s), io=63.6MiB (66.6MB), run=1003-1042msec 00:16:39.735 WRITE: bw=63.6MiB/s (66.7MB/s), 9567KiB/s-24.4MiB/s (9796kB/s-25.6MB/s), io=66.2MiB (69.5MB), run=1003-1042msec 00:16:39.735 00:16:39.735 Disk stats (read/write): 00:16:39.735 nvme0n1: ios=2976/3072, merge=0/0, ticks=27653/23918, in_queue=51571, util=97.39% 00:16:39.735 nvme0n2: ios=5147/5471, merge=0/0, ticks=44858/41007, in_queue=85865, util=98.38% 00:16:39.735 nvme0n3: ios=1816/2048, merge=0/0, ticks=13812/11848, in_queue=25660, util=98.23% 00:16:39.735 nvme0n4: ios=3641/4096, merge=0/0, ticks=16690/18156, in_queue=34846, util=98.32% 00:16:39.735 02:21:43 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:16:39.735 [global] 00:16:39.735 thread=1 00:16:39.735 invalidate=1 00:16:39.735 rw=randwrite 00:16:39.735 time_based=1 00:16:39.735 runtime=1 00:16:39.735 ioengine=libaio 00:16:39.735 direct=1 00:16:39.735 bs=4096 00:16:39.735 iodepth=128 00:16:39.735 norandommap=0 00:16:39.735 numjobs=1 00:16:39.735 00:16:39.735 verify_dump=1 00:16:39.735 verify_backlog=512 00:16:39.735 verify_state_save=0 00:16:39.735 do_verify=1 00:16:39.735 verify=crc32c-intel 00:16:39.735 [job0] 00:16:39.735 filename=/dev/nvme0n1 00:16:39.735 [job1] 00:16:39.735 filename=/dev/nvme0n2 00:16:39.735 [job2] 00:16:39.735 filename=/dev/nvme0n3 00:16:39.735 [job3] 00:16:39.735 filename=/dev/nvme0n4 00:16:39.735 Could not set queue depth (nvme0n1) 00:16:39.735 Could not set queue depth (nvme0n2) 00:16:39.735 Could not set queue depth (nvme0n3) 00:16:39.735 Could not set queue depth (nvme0n4) 00:16:39.735 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:39.735 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:39.736 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:39.736 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:39.736 fio-3.35 00:16:39.736 Starting 4 threads 00:16:41.116 00:16:41.116 job0: (groupid=0, jobs=1): err= 0: pid=123838: Fri Nov 29 02:21:44 2024 00:16:41.116 read: IOPS=3562, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1006msec) 00:16:41.116 slat (usec): min=2, max=14108, avg=137.01, stdev=915.89 00:16:41.116 clat (usec): min=5624, max=41445, avg=17621.72, stdev=7177.69 00:16:41.116 lat (usec): min=5659, max=45845, avg=17758.73, stdev=7247.71 00:16:41.116 clat percentiles (usec): 00:16:41.116 | 1.00th=[ 6128], 5.00th=[ 9110], 10.00th=[ 9503], 20.00th=[12649], 00:16:41.116 | 30.00th=[13173], 40.00th=[13435], 50.00th=[16188], 60.00th=[17695], 00:16:41.116 | 70.00th=[20055], 80.00th=[23987], 90.00th=[27657], 95.00th=[30278], 00:16:41.116 | 99.00th=[39060], 99.50th=[39060], 99.90th=[41681], 99.95th=[41681], 00:16:41.116 | 99.99th=[41681] 00:16:41.116 write: IOPS=4009, BW=15.7MiB/s (16.4MB/s)(15.8MiB/1006msec); 0 zone resets 00:16:41.117 slat (usec): min=3, max=20657, avg=119.20, stdev=782.82 00:16:41.117 clat (usec): min=2796, max=52285, avg=15940.97, stdev=6828.51 00:16:41.117 lat (usec): min=4864, max=52294, avg=16060.17, stdev=6867.10 00:16:41.117 clat percentiles (usec): 00:16:41.117 | 1.00th=[ 7832], 5.00th=[ 9896], 10.00th=[10159], 20.00th=[11469], 00:16:41.117 | 30.00th=[11994], 40.00th=[12256], 50.00th=[12911], 60.00th=[14746], 00:16:41.117 | 70.00th=[17957], 80.00th=[21365], 90.00th=[23987], 95.00th=[27919], 00:16:41.117 | 99.00th=[41681], 99.50th=[50594], 99.90th=[52167], 99.95th=[52167], 00:16:41.117 | 99.99th=[52167] 00:16:41.117 bw ( KiB/s): min=14864, max=16384, per=22.65%, avg=15624.00, stdev=1074.80, samples=2 00:16:41.117 iops : min= 3716, max= 4096, avg=3906.00, stdev=268.70, samples=2 00:16:41.117 lat (msec) : 4=0.01%, 10=9.77%, 20=62.76%, 50=27.07%, 100=0.39% 00:16:41.117 cpu : usr=2.29%, sys=6.57%, ctx=323, majf=0, minf=1 00:16:41.117 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:41.117 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:41.117 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:41.117 issued rwts: total=3584,4034,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:41.117 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:41.117 job1: (groupid=0, jobs=1): err= 0: pid=123839: Fri Nov 29 02:21:44 2024 00:16:41.117 read: IOPS=4268, BW=16.7MiB/s (17.5MB/s)(16.7MiB/1004msec) 00:16:41.117 slat (usec): min=2, max=9543, avg=97.82, stdev=675.36 00:16:41.117 clat (usec): min=2302, max=51898, avg=13067.23, stdev=4834.45 00:16:41.117 lat (usec): min=2421, max=52364, avg=13165.05, stdev=4880.52 00:16:41.117 clat percentiles (usec): 00:16:41.117 | 1.00th=[ 5276], 5.00th=[ 6849], 10.00th=[ 7898], 20.00th=[ 9241], 00:16:41.117 | 30.00th=[10290], 40.00th=[11207], 50.00th=[12518], 60.00th=[14091], 00:16:41.117 | 70.00th=[14746], 80.00th=[16188], 90.00th=[19006], 95.00th=[19792], 00:16:41.117 | 99.00th=[26346], 99.50th=[28181], 99.90th=[51643], 99.95th=[51643], 00:16:41.117 | 99.99th=[51643] 00:16:41.117 write: IOPS=4589, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1004msec); 0 zone resets 00:16:41.117 slat (usec): min=3, max=10714, avg=111.85, stdev=665.83 00:16:41.117 clat (usec): min=1146, max=49555, avg=15481.93, stdev=9056.33 00:16:41.117 lat (usec): min=1158, max=49567, avg=15593.78, stdev=9128.59 00:16:41.117 clat percentiles (usec): 00:16:41.117 | 1.00th=[ 4113], 5.00th=[ 6390], 10.00th=[ 7439], 20.00th=[10290], 00:16:41.117 | 30.00th=[10945], 40.00th=[11731], 50.00th=[12780], 60.00th=[13304], 00:16:41.117 | 70.00th=[14877], 80.00th=[20841], 90.00th=[26608], 95.00th=[38536], 00:16:41.117 | 99.00th=[44827], 99.50th=[49021], 99.90th=[49546], 99.95th=[49546], 00:16:41.117 | 99.99th=[49546] 00:16:41.117 bw ( KiB/s): min=16384, max=20480, per=26.72%, avg=18432.00, stdev=2896.31, samples=2 00:16:41.117 iops : min= 4096, max= 5120, avg=4608.00, stdev=724.08, samples=2 00:16:41.117 lat (msec) : 2=0.11%, 4=0.42%, 10=20.25%, 20=66.08%, 50=13.02% 00:16:41.117 lat (msec) : 100=0.12% 00:16:41.117 cpu : usr=3.99%, sys=6.98%, ctx=348, majf=0, minf=1 00:16:41.117 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:16:41.117 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:41.117 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:41.117 issued rwts: total=4286,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:41.117 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:41.117 job2: (groupid=0, jobs=1): err= 0: pid=123840: Fri Nov 29 02:21:44 2024 00:16:41.117 read: IOPS=4297, BW=16.8MiB/s (17.6MB/s)(16.8MiB/1002msec) 00:16:41.117 slat (usec): min=2, max=18826, avg=109.04, stdev=685.83 00:16:41.117 clat (usec): min=402, max=33862, avg=13904.89, stdev=4730.30 00:16:41.117 lat (usec): min=3397, max=33881, avg=14013.93, stdev=4755.87 00:16:41.117 clat percentiles (usec): 00:16:41.117 | 1.00th=[ 7242], 5.00th=[ 9110], 10.00th=[10421], 20.00th=[11469], 00:16:41.117 | 30.00th=[11731], 40.00th=[11994], 50.00th=[12387], 60.00th=[12649], 00:16:41.117 | 70.00th=[13173], 80.00th=[16188], 90.00th=[21365], 95.00th=[24773], 00:16:41.117 | 99.00th=[29230], 99.50th=[30278], 99.90th=[31327], 99.95th=[32113], 00:16:41.117 | 99.99th=[33817] 00:16:41.117 write: IOPS=4598, BW=18.0MiB/s (18.8MB/s)(18.0MiB/1002msec); 0 zone resets 00:16:41.117 slat (usec): min=3, max=10667, avg=106.81, stdev=603.95 00:16:41.117 clat (usec): min=1824, max=41982, avg=14575.10, stdev=5804.18 00:16:41.117 lat (usec): min=1838, max=41997, avg=14681.91, stdev=5835.45 00:16:41.117 clat percentiles (usec): 00:16:41.117 | 1.00th=[ 5932], 5.00th=[ 9110], 10.00th=[ 9896], 20.00th=[11994], 00:16:41.117 | 30.00th=[12387], 40.00th=[12518], 50.00th=[12649], 60.00th=[12911], 00:16:41.117 | 70.00th=[13435], 80.00th=[15533], 90.00th=[23987], 95.00th=[26608], 00:16:41.117 | 99.00th=[36963], 99.50th=[40633], 99.90th=[41681], 99.95th=[42206], 00:16:41.117 | 99.99th=[42206] 00:16:41.117 bw ( KiB/s): min=16384, max=20480, per=26.72%, avg=18432.00, stdev=2896.31, samples=2 00:16:41.117 iops : min= 4096, max= 5120, avg=4608.00, stdev=724.08, samples=2 00:16:41.117 lat (usec) : 500=0.01% 00:16:41.117 lat (msec) : 2=0.12%, 4=0.65%, 10=8.90%, 20=76.92%, 50=13.39% 00:16:41.117 cpu : usr=3.80%, sys=7.69%, ctx=476, majf=0, minf=2 00:16:41.117 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:16:41.117 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:41.117 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:41.117 issued rwts: total=4306,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:41.117 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:41.117 job3: (groupid=0, jobs=1): err= 0: pid=123841: Fri Nov 29 02:21:44 2024 00:16:41.117 read: IOPS=3853, BW=15.1MiB/s (15.8MB/s)(15.1MiB/1003msec) 00:16:41.117 slat (usec): min=3, max=16637, avg=122.49, stdev=835.80 00:16:41.117 clat (usec): min=830, max=46244, avg=15238.66, stdev=5143.46 00:16:41.117 lat (usec): min=8060, max=46259, avg=15361.14, stdev=5219.53 00:16:41.117 clat percentiles (usec): 00:16:41.117 | 1.00th=[ 9372], 5.00th=[10814], 10.00th=[12387], 20.00th=[12780], 00:16:41.117 | 30.00th=[12911], 40.00th=[13173], 50.00th=[13304], 60.00th=[13435], 00:16:41.117 | 70.00th=[13829], 80.00th=[16319], 90.00th=[23725], 95.00th=[29230], 00:16:41.117 | 99.00th=[32637], 99.50th=[32900], 99.90th=[37487], 99.95th=[41157], 00:16:41.117 | 99.99th=[46400] 00:16:41.117 write: IOPS=4083, BW=16.0MiB/s (16.7MB/s)(16.0MiB/1003msec); 0 zone resets 00:16:41.117 slat (usec): min=4, max=13875, avg=116.47, stdev=730.84 00:16:41.117 clat (usec): min=7011, max=54468, avg=16634.11, stdev=5991.87 00:16:41.117 lat (usec): min=7023, max=54487, avg=16750.58, stdev=6045.24 00:16:41.117 clat percentiles (usec): 00:16:41.117 | 1.00th=[ 8586], 5.00th=[12518], 10.00th=[13042], 20.00th=[13435], 00:16:41.117 | 30.00th=[13698], 40.00th=[13960], 50.00th=[14222], 60.00th=[15139], 00:16:41.117 | 70.00th=[16712], 80.00th=[19268], 90.00th=[23987], 95.00th=[26870], 00:16:41.117 | 99.00th=[42206], 99.50th=[47973], 99.90th=[54264], 99.95th=[54264], 00:16:41.117 | 99.99th=[54264] 00:16:41.117 bw ( KiB/s): min=16304, max=16464, per=23.76%, avg=16384.00, stdev=113.14, samples=2 00:16:41.117 iops : min= 4076, max= 4116, avg=4096.00, stdev=28.28, samples=2 00:16:41.117 lat (usec) : 1000=0.01% 00:16:41.117 lat (msec) : 10=2.01%, 20=83.13%, 50=14.66%, 100=0.19% 00:16:41.117 cpu : usr=6.39%, sys=9.88%, ctx=262, majf=0, minf=2 00:16:41.117 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:41.117 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:41.117 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:41.117 issued rwts: total=3865,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:41.117 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:41.117 00:16:41.117 Run status group 0 (all jobs): 00:16:41.117 READ: bw=62.3MiB/s (65.3MB/s), 13.9MiB/s-16.8MiB/s (14.6MB/s-17.6MB/s), io=62.7MiB (65.7MB), run=1002-1006msec 00:16:41.117 WRITE: bw=67.4MiB/s (70.6MB/s), 15.7MiB/s-18.0MiB/s (16.4MB/s-18.8MB/s), io=67.8MiB (71.0MB), run=1002-1006msec 00:16:41.117 00:16:41.117 Disk stats (read/write): 00:16:41.117 nvme0n1: ios=3157/3584, merge=0/0, ticks=26672/25118, in_queue=51790, util=93.79% 00:16:41.117 nvme0n2: ios=3605/4096, merge=0/0, ticks=27933/34165, in_queue=62098, util=99.49% 00:16:41.117 nvme0n3: ios=3612/3794, merge=0/0, ticks=19296/23950, in_queue=43246, util=97.29% 00:16:41.117 nvme0n4: ios=3093/3503, merge=0/0, ticks=23058/27111, in_queue=50169, util=92.43% 00:16:41.117 02:21:44 -- target/fio.sh@55 -- # sync 00:16:41.117 02:21:44 -- target/fio.sh@59 -- # fio_pid=123989 00:16:41.117 02:21:44 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:16:41.117 02:21:44 -- target/fio.sh@61 -- # sleep 3 00:16:41.117 [global] 00:16:41.117 thread=1 00:16:41.117 invalidate=1 00:16:41.117 rw=read 00:16:41.117 time_based=1 00:16:41.117 runtime=10 00:16:41.117 ioengine=libaio 00:16:41.117 direct=1 00:16:41.117 bs=4096 00:16:41.117 iodepth=1 00:16:41.117 norandommap=1 00:16:41.117 numjobs=1 00:16:41.117 00:16:41.117 [job0] 00:16:41.117 filename=/dev/nvme0n1 00:16:41.117 [job1] 00:16:41.117 filename=/dev/nvme0n2 00:16:41.117 [job2] 00:16:41.117 filename=/dev/nvme0n3 00:16:41.117 [job3] 00:16:41.117 filename=/dev/nvme0n4 00:16:41.117 Could not set queue depth (nvme0n1) 00:16:41.117 Could not set queue depth (nvme0n2) 00:16:41.117 Could not set queue depth (nvme0n3) 00:16:41.117 Could not set queue depth (nvme0n4) 00:16:41.376 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:41.376 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:41.376 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:41.377 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:41.377 fio-3.35 00:16:41.377 Starting 4 threads 00:16:43.934 02:21:47 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:16:44.501 02:21:47 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:16:44.501 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=9007104, buflen=4096 00:16:44.501 fio: pid=124081, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:44.501 02:21:48 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:44.501 02:21:48 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:16:44.501 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=47308800, buflen=4096 00:16:44.501 fio: pid=124080, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:44.760 02:21:48 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:44.760 02:21:48 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:16:44.760 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=1695744, buflen=4096 00:16:44.760 fio: pid=124078, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:45.019 02:21:48 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:45.019 02:21:48 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:16:45.280 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=843776, buflen=4096 00:16:45.280 fio: pid=124079, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:45.280 00:16:45.280 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=124078: Fri Nov 29 02:21:48 2024 00:16:45.280 read: IOPS=120, BW=480KiB/s (491kB/s)(1656KiB/3451msec) 00:16:45.280 slat (nsec): min=6519, max=34257, avg=15088.83, stdev=6986.80 00:16:45.280 clat (usec): min=192, max=51318, avg=8258.03, stdev=16226.42 00:16:45.280 lat (usec): min=199, max=51331, avg=8273.08, stdev=16229.37 00:16:45.280 clat percentiles (usec): 00:16:45.280 | 1.00th=[ 204], 5.00th=[ 235], 10.00th=[ 243], 20.00th=[ 251], 00:16:45.280 | 30.00th=[ 260], 40.00th=[ 269], 50.00th=[ 277], 60.00th=[ 281], 00:16:45.280 | 70.00th=[ 289], 80.00th=[ 515], 90.00th=[41157], 95.00th=[41157], 00:16:45.280 | 99.00th=[41157], 99.50th=[41157], 99.90th=[51119], 99.95th=[51119], 00:16:45.280 | 99.99th=[51119] 00:16:45.280 bw ( KiB/s): min= 96, max= 2224, per=3.51%, avg=537.33, stdev=851.11, samples=6 00:16:45.280 iops : min= 24, max= 556, avg=134.33, stdev=212.78, samples=6 00:16:45.280 lat (usec) : 250=18.31%, 500=61.45%, 750=0.48% 00:16:45.280 lat (msec) : 50=19.28%, 100=0.24% 00:16:45.280 cpu : usr=0.12%, sys=0.23%, ctx=415, majf=0, minf=2 00:16:45.280 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:45.280 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:45.280 complete : 0=0.2%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:45.280 issued rwts: total=415,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:45.280 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:45.280 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=124079: Fri Nov 29 02:21:48 2024 00:16:45.280 read: IOPS=55, BW=220KiB/s (225kB/s)(824KiB/3752msec) 00:16:45.280 slat (usec): min=5, max=9967, avg=90.70, stdev=800.42 00:16:45.280 clat (usec): min=217, max=42096, avg=17980.16, stdev=20486.97 00:16:45.280 lat (usec): min=226, max=50963, avg=18071.22, stdev=20596.68 00:16:45.280 clat percentiles (usec): 00:16:45.280 | 1.00th=[ 233], 5.00th=[ 249], 10.00th=[ 258], 20.00th=[ 269], 00:16:45.280 | 30.00th=[ 281], 40.00th=[ 371], 50.00th=[ 392], 60.00th=[41157], 00:16:45.280 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:16:45.280 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:45.280 | 99.99th=[42206] 00:16:45.280 bw ( KiB/s): min= 93, max= 720, per=1.49%, avg=229.29, stdev=237.95, samples=7 00:16:45.280 iops : min= 23, max= 180, avg=57.29, stdev=59.51, samples=7 00:16:45.280 lat (usec) : 250=5.31%, 500=47.83%, 750=0.97%, 1000=2.42% 00:16:45.280 lat (msec) : 10=0.48%, 50=42.51% 00:16:45.280 cpu : usr=0.00%, sys=0.16%, ctx=210, majf=0, minf=2 00:16:45.280 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:45.280 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:45.280 complete : 0=0.5%, 4=99.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:45.280 issued rwts: total=207,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:45.280 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:45.280 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=124080: Fri Nov 29 02:21:48 2024 00:16:45.280 read: IOPS=3606, BW=14.1MiB/s (14.8MB/s)(45.1MiB/3203msec) 00:16:45.280 slat (nsec): min=4513, max=51446, avg=10187.78, stdev=4953.59 00:16:45.280 clat (usec): min=182, max=41029, avg=262.71, stdev=1134.85 00:16:45.280 lat (usec): min=187, max=41043, avg=272.89, stdev=1135.10 00:16:45.280 clat percentiles (usec): 00:16:45.280 | 1.00th=[ 190], 5.00th=[ 196], 10.00th=[ 200], 20.00th=[ 204], 00:16:45.280 | 30.00th=[ 210], 40.00th=[ 217], 50.00th=[ 221], 60.00th=[ 229], 00:16:45.280 | 70.00th=[ 237], 80.00th=[ 247], 90.00th=[ 262], 95.00th=[ 281], 00:16:45.280 | 99.00th=[ 388], 99.50th=[ 469], 99.90th=[ 1029], 99.95th=[41157], 00:16:45.280 | 99.99th=[41157] 00:16:45.280 bw ( KiB/s): min=12680, max=18552, per=100.00%, avg=15393.33, stdev=2352.20, samples=6 00:16:45.280 iops : min= 3170, max= 4638, avg=3848.33, stdev=588.05, samples=6 00:16:45.280 lat (usec) : 250=82.90%, 500=16.73%, 750=0.16%, 1000=0.09% 00:16:45.280 lat (msec) : 2=0.01%, 10=0.01%, 50=0.09% 00:16:45.280 cpu : usr=1.69%, sys=4.75%, ctx=11552, majf=0, minf=1 00:16:45.280 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:45.280 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:45.280 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:45.280 issued rwts: total=11551,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:45.280 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:45.280 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=124081: Fri Nov 29 02:21:48 2024 00:16:45.280 read: IOPS=754, BW=3019KiB/s (3091kB/s)(8796KiB/2914msec) 00:16:45.280 slat (nsec): min=7000, max=49137, avg=18104.25, stdev=4572.66 00:16:45.280 clat (usec): min=197, max=42125, avg=1290.43, stdev=6470.34 00:16:45.280 lat (usec): min=204, max=42141, avg=1308.54, stdev=6470.89 00:16:45.280 clat percentiles (usec): 00:16:45.280 | 1.00th=[ 206], 5.00th=[ 217], 10.00th=[ 231], 20.00th=[ 247], 00:16:45.280 | 30.00th=[ 251], 40.00th=[ 253], 50.00th=[ 258], 60.00th=[ 260], 00:16:45.280 | 70.00th=[ 265], 80.00th=[ 269], 90.00th=[ 277], 95.00th=[ 285], 00:16:45.280 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:45.280 | 99.99th=[42206] 00:16:45.281 bw ( KiB/s): min= 96, max=12848, per=17.27%, avg=2646.40, stdev=5702.87, samples=5 00:16:45.281 iops : min= 24, max= 3212, avg=661.60, stdev=1425.72, samples=5 00:16:45.281 lat (usec) : 250=30.36%, 500=67.09% 00:16:45.281 lat (msec) : 50=2.50% 00:16:45.281 cpu : usr=1.06%, sys=1.79%, ctx=2202, majf=0, minf=2 00:16:45.281 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:45.281 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:45.281 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:45.281 issued rwts: total=2200,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:45.281 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:45.281 00:16:45.281 Run status group 0 (all jobs): 00:16:45.281 READ: bw=15.0MiB/s (15.7MB/s), 220KiB/s-14.1MiB/s (225kB/s-14.8MB/s), io=56.1MiB (58.9MB), run=2914-3752msec 00:16:45.281 00:16:45.281 Disk stats (read/write): 00:16:45.281 nvme0n1: ios=412/0, merge=0/0, ticks=3323/0, in_queue=3323, util=95.99% 00:16:45.281 nvme0n2: ios=203/0, merge=0/0, ticks=3582/0, in_queue=3582, util=96.22% 00:16:45.281 nvme0n3: ios=11548/0, merge=0/0, ticks=2843/0, in_queue=2843, util=96.79% 00:16:45.281 nvme0n4: ios=2243/0, merge=0/0, ticks=3445/0, in_queue=3445, util=99.19% 00:16:45.539 02:21:48 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:45.539 02:21:48 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:16:45.798 02:21:49 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:45.798 02:21:49 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:16:46.058 02:21:49 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:46.058 02:21:49 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:16:46.317 02:21:49 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:46.317 02:21:49 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:16:46.576 02:21:50 -- target/fio.sh@69 -- # fio_status=0 00:16:46.576 02:21:50 -- target/fio.sh@70 -- # wait 123989 00:16:46.576 02:21:50 -- target/fio.sh@70 -- # fio_status=4 00:16:46.576 02:21:50 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:46.576 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:16:46.576 02:21:50 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:46.576 02:21:50 -- common/autotest_common.sh@1208 -- # local i=0 00:16:46.576 02:21:50 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:46.576 02:21:50 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:46.576 02:21:50 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:46.576 02:21:50 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:46.576 02:21:50 -- common/autotest_common.sh@1220 -- # return 0 00:16:46.576 02:21:50 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:16:46.576 02:21:50 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:16:46.576 nvmf hotplug test: fio failed as expected 00:16:46.576 02:21:50 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:46.834 02:21:50 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:16:46.834 02:21:50 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:16:46.834 02:21:50 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:16:46.834 02:21:50 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:16:46.834 02:21:50 -- target/fio.sh@91 -- # nvmftestfini 00:16:46.834 02:21:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:46.834 02:21:50 -- nvmf/common.sh@116 -- # sync 00:16:46.834 02:21:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:46.834 02:21:50 -- nvmf/common.sh@119 -- # set +e 00:16:46.834 02:21:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:46.834 02:21:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:46.834 rmmod nvme_tcp 00:16:46.834 rmmod nvme_fabrics 00:16:46.834 rmmod nvme_keyring 00:16:46.834 02:21:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:46.834 02:21:50 -- nvmf/common.sh@123 -- # set -e 00:16:46.834 02:21:50 -- nvmf/common.sh@124 -- # return 0 00:16:46.834 02:21:50 -- nvmf/common.sh@477 -- # '[' -n 121900 ']' 00:16:46.834 02:21:50 -- nvmf/common.sh@478 -- # killprocess 121900 00:16:46.834 02:21:50 -- common/autotest_common.sh@936 -- # '[' -z 121900 ']' 00:16:46.834 02:21:50 -- common/autotest_common.sh@940 -- # kill -0 121900 00:16:46.834 02:21:50 -- common/autotest_common.sh@941 -- # uname 00:16:46.834 02:21:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:46.834 02:21:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 121900 00:16:47.092 02:21:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:47.092 02:21:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:47.092 02:21:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 121900' 00:16:47.092 killing process with pid 121900 00:16:47.092 02:21:50 -- common/autotest_common.sh@955 -- # kill 121900 00:16:47.092 02:21:50 -- common/autotest_common.sh@960 -- # wait 121900 00:16:47.350 02:21:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:47.350 02:21:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:47.350 02:21:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:47.350 02:21:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:47.350 02:21:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:47.350 02:21:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:47.350 02:21:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:47.350 02:21:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:49.282 02:21:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:49.282 00:16:49.282 real 0m24.294s 00:16:49.282 user 1m25.857s 00:16:49.282 sys 0m6.418s 00:16:49.282 02:21:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:49.282 02:21:52 -- common/autotest_common.sh@10 -- # set +x 00:16:49.282 ************************************ 00:16:49.282 END TEST nvmf_fio_target 00:16:49.282 ************************************ 00:16:49.282 02:21:52 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:49.282 02:21:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:49.282 02:21:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:49.282 02:21:52 -- common/autotest_common.sh@10 -- # set +x 00:16:49.282 ************************************ 00:16:49.282 START TEST nvmf_bdevio 00:16:49.282 ************************************ 00:16:49.282 02:21:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:49.282 * Looking for test storage... 00:16:49.282 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:49.282 02:21:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:49.282 02:21:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:49.282 02:21:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:49.542 02:21:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:49.542 02:21:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:49.542 02:21:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:49.542 02:21:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:49.542 02:21:53 -- scripts/common.sh@335 -- # IFS=.-: 00:16:49.542 02:21:53 -- scripts/common.sh@335 -- # read -ra ver1 00:16:49.542 02:21:53 -- scripts/common.sh@336 -- # IFS=.-: 00:16:49.542 02:21:53 -- scripts/common.sh@336 -- # read -ra ver2 00:16:49.542 02:21:53 -- scripts/common.sh@337 -- # local 'op=<' 00:16:49.542 02:21:53 -- scripts/common.sh@339 -- # ver1_l=2 00:16:49.542 02:21:53 -- scripts/common.sh@340 -- # ver2_l=1 00:16:49.542 02:21:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:49.542 02:21:53 -- scripts/common.sh@343 -- # case "$op" in 00:16:49.542 02:21:53 -- scripts/common.sh@344 -- # : 1 00:16:49.542 02:21:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:49.542 02:21:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:49.542 02:21:53 -- scripts/common.sh@364 -- # decimal 1 00:16:49.542 02:21:53 -- scripts/common.sh@352 -- # local d=1 00:16:49.542 02:21:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:49.542 02:21:53 -- scripts/common.sh@354 -- # echo 1 00:16:49.542 02:21:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:49.542 02:21:53 -- scripts/common.sh@365 -- # decimal 2 00:16:49.542 02:21:53 -- scripts/common.sh@352 -- # local d=2 00:16:49.542 02:21:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:49.542 02:21:53 -- scripts/common.sh@354 -- # echo 2 00:16:49.542 02:21:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:49.542 02:21:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:49.542 02:21:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:49.542 02:21:53 -- scripts/common.sh@367 -- # return 0 00:16:49.542 02:21:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:49.542 02:21:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:49.542 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:49.542 --rc genhtml_branch_coverage=1 00:16:49.542 --rc genhtml_function_coverage=1 00:16:49.542 --rc genhtml_legend=1 00:16:49.542 --rc geninfo_all_blocks=1 00:16:49.542 --rc geninfo_unexecuted_blocks=1 00:16:49.542 00:16:49.542 ' 00:16:49.542 02:21:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:49.542 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:49.542 --rc genhtml_branch_coverage=1 00:16:49.542 --rc genhtml_function_coverage=1 00:16:49.542 --rc genhtml_legend=1 00:16:49.542 --rc geninfo_all_blocks=1 00:16:49.542 --rc geninfo_unexecuted_blocks=1 00:16:49.542 00:16:49.542 ' 00:16:49.542 02:21:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:49.542 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:49.542 --rc genhtml_branch_coverage=1 00:16:49.542 --rc genhtml_function_coverage=1 00:16:49.542 --rc genhtml_legend=1 00:16:49.542 --rc geninfo_all_blocks=1 00:16:49.542 --rc geninfo_unexecuted_blocks=1 00:16:49.542 00:16:49.542 ' 00:16:49.542 02:21:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:49.542 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:49.542 --rc genhtml_branch_coverage=1 00:16:49.542 --rc genhtml_function_coverage=1 00:16:49.542 --rc genhtml_legend=1 00:16:49.542 --rc geninfo_all_blocks=1 00:16:49.542 --rc geninfo_unexecuted_blocks=1 00:16:49.542 00:16:49.542 ' 00:16:49.542 02:21:53 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:49.542 02:21:53 -- nvmf/common.sh@7 -- # uname -s 00:16:49.542 02:21:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:49.542 02:21:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:49.542 02:21:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:49.542 02:21:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:49.542 02:21:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:49.542 02:21:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:49.542 02:21:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:49.542 02:21:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:49.542 02:21:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:49.542 02:21:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:49.542 02:21:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:49.542 02:21:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:49.542 02:21:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:49.542 02:21:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:49.542 02:21:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:49.542 02:21:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:49.542 02:21:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:49.542 02:21:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:49.542 02:21:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:49.542 02:21:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:49.542 02:21:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:49.542 02:21:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:49.542 02:21:53 -- paths/export.sh@5 -- # export PATH 00:16:49.543 02:21:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:49.543 02:21:53 -- nvmf/common.sh@46 -- # : 0 00:16:49.543 02:21:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:49.543 02:21:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:49.543 02:21:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:49.543 02:21:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:49.543 02:21:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:49.543 02:21:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:49.543 02:21:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:49.543 02:21:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:49.543 02:21:53 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:49.543 02:21:53 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:49.543 02:21:53 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:49.543 02:21:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:49.543 02:21:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:49.543 02:21:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:49.543 02:21:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:49.543 02:21:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:49.543 02:21:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:49.543 02:21:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:49.543 02:21:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:49.543 02:21:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:49.543 02:21:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:49.543 02:21:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:49.543 02:21:53 -- common/autotest_common.sh@10 -- # set +x 00:16:52.077 02:21:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:52.077 02:21:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:52.077 02:21:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:52.077 02:21:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:52.077 02:21:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:52.077 02:21:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:52.077 02:21:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:52.077 02:21:55 -- nvmf/common.sh@294 -- # net_devs=() 00:16:52.078 02:21:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:52.078 02:21:55 -- nvmf/common.sh@295 -- # e810=() 00:16:52.078 02:21:55 -- nvmf/common.sh@295 -- # local -ga e810 00:16:52.078 02:21:55 -- nvmf/common.sh@296 -- # x722=() 00:16:52.078 02:21:55 -- nvmf/common.sh@296 -- # local -ga x722 00:16:52.078 02:21:55 -- nvmf/common.sh@297 -- # mlx=() 00:16:52.078 02:21:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:52.078 02:21:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:52.078 02:21:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:52.078 02:21:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:52.078 02:21:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:52.078 02:21:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:52.078 02:21:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:52.078 02:21:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:52.078 02:21:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:52.078 02:21:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:52.078 02:21:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:52.078 02:21:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:52.078 02:21:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:52.078 02:21:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:52.078 02:21:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:52.078 02:21:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:52.078 02:21:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:52.078 02:21:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:52.078 02:21:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:52.078 02:21:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:52.078 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:52.078 02:21:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:52.078 02:21:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:52.078 02:21:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:52.078 02:21:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:52.078 02:21:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:52.078 02:21:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:52.078 02:21:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:52.078 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:52.078 02:21:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:52.078 02:21:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:52.078 02:21:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:52.078 02:21:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:52.078 02:21:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:52.078 02:21:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:52.078 02:21:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:52.078 02:21:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:52.078 02:21:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:52.078 02:21:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:52.078 02:21:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:52.078 02:21:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:52.078 02:21:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:52.078 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:52.078 02:21:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:52.078 02:21:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:52.078 02:21:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:52.078 02:21:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:52.078 02:21:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:52.078 02:21:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:52.078 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:52.078 02:21:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:52.078 02:21:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:52.078 02:21:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:52.078 02:21:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:52.078 02:21:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:52.078 02:21:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:52.078 02:21:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:52.078 02:21:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:52.078 02:21:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:52.078 02:21:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:52.078 02:21:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:52.078 02:21:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:52.078 02:21:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:52.078 02:21:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:52.078 02:21:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:52.078 02:21:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:52.078 02:21:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:52.078 02:21:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:52.078 02:21:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:52.078 02:21:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:52.078 02:21:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:52.078 02:21:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:52.078 02:21:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:52.078 02:21:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:52.078 02:21:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:52.078 02:21:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:52.078 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:52.078 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.230 ms 00:16:52.078 00:16:52.078 --- 10.0.0.2 ping statistics --- 00:16:52.078 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:52.078 rtt min/avg/max/mdev = 0.230/0.230/0.230/0.000 ms 00:16:52.078 02:21:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:52.078 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:52.078 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.090 ms 00:16:52.078 00:16:52.078 --- 10.0.0.1 ping statistics --- 00:16:52.078 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:52.078 rtt min/avg/max/mdev = 0.090/0.090/0.090/0.000 ms 00:16:52.078 02:21:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:52.078 02:21:55 -- nvmf/common.sh@410 -- # return 0 00:16:52.078 02:21:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:52.078 02:21:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:52.078 02:21:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:52.078 02:21:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:52.078 02:21:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:52.078 02:21:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:52.078 02:21:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:52.078 02:21:55 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:16:52.078 02:21:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:52.078 02:21:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:52.078 02:21:55 -- common/autotest_common.sh@10 -- # set +x 00:16:52.078 02:21:55 -- nvmf/common.sh@469 -- # nvmfpid=126740 00:16:52.078 02:21:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:16:52.078 02:21:55 -- nvmf/common.sh@470 -- # waitforlisten 126740 00:16:52.078 02:21:55 -- common/autotest_common.sh@829 -- # '[' -z 126740 ']' 00:16:52.078 02:21:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:52.078 02:21:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:52.078 02:21:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:52.078 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:52.078 02:21:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:52.078 02:21:55 -- common/autotest_common.sh@10 -- # set +x 00:16:52.078 [2024-11-29 02:21:55.405087] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:52.078 [2024-11-29 02:21:55.405168] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:52.078 EAL: No free 2048 kB hugepages reported on node 1 00:16:52.078 [2024-11-29 02:21:55.479211] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:52.078 [2024-11-29 02:21:55.600748] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:52.078 [2024-11-29 02:21:55.600906] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:52.078 [2024-11-29 02:21:55.600926] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:52.078 [2024-11-29 02:21:55.600940] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:52.078 [2024-11-29 02:21:55.601007] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:52.078 [2024-11-29 02:21:55.601065] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:16:52.078 [2024-11-29 02:21:55.601120] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:16:52.078 [2024-11-29 02:21:55.601123] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:53.015 02:21:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:53.015 02:21:56 -- common/autotest_common.sh@862 -- # return 0 00:16:53.015 02:21:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:53.015 02:21:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:53.015 02:21:56 -- common/autotest_common.sh@10 -- # set +x 00:16:53.015 02:21:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:53.015 02:21:56 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:53.015 02:21:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:53.015 02:21:56 -- common/autotest_common.sh@10 -- # set +x 00:16:53.015 [2024-11-29 02:21:56.427015] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:53.015 02:21:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:53.015 02:21:56 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:53.015 02:21:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:53.015 02:21:56 -- common/autotest_common.sh@10 -- # set +x 00:16:53.015 Malloc0 00:16:53.015 02:21:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:53.015 02:21:56 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:53.015 02:21:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:53.015 02:21:56 -- common/autotest_common.sh@10 -- # set +x 00:16:53.015 02:21:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:53.015 02:21:56 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:53.015 02:21:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:53.015 02:21:56 -- common/autotest_common.sh@10 -- # set +x 00:16:53.015 02:21:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:53.015 02:21:56 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:53.015 02:21:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:53.015 02:21:56 -- common/autotest_common.sh@10 -- # set +x 00:16:53.015 [2024-11-29 02:21:56.480831] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:53.015 02:21:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:53.016 02:21:56 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:16:53.016 02:21:56 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:16:53.016 02:21:56 -- nvmf/common.sh@520 -- # config=() 00:16:53.016 02:21:56 -- nvmf/common.sh@520 -- # local subsystem config 00:16:53.016 02:21:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:53.016 02:21:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:53.016 { 00:16:53.016 "params": { 00:16:53.016 "name": "Nvme$subsystem", 00:16:53.016 "trtype": "$TEST_TRANSPORT", 00:16:53.016 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:53.016 "adrfam": "ipv4", 00:16:53.016 "trsvcid": "$NVMF_PORT", 00:16:53.016 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:53.016 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:53.016 "hdgst": ${hdgst:-false}, 00:16:53.016 "ddgst": ${ddgst:-false} 00:16:53.016 }, 00:16:53.016 "method": "bdev_nvme_attach_controller" 00:16:53.016 } 00:16:53.016 EOF 00:16:53.016 )") 00:16:53.016 02:21:56 -- nvmf/common.sh@542 -- # cat 00:16:53.016 02:21:56 -- nvmf/common.sh@544 -- # jq . 00:16:53.016 02:21:56 -- nvmf/common.sh@545 -- # IFS=, 00:16:53.016 02:21:56 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:53.016 "params": { 00:16:53.016 "name": "Nvme1", 00:16:53.016 "trtype": "tcp", 00:16:53.016 "traddr": "10.0.0.2", 00:16:53.016 "adrfam": "ipv4", 00:16:53.016 "trsvcid": "4420", 00:16:53.016 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:53.016 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:53.016 "hdgst": false, 00:16:53.016 "ddgst": false 00:16:53.016 }, 00:16:53.016 "method": "bdev_nvme_attach_controller" 00:16:53.016 }' 00:16:53.016 [2024-11-29 02:21:56.524800] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:53.016 [2024-11-29 02:21:56.524866] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid126897 ] 00:16:53.016 EAL: No free 2048 kB hugepages reported on node 1 00:16:53.016 [2024-11-29 02:21:56.584970] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:53.275 [2024-11-29 02:21:56.699135] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:53.275 [2024-11-29 02:21:56.699185] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:53.275 [2024-11-29 02:21:56.699188] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:53.275 [2024-11-29 02:21:56.953619] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:16:53.275 [2024-11-29 02:21:56.953684] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:16:53.533 I/O targets: 00:16:53.533 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:16:53.533 00:16:53.533 00:16:53.533 CUnit - A unit testing framework for C - Version 2.1-3 00:16:53.533 http://cunit.sourceforge.net/ 00:16:53.533 00:16:53.533 00:16:53.533 Suite: bdevio tests on: Nvme1n1 00:16:53.533 Test: blockdev write read block ...passed 00:16:53.533 Test: blockdev write zeroes read block ...passed 00:16:53.533 Test: blockdev write zeroes read no split ...passed 00:16:53.533 Test: blockdev write zeroes read split ...passed 00:16:53.533 Test: blockdev write zeroes read split partial ...passed 00:16:53.533 Test: blockdev reset ...[2024-11-29 02:21:57.188216] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:16:53.533 [2024-11-29 02:21:57.188317] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x238ff20 (9): Bad file descriptor 00:16:53.794 [2024-11-29 02:21:57.243019] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:53.794 passed 00:16:53.794 Test: blockdev write read 8 blocks ...passed 00:16:53.794 Test: blockdev write read size > 128k ...passed 00:16:53.794 Test: blockdev write read invalid size ...passed 00:16:53.794 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:16:53.794 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:16:53.794 Test: blockdev write read max offset ...passed 00:16:53.794 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:16:53.794 Test: blockdev writev readv 8 blocks ...passed 00:16:53.794 Test: blockdev writev readv 30 x 1block ...passed 00:16:54.054 Test: blockdev writev readv block ...passed 00:16:54.054 Test: blockdev writev readv size > 128k ...passed 00:16:54.054 Test: blockdev writev readv size > 128k in two iovs ...passed 00:16:54.054 Test: blockdev comparev and writev ...[2024-11-29 02:21:57.494707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:54.054 [2024-11-29 02:21:57.494745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:16:54.054 [2024-11-29 02:21:57.494770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:54.054 [2024-11-29 02:21:57.494789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:16:54.054 [2024-11-29 02:21:57.495153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:54.054 [2024-11-29 02:21:57.495177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:16:54.054 [2024-11-29 02:21:57.495199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:54.054 [2024-11-29 02:21:57.495216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:16:54.054 [2024-11-29 02:21:57.495582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:54.054 [2024-11-29 02:21:57.495607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:16:54.055 [2024-11-29 02:21:57.495627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:54.055 [2024-11-29 02:21:57.495643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:16:54.055 [2024-11-29 02:21:57.495978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:54.055 [2024-11-29 02:21:57.496002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:16:54.055 [2024-11-29 02:21:57.496023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:54.055 [2024-11-29 02:21:57.496038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:16:54.055 passed 00:16:54.055 Test: blockdev nvme passthru rw ...passed 00:16:54.055 Test: blockdev nvme passthru vendor specific ...[2024-11-29 02:21:57.577650] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:54.055 [2024-11-29 02:21:57.577677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:16:54.055 [2024-11-29 02:21:57.577841] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:54.055 [2024-11-29 02:21:57.577863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:16:54.055 [2024-11-29 02:21:57.578032] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:54.055 [2024-11-29 02:21:57.578053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:16:54.055 [2024-11-29 02:21:57.578224] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:54.055 [2024-11-29 02:21:57.578246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:16:54.055 passed 00:16:54.055 Test: blockdev nvme admin passthru ...passed 00:16:54.055 Test: blockdev copy ...passed 00:16:54.055 00:16:54.055 Run Summary: Type Total Ran Passed Failed Inactive 00:16:54.055 suites 1 1 n/a 0 0 00:16:54.055 tests 23 23 23 0 0 00:16:54.055 asserts 152 152 152 0 n/a 00:16:54.055 00:16:54.055 Elapsed time = 1.350 seconds 00:16:54.313 02:21:57 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:54.313 02:21:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:54.313 02:21:57 -- common/autotest_common.sh@10 -- # set +x 00:16:54.313 02:21:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:54.313 02:21:57 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:16:54.313 02:21:57 -- target/bdevio.sh@30 -- # nvmftestfini 00:16:54.313 02:21:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:54.313 02:21:57 -- nvmf/common.sh@116 -- # sync 00:16:54.313 02:21:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:54.313 02:21:57 -- nvmf/common.sh@119 -- # set +e 00:16:54.313 02:21:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:54.313 02:21:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:54.313 rmmod nvme_tcp 00:16:54.313 rmmod nvme_fabrics 00:16:54.313 rmmod nvme_keyring 00:16:54.313 02:21:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:54.313 02:21:57 -- nvmf/common.sh@123 -- # set -e 00:16:54.313 02:21:57 -- nvmf/common.sh@124 -- # return 0 00:16:54.313 02:21:57 -- nvmf/common.sh@477 -- # '[' -n 126740 ']' 00:16:54.313 02:21:57 -- nvmf/common.sh@478 -- # killprocess 126740 00:16:54.313 02:21:57 -- common/autotest_common.sh@936 -- # '[' -z 126740 ']' 00:16:54.313 02:21:57 -- common/autotest_common.sh@940 -- # kill -0 126740 00:16:54.313 02:21:57 -- common/autotest_common.sh@941 -- # uname 00:16:54.313 02:21:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:54.313 02:21:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 126740 00:16:54.313 02:21:57 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:16:54.313 02:21:57 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:16:54.313 02:21:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 126740' 00:16:54.313 killing process with pid 126740 00:16:54.313 02:21:57 -- common/autotest_common.sh@955 -- # kill 126740 00:16:54.313 02:21:57 -- common/autotest_common.sh@960 -- # wait 126740 00:16:54.881 02:21:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:54.881 02:21:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:54.881 02:21:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:54.882 02:21:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:54.882 02:21:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:54.882 02:21:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:54.882 02:21:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:54.882 02:21:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:56.783 02:22:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:56.783 00:16:56.783 real 0m7.447s 00:16:56.783 user 0m14.175s 00:16:56.783 sys 0m2.216s 00:16:56.783 02:22:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:56.783 02:22:00 -- common/autotest_common.sh@10 -- # set +x 00:16:56.783 ************************************ 00:16:56.783 END TEST nvmf_bdevio 00:16:56.783 ************************************ 00:16:56.783 02:22:00 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:16:56.783 02:22:00 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:16:56.783 02:22:00 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:16:56.783 02:22:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:56.783 02:22:00 -- common/autotest_common.sh@10 -- # set +x 00:16:56.783 ************************************ 00:16:56.783 START TEST nvmf_bdevio_no_huge 00:16:56.783 ************************************ 00:16:56.783 02:22:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:16:56.783 * Looking for test storage... 00:16:56.783 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:56.783 02:22:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:56.783 02:22:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:56.783 02:22:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:57.043 02:22:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:57.043 02:22:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:57.043 02:22:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:57.043 02:22:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:57.043 02:22:00 -- scripts/common.sh@335 -- # IFS=.-: 00:16:57.043 02:22:00 -- scripts/common.sh@335 -- # read -ra ver1 00:16:57.043 02:22:00 -- scripts/common.sh@336 -- # IFS=.-: 00:16:57.043 02:22:00 -- scripts/common.sh@336 -- # read -ra ver2 00:16:57.043 02:22:00 -- scripts/common.sh@337 -- # local 'op=<' 00:16:57.043 02:22:00 -- scripts/common.sh@339 -- # ver1_l=2 00:16:57.043 02:22:00 -- scripts/common.sh@340 -- # ver2_l=1 00:16:57.043 02:22:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:57.043 02:22:00 -- scripts/common.sh@343 -- # case "$op" in 00:16:57.043 02:22:00 -- scripts/common.sh@344 -- # : 1 00:16:57.043 02:22:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:57.043 02:22:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:57.043 02:22:00 -- scripts/common.sh@364 -- # decimal 1 00:16:57.043 02:22:00 -- scripts/common.sh@352 -- # local d=1 00:16:57.043 02:22:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:57.043 02:22:00 -- scripts/common.sh@354 -- # echo 1 00:16:57.043 02:22:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:57.043 02:22:00 -- scripts/common.sh@365 -- # decimal 2 00:16:57.043 02:22:00 -- scripts/common.sh@352 -- # local d=2 00:16:57.043 02:22:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:57.043 02:22:00 -- scripts/common.sh@354 -- # echo 2 00:16:57.043 02:22:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:57.043 02:22:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:57.043 02:22:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:57.043 02:22:00 -- scripts/common.sh@367 -- # return 0 00:16:57.043 02:22:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:57.043 02:22:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:57.043 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:57.043 --rc genhtml_branch_coverage=1 00:16:57.043 --rc genhtml_function_coverage=1 00:16:57.043 --rc genhtml_legend=1 00:16:57.043 --rc geninfo_all_blocks=1 00:16:57.043 --rc geninfo_unexecuted_blocks=1 00:16:57.043 00:16:57.043 ' 00:16:57.043 02:22:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:57.043 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:57.043 --rc genhtml_branch_coverage=1 00:16:57.043 --rc genhtml_function_coverage=1 00:16:57.043 --rc genhtml_legend=1 00:16:57.043 --rc geninfo_all_blocks=1 00:16:57.043 --rc geninfo_unexecuted_blocks=1 00:16:57.043 00:16:57.043 ' 00:16:57.043 02:22:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:57.043 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:57.043 --rc genhtml_branch_coverage=1 00:16:57.043 --rc genhtml_function_coverage=1 00:16:57.043 --rc genhtml_legend=1 00:16:57.043 --rc geninfo_all_blocks=1 00:16:57.043 --rc geninfo_unexecuted_blocks=1 00:16:57.043 00:16:57.043 ' 00:16:57.043 02:22:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:57.043 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:57.043 --rc genhtml_branch_coverage=1 00:16:57.043 --rc genhtml_function_coverage=1 00:16:57.043 --rc genhtml_legend=1 00:16:57.043 --rc geninfo_all_blocks=1 00:16:57.043 --rc geninfo_unexecuted_blocks=1 00:16:57.043 00:16:57.043 ' 00:16:57.043 02:22:00 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:57.043 02:22:00 -- nvmf/common.sh@7 -- # uname -s 00:16:57.043 02:22:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:57.043 02:22:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:57.043 02:22:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:57.043 02:22:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:57.043 02:22:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:57.043 02:22:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:57.043 02:22:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:57.043 02:22:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:57.043 02:22:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:57.043 02:22:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:57.043 02:22:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:57.043 02:22:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:57.043 02:22:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:57.043 02:22:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:57.043 02:22:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:57.043 02:22:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:57.043 02:22:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:57.043 02:22:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:57.043 02:22:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:57.043 02:22:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:57.043 02:22:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:57.043 02:22:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:57.043 02:22:00 -- paths/export.sh@5 -- # export PATH 00:16:57.043 02:22:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:57.043 02:22:00 -- nvmf/common.sh@46 -- # : 0 00:16:57.043 02:22:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:57.043 02:22:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:57.043 02:22:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:57.043 02:22:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:57.043 02:22:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:57.043 02:22:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:57.043 02:22:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:57.043 02:22:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:57.043 02:22:00 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:57.043 02:22:00 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:57.043 02:22:00 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:57.043 02:22:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:57.043 02:22:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:57.043 02:22:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:57.043 02:22:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:57.043 02:22:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:57.043 02:22:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:57.043 02:22:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:57.043 02:22:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:57.043 02:22:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:57.043 02:22:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:57.043 02:22:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:57.043 02:22:00 -- common/autotest_common.sh@10 -- # set +x 00:16:58.946 02:22:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:58.946 02:22:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:58.946 02:22:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:58.946 02:22:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:58.946 02:22:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:58.946 02:22:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:58.946 02:22:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:58.946 02:22:02 -- nvmf/common.sh@294 -- # net_devs=() 00:16:58.946 02:22:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:58.946 02:22:02 -- nvmf/common.sh@295 -- # e810=() 00:16:58.946 02:22:02 -- nvmf/common.sh@295 -- # local -ga e810 00:16:58.946 02:22:02 -- nvmf/common.sh@296 -- # x722=() 00:16:58.946 02:22:02 -- nvmf/common.sh@296 -- # local -ga x722 00:16:58.946 02:22:02 -- nvmf/common.sh@297 -- # mlx=() 00:16:58.946 02:22:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:58.946 02:22:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:58.946 02:22:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:58.946 02:22:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:58.946 02:22:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:58.946 02:22:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:58.946 02:22:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:58.946 02:22:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:58.946 02:22:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:58.946 02:22:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:58.946 02:22:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:58.946 02:22:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:58.946 02:22:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:58.946 02:22:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:58.946 02:22:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:58.946 02:22:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:58.946 02:22:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:58.946 02:22:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:58.946 02:22:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:58.946 02:22:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:58.946 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:58.946 02:22:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:58.946 02:22:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:58.946 02:22:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:58.946 02:22:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:58.946 02:22:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:58.946 02:22:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:58.946 02:22:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:58.946 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:58.946 02:22:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:58.946 02:22:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:58.946 02:22:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:58.946 02:22:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:58.946 02:22:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:58.946 02:22:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:58.946 02:22:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:58.946 02:22:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:58.946 02:22:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:58.946 02:22:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:58.946 02:22:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:58.946 02:22:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:58.946 02:22:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:58.946 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:58.946 02:22:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:58.946 02:22:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:58.946 02:22:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:58.946 02:22:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:58.946 02:22:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:58.946 02:22:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:58.946 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:58.946 02:22:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:58.946 02:22:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:58.946 02:22:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:58.946 02:22:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:58.946 02:22:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:58.946 02:22:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:58.947 02:22:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:58.947 02:22:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:58.947 02:22:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:58.947 02:22:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:58.947 02:22:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:58.947 02:22:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:58.947 02:22:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:58.947 02:22:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:58.947 02:22:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:58.947 02:22:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:58.947 02:22:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:58.947 02:22:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:58.947 02:22:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:58.947 02:22:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:58.947 02:22:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:58.947 02:22:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:58.947 02:22:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:58.947 02:22:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:58.947 02:22:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:58.947 02:22:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:58.947 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:58.947 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.298 ms 00:16:58.947 00:16:58.947 --- 10.0.0.2 ping statistics --- 00:16:58.947 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:58.947 rtt min/avg/max/mdev = 0.298/0.298/0.298/0.000 ms 00:16:58.947 02:22:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:58.947 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:58.947 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.056 ms 00:16:58.947 00:16:58.947 --- 10.0.0.1 ping statistics --- 00:16:58.947 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:58.947 rtt min/avg/max/mdev = 0.056/0.056/0.056/0.000 ms 00:16:58.947 02:22:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:58.947 02:22:02 -- nvmf/common.sh@410 -- # return 0 00:16:58.947 02:22:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:58.947 02:22:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:58.947 02:22:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:58.947 02:22:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:58.947 02:22:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:58.947 02:22:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:58.947 02:22:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:59.205 02:22:02 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:16:59.205 02:22:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:59.205 02:22:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:59.205 02:22:02 -- common/autotest_common.sh@10 -- # set +x 00:16:59.205 02:22:02 -- nvmf/common.sh@469 -- # nvmfpid=129106 00:16:59.205 02:22:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:16:59.205 02:22:02 -- nvmf/common.sh@470 -- # waitforlisten 129106 00:16:59.205 02:22:02 -- common/autotest_common.sh@829 -- # '[' -z 129106 ']' 00:16:59.205 02:22:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:59.205 02:22:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:59.205 02:22:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:59.205 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:59.205 02:22:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:59.205 02:22:02 -- common/autotest_common.sh@10 -- # set +x 00:16:59.205 [2024-11-29 02:22:02.684276] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:59.205 [2024-11-29 02:22:02.684362] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:16:59.205 [2024-11-29 02:22:02.758951] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:59.205 [2024-11-29 02:22:02.880875] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:59.205 [2024-11-29 02:22:02.881032] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:59.205 [2024-11-29 02:22:02.881069] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:59.205 [2024-11-29 02:22:02.881084] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:59.205 [2024-11-29 02:22:02.881168] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:59.205 [2024-11-29 02:22:02.881226] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:16:59.205 [2024-11-29 02:22:02.881258] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:16:59.205 [2024-11-29 02:22:02.881260] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:00.140 02:22:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:00.140 02:22:03 -- common/autotest_common.sh@862 -- # return 0 00:17:00.140 02:22:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:00.140 02:22:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:00.140 02:22:03 -- common/autotest_common.sh@10 -- # set +x 00:17:00.140 02:22:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:00.140 02:22:03 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:00.140 02:22:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:00.140 02:22:03 -- common/autotest_common.sh@10 -- # set +x 00:17:00.140 [2024-11-29 02:22:03.663800] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:00.140 02:22:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:00.140 02:22:03 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:00.140 02:22:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:00.140 02:22:03 -- common/autotest_common.sh@10 -- # set +x 00:17:00.140 Malloc0 00:17:00.140 02:22:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:00.140 02:22:03 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:00.140 02:22:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:00.140 02:22:03 -- common/autotest_common.sh@10 -- # set +x 00:17:00.140 02:22:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:00.140 02:22:03 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:00.140 02:22:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:00.140 02:22:03 -- common/autotest_common.sh@10 -- # set +x 00:17:00.140 02:22:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:00.140 02:22:03 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:00.140 02:22:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:00.140 02:22:03 -- common/autotest_common.sh@10 -- # set +x 00:17:00.140 [2024-11-29 02:22:03.701694] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:00.140 02:22:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:00.140 02:22:03 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:17:00.140 02:22:03 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:00.140 02:22:03 -- nvmf/common.sh@520 -- # config=() 00:17:00.140 02:22:03 -- nvmf/common.sh@520 -- # local subsystem config 00:17:00.140 02:22:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:00.140 02:22:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:00.140 { 00:17:00.140 "params": { 00:17:00.140 "name": "Nvme$subsystem", 00:17:00.140 "trtype": "$TEST_TRANSPORT", 00:17:00.140 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:00.140 "adrfam": "ipv4", 00:17:00.140 "trsvcid": "$NVMF_PORT", 00:17:00.140 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:00.140 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:00.140 "hdgst": ${hdgst:-false}, 00:17:00.140 "ddgst": ${ddgst:-false} 00:17:00.140 }, 00:17:00.140 "method": "bdev_nvme_attach_controller" 00:17:00.140 } 00:17:00.140 EOF 00:17:00.140 )") 00:17:00.140 02:22:03 -- nvmf/common.sh@542 -- # cat 00:17:00.140 02:22:03 -- nvmf/common.sh@544 -- # jq . 00:17:00.140 02:22:03 -- nvmf/common.sh@545 -- # IFS=, 00:17:00.140 02:22:03 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:00.140 "params": { 00:17:00.140 "name": "Nvme1", 00:17:00.140 "trtype": "tcp", 00:17:00.140 "traddr": "10.0.0.2", 00:17:00.140 "adrfam": "ipv4", 00:17:00.140 "trsvcid": "4420", 00:17:00.140 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:00.140 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:00.140 "hdgst": false, 00:17:00.140 "ddgst": false 00:17:00.140 }, 00:17:00.140 "method": "bdev_nvme_attach_controller" 00:17:00.140 }' 00:17:00.140 [2024-11-29 02:22:03.747500] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:00.140 [2024-11-29 02:22:03.747582] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid129195 ] 00:17:00.140 [2024-11-29 02:22:03.815826] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:00.399 [2024-11-29 02:22:03.931231] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:00.399 [2024-11-29 02:22:03.931284] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:00.399 [2024-11-29 02:22:03.931287] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:00.666 [2024-11-29 02:22:04.247452] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:00.666 [2024-11-29 02:22:04.247518] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:00.666 I/O targets: 00:17:00.666 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:00.666 00:17:00.666 00:17:00.666 CUnit - A unit testing framework for C - Version 2.1-3 00:17:00.666 http://cunit.sourceforge.net/ 00:17:00.666 00:17:00.666 00:17:00.666 Suite: bdevio tests on: Nvme1n1 00:17:00.666 Test: blockdev write read block ...passed 00:17:00.666 Test: blockdev write zeroes read block ...passed 00:17:00.666 Test: blockdev write zeroes read no split ...passed 00:17:00.924 Test: blockdev write zeroes read split ...passed 00:17:00.924 Test: blockdev write zeroes read split partial ...passed 00:17:00.924 Test: blockdev reset ...[2024-11-29 02:22:04.408758] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:00.924 [2024-11-29 02:22:04.408861] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x149a7d0 (9): Bad file descriptor 00:17:00.924 [2024-11-29 02:22:04.506700] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:00.924 passed 00:17:00.924 Test: blockdev write read 8 blocks ...passed 00:17:00.924 Test: blockdev write read size > 128k ...passed 00:17:00.924 Test: blockdev write read invalid size ...passed 00:17:00.924 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:00.924 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:00.924 Test: blockdev write read max offset ...passed 00:17:01.183 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:01.183 Test: blockdev writev readv 8 blocks ...passed 00:17:01.183 Test: blockdev writev readv 30 x 1block ...passed 00:17:01.183 Test: blockdev writev readv block ...passed 00:17:01.183 Test: blockdev writev readv size > 128k ...passed 00:17:01.183 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:01.183 Test: blockdev comparev and writev ...[2024-11-29 02:22:04.801588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:01.183 [2024-11-29 02:22:04.801625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:01.183 [2024-11-29 02:22:04.801649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:01.183 [2024-11-29 02:22:04.801666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:01.183 [2024-11-29 02:22:04.802087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:01.183 [2024-11-29 02:22:04.802111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:01.183 [2024-11-29 02:22:04.802132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:01.183 [2024-11-29 02:22:04.802147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:01.183 [2024-11-29 02:22:04.802557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:01.183 [2024-11-29 02:22:04.802581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:01.183 [2024-11-29 02:22:04.802602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:01.183 [2024-11-29 02:22:04.802617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:01.183 [2024-11-29 02:22:04.802982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:01.183 [2024-11-29 02:22:04.803005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:01.183 [2024-11-29 02:22:04.803026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:01.183 [2024-11-29 02:22:04.803042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:01.183 passed 00:17:01.442 Test: blockdev nvme passthru rw ...passed 00:17:01.442 Test: blockdev nvme passthru vendor specific ...[2024-11-29 02:22:04.884654] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:01.442 [2024-11-29 02:22:04.884697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:01.442 [2024-11-29 02:22:04.884861] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:01.442 [2024-11-29 02:22:04.884884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:01.442 [2024-11-29 02:22:04.885035] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:01.442 [2024-11-29 02:22:04.885058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:01.442 [2024-11-29 02:22:04.885209] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:01.442 [2024-11-29 02:22:04.885231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:01.442 passed 00:17:01.442 Test: blockdev nvme admin passthru ...passed 00:17:01.442 Test: blockdev copy ...passed 00:17:01.442 00:17:01.442 Run Summary: Type Total Ran Passed Failed Inactive 00:17:01.442 suites 1 1 n/a 0 0 00:17:01.442 tests 23 23 23 0 0 00:17:01.442 asserts 152 152 152 0 n/a 00:17:01.442 00:17:01.442 Elapsed time = 1.388 seconds 00:17:01.701 02:22:05 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:01.701 02:22:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:01.701 02:22:05 -- common/autotest_common.sh@10 -- # set +x 00:17:01.701 02:22:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:01.701 02:22:05 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:01.701 02:22:05 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:01.701 02:22:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:01.701 02:22:05 -- nvmf/common.sh@116 -- # sync 00:17:01.701 02:22:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:01.701 02:22:05 -- nvmf/common.sh@119 -- # set +e 00:17:01.701 02:22:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:01.701 02:22:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:01.701 rmmod nvme_tcp 00:17:01.701 rmmod nvme_fabrics 00:17:01.701 rmmod nvme_keyring 00:17:01.961 02:22:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:01.961 02:22:05 -- nvmf/common.sh@123 -- # set -e 00:17:01.961 02:22:05 -- nvmf/common.sh@124 -- # return 0 00:17:01.961 02:22:05 -- nvmf/common.sh@477 -- # '[' -n 129106 ']' 00:17:01.961 02:22:05 -- nvmf/common.sh@478 -- # killprocess 129106 00:17:01.961 02:22:05 -- common/autotest_common.sh@936 -- # '[' -z 129106 ']' 00:17:01.961 02:22:05 -- common/autotest_common.sh@940 -- # kill -0 129106 00:17:01.961 02:22:05 -- common/autotest_common.sh@941 -- # uname 00:17:01.961 02:22:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:01.961 02:22:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 129106 00:17:01.961 02:22:05 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:17:01.961 02:22:05 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:17:01.961 02:22:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 129106' 00:17:01.961 killing process with pid 129106 00:17:01.961 02:22:05 -- common/autotest_common.sh@955 -- # kill 129106 00:17:01.961 02:22:05 -- common/autotest_common.sh@960 -- # wait 129106 00:17:02.220 02:22:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:02.220 02:22:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:02.220 02:22:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:02.220 02:22:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:02.220 02:22:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:02.220 02:22:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:02.220 02:22:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:02.220 02:22:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:04.762 02:22:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:04.762 00:17:04.762 real 0m7.566s 00:17:04.762 user 0m15.189s 00:17:04.762 sys 0m2.642s 00:17:04.762 02:22:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:04.762 02:22:07 -- common/autotest_common.sh@10 -- # set +x 00:17:04.762 ************************************ 00:17:04.762 END TEST nvmf_bdevio_no_huge 00:17:04.762 ************************************ 00:17:04.762 02:22:07 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:04.762 02:22:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:04.762 02:22:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:04.762 02:22:07 -- common/autotest_common.sh@10 -- # set +x 00:17:04.762 ************************************ 00:17:04.762 START TEST nvmf_tls 00:17:04.762 ************************************ 00:17:04.762 02:22:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:04.762 * Looking for test storage... 00:17:04.762 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:04.762 02:22:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:04.762 02:22:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:04.762 02:22:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:04.762 02:22:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:04.762 02:22:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:04.762 02:22:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:04.762 02:22:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:04.762 02:22:08 -- scripts/common.sh@335 -- # IFS=.-: 00:17:04.762 02:22:08 -- scripts/common.sh@335 -- # read -ra ver1 00:17:04.762 02:22:08 -- scripts/common.sh@336 -- # IFS=.-: 00:17:04.762 02:22:08 -- scripts/common.sh@336 -- # read -ra ver2 00:17:04.762 02:22:08 -- scripts/common.sh@337 -- # local 'op=<' 00:17:04.762 02:22:08 -- scripts/common.sh@339 -- # ver1_l=2 00:17:04.762 02:22:08 -- scripts/common.sh@340 -- # ver2_l=1 00:17:04.762 02:22:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:04.762 02:22:08 -- scripts/common.sh@343 -- # case "$op" in 00:17:04.762 02:22:08 -- scripts/common.sh@344 -- # : 1 00:17:04.762 02:22:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:04.762 02:22:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:04.762 02:22:08 -- scripts/common.sh@364 -- # decimal 1 00:17:04.762 02:22:08 -- scripts/common.sh@352 -- # local d=1 00:17:04.762 02:22:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:04.762 02:22:08 -- scripts/common.sh@354 -- # echo 1 00:17:04.762 02:22:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:04.762 02:22:08 -- scripts/common.sh@365 -- # decimal 2 00:17:04.762 02:22:08 -- scripts/common.sh@352 -- # local d=2 00:17:04.762 02:22:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:04.762 02:22:08 -- scripts/common.sh@354 -- # echo 2 00:17:04.762 02:22:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:04.762 02:22:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:04.762 02:22:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:04.762 02:22:08 -- scripts/common.sh@367 -- # return 0 00:17:04.762 02:22:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:04.762 02:22:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:04.762 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:04.762 --rc genhtml_branch_coverage=1 00:17:04.762 --rc genhtml_function_coverage=1 00:17:04.762 --rc genhtml_legend=1 00:17:04.762 --rc geninfo_all_blocks=1 00:17:04.762 --rc geninfo_unexecuted_blocks=1 00:17:04.762 00:17:04.762 ' 00:17:04.762 02:22:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:04.762 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:04.762 --rc genhtml_branch_coverage=1 00:17:04.762 --rc genhtml_function_coverage=1 00:17:04.762 --rc genhtml_legend=1 00:17:04.762 --rc geninfo_all_blocks=1 00:17:04.762 --rc geninfo_unexecuted_blocks=1 00:17:04.762 00:17:04.762 ' 00:17:04.762 02:22:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:04.762 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:04.762 --rc genhtml_branch_coverage=1 00:17:04.762 --rc genhtml_function_coverage=1 00:17:04.762 --rc genhtml_legend=1 00:17:04.762 --rc geninfo_all_blocks=1 00:17:04.762 --rc geninfo_unexecuted_blocks=1 00:17:04.762 00:17:04.762 ' 00:17:04.762 02:22:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:04.762 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:04.762 --rc genhtml_branch_coverage=1 00:17:04.762 --rc genhtml_function_coverage=1 00:17:04.762 --rc genhtml_legend=1 00:17:04.762 --rc geninfo_all_blocks=1 00:17:04.762 --rc geninfo_unexecuted_blocks=1 00:17:04.762 00:17:04.762 ' 00:17:04.762 02:22:08 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:04.762 02:22:08 -- nvmf/common.sh@7 -- # uname -s 00:17:04.762 02:22:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:04.762 02:22:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:04.762 02:22:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:04.762 02:22:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:04.762 02:22:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:04.762 02:22:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:04.762 02:22:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:04.762 02:22:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:04.762 02:22:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:04.762 02:22:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:04.762 02:22:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:04.762 02:22:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:04.762 02:22:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:04.762 02:22:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:04.762 02:22:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:04.762 02:22:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:04.762 02:22:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:04.762 02:22:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:04.762 02:22:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:04.762 02:22:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:04.762 02:22:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:04.762 02:22:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:04.762 02:22:08 -- paths/export.sh@5 -- # export PATH 00:17:04.762 02:22:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:04.762 02:22:08 -- nvmf/common.sh@46 -- # : 0 00:17:04.762 02:22:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:04.762 02:22:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:04.762 02:22:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:04.762 02:22:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:04.762 02:22:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:04.762 02:22:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:04.762 02:22:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:04.762 02:22:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:04.763 02:22:08 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:04.763 02:22:08 -- target/tls.sh@71 -- # nvmftestinit 00:17:04.763 02:22:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:04.763 02:22:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:04.763 02:22:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:04.763 02:22:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:04.763 02:22:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:04.763 02:22:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:04.763 02:22:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:04.763 02:22:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:04.763 02:22:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:04.763 02:22:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:04.763 02:22:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:04.763 02:22:08 -- common/autotest_common.sh@10 -- # set +x 00:17:06.664 02:22:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:06.664 02:22:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:06.664 02:22:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:06.664 02:22:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:06.664 02:22:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:06.664 02:22:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:06.664 02:22:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:06.664 02:22:10 -- nvmf/common.sh@294 -- # net_devs=() 00:17:06.664 02:22:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:06.664 02:22:10 -- nvmf/common.sh@295 -- # e810=() 00:17:06.664 02:22:10 -- nvmf/common.sh@295 -- # local -ga e810 00:17:06.664 02:22:10 -- nvmf/common.sh@296 -- # x722=() 00:17:06.664 02:22:10 -- nvmf/common.sh@296 -- # local -ga x722 00:17:06.664 02:22:10 -- nvmf/common.sh@297 -- # mlx=() 00:17:06.664 02:22:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:06.664 02:22:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:06.664 02:22:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:06.664 02:22:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:06.664 02:22:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:06.664 02:22:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:06.664 02:22:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:06.664 02:22:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:06.664 02:22:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:06.664 02:22:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:06.664 02:22:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:06.664 02:22:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:06.664 02:22:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:06.664 02:22:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:06.664 02:22:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:06.664 02:22:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:06.664 02:22:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:06.664 02:22:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:06.664 02:22:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:06.664 02:22:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:06.664 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:06.664 02:22:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:06.664 02:22:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:06.664 02:22:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:06.664 02:22:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:06.664 02:22:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:06.664 02:22:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:06.664 02:22:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:06.664 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:06.664 02:22:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:06.664 02:22:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:06.664 02:22:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:06.664 02:22:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:06.664 02:22:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:06.664 02:22:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:06.664 02:22:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:06.664 02:22:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:06.664 02:22:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:06.664 02:22:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:06.664 02:22:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:06.664 02:22:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:06.664 02:22:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:06.664 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:06.664 02:22:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:06.664 02:22:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:06.664 02:22:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:06.664 02:22:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:06.664 02:22:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:06.664 02:22:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:06.664 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:06.664 02:22:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:06.664 02:22:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:06.664 02:22:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:06.664 02:22:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:06.664 02:22:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:06.664 02:22:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:06.664 02:22:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:06.664 02:22:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:06.664 02:22:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:06.664 02:22:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:06.664 02:22:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:06.664 02:22:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:06.664 02:22:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:06.664 02:22:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:06.664 02:22:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:06.664 02:22:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:06.664 02:22:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:06.664 02:22:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:06.664 02:22:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:06.664 02:22:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:06.664 02:22:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:06.664 02:22:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:06.664 02:22:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:06.664 02:22:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:06.664 02:22:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:06.664 02:22:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:06.664 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:06.664 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.206 ms 00:17:06.664 00:17:06.664 --- 10.0.0.2 ping statistics --- 00:17:06.664 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:06.664 rtt min/avg/max/mdev = 0.206/0.206/0.206/0.000 ms 00:17:06.664 02:22:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:06.664 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:06.664 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.076 ms 00:17:06.664 00:17:06.664 --- 10.0.0.1 ping statistics --- 00:17:06.664 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:06.664 rtt min/avg/max/mdev = 0.076/0.076/0.076/0.000 ms 00:17:06.664 02:22:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:06.664 02:22:10 -- nvmf/common.sh@410 -- # return 0 00:17:06.664 02:22:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:06.664 02:22:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:06.664 02:22:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:06.664 02:22:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:06.664 02:22:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:06.664 02:22:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:06.664 02:22:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:06.664 02:22:10 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:17:06.664 02:22:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:06.664 02:22:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:06.664 02:22:10 -- common/autotest_common.sh@10 -- # set +x 00:17:06.664 02:22:10 -- nvmf/common.sh@469 -- # nvmfpid=131368 00:17:06.664 02:22:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:17:06.664 02:22:10 -- nvmf/common.sh@470 -- # waitforlisten 131368 00:17:06.664 02:22:10 -- common/autotest_common.sh@829 -- # '[' -z 131368 ']' 00:17:06.664 02:22:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:06.664 02:22:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:06.664 02:22:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:06.664 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:06.664 02:22:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:06.664 02:22:10 -- common/autotest_common.sh@10 -- # set +x 00:17:06.664 [2024-11-29 02:22:10.294844] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:06.664 [2024-11-29 02:22:10.294924] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:06.664 EAL: No free 2048 kB hugepages reported on node 1 00:17:06.923 [2024-11-29 02:22:10.368908] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:06.923 [2024-11-29 02:22:10.486453] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:06.923 [2024-11-29 02:22:10.486592] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:06.923 [2024-11-29 02:22:10.486609] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:06.923 [2024-11-29 02:22:10.486623] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:06.923 [2024-11-29 02:22:10.486651] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:06.923 02:22:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:06.923 02:22:10 -- common/autotest_common.sh@862 -- # return 0 00:17:06.923 02:22:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:06.923 02:22:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:06.923 02:22:10 -- common/autotest_common.sh@10 -- # set +x 00:17:06.923 02:22:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:06.923 02:22:10 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:17:06.923 02:22:10 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:17:07.181 true 00:17:07.181 02:22:10 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:07.181 02:22:10 -- target/tls.sh@82 -- # jq -r .tls_version 00:17:07.440 02:22:11 -- target/tls.sh@82 -- # version=0 00:17:07.440 02:22:11 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:17:07.440 02:22:11 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:07.698 02:22:11 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:07.698 02:22:11 -- target/tls.sh@90 -- # jq -r .tls_version 00:17:07.956 02:22:11 -- target/tls.sh@90 -- # version=13 00:17:07.956 02:22:11 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:17:07.956 02:22:11 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:17:08.214 02:22:11 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:08.214 02:22:11 -- target/tls.sh@98 -- # jq -r .tls_version 00:17:08.471 02:22:12 -- target/tls.sh@98 -- # version=7 00:17:08.471 02:22:12 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:17:08.471 02:22:12 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:08.471 02:22:12 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:17:08.729 02:22:12 -- target/tls.sh@105 -- # ktls=false 00:17:08.729 02:22:12 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:17:08.729 02:22:12 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:17:08.989 02:22:12 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:08.989 02:22:12 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:17:09.249 02:22:12 -- target/tls.sh@113 -- # ktls=true 00:17:09.249 02:22:12 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:17:09.249 02:22:12 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:17:09.508 02:22:13 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:09.508 02:22:13 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:17:09.767 02:22:13 -- target/tls.sh@121 -- # ktls=false 00:17:09.767 02:22:13 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:17:09.767 02:22:13 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:17:09.767 02:22:13 -- target/tls.sh@49 -- # local key hash crc 00:17:09.767 02:22:13 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:17:09.767 02:22:13 -- target/tls.sh@51 -- # hash=01 00:17:09.767 02:22:13 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:17:09.767 02:22:13 -- target/tls.sh@52 -- # gzip -1 -c 00:17:09.767 02:22:13 -- target/tls.sh@52 -- # tail -c8 00:17:09.767 02:22:13 -- target/tls.sh@52 -- # head -c 4 00:17:09.767 02:22:13 -- target/tls.sh@52 -- # crc='p$H�' 00:17:09.767 02:22:13 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:09.767 02:22:13 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:17:09.767 02:22:13 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:09.767 02:22:13 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:09.767 02:22:13 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:17:09.767 02:22:13 -- target/tls.sh@49 -- # local key hash crc 00:17:09.767 02:22:13 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:17:09.767 02:22:13 -- target/tls.sh@51 -- # hash=01 00:17:09.767 02:22:13 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:17:09.767 02:22:13 -- target/tls.sh@52 -- # gzip -1 -c 00:17:09.767 02:22:13 -- target/tls.sh@52 -- # tail -c8 00:17:09.767 02:22:13 -- target/tls.sh@52 -- # head -c 4 00:17:09.767 02:22:13 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:17:09.767 02:22:13 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:09.767 02:22:13 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:17:09.767 02:22:13 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:09.767 02:22:13 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:09.767 02:22:13 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:09.767 02:22:13 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:09.767 02:22:13 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:09.767 02:22:13 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:09.767 02:22:13 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:09.767 02:22:13 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:09.767 02:22:13 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:10.025 02:22:13 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:17:10.594 02:22:14 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:10.595 02:22:14 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:10.595 02:22:14 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:10.595 [2024-11-29 02:22:14.258280] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:10.853 02:22:14 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:10.853 02:22:14 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:11.110 [2024-11-29 02:22:14.747583] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:11.110 [2024-11-29 02:22:14.747829] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:11.110 02:22:14 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:11.369 malloc0 00:17:11.369 02:22:15 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:11.625 02:22:15 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:11.883 02:22:15 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:12.139 EAL: No free 2048 kB hugepages reported on node 1 00:17:22.162 Initializing NVMe Controllers 00:17:22.162 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:17:22.162 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:22.162 Initialization complete. Launching workers. 00:17:22.162 ======================================================== 00:17:22.162 Latency(us) 00:17:22.162 Device Information : IOPS MiB/s Average min max 00:17:22.162 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7757.57 30.30 8252.74 1231.95 9257.11 00:17:22.162 ======================================================== 00:17:22.162 Total : 7757.57 30.30 8252.74 1231.95 9257.11 00:17:22.162 00:17:22.162 02:22:25 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:22.162 02:22:25 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:22.162 02:22:25 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:22.162 02:22:25 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:22.162 02:22:25 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:22.162 02:22:25 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:22.162 02:22:25 -- target/tls.sh@28 -- # bdevperf_pid=133326 00:17:22.162 02:22:25 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:22.162 02:22:25 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:22.162 02:22:25 -- target/tls.sh@31 -- # waitforlisten 133326 /var/tmp/bdevperf.sock 00:17:22.162 02:22:25 -- common/autotest_common.sh@829 -- # '[' -z 133326 ']' 00:17:22.162 02:22:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:22.162 02:22:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:22.162 02:22:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:22.162 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:22.162 02:22:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:22.162 02:22:25 -- common/autotest_common.sh@10 -- # set +x 00:17:22.162 [2024-11-29 02:22:25.687364] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:22.162 [2024-11-29 02:22:25.687480] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid133326 ] 00:17:22.162 EAL: No free 2048 kB hugepages reported on node 1 00:17:22.162 [2024-11-29 02:22:25.746306] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:22.421 [2024-11-29 02:22:25.850904] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:22.989 02:22:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:22.989 02:22:26 -- common/autotest_common.sh@862 -- # return 0 00:17:22.989 02:22:26 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:23.249 [2024-11-29 02:22:26.885878] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:23.508 TLSTESTn1 00:17:23.508 02:22:26 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:23.508 Running I/O for 10 seconds... 00:17:33.493 00:17:33.493 Latency(us) 00:17:33.493 [2024-11-29T01:22:37.174Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:33.493 [2024-11-29T01:22:37.174Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:33.493 Verification LBA range: start 0x0 length 0x2000 00:17:33.493 TLSTESTn1 : 10.03 3193.21 12.47 0.00 0.00 39999.37 9369.22 85051.16 00:17:33.494 [2024-11-29T01:22:37.175Z] =================================================================================================================== 00:17:33.494 [2024-11-29T01:22:37.175Z] Total : 3193.21 12.47 0.00 0.00 39999.37 9369.22 85051.16 00:17:33.494 0 00:17:33.494 02:22:37 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:33.494 02:22:37 -- target/tls.sh@45 -- # killprocess 133326 00:17:33.494 02:22:37 -- common/autotest_common.sh@936 -- # '[' -z 133326 ']' 00:17:33.494 02:22:37 -- common/autotest_common.sh@940 -- # kill -0 133326 00:17:33.494 02:22:37 -- common/autotest_common.sh@941 -- # uname 00:17:33.494 02:22:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:33.494 02:22:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 133326 00:17:33.753 02:22:37 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:33.753 02:22:37 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:33.754 02:22:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 133326' 00:17:33.754 killing process with pid 133326 00:17:33.754 02:22:37 -- common/autotest_common.sh@955 -- # kill 133326 00:17:33.754 Received shutdown signal, test time was about 10.000000 seconds 00:17:33.754 00:17:33.754 Latency(us) 00:17:33.754 [2024-11-29T01:22:37.435Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:33.754 [2024-11-29T01:22:37.435Z] =================================================================================================================== 00:17:33.754 [2024-11-29T01:22:37.435Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:33.754 02:22:37 -- common/autotest_common.sh@960 -- # wait 133326 00:17:34.012 02:22:37 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:34.012 02:22:37 -- common/autotest_common.sh@650 -- # local es=0 00:17:34.012 02:22:37 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:34.012 02:22:37 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:34.012 02:22:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:34.012 02:22:37 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:34.012 02:22:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:34.012 02:22:37 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:34.012 02:22:37 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:34.012 02:22:37 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:34.012 02:22:37 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:34.012 02:22:37 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:17:34.012 02:22:37 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:34.012 02:22:37 -- target/tls.sh@28 -- # bdevperf_pid=134704 00:17:34.012 02:22:37 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:34.012 02:22:37 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:34.012 02:22:37 -- target/tls.sh@31 -- # waitforlisten 134704 /var/tmp/bdevperf.sock 00:17:34.012 02:22:37 -- common/autotest_common.sh@829 -- # '[' -z 134704 ']' 00:17:34.012 02:22:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:34.012 02:22:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:34.012 02:22:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:34.012 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:34.012 02:22:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:34.012 02:22:37 -- common/autotest_common.sh@10 -- # set +x 00:17:34.012 [2024-11-29 02:22:37.501280] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:34.012 [2024-11-29 02:22:37.501358] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid134704 ] 00:17:34.012 EAL: No free 2048 kB hugepages reported on node 1 00:17:34.012 [2024-11-29 02:22:37.558429] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:34.012 [2024-11-29 02:22:37.658136] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:34.949 02:22:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:34.949 02:22:38 -- common/autotest_common.sh@862 -- # return 0 00:17:34.949 02:22:38 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:35.208 [2024-11-29 02:22:38.686155] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:35.208 [2024-11-29 02:22:38.692305] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:35.208 [2024-11-29 02:22:38.693023] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x207e1f0 (107): Transport endpoint is not connected 00:17:35.208 [2024-11-29 02:22:38.694009] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x207e1f0 (9): Bad file descriptor 00:17:35.208 [2024-11-29 02:22:38.695009] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:35.208 [2024-11-29 02:22:38.695028] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:35.208 [2024-11-29 02:22:38.695057] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:35.208 request: 00:17:35.208 { 00:17:35.208 "name": "TLSTEST", 00:17:35.208 "trtype": "tcp", 00:17:35.208 "traddr": "10.0.0.2", 00:17:35.208 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:35.208 "adrfam": "ipv4", 00:17:35.208 "trsvcid": "4420", 00:17:35.208 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:35.208 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:17:35.208 "method": "bdev_nvme_attach_controller", 00:17:35.208 "req_id": 1 00:17:35.208 } 00:17:35.208 Got JSON-RPC error response 00:17:35.208 response: 00:17:35.208 { 00:17:35.208 "code": -32602, 00:17:35.208 "message": "Invalid parameters" 00:17:35.208 } 00:17:35.208 02:22:38 -- target/tls.sh@36 -- # killprocess 134704 00:17:35.208 02:22:38 -- common/autotest_common.sh@936 -- # '[' -z 134704 ']' 00:17:35.208 02:22:38 -- common/autotest_common.sh@940 -- # kill -0 134704 00:17:35.208 02:22:38 -- common/autotest_common.sh@941 -- # uname 00:17:35.208 02:22:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:35.208 02:22:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 134704 00:17:35.208 02:22:38 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:35.208 02:22:38 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:35.208 02:22:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 134704' 00:17:35.208 killing process with pid 134704 00:17:35.208 02:22:38 -- common/autotest_common.sh@955 -- # kill 134704 00:17:35.208 Received shutdown signal, test time was about 10.000000 seconds 00:17:35.208 00:17:35.208 Latency(us) 00:17:35.208 [2024-11-29T01:22:38.889Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:35.208 [2024-11-29T01:22:38.889Z] =================================================================================================================== 00:17:35.208 [2024-11-29T01:22:38.889Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:35.208 02:22:38 -- common/autotest_common.sh@960 -- # wait 134704 00:17:35.466 02:22:39 -- target/tls.sh@37 -- # return 1 00:17:35.467 02:22:39 -- common/autotest_common.sh@653 -- # es=1 00:17:35.467 02:22:39 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:35.467 02:22:39 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:35.467 02:22:39 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:35.467 02:22:39 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:35.467 02:22:39 -- common/autotest_common.sh@650 -- # local es=0 00:17:35.467 02:22:39 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:35.467 02:22:39 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:35.467 02:22:39 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:35.467 02:22:39 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:35.467 02:22:39 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:35.467 02:22:39 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:35.467 02:22:39 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:35.467 02:22:39 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:35.467 02:22:39 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:17:35.467 02:22:39 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:35.467 02:22:39 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:35.467 02:22:39 -- target/tls.sh@28 -- # bdevperf_pid=134970 00:17:35.467 02:22:39 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:35.467 02:22:39 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:35.467 02:22:39 -- target/tls.sh@31 -- # waitforlisten 134970 /var/tmp/bdevperf.sock 00:17:35.467 02:22:39 -- common/autotest_common.sh@829 -- # '[' -z 134970 ']' 00:17:35.467 02:22:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:35.467 02:22:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:35.467 02:22:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:35.467 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:35.467 02:22:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:35.467 02:22:39 -- common/autotest_common.sh@10 -- # set +x 00:17:35.467 [2024-11-29 02:22:39.048511] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:35.467 [2024-11-29 02:22:39.048593] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid134970 ] 00:17:35.467 EAL: No free 2048 kB hugepages reported on node 1 00:17:35.467 [2024-11-29 02:22:39.106408] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:35.726 [2024-11-29 02:22:39.207321] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:36.663 02:22:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:36.663 02:22:39 -- common/autotest_common.sh@862 -- # return 0 00:17:36.664 02:22:39 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:36.664 [2024-11-29 02:22:40.247789] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:36.664 [2024-11-29 02:22:40.256137] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:36.664 [2024-11-29 02:22:40.256170] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:36.664 [2024-11-29 02:22:40.256224] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:36.664 [2024-11-29 02:22:40.256630] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe411f0 (107): Transport endpoint is not connected 00:17:36.664 [2024-11-29 02:22:40.257618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe411f0 (9): Bad file descriptor 00:17:36.664 [2024-11-29 02:22:40.258616] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:36.664 [2024-11-29 02:22:40.258637] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:36.664 [2024-11-29 02:22:40.258652] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:36.664 request: 00:17:36.664 { 00:17:36.664 "name": "TLSTEST", 00:17:36.664 "trtype": "tcp", 00:17:36.664 "traddr": "10.0.0.2", 00:17:36.664 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:36.664 "adrfam": "ipv4", 00:17:36.664 "trsvcid": "4420", 00:17:36.664 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:36.664 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:36.664 "method": "bdev_nvme_attach_controller", 00:17:36.664 "req_id": 1 00:17:36.664 } 00:17:36.664 Got JSON-RPC error response 00:17:36.664 response: 00:17:36.664 { 00:17:36.664 "code": -32602, 00:17:36.664 "message": "Invalid parameters" 00:17:36.664 } 00:17:36.664 02:22:40 -- target/tls.sh@36 -- # killprocess 134970 00:17:36.664 02:22:40 -- common/autotest_common.sh@936 -- # '[' -z 134970 ']' 00:17:36.664 02:22:40 -- common/autotest_common.sh@940 -- # kill -0 134970 00:17:36.664 02:22:40 -- common/autotest_common.sh@941 -- # uname 00:17:36.664 02:22:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:36.664 02:22:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 134970 00:17:36.664 02:22:40 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:36.664 02:22:40 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:36.664 02:22:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 134970' 00:17:36.664 killing process with pid 134970 00:17:36.664 02:22:40 -- common/autotest_common.sh@955 -- # kill 134970 00:17:36.664 Received shutdown signal, test time was about 10.000000 seconds 00:17:36.664 00:17:36.664 Latency(us) 00:17:36.664 [2024-11-29T01:22:40.345Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:36.664 [2024-11-29T01:22:40.345Z] =================================================================================================================== 00:17:36.664 [2024-11-29T01:22:40.345Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:36.664 02:22:40 -- common/autotest_common.sh@960 -- # wait 134970 00:17:36.922 02:22:40 -- target/tls.sh@37 -- # return 1 00:17:36.922 02:22:40 -- common/autotest_common.sh@653 -- # es=1 00:17:36.922 02:22:40 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:36.922 02:22:40 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:36.922 02:22:40 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:36.922 02:22:40 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:36.922 02:22:40 -- common/autotest_common.sh@650 -- # local es=0 00:17:36.922 02:22:40 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:36.922 02:22:40 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:36.922 02:22:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:36.922 02:22:40 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:36.923 02:22:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:36.923 02:22:40 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:36.923 02:22:40 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:36.923 02:22:40 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:17:36.923 02:22:40 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:36.923 02:22:40 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:36.923 02:22:40 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:36.923 02:22:40 -- target/tls.sh@28 -- # bdevperf_pid=135124 00:17:36.923 02:22:40 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:36.923 02:22:40 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:36.923 02:22:40 -- target/tls.sh@31 -- # waitforlisten 135124 /var/tmp/bdevperf.sock 00:17:36.923 02:22:40 -- common/autotest_common.sh@829 -- # '[' -z 135124 ']' 00:17:36.923 02:22:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:36.923 02:22:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:36.923 02:22:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:36.923 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:36.923 02:22:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:36.923 02:22:40 -- common/autotest_common.sh@10 -- # set +x 00:17:37.181 [2024-11-29 02:22:40.623524] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:37.181 [2024-11-29 02:22:40.623596] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid135124 ] 00:17:37.181 EAL: No free 2048 kB hugepages reported on node 1 00:17:37.181 [2024-11-29 02:22:40.682077] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:37.181 [2024-11-29 02:22:40.791063] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:38.116 02:22:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:38.116 02:22:41 -- common/autotest_common.sh@862 -- # return 0 00:17:38.116 02:22:41 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:38.376 [2024-11-29 02:22:41.823356] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:38.376 [2024-11-29 02:22:41.830254] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:38.376 [2024-11-29 02:22:41.830287] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:38.376 [2024-11-29 02:22:41.830344] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:38.376 [2024-11-29 02:22:41.831244] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbc31f0 (107): Transport endpoint is not connected 00:17:38.376 [2024-11-29 02:22:41.832220] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbc31f0 (9): Bad file descriptor 00:17:38.376 [2024-11-29 02:22:41.833220] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:17:38.376 [2024-11-29 02:22:41.833238] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:38.376 [2024-11-29 02:22:41.833267] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:17:38.376 request: 00:17:38.376 { 00:17:38.376 "name": "TLSTEST", 00:17:38.376 "trtype": "tcp", 00:17:38.376 "traddr": "10.0.0.2", 00:17:38.376 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:38.376 "adrfam": "ipv4", 00:17:38.376 "trsvcid": "4420", 00:17:38.376 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:38.376 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:38.376 "method": "bdev_nvme_attach_controller", 00:17:38.376 "req_id": 1 00:17:38.376 } 00:17:38.376 Got JSON-RPC error response 00:17:38.376 response: 00:17:38.376 { 00:17:38.376 "code": -32602, 00:17:38.376 "message": "Invalid parameters" 00:17:38.376 } 00:17:38.376 02:22:41 -- target/tls.sh@36 -- # killprocess 135124 00:17:38.376 02:22:41 -- common/autotest_common.sh@936 -- # '[' -z 135124 ']' 00:17:38.376 02:22:41 -- common/autotest_common.sh@940 -- # kill -0 135124 00:17:38.376 02:22:41 -- common/autotest_common.sh@941 -- # uname 00:17:38.376 02:22:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:38.376 02:22:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 135124 00:17:38.376 02:22:41 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:38.376 02:22:41 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:38.376 02:22:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 135124' 00:17:38.376 killing process with pid 135124 00:17:38.376 02:22:41 -- common/autotest_common.sh@955 -- # kill 135124 00:17:38.376 Received shutdown signal, test time was about 10.000000 seconds 00:17:38.376 00:17:38.376 Latency(us) 00:17:38.376 [2024-11-29T01:22:42.057Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:38.376 [2024-11-29T01:22:42.057Z] =================================================================================================================== 00:17:38.376 [2024-11-29T01:22:42.057Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:38.376 02:22:41 -- common/autotest_common.sh@960 -- # wait 135124 00:17:38.636 02:22:42 -- target/tls.sh@37 -- # return 1 00:17:38.636 02:22:42 -- common/autotest_common.sh@653 -- # es=1 00:17:38.636 02:22:42 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:38.636 02:22:42 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:38.636 02:22:42 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:38.636 02:22:42 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:38.636 02:22:42 -- common/autotest_common.sh@650 -- # local es=0 00:17:38.636 02:22:42 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:38.636 02:22:42 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:38.636 02:22:42 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:38.636 02:22:42 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:38.636 02:22:42 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:38.636 02:22:42 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:38.636 02:22:42 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:38.636 02:22:42 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:38.636 02:22:42 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:38.636 02:22:42 -- target/tls.sh@23 -- # psk= 00:17:38.636 02:22:42 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:38.636 02:22:42 -- target/tls.sh@28 -- # bdevperf_pid=135276 00:17:38.636 02:22:42 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:38.636 02:22:42 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:38.636 02:22:42 -- target/tls.sh@31 -- # waitforlisten 135276 /var/tmp/bdevperf.sock 00:17:38.636 02:22:42 -- common/autotest_common.sh@829 -- # '[' -z 135276 ']' 00:17:38.636 02:22:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:38.636 02:22:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:38.636 02:22:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:38.636 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:38.636 02:22:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:38.636 02:22:42 -- common/autotest_common.sh@10 -- # set +x 00:17:38.636 [2024-11-29 02:22:42.182802] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:38.636 [2024-11-29 02:22:42.182876] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid135276 ] 00:17:38.636 EAL: No free 2048 kB hugepages reported on node 1 00:17:38.636 [2024-11-29 02:22:42.239507] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:38.897 [2024-11-29 02:22:42.345239] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:39.835 02:22:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:39.835 02:22:43 -- common/autotest_common.sh@862 -- # return 0 00:17:39.835 02:22:43 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:17:39.835 [2024-11-29 02:22:43.394441] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:39.835 [2024-11-29 02:22:43.395843] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1446050 (9): Bad file descriptor 00:17:39.835 [2024-11-29 02:22:43.396839] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:39.835 [2024-11-29 02:22:43.396858] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:39.835 [2024-11-29 02:22:43.396887] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:39.835 request: 00:17:39.835 { 00:17:39.835 "name": "TLSTEST", 00:17:39.835 "trtype": "tcp", 00:17:39.835 "traddr": "10.0.0.2", 00:17:39.835 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:39.835 "adrfam": "ipv4", 00:17:39.835 "trsvcid": "4420", 00:17:39.835 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:39.835 "method": "bdev_nvme_attach_controller", 00:17:39.835 "req_id": 1 00:17:39.835 } 00:17:39.835 Got JSON-RPC error response 00:17:39.835 response: 00:17:39.835 { 00:17:39.835 "code": -32602, 00:17:39.835 "message": "Invalid parameters" 00:17:39.835 } 00:17:39.835 02:22:43 -- target/tls.sh@36 -- # killprocess 135276 00:17:39.835 02:22:43 -- common/autotest_common.sh@936 -- # '[' -z 135276 ']' 00:17:39.835 02:22:43 -- common/autotest_common.sh@940 -- # kill -0 135276 00:17:39.835 02:22:43 -- common/autotest_common.sh@941 -- # uname 00:17:39.835 02:22:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:39.835 02:22:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 135276 00:17:39.835 02:22:43 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:39.835 02:22:43 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:39.835 02:22:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 135276' 00:17:39.835 killing process with pid 135276 00:17:39.835 02:22:43 -- common/autotest_common.sh@955 -- # kill 135276 00:17:39.835 Received shutdown signal, test time was about 10.000000 seconds 00:17:39.835 00:17:39.835 Latency(us) 00:17:39.835 [2024-11-29T01:22:43.516Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:39.835 [2024-11-29T01:22:43.516Z] =================================================================================================================== 00:17:39.835 [2024-11-29T01:22:43.516Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:39.835 02:22:43 -- common/autotest_common.sh@960 -- # wait 135276 00:17:40.095 02:22:43 -- target/tls.sh@37 -- # return 1 00:17:40.095 02:22:43 -- common/autotest_common.sh@653 -- # es=1 00:17:40.095 02:22:43 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:40.095 02:22:43 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:40.095 02:22:43 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:40.095 02:22:43 -- target/tls.sh@167 -- # killprocess 131368 00:17:40.095 02:22:43 -- common/autotest_common.sh@936 -- # '[' -z 131368 ']' 00:17:40.095 02:22:43 -- common/autotest_common.sh@940 -- # kill -0 131368 00:17:40.095 02:22:43 -- common/autotest_common.sh@941 -- # uname 00:17:40.095 02:22:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:40.095 02:22:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 131368 00:17:40.095 02:22:43 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:40.096 02:22:43 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:40.096 02:22:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 131368' 00:17:40.096 killing process with pid 131368 00:17:40.096 02:22:43 -- common/autotest_common.sh@955 -- # kill 131368 00:17:40.096 02:22:43 -- common/autotest_common.sh@960 -- # wait 131368 00:17:40.665 02:22:44 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:17:40.665 02:22:44 -- target/tls.sh@49 -- # local key hash crc 00:17:40.665 02:22:44 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:17:40.665 02:22:44 -- target/tls.sh@51 -- # hash=02 00:17:40.665 02:22:44 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:17:40.665 02:22:44 -- target/tls.sh@52 -- # gzip -1 -c 00:17:40.665 02:22:44 -- target/tls.sh@52 -- # tail -c8 00:17:40.665 02:22:44 -- target/tls.sh@52 -- # head -c 4 00:17:40.665 02:22:44 -- target/tls.sh@52 -- # crc='�e�'\''' 00:17:40.665 02:22:44 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:40.665 02:22:44 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:17:40.665 02:22:44 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:40.665 02:22:44 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:40.665 02:22:44 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:40.665 02:22:44 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:40.665 02:22:44 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:40.665 02:22:44 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:17:40.665 02:22:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:40.665 02:22:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:40.665 02:22:44 -- common/autotest_common.sh@10 -- # set +x 00:17:40.665 02:22:44 -- nvmf/common.sh@469 -- # nvmfpid=135564 00:17:40.665 02:22:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:40.665 02:22:44 -- nvmf/common.sh@470 -- # waitforlisten 135564 00:17:40.665 02:22:44 -- common/autotest_common.sh@829 -- # '[' -z 135564 ']' 00:17:40.665 02:22:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:40.665 02:22:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:40.665 02:22:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:40.665 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:40.665 02:22:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:40.665 02:22:44 -- common/autotest_common.sh@10 -- # set +x 00:17:40.665 [2024-11-29 02:22:44.116504] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:40.665 [2024-11-29 02:22:44.116590] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:40.665 EAL: No free 2048 kB hugepages reported on node 1 00:17:40.665 [2024-11-29 02:22:44.182203] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:40.665 [2024-11-29 02:22:44.286606] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:40.665 [2024-11-29 02:22:44.286765] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:40.665 [2024-11-29 02:22:44.286782] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:40.665 [2024-11-29 02:22:44.286801] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:40.665 [2024-11-29 02:22:44.286829] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:41.601 02:22:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:41.601 02:22:45 -- common/autotest_common.sh@862 -- # return 0 00:17:41.601 02:22:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:41.601 02:22:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:41.601 02:22:45 -- common/autotest_common.sh@10 -- # set +x 00:17:41.601 02:22:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:41.601 02:22:45 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:41.601 02:22:45 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:41.601 02:22:45 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:41.859 [2024-11-29 02:22:45.394371] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:41.859 02:22:45 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:42.118 02:22:45 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:42.376 [2024-11-29 02:22:45.891752] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:42.376 [2024-11-29 02:22:45.891998] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:42.376 02:22:45 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:42.633 malloc0 00:17:42.633 02:22:46 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:42.891 02:22:46 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:43.149 02:22:46 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:43.149 02:22:46 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:43.149 02:22:46 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:43.149 02:22:46 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:43.149 02:22:46 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:43.149 02:22:46 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:43.149 02:22:46 -- target/tls.sh@28 -- # bdevperf_pid=135889 00:17:43.149 02:22:46 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:43.149 02:22:46 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:43.149 02:22:46 -- target/tls.sh@31 -- # waitforlisten 135889 /var/tmp/bdevperf.sock 00:17:43.149 02:22:46 -- common/autotest_common.sh@829 -- # '[' -z 135889 ']' 00:17:43.149 02:22:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:43.149 02:22:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:43.149 02:22:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:43.149 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:43.149 02:22:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:43.149 02:22:46 -- common/autotest_common.sh@10 -- # set +x 00:17:43.149 [2024-11-29 02:22:46.791347] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:43.149 [2024-11-29 02:22:46.791446] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid135889 ] 00:17:43.149 EAL: No free 2048 kB hugepages reported on node 1 00:17:43.408 [2024-11-29 02:22:46.852154] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:43.408 [2024-11-29 02:22:46.955616] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:44.347 02:22:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:44.347 02:22:47 -- common/autotest_common.sh@862 -- # return 0 00:17:44.347 02:22:47 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:44.347 [2024-11-29 02:22:47.999667] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:44.607 TLSTESTn1 00:17:44.607 02:22:48 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:44.607 Running I/O for 10 seconds... 00:17:54.596 00:17:54.596 Latency(us) 00:17:54.596 [2024-11-29T01:22:58.277Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:54.596 [2024-11-29T01:22:58.277Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:54.596 Verification LBA range: start 0x0 length 0x2000 00:17:54.596 TLSTESTn1 : 10.01 3719.08 14.53 0.00 0.00 34369.79 4660.34 44855.75 00:17:54.596 [2024-11-29T01:22:58.277Z] =================================================================================================================== 00:17:54.596 [2024-11-29T01:22:58.278Z] Total : 3719.08 14.53 0.00 0.00 34369.79 4660.34 44855.75 00:17:54.597 0 00:17:54.597 02:22:58 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:54.597 02:22:58 -- target/tls.sh@45 -- # killprocess 135889 00:17:54.597 02:22:58 -- common/autotest_common.sh@936 -- # '[' -z 135889 ']' 00:17:54.597 02:22:58 -- common/autotest_common.sh@940 -- # kill -0 135889 00:17:54.597 02:22:58 -- common/autotest_common.sh@941 -- # uname 00:17:54.597 02:22:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:54.597 02:22:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 135889 00:17:54.856 02:22:58 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:54.856 02:22:58 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:54.856 02:22:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 135889' 00:17:54.856 killing process with pid 135889 00:17:54.856 02:22:58 -- common/autotest_common.sh@955 -- # kill 135889 00:17:54.856 Received shutdown signal, test time was about 10.000000 seconds 00:17:54.856 00:17:54.856 Latency(us) 00:17:54.856 [2024-11-29T01:22:58.537Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:54.856 [2024-11-29T01:22:58.537Z] =================================================================================================================== 00:17:54.856 [2024-11-29T01:22:58.537Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:54.856 02:22:58 -- common/autotest_common.sh@960 -- # wait 135889 00:17:55.115 02:22:58 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:55.115 02:22:58 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:55.115 02:22:58 -- common/autotest_common.sh@650 -- # local es=0 00:17:55.115 02:22:58 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:55.115 02:22:58 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:55.115 02:22:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:55.115 02:22:58 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:55.115 02:22:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:55.115 02:22:58 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:55.115 02:22:58 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:55.115 02:22:58 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:55.115 02:22:58 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:55.115 02:22:58 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:55.115 02:22:58 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:55.115 02:22:58 -- target/tls.sh@28 -- # bdevperf_pid=137362 00:17:55.115 02:22:58 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:55.115 02:22:58 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:55.115 02:22:58 -- target/tls.sh@31 -- # waitforlisten 137362 /var/tmp/bdevperf.sock 00:17:55.115 02:22:58 -- common/autotest_common.sh@829 -- # '[' -z 137362 ']' 00:17:55.115 02:22:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:55.115 02:22:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:55.115 02:22:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:55.115 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:55.115 02:22:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:55.115 02:22:58 -- common/autotest_common.sh@10 -- # set +x 00:17:55.115 [2024-11-29 02:22:58.595105] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:55.115 [2024-11-29 02:22:58.595176] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid137362 ] 00:17:55.115 EAL: No free 2048 kB hugepages reported on node 1 00:17:55.115 [2024-11-29 02:22:58.652974] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:55.115 [2024-11-29 02:22:58.756233] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:56.052 02:22:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:56.052 02:22:59 -- common/autotest_common.sh@862 -- # return 0 00:17:56.052 02:22:59 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:56.312 [2024-11-29 02:22:59.880804] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:56.312 [2024-11-29 02:22:59.880863] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:17:56.312 request: 00:17:56.312 { 00:17:56.312 "name": "TLSTEST", 00:17:56.312 "trtype": "tcp", 00:17:56.312 "traddr": "10.0.0.2", 00:17:56.312 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:56.312 "adrfam": "ipv4", 00:17:56.312 "trsvcid": "4420", 00:17:56.312 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:56.312 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:56.312 "method": "bdev_nvme_attach_controller", 00:17:56.312 "req_id": 1 00:17:56.312 } 00:17:56.312 Got JSON-RPC error response 00:17:56.312 response: 00:17:56.312 { 00:17:56.312 "code": -22, 00:17:56.312 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:17:56.312 } 00:17:56.312 02:22:59 -- target/tls.sh@36 -- # killprocess 137362 00:17:56.312 02:22:59 -- common/autotest_common.sh@936 -- # '[' -z 137362 ']' 00:17:56.312 02:22:59 -- common/autotest_common.sh@940 -- # kill -0 137362 00:17:56.312 02:22:59 -- common/autotest_common.sh@941 -- # uname 00:17:56.312 02:22:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:56.312 02:22:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 137362 00:17:56.312 02:22:59 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:56.312 02:22:59 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:56.313 02:22:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 137362' 00:17:56.313 killing process with pid 137362 00:17:56.313 02:22:59 -- common/autotest_common.sh@955 -- # kill 137362 00:17:56.313 Received shutdown signal, test time was about 10.000000 seconds 00:17:56.313 00:17:56.313 Latency(us) 00:17:56.313 [2024-11-29T01:22:59.994Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:56.313 [2024-11-29T01:22:59.994Z] =================================================================================================================== 00:17:56.313 [2024-11-29T01:22:59.994Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:56.313 02:22:59 -- common/autotest_common.sh@960 -- # wait 137362 00:17:56.571 02:23:00 -- target/tls.sh@37 -- # return 1 00:17:56.571 02:23:00 -- common/autotest_common.sh@653 -- # es=1 00:17:56.571 02:23:00 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:56.571 02:23:00 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:56.571 02:23:00 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:56.571 02:23:00 -- target/tls.sh@183 -- # killprocess 135564 00:17:56.571 02:23:00 -- common/autotest_common.sh@936 -- # '[' -z 135564 ']' 00:17:56.571 02:23:00 -- common/autotest_common.sh@940 -- # kill -0 135564 00:17:56.571 02:23:00 -- common/autotest_common.sh@941 -- # uname 00:17:56.571 02:23:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:56.571 02:23:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 135564 00:17:56.571 02:23:00 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:56.571 02:23:00 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:56.571 02:23:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 135564' 00:17:56.571 killing process with pid 135564 00:17:56.571 02:23:00 -- common/autotest_common.sh@955 -- # kill 135564 00:17:56.571 02:23:00 -- common/autotest_common.sh@960 -- # wait 135564 00:17:57.138 02:23:00 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:17:57.138 02:23:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:57.138 02:23:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:57.138 02:23:00 -- common/autotest_common.sh@10 -- # set +x 00:17:57.138 02:23:00 -- nvmf/common.sh@469 -- # nvmfpid=137649 00:17:57.138 02:23:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:57.138 02:23:00 -- nvmf/common.sh@470 -- # waitforlisten 137649 00:17:57.138 02:23:00 -- common/autotest_common.sh@829 -- # '[' -z 137649 ']' 00:17:57.138 02:23:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:57.138 02:23:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:57.138 02:23:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:57.138 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:57.138 02:23:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:57.138 02:23:00 -- common/autotest_common.sh@10 -- # set +x 00:17:57.138 [2024-11-29 02:23:00.579862] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:57.138 [2024-11-29 02:23:00.579955] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:57.138 EAL: No free 2048 kB hugepages reported on node 1 00:17:57.138 [2024-11-29 02:23:00.643972] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:57.138 [2024-11-29 02:23:00.747735] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:57.138 [2024-11-29 02:23:00.747899] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:57.138 [2024-11-29 02:23:00.747917] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:57.138 [2024-11-29 02:23:00.747930] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:57.138 [2024-11-29 02:23:00.747957] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:58.074 02:23:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:58.074 02:23:01 -- common/autotest_common.sh@862 -- # return 0 00:17:58.074 02:23:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:58.074 02:23:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:58.074 02:23:01 -- common/autotest_common.sh@10 -- # set +x 00:17:58.074 02:23:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:58.074 02:23:01 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:58.074 02:23:01 -- common/autotest_common.sh@650 -- # local es=0 00:17:58.074 02:23:01 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:58.074 02:23:01 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:17:58.074 02:23:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:58.074 02:23:01 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:17:58.074 02:23:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:58.074 02:23:01 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:58.074 02:23:01 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:58.074 02:23:01 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:58.332 [2024-11-29 02:23:01.817293] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:58.332 02:23:01 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:58.590 02:23:02 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:58.848 [2024-11-29 02:23:02.306620] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:58.848 [2024-11-29 02:23:02.306888] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:58.848 02:23:02 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:59.106 malloc0 00:17:59.106 02:23:02 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:59.364 02:23:02 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:59.651 [2024-11-29 02:23:03.104974] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:17:59.651 [2024-11-29 02:23:03.105018] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:17:59.651 [2024-11-29 02:23:03.105044] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:17:59.651 request: 00:17:59.651 { 00:17:59.651 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:59.651 "host": "nqn.2016-06.io.spdk:host1", 00:17:59.651 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:59.651 "method": "nvmf_subsystem_add_host", 00:17:59.651 "req_id": 1 00:17:59.651 } 00:17:59.651 Got JSON-RPC error response 00:17:59.651 response: 00:17:59.651 { 00:17:59.651 "code": -32603, 00:17:59.651 "message": "Internal error" 00:17:59.651 } 00:17:59.651 02:23:03 -- common/autotest_common.sh@653 -- # es=1 00:17:59.651 02:23:03 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:59.651 02:23:03 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:59.651 02:23:03 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:59.651 02:23:03 -- target/tls.sh@189 -- # killprocess 137649 00:17:59.651 02:23:03 -- common/autotest_common.sh@936 -- # '[' -z 137649 ']' 00:17:59.651 02:23:03 -- common/autotest_common.sh@940 -- # kill -0 137649 00:17:59.651 02:23:03 -- common/autotest_common.sh@941 -- # uname 00:17:59.651 02:23:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:59.651 02:23:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 137649 00:17:59.651 02:23:03 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:59.651 02:23:03 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:59.651 02:23:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 137649' 00:17:59.651 killing process with pid 137649 00:17:59.651 02:23:03 -- common/autotest_common.sh@955 -- # kill 137649 00:17:59.651 02:23:03 -- common/autotest_common.sh@960 -- # wait 137649 00:17:59.941 02:23:03 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:59.942 02:23:03 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:17:59.942 02:23:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:59.942 02:23:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:59.942 02:23:03 -- common/autotest_common.sh@10 -- # set +x 00:17:59.942 02:23:03 -- nvmf/common.sh@469 -- # nvmfpid=137960 00:17:59.942 02:23:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:59.942 02:23:03 -- nvmf/common.sh@470 -- # waitforlisten 137960 00:17:59.942 02:23:03 -- common/autotest_common.sh@829 -- # '[' -z 137960 ']' 00:17:59.942 02:23:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:59.942 02:23:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:59.942 02:23:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:59.942 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:59.942 02:23:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:59.942 02:23:03 -- common/autotest_common.sh@10 -- # set +x 00:17:59.942 [2024-11-29 02:23:03.524472] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:59.942 [2024-11-29 02:23:03.524550] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:59.942 EAL: No free 2048 kB hugepages reported on node 1 00:17:59.942 [2024-11-29 02:23:03.588808] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:00.200 [2024-11-29 02:23:03.696680] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:00.200 [2024-11-29 02:23:03.696875] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:00.200 [2024-11-29 02:23:03.696893] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:00.200 [2024-11-29 02:23:03.696906] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:00.200 [2024-11-29 02:23:03.696936] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:01.136 02:23:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:01.136 02:23:04 -- common/autotest_common.sh@862 -- # return 0 00:18:01.136 02:23:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:01.136 02:23:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:01.136 02:23:04 -- common/autotest_common.sh@10 -- # set +x 00:18:01.136 02:23:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:01.136 02:23:04 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:01.136 02:23:04 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:01.136 02:23:04 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:01.395 [2024-11-29 02:23:04.828434] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:01.395 02:23:04 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:01.652 02:23:05 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:01.910 [2024-11-29 02:23:05.333774] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:01.910 [2024-11-29 02:23:05.334053] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:01.910 02:23:05 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:02.169 malloc0 00:18:02.169 02:23:05 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:02.428 02:23:05 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:02.687 02:23:06 -- target/tls.sh@197 -- # bdevperf_pid=138323 00:18:02.687 02:23:06 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:02.687 02:23:06 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:02.687 02:23:06 -- target/tls.sh@200 -- # waitforlisten 138323 /var/tmp/bdevperf.sock 00:18:02.687 02:23:06 -- common/autotest_common.sh@829 -- # '[' -z 138323 ']' 00:18:02.687 02:23:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:02.687 02:23:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:02.687 02:23:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:02.687 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:02.687 02:23:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:02.687 02:23:06 -- common/autotest_common.sh@10 -- # set +x 00:18:02.687 [2024-11-29 02:23:06.153509] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:02.687 [2024-11-29 02:23:06.153584] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid138323 ] 00:18:02.687 EAL: No free 2048 kB hugepages reported on node 1 00:18:02.687 [2024-11-29 02:23:06.213570] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:02.687 [2024-11-29 02:23:06.315642] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:03.623 02:23:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:03.623 02:23:07 -- common/autotest_common.sh@862 -- # return 0 00:18:03.623 02:23:07 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:03.880 [2024-11-29 02:23:07.364674] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:03.880 TLSTESTn1 00:18:03.880 02:23:07 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:18:04.138 02:23:07 -- target/tls.sh@205 -- # tgtconf='{ 00:18:04.138 "subsystems": [ 00:18:04.138 { 00:18:04.138 "subsystem": "iobuf", 00:18:04.138 "config": [ 00:18:04.138 { 00:18:04.138 "method": "iobuf_set_options", 00:18:04.138 "params": { 00:18:04.138 "small_pool_count": 8192, 00:18:04.138 "large_pool_count": 1024, 00:18:04.138 "small_bufsize": 8192, 00:18:04.138 "large_bufsize": 135168 00:18:04.138 } 00:18:04.138 } 00:18:04.138 ] 00:18:04.138 }, 00:18:04.138 { 00:18:04.138 "subsystem": "sock", 00:18:04.138 "config": [ 00:18:04.138 { 00:18:04.138 "method": "sock_impl_set_options", 00:18:04.138 "params": { 00:18:04.138 "impl_name": "posix", 00:18:04.138 "recv_buf_size": 2097152, 00:18:04.138 "send_buf_size": 2097152, 00:18:04.138 "enable_recv_pipe": true, 00:18:04.138 "enable_quickack": false, 00:18:04.138 "enable_placement_id": 0, 00:18:04.138 "enable_zerocopy_send_server": true, 00:18:04.138 "enable_zerocopy_send_client": false, 00:18:04.138 "zerocopy_threshold": 0, 00:18:04.138 "tls_version": 0, 00:18:04.138 "enable_ktls": false 00:18:04.138 } 00:18:04.138 }, 00:18:04.138 { 00:18:04.138 "method": "sock_impl_set_options", 00:18:04.138 "params": { 00:18:04.138 "impl_name": "ssl", 00:18:04.138 "recv_buf_size": 4096, 00:18:04.138 "send_buf_size": 4096, 00:18:04.138 "enable_recv_pipe": true, 00:18:04.138 "enable_quickack": false, 00:18:04.138 "enable_placement_id": 0, 00:18:04.138 "enable_zerocopy_send_server": true, 00:18:04.138 "enable_zerocopy_send_client": false, 00:18:04.138 "zerocopy_threshold": 0, 00:18:04.138 "tls_version": 0, 00:18:04.138 "enable_ktls": false 00:18:04.138 } 00:18:04.138 } 00:18:04.138 ] 00:18:04.138 }, 00:18:04.138 { 00:18:04.138 "subsystem": "vmd", 00:18:04.138 "config": [] 00:18:04.138 }, 00:18:04.138 { 00:18:04.138 "subsystem": "accel", 00:18:04.138 "config": [ 00:18:04.138 { 00:18:04.138 "method": "accel_set_options", 00:18:04.138 "params": { 00:18:04.138 "small_cache_size": 128, 00:18:04.138 "large_cache_size": 16, 00:18:04.138 "task_count": 2048, 00:18:04.138 "sequence_count": 2048, 00:18:04.138 "buf_count": 2048 00:18:04.138 } 00:18:04.138 } 00:18:04.138 ] 00:18:04.138 }, 00:18:04.138 { 00:18:04.138 "subsystem": "bdev", 00:18:04.138 "config": [ 00:18:04.138 { 00:18:04.138 "method": "bdev_set_options", 00:18:04.138 "params": { 00:18:04.138 "bdev_io_pool_size": 65535, 00:18:04.138 "bdev_io_cache_size": 256, 00:18:04.138 "bdev_auto_examine": true, 00:18:04.138 "iobuf_small_cache_size": 128, 00:18:04.138 "iobuf_large_cache_size": 16 00:18:04.138 } 00:18:04.138 }, 00:18:04.138 { 00:18:04.138 "method": "bdev_raid_set_options", 00:18:04.138 "params": { 00:18:04.138 "process_window_size_kb": 1024 00:18:04.138 } 00:18:04.138 }, 00:18:04.138 { 00:18:04.138 "method": "bdev_iscsi_set_options", 00:18:04.138 "params": { 00:18:04.138 "timeout_sec": 30 00:18:04.138 } 00:18:04.138 }, 00:18:04.138 { 00:18:04.138 "method": "bdev_nvme_set_options", 00:18:04.138 "params": { 00:18:04.139 "action_on_timeout": "none", 00:18:04.139 "timeout_us": 0, 00:18:04.139 "timeout_admin_us": 0, 00:18:04.139 "keep_alive_timeout_ms": 10000, 00:18:04.139 "transport_retry_count": 4, 00:18:04.139 "arbitration_burst": 0, 00:18:04.139 "low_priority_weight": 0, 00:18:04.139 "medium_priority_weight": 0, 00:18:04.139 "high_priority_weight": 0, 00:18:04.139 "nvme_adminq_poll_period_us": 10000, 00:18:04.139 "nvme_ioq_poll_period_us": 0, 00:18:04.139 "io_queue_requests": 0, 00:18:04.139 "delay_cmd_submit": true, 00:18:04.139 "bdev_retry_count": 3, 00:18:04.139 "transport_ack_timeout": 0, 00:18:04.139 "ctrlr_loss_timeout_sec": 0, 00:18:04.139 "reconnect_delay_sec": 0, 00:18:04.139 "fast_io_fail_timeout_sec": 0, 00:18:04.139 "generate_uuids": false, 00:18:04.139 "transport_tos": 0, 00:18:04.139 "io_path_stat": false, 00:18:04.139 "allow_accel_sequence": false 00:18:04.139 } 00:18:04.139 }, 00:18:04.139 { 00:18:04.139 "method": "bdev_nvme_set_hotplug", 00:18:04.139 "params": { 00:18:04.139 "period_us": 100000, 00:18:04.139 "enable": false 00:18:04.139 } 00:18:04.139 }, 00:18:04.139 { 00:18:04.139 "method": "bdev_malloc_create", 00:18:04.139 "params": { 00:18:04.139 "name": "malloc0", 00:18:04.139 "num_blocks": 8192, 00:18:04.139 "block_size": 4096, 00:18:04.139 "physical_block_size": 4096, 00:18:04.139 "uuid": "0860431a-8fed-4c58-8b01-d13aea14ebdf", 00:18:04.139 "optimal_io_boundary": 0 00:18:04.139 } 00:18:04.139 }, 00:18:04.139 { 00:18:04.139 "method": "bdev_wait_for_examine" 00:18:04.139 } 00:18:04.139 ] 00:18:04.139 }, 00:18:04.139 { 00:18:04.139 "subsystem": "nbd", 00:18:04.139 "config": [] 00:18:04.139 }, 00:18:04.139 { 00:18:04.139 "subsystem": "scheduler", 00:18:04.139 "config": [ 00:18:04.139 { 00:18:04.139 "method": "framework_set_scheduler", 00:18:04.139 "params": { 00:18:04.139 "name": "static" 00:18:04.139 } 00:18:04.139 } 00:18:04.139 ] 00:18:04.139 }, 00:18:04.139 { 00:18:04.139 "subsystem": "nvmf", 00:18:04.139 "config": [ 00:18:04.139 { 00:18:04.139 "method": "nvmf_set_config", 00:18:04.139 "params": { 00:18:04.139 "discovery_filter": "match_any", 00:18:04.139 "admin_cmd_passthru": { 00:18:04.139 "identify_ctrlr": false 00:18:04.139 } 00:18:04.139 } 00:18:04.139 }, 00:18:04.139 { 00:18:04.139 "method": "nvmf_set_max_subsystems", 00:18:04.139 "params": { 00:18:04.139 "max_subsystems": 1024 00:18:04.139 } 00:18:04.139 }, 00:18:04.139 { 00:18:04.139 "method": "nvmf_set_crdt", 00:18:04.139 "params": { 00:18:04.139 "crdt1": 0, 00:18:04.139 "crdt2": 0, 00:18:04.139 "crdt3": 0 00:18:04.139 } 00:18:04.139 }, 00:18:04.139 { 00:18:04.139 "method": "nvmf_create_transport", 00:18:04.139 "params": { 00:18:04.139 "trtype": "TCP", 00:18:04.139 "max_queue_depth": 128, 00:18:04.139 "max_io_qpairs_per_ctrlr": 127, 00:18:04.139 "in_capsule_data_size": 4096, 00:18:04.139 "max_io_size": 131072, 00:18:04.139 "io_unit_size": 131072, 00:18:04.139 "max_aq_depth": 128, 00:18:04.139 "num_shared_buffers": 511, 00:18:04.139 "buf_cache_size": 4294967295, 00:18:04.139 "dif_insert_or_strip": false, 00:18:04.139 "zcopy": false, 00:18:04.139 "c2h_success": false, 00:18:04.139 "sock_priority": 0, 00:18:04.139 "abort_timeout_sec": 1 00:18:04.139 } 00:18:04.139 }, 00:18:04.139 { 00:18:04.139 "method": "nvmf_create_subsystem", 00:18:04.139 "params": { 00:18:04.139 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:04.139 "allow_any_host": false, 00:18:04.139 "serial_number": "SPDK00000000000001", 00:18:04.139 "model_number": "SPDK bdev Controller", 00:18:04.139 "max_namespaces": 10, 00:18:04.139 "min_cntlid": 1, 00:18:04.139 "max_cntlid": 65519, 00:18:04.139 "ana_reporting": false 00:18:04.139 } 00:18:04.139 }, 00:18:04.139 { 00:18:04.139 "method": "nvmf_subsystem_add_host", 00:18:04.139 "params": { 00:18:04.139 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:04.139 "host": "nqn.2016-06.io.spdk:host1", 00:18:04.139 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:04.139 } 00:18:04.139 }, 00:18:04.139 { 00:18:04.139 "method": "nvmf_subsystem_add_ns", 00:18:04.139 "params": { 00:18:04.139 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:04.139 "namespace": { 00:18:04.139 "nsid": 1, 00:18:04.139 "bdev_name": "malloc0", 00:18:04.139 "nguid": "0860431A8FED4C588B01D13AEA14EBDF", 00:18:04.139 "uuid": "0860431a-8fed-4c58-8b01-d13aea14ebdf" 00:18:04.139 } 00:18:04.139 } 00:18:04.139 }, 00:18:04.139 { 00:18:04.139 "method": "nvmf_subsystem_add_listener", 00:18:04.139 "params": { 00:18:04.139 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:04.139 "listen_address": { 00:18:04.139 "trtype": "TCP", 00:18:04.139 "adrfam": "IPv4", 00:18:04.139 "traddr": "10.0.0.2", 00:18:04.139 "trsvcid": "4420" 00:18:04.139 }, 00:18:04.139 "secure_channel": true 00:18:04.139 } 00:18:04.139 } 00:18:04.139 ] 00:18:04.139 } 00:18:04.139 ] 00:18:04.139 }' 00:18:04.139 02:23:07 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:18:04.397 02:23:08 -- target/tls.sh@206 -- # bdevperfconf='{ 00:18:04.397 "subsystems": [ 00:18:04.397 { 00:18:04.397 "subsystem": "iobuf", 00:18:04.397 "config": [ 00:18:04.397 { 00:18:04.397 "method": "iobuf_set_options", 00:18:04.397 "params": { 00:18:04.397 "small_pool_count": 8192, 00:18:04.397 "large_pool_count": 1024, 00:18:04.397 "small_bufsize": 8192, 00:18:04.397 "large_bufsize": 135168 00:18:04.397 } 00:18:04.397 } 00:18:04.397 ] 00:18:04.397 }, 00:18:04.397 { 00:18:04.397 "subsystem": "sock", 00:18:04.397 "config": [ 00:18:04.397 { 00:18:04.397 "method": "sock_impl_set_options", 00:18:04.397 "params": { 00:18:04.397 "impl_name": "posix", 00:18:04.397 "recv_buf_size": 2097152, 00:18:04.397 "send_buf_size": 2097152, 00:18:04.397 "enable_recv_pipe": true, 00:18:04.397 "enable_quickack": false, 00:18:04.397 "enable_placement_id": 0, 00:18:04.397 "enable_zerocopy_send_server": true, 00:18:04.397 "enable_zerocopy_send_client": false, 00:18:04.397 "zerocopy_threshold": 0, 00:18:04.397 "tls_version": 0, 00:18:04.397 "enable_ktls": false 00:18:04.397 } 00:18:04.397 }, 00:18:04.397 { 00:18:04.397 "method": "sock_impl_set_options", 00:18:04.397 "params": { 00:18:04.397 "impl_name": "ssl", 00:18:04.397 "recv_buf_size": 4096, 00:18:04.397 "send_buf_size": 4096, 00:18:04.397 "enable_recv_pipe": true, 00:18:04.397 "enable_quickack": false, 00:18:04.397 "enable_placement_id": 0, 00:18:04.397 "enable_zerocopy_send_server": true, 00:18:04.397 "enable_zerocopy_send_client": false, 00:18:04.397 "zerocopy_threshold": 0, 00:18:04.397 "tls_version": 0, 00:18:04.397 "enable_ktls": false 00:18:04.397 } 00:18:04.397 } 00:18:04.397 ] 00:18:04.397 }, 00:18:04.397 { 00:18:04.397 "subsystem": "vmd", 00:18:04.397 "config": [] 00:18:04.397 }, 00:18:04.397 { 00:18:04.397 "subsystem": "accel", 00:18:04.397 "config": [ 00:18:04.397 { 00:18:04.397 "method": "accel_set_options", 00:18:04.397 "params": { 00:18:04.397 "small_cache_size": 128, 00:18:04.397 "large_cache_size": 16, 00:18:04.397 "task_count": 2048, 00:18:04.397 "sequence_count": 2048, 00:18:04.397 "buf_count": 2048 00:18:04.397 } 00:18:04.397 } 00:18:04.397 ] 00:18:04.397 }, 00:18:04.397 { 00:18:04.397 "subsystem": "bdev", 00:18:04.397 "config": [ 00:18:04.397 { 00:18:04.397 "method": "bdev_set_options", 00:18:04.397 "params": { 00:18:04.397 "bdev_io_pool_size": 65535, 00:18:04.397 "bdev_io_cache_size": 256, 00:18:04.397 "bdev_auto_examine": true, 00:18:04.397 "iobuf_small_cache_size": 128, 00:18:04.397 "iobuf_large_cache_size": 16 00:18:04.397 } 00:18:04.397 }, 00:18:04.397 { 00:18:04.397 "method": "bdev_raid_set_options", 00:18:04.397 "params": { 00:18:04.397 "process_window_size_kb": 1024 00:18:04.397 } 00:18:04.397 }, 00:18:04.397 { 00:18:04.397 "method": "bdev_iscsi_set_options", 00:18:04.397 "params": { 00:18:04.397 "timeout_sec": 30 00:18:04.397 } 00:18:04.397 }, 00:18:04.397 { 00:18:04.397 "method": "bdev_nvme_set_options", 00:18:04.397 "params": { 00:18:04.397 "action_on_timeout": "none", 00:18:04.397 "timeout_us": 0, 00:18:04.397 "timeout_admin_us": 0, 00:18:04.397 "keep_alive_timeout_ms": 10000, 00:18:04.397 "transport_retry_count": 4, 00:18:04.397 "arbitration_burst": 0, 00:18:04.397 "low_priority_weight": 0, 00:18:04.397 "medium_priority_weight": 0, 00:18:04.397 "high_priority_weight": 0, 00:18:04.397 "nvme_adminq_poll_period_us": 10000, 00:18:04.397 "nvme_ioq_poll_period_us": 0, 00:18:04.397 "io_queue_requests": 512, 00:18:04.397 "delay_cmd_submit": true, 00:18:04.397 "bdev_retry_count": 3, 00:18:04.397 "transport_ack_timeout": 0, 00:18:04.397 "ctrlr_loss_timeout_sec": 0, 00:18:04.397 "reconnect_delay_sec": 0, 00:18:04.397 "fast_io_fail_timeout_sec": 0, 00:18:04.397 "generate_uuids": false, 00:18:04.397 "transport_tos": 0, 00:18:04.397 "io_path_stat": false, 00:18:04.397 "allow_accel_sequence": false 00:18:04.397 } 00:18:04.397 }, 00:18:04.397 { 00:18:04.397 "method": "bdev_nvme_attach_controller", 00:18:04.397 "params": { 00:18:04.397 "name": "TLSTEST", 00:18:04.397 "trtype": "TCP", 00:18:04.397 "adrfam": "IPv4", 00:18:04.397 "traddr": "10.0.0.2", 00:18:04.397 "trsvcid": "4420", 00:18:04.397 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:04.397 "prchk_reftag": false, 00:18:04.397 "prchk_guard": false, 00:18:04.397 "ctrlr_loss_timeout_sec": 0, 00:18:04.397 "reconnect_delay_sec": 0, 00:18:04.397 "fast_io_fail_timeout_sec": 0, 00:18:04.397 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:04.397 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:04.397 "hdgst": false, 00:18:04.397 "ddgst": false 00:18:04.397 } 00:18:04.397 }, 00:18:04.397 { 00:18:04.397 "method": "bdev_nvme_set_hotplug", 00:18:04.397 "params": { 00:18:04.397 "period_us": 100000, 00:18:04.397 "enable": false 00:18:04.397 } 00:18:04.397 }, 00:18:04.397 { 00:18:04.397 "method": "bdev_wait_for_examine" 00:18:04.397 } 00:18:04.397 ] 00:18:04.397 }, 00:18:04.397 { 00:18:04.397 "subsystem": "nbd", 00:18:04.397 "config": [] 00:18:04.397 } 00:18:04.397 ] 00:18:04.397 }' 00:18:04.397 02:23:08 -- target/tls.sh@208 -- # killprocess 138323 00:18:04.397 02:23:08 -- common/autotest_common.sh@936 -- # '[' -z 138323 ']' 00:18:04.397 02:23:08 -- common/autotest_common.sh@940 -- # kill -0 138323 00:18:04.397 02:23:08 -- common/autotest_common.sh@941 -- # uname 00:18:04.397 02:23:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:04.397 02:23:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 138323 00:18:04.656 02:23:08 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:04.656 02:23:08 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:04.656 02:23:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 138323' 00:18:04.656 killing process with pid 138323 00:18:04.656 02:23:08 -- common/autotest_common.sh@955 -- # kill 138323 00:18:04.656 Received shutdown signal, test time was about 10.000000 seconds 00:18:04.656 00:18:04.656 Latency(us) 00:18:04.656 [2024-11-29T01:23:08.337Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:04.656 [2024-11-29T01:23:08.337Z] =================================================================================================================== 00:18:04.656 [2024-11-29T01:23:08.337Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:04.656 02:23:08 -- common/autotest_common.sh@960 -- # wait 138323 00:18:04.915 02:23:08 -- target/tls.sh@209 -- # killprocess 137960 00:18:04.915 02:23:08 -- common/autotest_common.sh@936 -- # '[' -z 137960 ']' 00:18:04.915 02:23:08 -- common/autotest_common.sh@940 -- # kill -0 137960 00:18:04.915 02:23:08 -- common/autotest_common.sh@941 -- # uname 00:18:04.915 02:23:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:04.915 02:23:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 137960 00:18:04.915 02:23:08 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:04.915 02:23:08 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:04.915 02:23:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 137960' 00:18:04.915 killing process with pid 137960 00:18:04.915 02:23:08 -- common/autotest_common.sh@955 -- # kill 137960 00:18:04.915 02:23:08 -- common/autotest_common.sh@960 -- # wait 137960 00:18:05.174 02:23:08 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:18:05.174 02:23:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:05.174 02:23:08 -- target/tls.sh@212 -- # echo '{ 00:18:05.174 "subsystems": [ 00:18:05.174 { 00:18:05.174 "subsystem": "iobuf", 00:18:05.174 "config": [ 00:18:05.174 { 00:18:05.174 "method": "iobuf_set_options", 00:18:05.174 "params": { 00:18:05.174 "small_pool_count": 8192, 00:18:05.174 "large_pool_count": 1024, 00:18:05.174 "small_bufsize": 8192, 00:18:05.174 "large_bufsize": 135168 00:18:05.174 } 00:18:05.174 } 00:18:05.174 ] 00:18:05.174 }, 00:18:05.174 { 00:18:05.174 "subsystem": "sock", 00:18:05.174 "config": [ 00:18:05.174 { 00:18:05.174 "method": "sock_impl_set_options", 00:18:05.174 "params": { 00:18:05.174 "impl_name": "posix", 00:18:05.174 "recv_buf_size": 2097152, 00:18:05.174 "send_buf_size": 2097152, 00:18:05.174 "enable_recv_pipe": true, 00:18:05.174 "enable_quickack": false, 00:18:05.174 "enable_placement_id": 0, 00:18:05.174 "enable_zerocopy_send_server": true, 00:18:05.174 "enable_zerocopy_send_client": false, 00:18:05.174 "zerocopy_threshold": 0, 00:18:05.174 "tls_version": 0, 00:18:05.174 "enable_ktls": false 00:18:05.174 } 00:18:05.174 }, 00:18:05.174 { 00:18:05.174 "method": "sock_impl_set_options", 00:18:05.174 "params": { 00:18:05.174 "impl_name": "ssl", 00:18:05.174 "recv_buf_size": 4096, 00:18:05.174 "send_buf_size": 4096, 00:18:05.174 "enable_recv_pipe": true, 00:18:05.174 "enable_quickack": false, 00:18:05.174 "enable_placement_id": 0, 00:18:05.174 "enable_zerocopy_send_server": true, 00:18:05.174 "enable_zerocopy_send_client": false, 00:18:05.174 "zerocopy_threshold": 0, 00:18:05.174 "tls_version": 0, 00:18:05.174 "enable_ktls": false 00:18:05.174 } 00:18:05.174 } 00:18:05.174 ] 00:18:05.174 }, 00:18:05.174 { 00:18:05.174 "subsystem": "vmd", 00:18:05.174 "config": [] 00:18:05.174 }, 00:18:05.174 { 00:18:05.174 "subsystem": "accel", 00:18:05.174 "config": [ 00:18:05.174 { 00:18:05.174 "method": "accel_set_options", 00:18:05.174 "params": { 00:18:05.174 "small_cache_size": 128, 00:18:05.174 "large_cache_size": 16, 00:18:05.174 "task_count": 2048, 00:18:05.174 "sequence_count": 2048, 00:18:05.174 "buf_count": 2048 00:18:05.174 } 00:18:05.174 } 00:18:05.174 ] 00:18:05.174 }, 00:18:05.174 { 00:18:05.174 "subsystem": "bdev", 00:18:05.174 "config": [ 00:18:05.174 { 00:18:05.174 "method": "bdev_set_options", 00:18:05.174 "params": { 00:18:05.174 "bdev_io_pool_size": 65535, 00:18:05.174 "bdev_io_cache_size": 256, 00:18:05.174 "bdev_auto_examine": true, 00:18:05.174 "iobuf_small_cache_size": 128, 00:18:05.174 "iobuf_large_cache_size": 16 00:18:05.174 } 00:18:05.174 }, 00:18:05.174 { 00:18:05.174 "method": "bdev_raid_set_options", 00:18:05.174 "params": { 00:18:05.174 "process_window_size_kb": 1024 00:18:05.174 } 00:18:05.174 }, 00:18:05.174 { 00:18:05.174 "method": "bdev_iscsi_set_options", 00:18:05.174 "params": { 00:18:05.174 "timeout_sec": 30 00:18:05.174 } 00:18:05.174 }, 00:18:05.174 { 00:18:05.174 "method": "bdev_nvme_set_options", 00:18:05.174 "params": { 00:18:05.174 "action_on_timeout": "none", 00:18:05.174 "timeout_us": 0, 00:18:05.174 "timeout_admin_us": 0, 00:18:05.174 "keep_alive_timeout_ms": 10000, 00:18:05.174 "transport_retry_count": 4, 00:18:05.174 "arbitration_burst": 0, 00:18:05.174 "low_priority_weight": 0, 00:18:05.174 "medium_priority_weight": 0, 00:18:05.175 "high_priority_weight": 0, 00:18:05.175 "nvme_adminq_poll_period_us": 10000, 00:18:05.175 "nvme_ioq_poll_period_us": 0, 00:18:05.175 "io_queue_requests": 0, 00:18:05.175 "delay_cmd_submit": true, 00:18:05.175 "bdev_retry_count": 3, 00:18:05.175 "transport_ack_timeout": 0, 00:18:05.175 "ctrlr_loss_timeout_sec": 0, 00:18:05.175 "reconnect_delay_sec": 0, 00:18:05.175 "fast_io_fail_timeout_sec": 0, 00:18:05.175 "generate_uuids": false, 00:18:05.175 "transport_tos": 0, 00:18:05.175 "io_path_stat": false, 00:18:05.175 "allow_accel_sequence": false 00:18:05.175 } 00:18:05.175 }, 00:18:05.175 { 00:18:05.175 "method": "bdev_nvme_set_hotplug", 00:18:05.175 "params": { 00:18:05.175 "period_us": 100000, 00:18:05.175 "enable": false 00:18:05.175 } 00:18:05.175 }, 00:18:05.175 { 00:18:05.175 "method": "bdev_malloc_create", 00:18:05.175 "params": { 00:18:05.175 "name": "malloc0", 00:18:05.175 "num_blocks": 8192, 00:18:05.175 "block_size": 4096, 00:18:05.175 "physical_block_size": 4096, 00:18:05.175 "uuid": "0860431a-8fed-4c58-8b01-d13aea14ebdf", 00:18:05.175 "optimal_io_boundary": 0 00:18:05.175 } 00:18:05.175 }, 00:18:05.175 { 00:18:05.175 "method": "bdev_wait_for_examine" 00:18:05.175 } 00:18:05.175 ] 00:18:05.175 }, 00:18:05.175 { 00:18:05.175 "subsystem": "nbd", 00:18:05.175 "config": [] 00:18:05.175 }, 00:18:05.175 { 00:18:05.175 "subsystem": "scheduler", 00:18:05.175 "config": [ 00:18:05.175 { 00:18:05.175 "method": "framework_set_scheduler", 00:18:05.175 "params": { 00:18:05.175 "name": "static" 00:18:05.175 } 00:18:05.175 } 00:18:05.175 ] 00:18:05.175 }, 00:18:05.175 { 00:18:05.175 "subsystem": "nvmf", 00:18:05.175 "config": [ 00:18:05.175 { 00:18:05.175 "method": "nvmf_set_config", 00:18:05.175 "params": { 00:18:05.175 "discovery_filter": "match_any", 00:18:05.175 "admin_cmd_passthru": { 00:18:05.175 "identify_ctrlr": false 00:18:05.175 } 00:18:05.175 } 00:18:05.175 }, 00:18:05.175 { 00:18:05.175 "method": "nvmf_set_max_subsystems", 00:18:05.175 "params": { 00:18:05.175 "max_subsystems": 1024 00:18:05.175 } 00:18:05.175 }, 00:18:05.175 { 00:18:05.175 "method": "nvmf_set_crdt", 00:18:05.175 "params": { 00:18:05.175 "crdt1": 0, 00:18:05.175 "crdt2": 0, 00:18:05.175 "crdt3": 0 00:18:05.175 } 00:18:05.175 }, 00:18:05.175 { 00:18:05.175 "method": "nvmf_create_transport", 00:18:05.175 "params": { 00:18:05.175 "trtype": "TCP", 00:18:05.175 "max_queue_depth": 128, 00:18:05.175 "max_io_qpairs_per_ctrlr": 127, 00:18:05.175 "in_capsule_data_size": 4096, 00:18:05.175 "max_io_size": 131072, 00:18:05.175 "io_unit_size": 131072, 00:18:05.175 "max_aq_depth": 128, 00:18:05.175 "num_shared_buffers": 511, 00:18:05.175 "buf_cache_size": 4294967295, 00:18:05.175 "dif_insert_or_strip": false, 00:18:05.175 "zcopy": false, 00:18:05.175 "c2h_success": false, 00:18:05.175 "sock_priority": 0, 00:18:05.175 "abort_timeout_sec": 1 00:18:05.175 } 00:18:05.175 }, 00:18:05.175 { 00:18:05.175 "method": "nvmf_create_subsystem", 00:18:05.175 "params": { 00:18:05.175 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:05.175 "allow_any_host": false, 00:18:05.175 "serial_number": "SPDK00000000000001", 00:18:05.175 "model_number": "SPDK bdev Controller", 00:18:05.175 "max_namespaces": 10, 00:18:05.175 "min_cntlid": 1, 00:18:05.175 "max_cntlid": 65519, 00:18:05.175 "ana_reporting": false 00:18:05.175 } 00:18:05.175 }, 00:18:05.175 { 00:18:05.175 "method": "nvmf_subsystem_add_host", 00:18:05.175 "params": { 00:18:05.175 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:05.175 "host": "nqn.2016-06.io.spdk:host1", 00:18:05.175 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:05.175 } 00:18:05.175 }, 00:18:05.175 { 00:18:05.175 "method": "nvmf_subsystem_add_ns", 00:18:05.175 "params": { 00:18:05.175 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:05.175 "namespace": { 00:18:05.175 "nsid": 1, 00:18:05.175 "bdev_name": "malloc0", 00:18:05.175 "nguid": "0860431A8FED4C588B01D13AEA14EBDF", 00:18:05.175 "uuid": "0860431a-8fed-4c58-8b01-d13aea14ebdf" 00:18:05.175 } 00:18:05.175 } 00:18:05.175 }, 00:18:05.175 { 00:18:05.175 "method": "nvmf_subsystem_add_listener", 00:18:05.175 "params": { 00:18:05.175 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:05.175 "listen_address": { 00:18:05.175 "trtype": "TCP", 00:18:05.175 "adrfam": "IPv4", 00:18:05.175 "traddr": "10.0.0.2", 00:18:05.175 "trsvcid": "4420" 00:18:05.175 }, 00:18:05.175 "secure_channel": true 00:18:05.175 } 00:18:05.175 } 00:18:05.175 ] 00:18:05.175 } 00:18:05.175 ] 00:18:05.175 }' 00:18:05.175 02:23:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:05.175 02:23:08 -- common/autotest_common.sh@10 -- # set +x 00:18:05.175 02:23:08 -- nvmf/common.sh@469 -- # nvmfpid=138682 00:18:05.175 02:23:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:18:05.175 02:23:08 -- nvmf/common.sh@470 -- # waitforlisten 138682 00:18:05.175 02:23:08 -- common/autotest_common.sh@829 -- # '[' -z 138682 ']' 00:18:05.175 02:23:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:05.175 02:23:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:05.175 02:23:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:05.175 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:05.175 02:23:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:05.175 02:23:08 -- common/autotest_common.sh@10 -- # set +x 00:18:05.175 [2024-11-29 02:23:08.711172] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:05.175 [2024-11-29 02:23:08.711263] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:05.175 EAL: No free 2048 kB hugepages reported on node 1 00:18:05.175 [2024-11-29 02:23:08.779608] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:05.435 [2024-11-29 02:23:08.891337] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:05.435 [2024-11-29 02:23:08.891524] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:05.435 [2024-11-29 02:23:08.891547] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:05.435 [2024-11-29 02:23:08.891562] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:05.435 [2024-11-29 02:23:08.891602] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:05.693 [2024-11-29 02:23:09.123851] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:05.693 [2024-11-29 02:23:09.155863] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:05.693 [2024-11-29 02:23:09.156125] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:06.260 02:23:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:06.260 02:23:09 -- common/autotest_common.sh@862 -- # return 0 00:18:06.260 02:23:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:06.260 02:23:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:06.260 02:23:09 -- common/autotest_common.sh@10 -- # set +x 00:18:06.260 02:23:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:06.260 02:23:09 -- target/tls.sh@216 -- # bdevperf_pid=138839 00:18:06.260 02:23:09 -- target/tls.sh@217 -- # waitforlisten 138839 /var/tmp/bdevperf.sock 00:18:06.260 02:23:09 -- common/autotest_common.sh@829 -- # '[' -z 138839 ']' 00:18:06.260 02:23:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:06.260 02:23:09 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:18:06.260 02:23:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:06.260 02:23:09 -- target/tls.sh@213 -- # echo '{ 00:18:06.260 "subsystems": [ 00:18:06.260 { 00:18:06.260 "subsystem": "iobuf", 00:18:06.260 "config": [ 00:18:06.260 { 00:18:06.260 "method": "iobuf_set_options", 00:18:06.260 "params": { 00:18:06.260 "small_pool_count": 8192, 00:18:06.260 "large_pool_count": 1024, 00:18:06.260 "small_bufsize": 8192, 00:18:06.260 "large_bufsize": 135168 00:18:06.260 } 00:18:06.260 } 00:18:06.260 ] 00:18:06.260 }, 00:18:06.260 { 00:18:06.260 "subsystem": "sock", 00:18:06.260 "config": [ 00:18:06.260 { 00:18:06.260 "method": "sock_impl_set_options", 00:18:06.260 "params": { 00:18:06.260 "impl_name": "posix", 00:18:06.260 "recv_buf_size": 2097152, 00:18:06.260 "send_buf_size": 2097152, 00:18:06.260 "enable_recv_pipe": true, 00:18:06.260 "enable_quickack": false, 00:18:06.260 "enable_placement_id": 0, 00:18:06.260 "enable_zerocopy_send_server": true, 00:18:06.260 "enable_zerocopy_send_client": false, 00:18:06.260 "zerocopy_threshold": 0, 00:18:06.260 "tls_version": 0, 00:18:06.260 "enable_ktls": false 00:18:06.260 } 00:18:06.260 }, 00:18:06.260 { 00:18:06.260 "method": "sock_impl_set_options", 00:18:06.260 "params": { 00:18:06.260 "impl_name": "ssl", 00:18:06.260 "recv_buf_size": 4096, 00:18:06.260 "send_buf_size": 4096, 00:18:06.260 "enable_recv_pipe": true, 00:18:06.260 "enable_quickack": false, 00:18:06.260 "enable_placement_id": 0, 00:18:06.260 "enable_zerocopy_send_server": true, 00:18:06.260 "enable_zerocopy_send_client": false, 00:18:06.260 "zerocopy_threshold": 0, 00:18:06.260 "tls_version": 0, 00:18:06.260 "enable_ktls": false 00:18:06.260 } 00:18:06.260 } 00:18:06.260 ] 00:18:06.260 }, 00:18:06.260 { 00:18:06.260 "subsystem": "vmd", 00:18:06.260 "config": [] 00:18:06.260 }, 00:18:06.260 { 00:18:06.260 "subsystem": "accel", 00:18:06.260 "config": [ 00:18:06.260 { 00:18:06.260 "method": "accel_set_options", 00:18:06.260 "params": { 00:18:06.260 "small_cache_size": 128, 00:18:06.260 "large_cache_size": 16, 00:18:06.260 "task_count": 2048, 00:18:06.260 "sequence_count": 2048, 00:18:06.260 "buf_count": 2048 00:18:06.260 } 00:18:06.260 } 00:18:06.260 ] 00:18:06.260 }, 00:18:06.260 { 00:18:06.260 "subsystem": "bdev", 00:18:06.260 "config": [ 00:18:06.260 { 00:18:06.260 "method": "bdev_set_options", 00:18:06.260 "params": { 00:18:06.260 "bdev_io_pool_size": 65535, 00:18:06.260 "bdev_io_cache_size": 256, 00:18:06.260 "bdev_auto_examine": true, 00:18:06.260 "iobuf_small_cache_size": 128, 00:18:06.260 "iobuf_large_cache_size": 16 00:18:06.260 } 00:18:06.260 }, 00:18:06.260 { 00:18:06.260 "method": "bdev_raid_set_options", 00:18:06.260 "params": { 00:18:06.260 "process_window_size_kb": 1024 00:18:06.260 } 00:18:06.260 }, 00:18:06.260 { 00:18:06.260 "method": "bdev_iscsi_set_options", 00:18:06.260 "params": { 00:18:06.260 "timeout_sec": 30 00:18:06.260 } 00:18:06.260 }, 00:18:06.260 { 00:18:06.260 "method": "bdev_nvme_set_options", 00:18:06.260 "params": { 00:18:06.260 "action_on_timeout": "none", 00:18:06.260 "timeout_us": 0, 00:18:06.260 "timeout_admin_us": 0, 00:18:06.261 "keep_alive_timeout_ms": 10000, 00:18:06.261 "transport_retry_count": 4, 00:18:06.261 "arbitration_burst": 0, 00:18:06.261 "low_priority_weight": 0, 00:18:06.261 "medium_priority_weight": 0, 00:18:06.261 "high_priority_weight": 0, 00:18:06.261 "nvme_adminq_poll_period_us": 10000, 00:18:06.261 "nvme_ioq_poll_period_us": 0, 00:18:06.261 "io_queue_requests": 512, 00:18:06.261 "delay_cmd_submit": true, 00:18:06.261 "bdev_retry_count": 3, 00:18:06.261 "transport_ack_timeout": 0, 00:18:06.261 "ctrlr_loss_timeout_sec": 0, 00:18:06.261 "reconnect_delay_sec": 0, 00:18:06.261 "fast_io_fail_timeout_sec": 0, 00:18:06.261 "generate_uuids": false, 00:18:06.261 "transport_tos": 0, 00:18:06.261 "io_path_stat": false, 00:18:06.261 "allow_accel_sequence": false 00:18:06.261 } 00:18:06.261 }, 00:18:06.261 { 00:18:06.261 "method": "bdev_nvme_attach_controller", 00:18:06.261 "params": { 00:18:06.261 "name": "TLSTEST", 00:18:06.261 "trtype": "TCP", 00:18:06.261 "adrfam": "IPv4", 00:18:06.261 "traddr": "10.0.0.2", 00:18:06.261 "trsvcid": "4420", 00:18:06.261 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:06.261 "prchk_reftag": false, 00:18:06.261 "prchk_guard": false, 00:18:06.261 "ctrlr_loss_timeout_sec": 0, 00:18:06.261 "reconnect_delay_sec": 0, 00:18:06.261 "fast_io_fail_timeout_sec": 0, 00:18:06.261 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:06.261 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:06.261 "hdgst": false, 00:18:06.261 "ddgst": false 00:18:06.261 } 00:18:06.261 }, 00:18:06.261 { 00:18:06.261 "method": "bdev_nvme_set_hotplug", 00:18:06.261 "params": { 00:18:06.261 "period_us": 100000, 00:18:06.261 "enable": false 00:18:06.261 } 00:18:06.261 }, 00:18:06.261 { 00:18:06.261 "method": "bdev_wait_for_examine" 00:18:06.261 } 00:18:06.261 ] 00:18:06.261 }, 00:18:06.261 { 00:18:06.261 "subsystem": "nbd", 00:18:06.261 "config": [] 00:18:06.261 } 00:18:06.261 ] 00:18:06.261 }' 00:18:06.261 02:23:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:06.261 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:06.261 02:23:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:06.261 02:23:09 -- common/autotest_common.sh@10 -- # set +x 00:18:06.261 [2024-11-29 02:23:09.765124] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:06.261 [2024-11-29 02:23:09.765211] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid138839 ] 00:18:06.261 EAL: No free 2048 kB hugepages reported on node 1 00:18:06.261 [2024-11-29 02:23:09.823436] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:06.261 [2024-11-29 02:23:09.930905] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:06.520 [2024-11-29 02:23:10.099938] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:07.087 02:23:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:07.087 02:23:10 -- common/autotest_common.sh@862 -- # return 0 00:18:07.087 02:23:10 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:18:07.346 Running I/O for 10 seconds... 00:18:17.333 00:18:17.333 Latency(us) 00:18:17.333 [2024-11-29T01:23:21.014Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:17.333 [2024-11-29T01:23:21.014Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:17.334 Verification LBA range: start 0x0 length 0x2000 00:18:17.334 TLSTESTn1 : 10.01 4653.21 18.18 0.00 0.00 27475.21 3252.53 47768.46 00:18:17.334 [2024-11-29T01:23:21.015Z] =================================================================================================================== 00:18:17.334 [2024-11-29T01:23:21.015Z] Total : 4653.21 18.18 0.00 0.00 27475.21 3252.53 47768.46 00:18:17.334 0 00:18:17.334 02:23:20 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:17.334 02:23:20 -- target/tls.sh@223 -- # killprocess 138839 00:18:17.334 02:23:20 -- common/autotest_common.sh@936 -- # '[' -z 138839 ']' 00:18:17.334 02:23:20 -- common/autotest_common.sh@940 -- # kill -0 138839 00:18:17.334 02:23:20 -- common/autotest_common.sh@941 -- # uname 00:18:17.334 02:23:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:17.334 02:23:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 138839 00:18:17.334 02:23:20 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:17.334 02:23:20 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:17.334 02:23:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 138839' 00:18:17.334 killing process with pid 138839 00:18:17.334 02:23:20 -- common/autotest_common.sh@955 -- # kill 138839 00:18:17.334 Received shutdown signal, test time was about 10.000000 seconds 00:18:17.334 00:18:17.334 Latency(us) 00:18:17.334 [2024-11-29T01:23:21.015Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:17.334 [2024-11-29T01:23:21.015Z] =================================================================================================================== 00:18:17.334 [2024-11-29T01:23:21.015Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:17.334 02:23:20 -- common/autotest_common.sh@960 -- # wait 138839 00:18:17.592 02:23:21 -- target/tls.sh@224 -- # killprocess 138682 00:18:17.592 02:23:21 -- common/autotest_common.sh@936 -- # '[' -z 138682 ']' 00:18:17.592 02:23:21 -- common/autotest_common.sh@940 -- # kill -0 138682 00:18:17.592 02:23:21 -- common/autotest_common.sh@941 -- # uname 00:18:17.592 02:23:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:17.592 02:23:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 138682 00:18:17.592 02:23:21 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:17.592 02:23:21 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:17.592 02:23:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 138682' 00:18:17.592 killing process with pid 138682 00:18:17.592 02:23:21 -- common/autotest_common.sh@955 -- # kill 138682 00:18:17.592 02:23:21 -- common/autotest_common.sh@960 -- # wait 138682 00:18:17.850 02:23:21 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:18:17.850 02:23:21 -- target/tls.sh@227 -- # cleanup 00:18:17.850 02:23:21 -- target/tls.sh@15 -- # process_shm --id 0 00:18:17.850 02:23:21 -- common/autotest_common.sh@806 -- # type=--id 00:18:17.850 02:23:21 -- common/autotest_common.sh@807 -- # id=0 00:18:17.850 02:23:21 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:17.850 02:23:21 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:17.850 02:23:21 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:17.850 02:23:21 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:17.850 02:23:21 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:17.850 02:23:21 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:17.850 nvmf_trace.0 00:18:18.109 02:23:21 -- common/autotest_common.sh@821 -- # return 0 00:18:18.109 02:23:21 -- target/tls.sh@16 -- # killprocess 138839 00:18:18.109 02:23:21 -- common/autotest_common.sh@936 -- # '[' -z 138839 ']' 00:18:18.109 02:23:21 -- common/autotest_common.sh@940 -- # kill -0 138839 00:18:18.109 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (138839) - No such process 00:18:18.109 02:23:21 -- common/autotest_common.sh@963 -- # echo 'Process with pid 138839 is not found' 00:18:18.109 Process with pid 138839 is not found 00:18:18.109 02:23:21 -- target/tls.sh@17 -- # nvmftestfini 00:18:18.109 02:23:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:18.109 02:23:21 -- nvmf/common.sh@116 -- # sync 00:18:18.109 02:23:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:18.109 02:23:21 -- nvmf/common.sh@119 -- # set +e 00:18:18.109 02:23:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:18.109 02:23:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:18.109 rmmod nvme_tcp 00:18:18.109 rmmod nvme_fabrics 00:18:18.109 rmmod nvme_keyring 00:18:18.109 02:23:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:18.109 02:23:21 -- nvmf/common.sh@123 -- # set -e 00:18:18.109 02:23:21 -- nvmf/common.sh@124 -- # return 0 00:18:18.109 02:23:21 -- nvmf/common.sh@477 -- # '[' -n 138682 ']' 00:18:18.109 02:23:21 -- nvmf/common.sh@478 -- # killprocess 138682 00:18:18.109 02:23:21 -- common/autotest_common.sh@936 -- # '[' -z 138682 ']' 00:18:18.109 02:23:21 -- common/autotest_common.sh@940 -- # kill -0 138682 00:18:18.109 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (138682) - No such process 00:18:18.109 02:23:21 -- common/autotest_common.sh@963 -- # echo 'Process with pid 138682 is not found' 00:18:18.109 Process with pid 138682 is not found 00:18:18.109 02:23:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:18.109 02:23:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:18.109 02:23:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:18.109 02:23:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:18.109 02:23:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:18.109 02:23:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:18.109 02:23:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:18.109 02:23:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:20.010 02:23:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:20.010 02:23:23 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:20.010 00:18:20.010 real 1m15.695s 00:18:20.010 user 1m55.953s 00:18:20.010 sys 0m24.942s 00:18:20.010 02:23:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:20.010 02:23:23 -- common/autotest_common.sh@10 -- # set +x 00:18:20.010 ************************************ 00:18:20.010 END TEST nvmf_tls 00:18:20.010 ************************************ 00:18:20.010 02:23:23 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:20.010 02:23:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:20.010 02:23:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:20.010 02:23:23 -- common/autotest_common.sh@10 -- # set +x 00:18:20.010 ************************************ 00:18:20.010 START TEST nvmf_fips 00:18:20.010 ************************************ 00:18:20.010 02:23:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:20.269 * Looking for test storage... 00:18:20.270 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:18:20.270 02:23:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:20.270 02:23:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:20.270 02:23:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:20.270 02:23:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:20.270 02:23:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:20.270 02:23:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:20.270 02:23:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:20.270 02:23:23 -- scripts/common.sh@335 -- # IFS=.-: 00:18:20.270 02:23:23 -- scripts/common.sh@335 -- # read -ra ver1 00:18:20.270 02:23:23 -- scripts/common.sh@336 -- # IFS=.-: 00:18:20.270 02:23:23 -- scripts/common.sh@336 -- # read -ra ver2 00:18:20.270 02:23:23 -- scripts/common.sh@337 -- # local 'op=<' 00:18:20.270 02:23:23 -- scripts/common.sh@339 -- # ver1_l=2 00:18:20.270 02:23:23 -- scripts/common.sh@340 -- # ver2_l=1 00:18:20.270 02:23:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:20.270 02:23:23 -- scripts/common.sh@343 -- # case "$op" in 00:18:20.270 02:23:23 -- scripts/common.sh@344 -- # : 1 00:18:20.270 02:23:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:20.270 02:23:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:20.270 02:23:23 -- scripts/common.sh@364 -- # decimal 1 00:18:20.270 02:23:23 -- scripts/common.sh@352 -- # local d=1 00:18:20.270 02:23:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:20.270 02:23:23 -- scripts/common.sh@354 -- # echo 1 00:18:20.270 02:23:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:20.270 02:23:23 -- scripts/common.sh@365 -- # decimal 2 00:18:20.270 02:23:23 -- scripts/common.sh@352 -- # local d=2 00:18:20.270 02:23:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:20.270 02:23:23 -- scripts/common.sh@354 -- # echo 2 00:18:20.270 02:23:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:20.270 02:23:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:20.270 02:23:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:20.270 02:23:23 -- scripts/common.sh@367 -- # return 0 00:18:20.270 02:23:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:20.270 02:23:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:20.270 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:20.270 --rc genhtml_branch_coverage=1 00:18:20.270 --rc genhtml_function_coverage=1 00:18:20.270 --rc genhtml_legend=1 00:18:20.270 --rc geninfo_all_blocks=1 00:18:20.270 --rc geninfo_unexecuted_blocks=1 00:18:20.270 00:18:20.270 ' 00:18:20.270 02:23:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:20.270 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:20.270 --rc genhtml_branch_coverage=1 00:18:20.270 --rc genhtml_function_coverage=1 00:18:20.270 --rc genhtml_legend=1 00:18:20.270 --rc geninfo_all_blocks=1 00:18:20.270 --rc geninfo_unexecuted_blocks=1 00:18:20.270 00:18:20.270 ' 00:18:20.270 02:23:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:20.270 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:20.270 --rc genhtml_branch_coverage=1 00:18:20.270 --rc genhtml_function_coverage=1 00:18:20.270 --rc genhtml_legend=1 00:18:20.270 --rc geninfo_all_blocks=1 00:18:20.270 --rc geninfo_unexecuted_blocks=1 00:18:20.270 00:18:20.270 ' 00:18:20.270 02:23:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:20.270 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:20.270 --rc genhtml_branch_coverage=1 00:18:20.270 --rc genhtml_function_coverage=1 00:18:20.270 --rc genhtml_legend=1 00:18:20.270 --rc geninfo_all_blocks=1 00:18:20.270 --rc geninfo_unexecuted_blocks=1 00:18:20.270 00:18:20.270 ' 00:18:20.270 02:23:23 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:20.270 02:23:23 -- nvmf/common.sh@7 -- # uname -s 00:18:20.270 02:23:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:20.270 02:23:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:20.270 02:23:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:20.270 02:23:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:20.270 02:23:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:20.270 02:23:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:20.270 02:23:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:20.270 02:23:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:20.270 02:23:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:20.270 02:23:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:20.270 02:23:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:20.270 02:23:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:20.270 02:23:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:20.270 02:23:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:20.270 02:23:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:20.270 02:23:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:20.270 02:23:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:20.270 02:23:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:20.270 02:23:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:20.270 02:23:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:20.270 02:23:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:20.270 02:23:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:20.270 02:23:23 -- paths/export.sh@5 -- # export PATH 00:18:20.270 02:23:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:20.270 02:23:23 -- nvmf/common.sh@46 -- # : 0 00:18:20.270 02:23:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:20.270 02:23:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:20.270 02:23:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:20.270 02:23:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:20.270 02:23:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:20.270 02:23:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:20.270 02:23:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:20.270 02:23:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:20.270 02:23:23 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:20.270 02:23:23 -- fips/fips.sh@89 -- # check_openssl_version 00:18:20.270 02:23:23 -- fips/fips.sh@83 -- # local target=3.0.0 00:18:20.270 02:23:23 -- fips/fips.sh@85 -- # openssl version 00:18:20.270 02:23:23 -- fips/fips.sh@85 -- # awk '{print $2}' 00:18:20.270 02:23:23 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:18:20.270 02:23:23 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:18:20.270 02:23:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:20.270 02:23:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:20.270 02:23:23 -- scripts/common.sh@335 -- # IFS=.-: 00:18:20.270 02:23:23 -- scripts/common.sh@335 -- # read -ra ver1 00:18:20.270 02:23:23 -- scripts/common.sh@336 -- # IFS=.-: 00:18:20.270 02:23:23 -- scripts/common.sh@336 -- # read -ra ver2 00:18:20.270 02:23:23 -- scripts/common.sh@337 -- # local 'op=>=' 00:18:20.270 02:23:23 -- scripts/common.sh@339 -- # ver1_l=3 00:18:20.270 02:23:23 -- scripts/common.sh@340 -- # ver2_l=3 00:18:20.270 02:23:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:20.270 02:23:23 -- scripts/common.sh@343 -- # case "$op" in 00:18:20.270 02:23:23 -- scripts/common.sh@347 -- # : 1 00:18:20.270 02:23:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:20.270 02:23:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:20.270 02:23:23 -- scripts/common.sh@364 -- # decimal 3 00:18:20.270 02:23:23 -- scripts/common.sh@352 -- # local d=3 00:18:20.270 02:23:23 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:20.270 02:23:23 -- scripts/common.sh@354 -- # echo 3 00:18:20.270 02:23:23 -- scripts/common.sh@364 -- # ver1[v]=3 00:18:20.270 02:23:23 -- scripts/common.sh@365 -- # decimal 3 00:18:20.270 02:23:23 -- scripts/common.sh@352 -- # local d=3 00:18:20.270 02:23:23 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:20.270 02:23:23 -- scripts/common.sh@354 -- # echo 3 00:18:20.270 02:23:23 -- scripts/common.sh@365 -- # ver2[v]=3 00:18:20.270 02:23:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:20.270 02:23:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:20.270 02:23:23 -- scripts/common.sh@363 -- # (( v++ )) 00:18:20.270 02:23:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:20.270 02:23:23 -- scripts/common.sh@364 -- # decimal 1 00:18:20.270 02:23:23 -- scripts/common.sh@352 -- # local d=1 00:18:20.270 02:23:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:20.270 02:23:23 -- scripts/common.sh@354 -- # echo 1 00:18:20.270 02:23:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:20.270 02:23:23 -- scripts/common.sh@365 -- # decimal 0 00:18:20.270 02:23:23 -- scripts/common.sh@352 -- # local d=0 00:18:20.270 02:23:23 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:18:20.270 02:23:23 -- scripts/common.sh@354 -- # echo 0 00:18:20.270 02:23:23 -- scripts/common.sh@365 -- # ver2[v]=0 00:18:20.270 02:23:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:20.270 02:23:23 -- scripts/common.sh@366 -- # return 0 00:18:20.271 02:23:23 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:18:20.271 02:23:23 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:18:20.271 02:23:23 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:18:20.271 02:23:23 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:18:20.271 02:23:23 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:18:20.271 02:23:23 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:18:20.271 02:23:23 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:18:20.271 02:23:23 -- fips/fips.sh@113 -- # build_openssl_config 00:18:20.271 02:23:23 -- fips/fips.sh@37 -- # cat 00:18:20.271 02:23:23 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:18:20.271 02:23:23 -- fips/fips.sh@58 -- # cat - 00:18:20.271 02:23:23 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:18:20.271 02:23:23 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:18:20.271 02:23:23 -- fips/fips.sh@116 -- # mapfile -t providers 00:18:20.271 02:23:23 -- fips/fips.sh@116 -- # openssl list -providers 00:18:20.271 02:23:23 -- fips/fips.sh@116 -- # grep name 00:18:20.271 02:23:23 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:18:20.271 02:23:23 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:18:20.271 02:23:23 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:18:20.271 02:23:23 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:18:20.271 02:23:23 -- fips/fips.sh@127 -- # : 00:18:20.271 02:23:23 -- common/autotest_common.sh@650 -- # local es=0 00:18:20.271 02:23:23 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:18:20.271 02:23:23 -- common/autotest_common.sh@638 -- # local arg=openssl 00:18:20.271 02:23:23 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:20.271 02:23:23 -- common/autotest_common.sh@642 -- # type -t openssl 00:18:20.271 02:23:23 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:20.271 02:23:23 -- common/autotest_common.sh@644 -- # type -P openssl 00:18:20.271 02:23:23 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:20.271 02:23:23 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:18:20.271 02:23:23 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:18:20.271 02:23:23 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:18:20.271 Error setting digest 00:18:20.271 40A24DC2E27F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:18:20.271 40A24DC2E27F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:18:20.271 02:23:23 -- common/autotest_common.sh@653 -- # es=1 00:18:20.271 02:23:23 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:20.271 02:23:23 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:20.271 02:23:23 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:20.271 02:23:23 -- fips/fips.sh@130 -- # nvmftestinit 00:18:20.271 02:23:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:20.271 02:23:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:20.271 02:23:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:20.271 02:23:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:20.271 02:23:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:20.271 02:23:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:20.271 02:23:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:20.271 02:23:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:20.529 02:23:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:20.529 02:23:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:20.529 02:23:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:20.529 02:23:23 -- common/autotest_common.sh@10 -- # set +x 00:18:22.433 02:23:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:22.433 02:23:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:22.433 02:23:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:22.433 02:23:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:22.433 02:23:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:22.433 02:23:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:22.433 02:23:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:22.433 02:23:25 -- nvmf/common.sh@294 -- # net_devs=() 00:18:22.433 02:23:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:22.433 02:23:25 -- nvmf/common.sh@295 -- # e810=() 00:18:22.433 02:23:25 -- nvmf/common.sh@295 -- # local -ga e810 00:18:22.433 02:23:25 -- nvmf/common.sh@296 -- # x722=() 00:18:22.433 02:23:25 -- nvmf/common.sh@296 -- # local -ga x722 00:18:22.433 02:23:25 -- nvmf/common.sh@297 -- # mlx=() 00:18:22.433 02:23:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:22.433 02:23:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:22.433 02:23:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:22.434 02:23:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:22.434 02:23:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:22.434 02:23:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:22.434 02:23:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:22.434 02:23:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:22.434 02:23:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:22.434 02:23:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:22.434 02:23:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:22.434 02:23:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:22.434 02:23:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:22.434 02:23:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:22.434 02:23:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:22.434 02:23:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:22.434 02:23:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:22.434 02:23:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:22.434 02:23:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:22.434 02:23:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:22.434 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:22.434 02:23:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:22.434 02:23:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:22.434 02:23:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:22.434 02:23:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:22.434 02:23:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:22.434 02:23:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:22.434 02:23:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:22.434 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:22.434 02:23:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:22.434 02:23:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:22.434 02:23:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:22.434 02:23:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:22.434 02:23:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:22.434 02:23:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:22.434 02:23:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:22.434 02:23:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:22.434 02:23:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:22.434 02:23:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:22.434 02:23:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:22.434 02:23:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:22.434 02:23:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:22.434 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:22.434 02:23:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:22.434 02:23:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:22.434 02:23:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:22.434 02:23:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:22.434 02:23:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:22.434 02:23:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:22.434 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:22.434 02:23:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:22.434 02:23:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:22.434 02:23:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:22.434 02:23:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:22.434 02:23:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:22.434 02:23:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:22.434 02:23:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:22.434 02:23:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:22.434 02:23:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:22.434 02:23:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:22.434 02:23:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:22.434 02:23:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:22.434 02:23:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:22.434 02:23:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:22.434 02:23:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:22.434 02:23:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:22.434 02:23:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:22.434 02:23:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:22.434 02:23:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:22.434 02:23:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:22.434 02:23:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:22.434 02:23:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:22.434 02:23:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:22.434 02:23:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:22.434 02:23:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:22.434 02:23:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:22.434 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:22.434 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.292 ms 00:18:22.434 00:18:22.434 --- 10.0.0.2 ping statistics --- 00:18:22.434 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:22.434 rtt min/avg/max/mdev = 0.292/0.292/0.292/0.000 ms 00:18:22.434 02:23:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:22.434 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:22.434 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.057 ms 00:18:22.434 00:18:22.434 --- 10.0.0.1 ping statistics --- 00:18:22.434 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:22.434 rtt min/avg/max/mdev = 0.057/0.057/0.057/0.000 ms 00:18:22.434 02:23:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:22.434 02:23:26 -- nvmf/common.sh@410 -- # return 0 00:18:22.434 02:23:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:22.434 02:23:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:22.434 02:23:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:22.434 02:23:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:22.434 02:23:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:22.434 02:23:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:22.434 02:23:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:22.434 02:23:26 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:18:22.434 02:23:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:22.434 02:23:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:22.434 02:23:26 -- common/autotest_common.sh@10 -- # set +x 00:18:22.434 02:23:26 -- nvmf/common.sh@469 -- # nvmfpid=142191 00:18:22.434 02:23:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:22.435 02:23:26 -- nvmf/common.sh@470 -- # waitforlisten 142191 00:18:22.435 02:23:26 -- common/autotest_common.sh@829 -- # '[' -z 142191 ']' 00:18:22.435 02:23:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:22.435 02:23:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:22.435 02:23:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:22.435 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:22.435 02:23:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:22.435 02:23:26 -- common/autotest_common.sh@10 -- # set +x 00:18:22.695 [2024-11-29 02:23:26.159767] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:22.695 [2024-11-29 02:23:26.159848] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:22.695 EAL: No free 2048 kB hugepages reported on node 1 00:18:22.695 [2024-11-29 02:23:26.227073] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:22.695 [2024-11-29 02:23:26.345144] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:22.695 [2024-11-29 02:23:26.345322] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:22.695 [2024-11-29 02:23:26.345341] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:22.695 [2024-11-29 02:23:26.345357] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:22.695 [2024-11-29 02:23:26.345391] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:23.632 02:23:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:23.632 02:23:27 -- common/autotest_common.sh@862 -- # return 0 00:18:23.632 02:23:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:23.632 02:23:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:23.632 02:23:27 -- common/autotest_common.sh@10 -- # set +x 00:18:23.632 02:23:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:23.632 02:23:27 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:18:23.632 02:23:27 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:23.632 02:23:27 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:23.632 02:23:27 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:23.632 02:23:27 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:23.632 02:23:27 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:23.632 02:23:27 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:23.632 02:23:27 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:23.890 [2024-11-29 02:23:27.439159] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:23.890 [2024-11-29 02:23:27.455138] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:23.890 [2024-11-29 02:23:27.455373] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:23.890 malloc0 00:18:23.890 02:23:27 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:23.890 02:23:27 -- fips/fips.sh@147 -- # bdevperf_pid=142352 00:18:23.890 02:23:27 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:23.890 02:23:27 -- fips/fips.sh@148 -- # waitforlisten 142352 /var/tmp/bdevperf.sock 00:18:23.890 02:23:27 -- common/autotest_common.sh@829 -- # '[' -z 142352 ']' 00:18:23.890 02:23:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:23.890 02:23:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:23.890 02:23:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:23.890 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:23.890 02:23:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:23.890 02:23:27 -- common/autotest_common.sh@10 -- # set +x 00:18:24.151 [2024-11-29 02:23:27.573759] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:24.151 [2024-11-29 02:23:27.573842] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid142352 ] 00:18:24.151 EAL: No free 2048 kB hugepages reported on node 1 00:18:24.151 [2024-11-29 02:23:27.635204] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:24.151 [2024-11-29 02:23:27.745351] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:25.090 02:23:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:25.090 02:23:28 -- common/autotest_common.sh@862 -- # return 0 00:18:25.090 02:23:28 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:25.349 [2024-11-29 02:23:28.845009] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:25.349 TLSTESTn1 00:18:25.349 02:23:28 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:25.609 Running I/O for 10 seconds... 00:18:35.601 00:18:35.601 Latency(us) 00:18:35.601 [2024-11-29T01:23:39.282Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:35.601 [2024-11-29T01:23:39.282Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:35.601 Verification LBA range: start 0x0 length 0x2000 00:18:35.601 TLSTESTn1 : 10.01 3705.86 14.48 0.00 0.00 34491.04 5145.79 40972.14 00:18:35.601 [2024-11-29T01:23:39.282Z] =================================================================================================================== 00:18:35.601 [2024-11-29T01:23:39.282Z] Total : 3705.86 14.48 0.00 0.00 34491.04 5145.79 40972.14 00:18:35.601 0 00:18:35.601 02:23:39 -- fips/fips.sh@1 -- # cleanup 00:18:35.601 02:23:39 -- fips/fips.sh@15 -- # process_shm --id 0 00:18:35.601 02:23:39 -- common/autotest_common.sh@806 -- # type=--id 00:18:35.601 02:23:39 -- common/autotest_common.sh@807 -- # id=0 00:18:35.601 02:23:39 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:35.601 02:23:39 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:35.601 02:23:39 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:35.601 02:23:39 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:35.601 02:23:39 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:35.601 02:23:39 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:35.601 nvmf_trace.0 00:18:35.601 02:23:39 -- common/autotest_common.sh@821 -- # return 0 00:18:35.601 02:23:39 -- fips/fips.sh@16 -- # killprocess 142352 00:18:35.601 02:23:39 -- common/autotest_common.sh@936 -- # '[' -z 142352 ']' 00:18:35.601 02:23:39 -- common/autotest_common.sh@940 -- # kill -0 142352 00:18:35.601 02:23:39 -- common/autotest_common.sh@941 -- # uname 00:18:35.601 02:23:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:35.601 02:23:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 142352 00:18:35.601 02:23:39 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:35.601 02:23:39 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:35.601 02:23:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 142352' 00:18:35.601 killing process with pid 142352 00:18:35.601 02:23:39 -- common/autotest_common.sh@955 -- # kill 142352 00:18:35.601 Received shutdown signal, test time was about 10.000000 seconds 00:18:35.601 00:18:35.601 Latency(us) 00:18:35.601 [2024-11-29T01:23:39.282Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:35.601 [2024-11-29T01:23:39.282Z] =================================================================================================================== 00:18:35.601 [2024-11-29T01:23:39.282Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:35.601 02:23:39 -- common/autotest_common.sh@960 -- # wait 142352 00:18:35.860 02:23:39 -- fips/fips.sh@17 -- # nvmftestfini 00:18:35.860 02:23:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:35.860 02:23:39 -- nvmf/common.sh@116 -- # sync 00:18:35.860 02:23:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:35.860 02:23:39 -- nvmf/common.sh@119 -- # set +e 00:18:35.860 02:23:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:35.860 02:23:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:35.860 rmmod nvme_tcp 00:18:35.860 rmmod nvme_fabrics 00:18:35.860 rmmod nvme_keyring 00:18:35.860 02:23:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:35.860 02:23:39 -- nvmf/common.sh@123 -- # set -e 00:18:35.860 02:23:39 -- nvmf/common.sh@124 -- # return 0 00:18:35.860 02:23:39 -- nvmf/common.sh@477 -- # '[' -n 142191 ']' 00:18:35.860 02:23:39 -- nvmf/common.sh@478 -- # killprocess 142191 00:18:35.860 02:23:39 -- common/autotest_common.sh@936 -- # '[' -z 142191 ']' 00:18:35.860 02:23:39 -- common/autotest_common.sh@940 -- # kill -0 142191 00:18:35.860 02:23:39 -- common/autotest_common.sh@941 -- # uname 00:18:35.860 02:23:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:35.860 02:23:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 142191 00:18:36.120 02:23:39 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:36.120 02:23:39 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:36.120 02:23:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 142191' 00:18:36.120 killing process with pid 142191 00:18:36.120 02:23:39 -- common/autotest_common.sh@955 -- # kill 142191 00:18:36.120 02:23:39 -- common/autotest_common.sh@960 -- # wait 142191 00:18:36.378 02:23:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:36.378 02:23:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:36.378 02:23:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:36.378 02:23:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:36.378 02:23:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:36.378 02:23:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:36.378 02:23:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:36.378 02:23:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:38.297 02:23:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:38.297 02:23:41 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:38.297 00:18:38.297 real 0m18.224s 00:18:38.297 user 0m20.264s 00:18:38.297 sys 0m6.800s 00:18:38.297 02:23:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:38.297 02:23:41 -- common/autotest_common.sh@10 -- # set +x 00:18:38.297 ************************************ 00:18:38.297 END TEST nvmf_fips 00:18:38.297 ************************************ 00:18:38.297 02:23:41 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:18:38.297 02:23:41 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:38.297 02:23:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:38.297 02:23:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:38.297 02:23:41 -- common/autotest_common.sh@10 -- # set +x 00:18:38.297 ************************************ 00:18:38.297 START TEST nvmf_fuzz 00:18:38.297 ************************************ 00:18:38.297 02:23:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:38.297 * Looking for test storage... 00:18:38.298 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:38.298 02:23:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:38.298 02:23:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:38.298 02:23:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:38.559 02:23:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:38.559 02:23:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:38.559 02:23:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:38.559 02:23:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:38.559 02:23:42 -- scripts/common.sh@335 -- # IFS=.-: 00:18:38.559 02:23:42 -- scripts/common.sh@335 -- # read -ra ver1 00:18:38.559 02:23:42 -- scripts/common.sh@336 -- # IFS=.-: 00:18:38.559 02:23:42 -- scripts/common.sh@336 -- # read -ra ver2 00:18:38.559 02:23:42 -- scripts/common.sh@337 -- # local 'op=<' 00:18:38.559 02:23:42 -- scripts/common.sh@339 -- # ver1_l=2 00:18:38.559 02:23:42 -- scripts/common.sh@340 -- # ver2_l=1 00:18:38.559 02:23:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:38.559 02:23:42 -- scripts/common.sh@343 -- # case "$op" in 00:18:38.559 02:23:42 -- scripts/common.sh@344 -- # : 1 00:18:38.559 02:23:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:38.559 02:23:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:38.559 02:23:42 -- scripts/common.sh@364 -- # decimal 1 00:18:38.559 02:23:42 -- scripts/common.sh@352 -- # local d=1 00:18:38.559 02:23:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:38.559 02:23:42 -- scripts/common.sh@354 -- # echo 1 00:18:38.559 02:23:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:38.559 02:23:42 -- scripts/common.sh@365 -- # decimal 2 00:18:38.559 02:23:42 -- scripts/common.sh@352 -- # local d=2 00:18:38.559 02:23:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:38.559 02:23:42 -- scripts/common.sh@354 -- # echo 2 00:18:38.559 02:23:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:38.559 02:23:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:38.559 02:23:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:38.559 02:23:42 -- scripts/common.sh@367 -- # return 0 00:18:38.559 02:23:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:38.559 02:23:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:38.559 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:38.559 --rc genhtml_branch_coverage=1 00:18:38.559 --rc genhtml_function_coverage=1 00:18:38.559 --rc genhtml_legend=1 00:18:38.559 --rc geninfo_all_blocks=1 00:18:38.559 --rc geninfo_unexecuted_blocks=1 00:18:38.559 00:18:38.559 ' 00:18:38.559 02:23:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:38.559 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:38.559 --rc genhtml_branch_coverage=1 00:18:38.559 --rc genhtml_function_coverage=1 00:18:38.559 --rc genhtml_legend=1 00:18:38.559 --rc geninfo_all_blocks=1 00:18:38.559 --rc geninfo_unexecuted_blocks=1 00:18:38.559 00:18:38.559 ' 00:18:38.559 02:23:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:38.559 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:38.559 --rc genhtml_branch_coverage=1 00:18:38.559 --rc genhtml_function_coverage=1 00:18:38.559 --rc genhtml_legend=1 00:18:38.559 --rc geninfo_all_blocks=1 00:18:38.559 --rc geninfo_unexecuted_blocks=1 00:18:38.559 00:18:38.559 ' 00:18:38.559 02:23:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:38.559 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:38.559 --rc genhtml_branch_coverage=1 00:18:38.559 --rc genhtml_function_coverage=1 00:18:38.559 --rc genhtml_legend=1 00:18:38.559 --rc geninfo_all_blocks=1 00:18:38.559 --rc geninfo_unexecuted_blocks=1 00:18:38.559 00:18:38.559 ' 00:18:38.559 02:23:42 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:38.559 02:23:42 -- nvmf/common.sh@7 -- # uname -s 00:18:38.559 02:23:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:38.559 02:23:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:38.559 02:23:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:38.559 02:23:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:38.559 02:23:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:38.559 02:23:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:38.559 02:23:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:38.559 02:23:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:38.559 02:23:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:38.559 02:23:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:38.559 02:23:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:38.559 02:23:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:38.559 02:23:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:38.559 02:23:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:38.559 02:23:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:38.559 02:23:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:38.559 02:23:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:38.559 02:23:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:38.559 02:23:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:38.559 02:23:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:38.559 02:23:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:38.560 02:23:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:38.560 02:23:42 -- paths/export.sh@5 -- # export PATH 00:18:38.560 02:23:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:38.560 02:23:42 -- nvmf/common.sh@46 -- # : 0 00:18:38.560 02:23:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:38.560 02:23:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:38.560 02:23:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:38.560 02:23:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:38.560 02:23:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:38.560 02:23:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:38.560 02:23:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:38.560 02:23:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:38.560 02:23:42 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:18:38.560 02:23:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:38.560 02:23:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:38.560 02:23:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:38.560 02:23:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:38.560 02:23:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:38.560 02:23:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:38.560 02:23:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:38.560 02:23:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:38.560 02:23:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:38.560 02:23:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:38.560 02:23:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:38.560 02:23:42 -- common/autotest_common.sh@10 -- # set +x 00:18:40.528 02:23:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:40.528 02:23:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:40.528 02:23:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:40.528 02:23:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:40.528 02:23:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:40.528 02:23:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:40.528 02:23:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:40.528 02:23:44 -- nvmf/common.sh@294 -- # net_devs=() 00:18:40.528 02:23:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:40.528 02:23:44 -- nvmf/common.sh@295 -- # e810=() 00:18:40.528 02:23:44 -- nvmf/common.sh@295 -- # local -ga e810 00:18:40.528 02:23:44 -- nvmf/common.sh@296 -- # x722=() 00:18:40.528 02:23:44 -- nvmf/common.sh@296 -- # local -ga x722 00:18:40.528 02:23:44 -- nvmf/common.sh@297 -- # mlx=() 00:18:40.528 02:23:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:40.528 02:23:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:40.528 02:23:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:40.528 02:23:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:40.528 02:23:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:40.528 02:23:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:40.528 02:23:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:40.528 02:23:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:40.528 02:23:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:40.528 02:23:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:40.528 02:23:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:40.528 02:23:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:40.528 02:23:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:40.528 02:23:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:40.528 02:23:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:40.528 02:23:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:40.528 02:23:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:40.528 02:23:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:40.528 02:23:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:40.528 02:23:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:40.528 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:40.528 02:23:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:40.528 02:23:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:40.528 02:23:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:40.528 02:23:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:40.528 02:23:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:40.528 02:23:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:40.528 02:23:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:40.528 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:40.528 02:23:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:40.528 02:23:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:40.528 02:23:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:40.528 02:23:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:40.528 02:23:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:40.528 02:23:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:40.529 02:23:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:40.529 02:23:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:40.529 02:23:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:40.529 02:23:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:40.529 02:23:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:40.529 02:23:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:40.529 02:23:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:40.529 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:40.529 02:23:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:40.529 02:23:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:40.529 02:23:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:40.529 02:23:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:40.529 02:23:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:40.529 02:23:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:40.529 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:40.529 02:23:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:40.529 02:23:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:40.529 02:23:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:40.529 02:23:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:40.529 02:23:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:40.529 02:23:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:40.529 02:23:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:40.529 02:23:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:40.529 02:23:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:40.529 02:23:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:40.529 02:23:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:40.529 02:23:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:40.529 02:23:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:40.529 02:23:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:40.529 02:23:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:40.529 02:23:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:40.529 02:23:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:40.529 02:23:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:40.529 02:23:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:40.529 02:23:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:40.529 02:23:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:40.529 02:23:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:40.529 02:23:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:40.788 02:23:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:40.788 02:23:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:40.788 02:23:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:40.788 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:40.788 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.209 ms 00:18:40.788 00:18:40.788 --- 10.0.0.2 ping statistics --- 00:18:40.788 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:40.788 rtt min/avg/max/mdev = 0.209/0.209/0.209/0.000 ms 00:18:40.788 02:23:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:40.788 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:40.788 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.070 ms 00:18:40.788 00:18:40.788 --- 10.0.0.1 ping statistics --- 00:18:40.788 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:40.788 rtt min/avg/max/mdev = 0.070/0.070/0.070/0.000 ms 00:18:40.788 02:23:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:40.788 02:23:44 -- nvmf/common.sh@410 -- # return 0 00:18:40.788 02:23:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:40.788 02:23:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:40.788 02:23:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:40.788 02:23:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:40.788 02:23:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:40.788 02:23:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:40.788 02:23:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:40.788 02:23:44 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=145800 00:18:40.788 02:23:44 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:40.788 02:23:44 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:18:40.788 02:23:44 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 145800 00:18:40.788 02:23:44 -- common/autotest_common.sh@829 -- # '[' -z 145800 ']' 00:18:40.788 02:23:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:40.788 02:23:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:40.788 02:23:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:40.788 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:40.788 02:23:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:40.788 02:23:44 -- common/autotest_common.sh@10 -- # set +x 00:18:41.726 02:23:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:41.726 02:23:45 -- common/autotest_common.sh@862 -- # return 0 00:18:41.726 02:23:45 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:41.726 02:23:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:41.726 02:23:45 -- common/autotest_common.sh@10 -- # set +x 00:18:41.726 02:23:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:41.726 02:23:45 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:18:41.726 02:23:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:41.726 02:23:45 -- common/autotest_common.sh@10 -- # set +x 00:18:41.726 Malloc0 00:18:41.726 02:23:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:41.726 02:23:45 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:41.726 02:23:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:41.726 02:23:45 -- common/autotest_common.sh@10 -- # set +x 00:18:41.726 02:23:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:41.726 02:23:45 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:41.726 02:23:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:41.726 02:23:45 -- common/autotest_common.sh@10 -- # set +x 00:18:41.726 02:23:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:41.726 02:23:45 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:41.726 02:23:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:41.726 02:23:45 -- common/autotest_common.sh@10 -- # set +x 00:18:41.726 02:23:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:41.726 02:23:45 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:18:41.726 02:23:45 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:19:13.815 Fuzzing completed. Shutting down the fuzz application 00:19:13.815 00:19:13.815 Dumping successful admin opcodes: 00:19:13.815 8, 9, 10, 24, 00:19:13.815 Dumping successful io opcodes: 00:19:13.815 0, 9, 00:19:13.815 NS: 0x200003aeff00 I/O qp, Total commands completed: 454091, total successful commands: 2635, random_seed: 3296941824 00:19:13.815 NS: 0x200003aeff00 admin qp, Total commands completed: 56496, total successful commands: 448, random_seed: 524828864 00:19:13.816 02:24:16 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:19:13.816 Fuzzing completed. Shutting down the fuzz application 00:19:13.816 00:19:13.816 Dumping successful admin opcodes: 00:19:13.816 24, 00:19:13.816 Dumping successful io opcodes: 00:19:13.816 00:19:13.816 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 3072991375 00:19:13.816 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 3073134499 00:19:13.816 02:24:17 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:13.816 02:24:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:13.816 02:24:17 -- common/autotest_common.sh@10 -- # set +x 00:19:13.816 02:24:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:13.816 02:24:17 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:19:13.816 02:24:17 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:19:13.816 02:24:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:13.816 02:24:17 -- nvmf/common.sh@116 -- # sync 00:19:13.816 02:24:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:13.816 02:24:17 -- nvmf/common.sh@119 -- # set +e 00:19:13.816 02:24:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:13.816 02:24:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:13.816 rmmod nvme_tcp 00:19:13.816 rmmod nvme_fabrics 00:19:14.075 rmmod nvme_keyring 00:19:14.075 02:24:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:14.075 02:24:17 -- nvmf/common.sh@123 -- # set -e 00:19:14.075 02:24:17 -- nvmf/common.sh@124 -- # return 0 00:19:14.075 02:24:17 -- nvmf/common.sh@477 -- # '[' -n 145800 ']' 00:19:14.075 02:24:17 -- nvmf/common.sh@478 -- # killprocess 145800 00:19:14.075 02:24:17 -- common/autotest_common.sh@936 -- # '[' -z 145800 ']' 00:19:14.075 02:24:17 -- common/autotest_common.sh@940 -- # kill -0 145800 00:19:14.075 02:24:17 -- common/autotest_common.sh@941 -- # uname 00:19:14.075 02:24:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:14.075 02:24:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 145800 00:19:14.075 02:24:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:14.075 02:24:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:14.075 02:24:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 145800' 00:19:14.075 killing process with pid 145800 00:19:14.075 02:24:17 -- common/autotest_common.sh@955 -- # kill 145800 00:19:14.075 02:24:17 -- common/autotest_common.sh@960 -- # wait 145800 00:19:14.334 02:24:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:14.334 02:24:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:14.334 02:24:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:14.334 02:24:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:14.334 02:24:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:14.334 02:24:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:14.334 02:24:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:14.334 02:24:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:16.873 02:24:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:16.873 02:24:19 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:19:16.873 00:19:16.873 real 0m38.031s 00:19:16.873 user 0m52.569s 00:19:16.873 sys 0m15.241s 00:19:16.873 02:24:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:16.873 02:24:19 -- common/autotest_common.sh@10 -- # set +x 00:19:16.873 ************************************ 00:19:16.873 END TEST nvmf_fuzz 00:19:16.873 ************************************ 00:19:16.873 02:24:19 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:16.873 02:24:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:16.873 02:24:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:16.873 02:24:19 -- common/autotest_common.sh@10 -- # set +x 00:19:16.873 ************************************ 00:19:16.873 START TEST nvmf_multiconnection 00:19:16.873 ************************************ 00:19:16.873 02:24:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:16.873 * Looking for test storage... 00:19:16.873 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:16.873 02:24:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:16.873 02:24:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:16.873 02:24:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:16.873 02:24:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:16.873 02:24:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:16.873 02:24:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:16.873 02:24:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:16.873 02:24:20 -- scripts/common.sh@335 -- # IFS=.-: 00:19:16.873 02:24:20 -- scripts/common.sh@335 -- # read -ra ver1 00:19:16.873 02:24:20 -- scripts/common.sh@336 -- # IFS=.-: 00:19:16.873 02:24:20 -- scripts/common.sh@336 -- # read -ra ver2 00:19:16.873 02:24:20 -- scripts/common.sh@337 -- # local 'op=<' 00:19:16.873 02:24:20 -- scripts/common.sh@339 -- # ver1_l=2 00:19:16.873 02:24:20 -- scripts/common.sh@340 -- # ver2_l=1 00:19:16.873 02:24:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:16.873 02:24:20 -- scripts/common.sh@343 -- # case "$op" in 00:19:16.874 02:24:20 -- scripts/common.sh@344 -- # : 1 00:19:16.874 02:24:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:16.874 02:24:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:16.874 02:24:20 -- scripts/common.sh@364 -- # decimal 1 00:19:16.874 02:24:20 -- scripts/common.sh@352 -- # local d=1 00:19:16.874 02:24:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:16.874 02:24:20 -- scripts/common.sh@354 -- # echo 1 00:19:16.874 02:24:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:16.874 02:24:20 -- scripts/common.sh@365 -- # decimal 2 00:19:16.874 02:24:20 -- scripts/common.sh@352 -- # local d=2 00:19:16.874 02:24:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:16.874 02:24:20 -- scripts/common.sh@354 -- # echo 2 00:19:16.874 02:24:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:16.874 02:24:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:16.874 02:24:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:16.874 02:24:20 -- scripts/common.sh@367 -- # return 0 00:19:16.874 02:24:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:16.874 02:24:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:16.874 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:16.874 --rc genhtml_branch_coverage=1 00:19:16.874 --rc genhtml_function_coverage=1 00:19:16.874 --rc genhtml_legend=1 00:19:16.874 --rc geninfo_all_blocks=1 00:19:16.874 --rc geninfo_unexecuted_blocks=1 00:19:16.874 00:19:16.874 ' 00:19:16.874 02:24:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:16.874 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:16.874 --rc genhtml_branch_coverage=1 00:19:16.874 --rc genhtml_function_coverage=1 00:19:16.874 --rc genhtml_legend=1 00:19:16.874 --rc geninfo_all_blocks=1 00:19:16.874 --rc geninfo_unexecuted_blocks=1 00:19:16.874 00:19:16.874 ' 00:19:16.874 02:24:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:16.874 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:16.874 --rc genhtml_branch_coverage=1 00:19:16.874 --rc genhtml_function_coverage=1 00:19:16.874 --rc genhtml_legend=1 00:19:16.874 --rc geninfo_all_blocks=1 00:19:16.874 --rc geninfo_unexecuted_blocks=1 00:19:16.874 00:19:16.874 ' 00:19:16.874 02:24:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:16.874 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:16.874 --rc genhtml_branch_coverage=1 00:19:16.874 --rc genhtml_function_coverage=1 00:19:16.874 --rc genhtml_legend=1 00:19:16.874 --rc geninfo_all_blocks=1 00:19:16.874 --rc geninfo_unexecuted_blocks=1 00:19:16.874 00:19:16.874 ' 00:19:16.874 02:24:20 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:16.874 02:24:20 -- nvmf/common.sh@7 -- # uname -s 00:19:16.874 02:24:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:16.874 02:24:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:16.874 02:24:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:16.874 02:24:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:16.874 02:24:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:16.874 02:24:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:16.874 02:24:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:16.874 02:24:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:16.874 02:24:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:16.874 02:24:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:16.874 02:24:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:16.874 02:24:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:16.874 02:24:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:16.874 02:24:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:16.874 02:24:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:16.874 02:24:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:16.874 02:24:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:16.874 02:24:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:16.874 02:24:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:16.874 02:24:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:16.874 02:24:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:16.874 02:24:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:16.874 02:24:20 -- paths/export.sh@5 -- # export PATH 00:19:16.874 02:24:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:16.874 02:24:20 -- nvmf/common.sh@46 -- # : 0 00:19:16.874 02:24:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:16.874 02:24:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:16.874 02:24:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:16.874 02:24:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:16.874 02:24:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:16.874 02:24:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:16.874 02:24:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:16.874 02:24:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:16.874 02:24:20 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:16.874 02:24:20 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:16.874 02:24:20 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:19:16.874 02:24:20 -- target/multiconnection.sh@16 -- # nvmftestinit 00:19:16.874 02:24:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:16.874 02:24:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:16.874 02:24:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:16.874 02:24:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:16.874 02:24:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:16.874 02:24:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:16.874 02:24:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:16.874 02:24:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:16.874 02:24:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:16.874 02:24:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:16.874 02:24:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:16.874 02:24:20 -- common/autotest_common.sh@10 -- # set +x 00:19:18.782 02:24:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:18.782 02:24:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:18.782 02:24:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:18.782 02:24:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:18.782 02:24:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:18.782 02:24:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:18.782 02:24:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:18.782 02:24:22 -- nvmf/common.sh@294 -- # net_devs=() 00:19:18.782 02:24:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:18.782 02:24:22 -- nvmf/common.sh@295 -- # e810=() 00:19:18.782 02:24:22 -- nvmf/common.sh@295 -- # local -ga e810 00:19:18.782 02:24:22 -- nvmf/common.sh@296 -- # x722=() 00:19:18.782 02:24:22 -- nvmf/common.sh@296 -- # local -ga x722 00:19:18.782 02:24:22 -- nvmf/common.sh@297 -- # mlx=() 00:19:18.782 02:24:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:18.782 02:24:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:18.782 02:24:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:18.782 02:24:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:18.782 02:24:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:18.782 02:24:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:18.782 02:24:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:18.782 02:24:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:18.782 02:24:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:18.782 02:24:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:18.782 02:24:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:18.782 02:24:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:18.782 02:24:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:18.782 02:24:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:18.782 02:24:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:18.782 02:24:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:18.782 02:24:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:18.782 02:24:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:18.782 02:24:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:18.782 02:24:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:18.782 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:18.782 02:24:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:18.782 02:24:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:18.782 02:24:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:18.782 02:24:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:18.782 02:24:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:18.782 02:24:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:18.782 02:24:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:18.782 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:18.782 02:24:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:18.782 02:24:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:18.782 02:24:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:18.782 02:24:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:18.782 02:24:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:18.782 02:24:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:18.782 02:24:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:18.782 02:24:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:18.782 02:24:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:18.782 02:24:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:18.782 02:24:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:18.782 02:24:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:18.782 02:24:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:18.782 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:18.782 02:24:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:18.782 02:24:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:18.782 02:24:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:18.782 02:24:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:18.782 02:24:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:18.782 02:24:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:18.782 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:18.782 02:24:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:18.782 02:24:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:18.782 02:24:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:18.782 02:24:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:18.782 02:24:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:18.782 02:24:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:18.782 02:24:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:18.782 02:24:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:18.782 02:24:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:18.782 02:24:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:18.782 02:24:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:18.782 02:24:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:18.782 02:24:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:18.782 02:24:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:18.782 02:24:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:18.782 02:24:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:18.783 02:24:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:18.783 02:24:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:18.783 02:24:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:18.783 02:24:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:18.783 02:24:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:18.783 02:24:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:18.783 02:24:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:18.783 02:24:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:18.783 02:24:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:18.783 02:24:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:18.783 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:18.783 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.214 ms 00:19:18.783 00:19:18.783 --- 10.0.0.2 ping statistics --- 00:19:18.783 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:18.783 rtt min/avg/max/mdev = 0.214/0.214/0.214/0.000 ms 00:19:18.783 02:24:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:18.783 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:18.783 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.088 ms 00:19:18.783 00:19:18.783 --- 10.0.0.1 ping statistics --- 00:19:18.783 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:18.783 rtt min/avg/max/mdev = 0.088/0.088/0.088/0.000 ms 00:19:18.783 02:24:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:18.783 02:24:22 -- nvmf/common.sh@410 -- # return 0 00:19:18.783 02:24:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:18.783 02:24:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:18.783 02:24:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:18.783 02:24:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:18.783 02:24:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:18.783 02:24:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:18.783 02:24:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:18.783 02:24:22 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:19:18.783 02:24:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:18.783 02:24:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:18.783 02:24:22 -- common/autotest_common.sh@10 -- # set +x 00:19:18.783 02:24:22 -- nvmf/common.sh@469 -- # nvmfpid=152413 00:19:18.783 02:24:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:18.783 02:24:22 -- nvmf/common.sh@470 -- # waitforlisten 152413 00:19:18.783 02:24:22 -- common/autotest_common.sh@829 -- # '[' -z 152413 ']' 00:19:18.783 02:24:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:18.783 02:24:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:18.783 02:24:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:18.783 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:18.783 02:24:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:18.783 02:24:22 -- common/autotest_common.sh@10 -- # set +x 00:19:18.783 [2024-11-29 02:24:22.346349] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:18.783 [2024-11-29 02:24:22.346472] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:18.783 EAL: No free 2048 kB hugepages reported on node 1 00:19:18.783 [2024-11-29 02:24:22.416530] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:19.043 [2024-11-29 02:24:22.537037] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:19.043 [2024-11-29 02:24:22.537209] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:19.043 [2024-11-29 02:24:22.537229] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:19.043 [2024-11-29 02:24:22.537243] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:19.043 [2024-11-29 02:24:22.537328] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:19.043 [2024-11-29 02:24:22.537922] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:19.043 [2024-11-29 02:24:22.537977] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:19.043 [2024-11-29 02:24:22.537980] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:19.982 02:24:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:19.982 02:24:23 -- common/autotest_common.sh@862 -- # return 0 00:19:19.982 02:24:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:19.982 02:24:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:19.982 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:19.982 02:24:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:19.982 02:24:23 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:19.982 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:19.982 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:19.983 [2024-11-29 02:24:23.358996] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:19.983 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:19.983 02:24:23 -- target/multiconnection.sh@21 -- # seq 1 11 00:19:19.983 02:24:23 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:19.983 02:24:23 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:19:19.983 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:19.983 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:19.983 Malloc1 00:19:19.983 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:19.983 02:24:23 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:19:19.983 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:19.983 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:19.983 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:19.983 02:24:23 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:19.983 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:19.983 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:19.983 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:19.983 02:24:23 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:19.983 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:19.983 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:19.983 [2024-11-29 02:24:23.413886] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:19.983 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:19.983 02:24:23 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:19.983 02:24:23 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:19:19.983 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:19.983 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:19.983 Malloc2 00:19:19.983 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:19.983 02:24:23 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:19.983 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:19.983 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:19.983 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:19.983 02:24:23 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:19:19.983 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:19.983 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:19.983 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:19.983 02:24:23 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:19.983 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:19.983 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:19.983 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:19.983 02:24:23 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:19.983 02:24:23 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:19:19.983 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:19.983 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:19.983 Malloc3 00:19:19.983 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:19.983 02:24:23 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:19:19.983 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:19.983 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:19.983 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:19.983 02:24:23 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:19:19.983 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:19.983 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:19.983 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:19.983 02:24:23 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:19:19.983 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:19.983 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:19.983 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:19.983 02:24:23 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:19.983 02:24:23 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:19:19.983 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:19.983 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:19.983 Malloc4 00:19:19.983 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:19.983 02:24:23 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:19:19.983 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:19.983 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:19.983 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:19.983 02:24:23 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:19:19.983 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:19.983 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:19.983 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:19.983 02:24:23 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:19:19.983 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:19.983 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:19.983 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:19.983 02:24:23 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:19.983 02:24:23 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:19:19.983 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:19.983 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:19.983 Malloc5 00:19:19.983 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:19.983 02:24:23 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:19:19.983 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:19.983 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:19.983 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:19.983 02:24:23 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:19:19.983 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:19.983 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:19.983 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:19.983 02:24:23 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:19:19.983 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:19.983 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:19.983 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:19.983 02:24:23 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:19.983 02:24:23 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:19:19.983 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:19.983 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:19.983 Malloc6 00:19:19.983 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:19.983 02:24:23 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:19:19.983 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:19.983 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:19.983 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:19.983 02:24:23 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:19:19.983 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:19.983 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:19.983 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:19.983 02:24:23 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:19:19.983 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:19.983 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:19.983 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:19.983 02:24:23 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:19.983 02:24:23 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:19:19.983 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:19.983 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:20.243 Malloc7 00:19:20.243 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:20.243 02:24:23 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:19:20.243 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:20.243 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:20.243 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:20.243 02:24:23 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:19:20.243 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:20.243 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:20.243 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:20.243 02:24:23 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:19:20.243 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:20.243 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:20.243 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:20.243 02:24:23 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:20.243 02:24:23 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:19:20.243 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:20.243 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:20.243 Malloc8 00:19:20.243 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:20.243 02:24:23 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:19:20.243 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:20.243 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:20.243 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:20.243 02:24:23 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:19:20.243 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:20.243 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:20.243 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:20.243 02:24:23 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:19:20.243 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:20.243 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:20.243 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:20.243 02:24:23 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:20.243 02:24:23 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:19:20.243 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:20.243 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:20.243 Malloc9 00:19:20.243 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:20.243 02:24:23 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:19:20.243 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:20.243 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:20.243 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:20.243 02:24:23 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:19:20.243 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:20.243 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:20.243 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:20.243 02:24:23 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:19:20.243 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:20.243 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:20.243 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:20.243 02:24:23 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:20.243 02:24:23 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:19:20.243 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:20.243 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:20.243 Malloc10 00:19:20.243 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:20.243 02:24:23 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:19:20.243 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:20.243 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:20.243 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:20.243 02:24:23 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:19:20.243 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:20.243 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:20.243 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:20.243 02:24:23 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:19:20.243 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:20.243 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:20.243 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:20.243 02:24:23 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:20.243 02:24:23 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:19:20.243 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:20.243 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:20.243 Malloc11 00:19:20.243 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:20.243 02:24:23 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:19:20.243 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:20.243 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:20.243 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:20.243 02:24:23 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:19:20.243 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:20.243 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:20.243 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:20.243 02:24:23 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:19:20.243 02:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:20.243 02:24:23 -- common/autotest_common.sh@10 -- # set +x 00:19:20.243 02:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:20.243 02:24:23 -- target/multiconnection.sh@28 -- # seq 1 11 00:19:20.243 02:24:23 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:20.243 02:24:23 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:21.182 02:24:24 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:19:21.182 02:24:24 -- common/autotest_common.sh@1187 -- # local i=0 00:19:21.182 02:24:24 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:21.182 02:24:24 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:21.182 02:24:24 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:23.088 02:24:26 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:23.088 02:24:26 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:23.088 02:24:26 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:19:23.088 02:24:26 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:23.088 02:24:26 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:23.088 02:24:26 -- common/autotest_common.sh@1197 -- # return 0 00:19:23.088 02:24:26 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:23.088 02:24:26 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:19:23.657 02:24:27 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:19:23.657 02:24:27 -- common/autotest_common.sh@1187 -- # local i=0 00:19:23.657 02:24:27 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:23.657 02:24:27 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:23.657 02:24:27 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:26.198 02:24:29 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:26.198 02:24:29 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:26.198 02:24:29 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:19:26.198 02:24:29 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:26.198 02:24:29 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:26.198 02:24:29 -- common/autotest_common.sh@1197 -- # return 0 00:19:26.198 02:24:29 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:26.198 02:24:29 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:19:26.456 02:24:29 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:19:26.456 02:24:29 -- common/autotest_common.sh@1187 -- # local i=0 00:19:26.456 02:24:29 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:26.456 02:24:29 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:26.456 02:24:29 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:28.363 02:24:31 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:28.363 02:24:31 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:28.363 02:24:31 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:19:28.363 02:24:31 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:28.363 02:24:31 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:28.363 02:24:31 -- common/autotest_common.sh@1197 -- # return 0 00:19:28.363 02:24:31 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:28.363 02:24:31 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:19:29.300 02:24:32 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:19:29.300 02:24:32 -- common/autotest_common.sh@1187 -- # local i=0 00:19:29.300 02:24:32 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:29.300 02:24:32 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:29.300 02:24:32 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:31.203 02:24:34 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:31.203 02:24:34 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:31.203 02:24:34 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:19:31.203 02:24:34 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:31.203 02:24:34 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:31.203 02:24:34 -- common/autotest_common.sh@1197 -- # return 0 00:19:31.203 02:24:34 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:31.203 02:24:34 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:19:32.139 02:24:35 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:19:32.139 02:24:35 -- common/autotest_common.sh@1187 -- # local i=0 00:19:32.139 02:24:35 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:32.139 02:24:35 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:32.139 02:24:35 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:34.046 02:24:37 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:34.046 02:24:37 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:34.046 02:24:37 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:19:34.046 02:24:37 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:34.046 02:24:37 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:34.046 02:24:37 -- common/autotest_common.sh@1197 -- # return 0 00:19:34.046 02:24:37 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:34.046 02:24:37 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:19:34.982 02:24:38 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:19:34.982 02:24:38 -- common/autotest_common.sh@1187 -- # local i=0 00:19:34.982 02:24:38 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:34.982 02:24:38 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:34.982 02:24:38 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:36.924 02:24:40 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:36.924 02:24:40 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:36.924 02:24:40 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:19:36.924 02:24:40 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:36.924 02:24:40 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:36.924 02:24:40 -- common/autotest_common.sh@1197 -- # return 0 00:19:36.924 02:24:40 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.924 02:24:40 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:19:37.493 02:24:41 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:19:37.493 02:24:41 -- common/autotest_common.sh@1187 -- # local i=0 00:19:37.493 02:24:41 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:37.493 02:24:41 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:37.493 02:24:41 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:39.397 02:24:43 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:39.397 02:24:43 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:39.397 02:24:43 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:19:39.397 02:24:43 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:39.397 02:24:43 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:39.397 02:24:43 -- common/autotest_common.sh@1197 -- # return 0 00:19:39.397 02:24:43 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:39.397 02:24:43 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:19:40.353 02:24:43 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:19:40.353 02:24:43 -- common/autotest_common.sh@1187 -- # local i=0 00:19:40.353 02:24:43 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:40.353 02:24:43 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:40.353 02:24:43 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:42.274 02:24:45 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:42.274 02:24:45 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:42.274 02:24:45 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:19:42.274 02:24:45 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:42.274 02:24:45 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:42.274 02:24:45 -- common/autotest_common.sh@1197 -- # return 0 00:19:42.274 02:24:45 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:42.274 02:24:45 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:19:43.212 02:24:46 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:19:43.212 02:24:46 -- common/autotest_common.sh@1187 -- # local i=0 00:19:43.212 02:24:46 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:43.212 02:24:46 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:43.212 02:24:46 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:45.121 02:24:48 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:45.121 02:24:48 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:45.121 02:24:48 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:19:45.121 02:24:48 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:45.121 02:24:48 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:45.121 02:24:48 -- common/autotest_common.sh@1197 -- # return 0 00:19:45.121 02:24:48 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:45.121 02:24:48 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:19:46.057 02:24:49 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:19:46.057 02:24:49 -- common/autotest_common.sh@1187 -- # local i=0 00:19:46.057 02:24:49 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:46.057 02:24:49 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:46.057 02:24:49 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:47.962 02:24:51 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:47.962 02:24:51 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:47.962 02:24:51 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:19:47.962 02:24:51 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:47.962 02:24:51 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:47.962 02:24:51 -- common/autotest_common.sh@1197 -- # return 0 00:19:47.962 02:24:51 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:47.962 02:24:51 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:19:48.898 02:24:52 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:19:48.898 02:24:52 -- common/autotest_common.sh@1187 -- # local i=0 00:19:48.898 02:24:52 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:48.898 02:24:52 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:48.898 02:24:52 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:50.806 02:24:54 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:50.806 02:24:54 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:50.806 02:24:54 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:19:51.064 02:24:54 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:51.064 02:24:54 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:51.064 02:24:54 -- common/autotest_common.sh@1197 -- # return 0 00:19:51.064 02:24:54 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:19:51.064 [global] 00:19:51.064 thread=1 00:19:51.064 invalidate=1 00:19:51.064 rw=read 00:19:51.064 time_based=1 00:19:51.064 runtime=10 00:19:51.064 ioengine=libaio 00:19:51.064 direct=1 00:19:51.064 bs=262144 00:19:51.064 iodepth=64 00:19:51.064 norandommap=1 00:19:51.064 numjobs=1 00:19:51.064 00:19:51.064 [job0] 00:19:51.065 filename=/dev/nvme0n1 00:19:51.065 [job1] 00:19:51.065 filename=/dev/nvme10n1 00:19:51.065 [job2] 00:19:51.065 filename=/dev/nvme1n1 00:19:51.065 [job3] 00:19:51.065 filename=/dev/nvme2n1 00:19:51.065 [job4] 00:19:51.065 filename=/dev/nvme3n1 00:19:51.065 [job5] 00:19:51.065 filename=/dev/nvme4n1 00:19:51.065 [job6] 00:19:51.065 filename=/dev/nvme5n1 00:19:51.065 [job7] 00:19:51.065 filename=/dev/nvme6n1 00:19:51.065 [job8] 00:19:51.065 filename=/dev/nvme7n1 00:19:51.065 [job9] 00:19:51.065 filename=/dev/nvme8n1 00:19:51.065 [job10] 00:19:51.065 filename=/dev/nvme9n1 00:19:51.065 Could not set queue depth (nvme0n1) 00:19:51.065 Could not set queue depth (nvme10n1) 00:19:51.065 Could not set queue depth (nvme1n1) 00:19:51.065 Could not set queue depth (nvme2n1) 00:19:51.065 Could not set queue depth (nvme3n1) 00:19:51.065 Could not set queue depth (nvme4n1) 00:19:51.065 Could not set queue depth (nvme5n1) 00:19:51.065 Could not set queue depth (nvme6n1) 00:19:51.065 Could not set queue depth (nvme7n1) 00:19:51.065 Could not set queue depth (nvme8n1) 00:19:51.065 Could not set queue depth (nvme9n1) 00:19:51.323 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:51.323 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:51.323 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:51.323 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:51.323 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:51.323 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:51.323 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:51.323 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:51.323 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:51.323 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:51.323 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:51.323 fio-3.35 00:19:51.323 Starting 11 threads 00:20:03.538 00:20:03.538 job0: (groupid=0, jobs=1): err= 0: pid=156785: Fri Nov 29 02:25:05 2024 00:20:03.538 read: IOPS=827, BW=207MiB/s (217MB/s)(2089MiB/10098msec) 00:20:03.538 slat (usec): min=13, max=94193, avg=1109.41, stdev=3924.84 00:20:03.538 clat (usec): min=1588, max=232905, avg=76150.34, stdev=45775.52 00:20:03.538 lat (msec): min=2, max=244, avg=77.26, stdev=46.49 00:20:03.538 clat percentiles (msec): 00:20:03.538 | 1.00th=[ 12], 5.00th=[ 27], 10.00th=[ 30], 20.00th=[ 33], 00:20:03.538 | 30.00th=[ 37], 40.00th=[ 46], 50.00th=[ 66], 60.00th=[ 82], 00:20:03.538 | 70.00th=[ 108], 80.00th=[ 126], 90.00th=[ 144], 95.00th=[ 155], 00:20:03.538 | 99.00th=[ 176], 99.50th=[ 188], 99.90th=[ 224], 99.95th=[ 232], 00:20:03.538 | 99.99th=[ 234] 00:20:03.538 bw ( KiB/s): min=99840, max=490496, per=10.68%, avg=212284.65, stdev=126964.76, samples=20 00:20:03.538 iops : min= 390, max= 1916, avg=829.15, stdev=496.00, samples=20 00:20:03.538 lat (msec) : 2=0.01%, 4=0.23%, 10=0.63%, 20=1.87%, 50=40.50% 00:20:03.538 lat (msec) : 100=22.94%, 250=33.82% 00:20:03.538 cpu : usr=0.42%, sys=2.89%, ctx=1565, majf=0, minf=4097 00:20:03.538 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:03.538 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:03.538 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:03.538 issued rwts: total=8357,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:03.538 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:03.538 job1: (groupid=0, jobs=1): err= 0: pid=156786: Fri Nov 29 02:25:05 2024 00:20:03.538 read: IOPS=543, BW=136MiB/s (143MB/s)(1363MiB/10020msec) 00:20:03.538 slat (usec): min=13, max=144011, avg=1587.99, stdev=6072.87 00:20:03.538 clat (usec): min=1969, max=393435, avg=115991.63, stdev=52238.70 00:20:03.538 lat (usec): min=1994, max=393495, avg=117579.62, stdev=53157.62 00:20:03.538 clat percentiles (msec): 00:20:03.538 | 1.00th=[ 5], 5.00th=[ 19], 10.00th=[ 48], 20.00th=[ 78], 00:20:03.538 | 30.00th=[ 94], 40.00th=[ 110], 50.00th=[ 121], 60.00th=[ 130], 00:20:03.538 | 70.00th=[ 138], 80.00th=[ 150], 90.00th=[ 171], 95.00th=[ 203], 00:20:03.538 | 99.00th=[ 284], 99.50th=[ 296], 99.90th=[ 321], 99.95th=[ 393], 00:20:03.538 | 99.99th=[ 393] 00:20:03.538 bw ( KiB/s): min=59392, max=260096, per=6.93%, avg=137859.80, stdev=44208.00, samples=20 00:20:03.538 iops : min= 232, max= 1016, avg=538.45, stdev=172.63, samples=20 00:20:03.538 lat (msec) : 2=0.06%, 4=0.86%, 10=1.89%, 20=2.70%, 50=4.95% 00:20:03.538 lat (msec) : 100=23.23%, 250=64.86%, 500=1.45% 00:20:03.538 cpu : usr=0.29%, sys=1.91%, ctx=1074, majf=0, minf=4097 00:20:03.538 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:03.538 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:03.538 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:03.538 issued rwts: total=5450,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:03.539 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:03.539 job2: (groupid=0, jobs=1): err= 0: pid=156808: Fri Nov 29 02:25:05 2024 00:20:03.539 read: IOPS=1226, BW=307MiB/s (322MB/s)(3073MiB/10020msec) 00:20:03.539 slat (usec): min=12, max=126797, avg=733.53, stdev=2968.66 00:20:03.539 clat (usec): min=838, max=282187, avg=51388.80, stdev=40162.79 00:20:03.539 lat (usec): min=859, max=282208, avg=52122.33, stdev=40657.97 00:20:03.539 clat percentiles (msec): 00:20:03.539 | 1.00th=[ 3], 5.00th=[ 12], 10.00th=[ 26], 20.00th=[ 29], 00:20:03.539 | 30.00th=[ 30], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 46], 00:20:03.539 | 70.00th=[ 53], 80.00th=[ 68], 90.00th=[ 95], 95.00th=[ 155], 00:20:03.539 | 99.00th=[ 199], 99.50th=[ 215], 99.90th=[ 247], 99.95th=[ 247], 00:20:03.539 | 99.99th=[ 284] 00:20:03.539 bw ( KiB/s): min=100864, max=555520, per=15.74%, avg=312942.15, stdev=132457.91, samples=20 00:20:03.539 iops : min= 394, max= 2170, avg=1222.35, stdev=517.38, samples=20 00:20:03.539 lat (usec) : 1000=0.05% 00:20:03.539 lat (msec) : 2=0.41%, 4=1.99%, 10=2.15%, 20=2.48%, 50=59.39% 00:20:03.539 lat (msec) : 100=24.02%, 250=9.50%, 500=0.02% 00:20:03.539 cpu : usr=0.66%, sys=3.99%, ctx=2389, majf=0, minf=4097 00:20:03.539 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:20:03.539 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:03.539 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:03.539 issued rwts: total=12290,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:03.539 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:03.539 job3: (groupid=0, jobs=1): err= 0: pid=156819: Fri Nov 29 02:25:05 2024 00:20:03.539 read: IOPS=580, BW=145MiB/s (152MB/s)(1462MiB/10079msec) 00:20:03.539 slat (usec): min=10, max=123098, avg=1441.73, stdev=4985.06 00:20:03.539 clat (usec): min=1199, max=323480, avg=108792.36, stdev=52834.39 00:20:03.539 lat (usec): min=1220, max=361767, avg=110234.09, stdev=53652.57 00:20:03.539 clat percentiles (msec): 00:20:03.539 | 1.00th=[ 5], 5.00th=[ 18], 10.00th=[ 39], 20.00th=[ 60], 00:20:03.539 | 30.00th=[ 78], 40.00th=[ 103], 50.00th=[ 118], 60.00th=[ 128], 00:20:03.539 | 70.00th=[ 138], 80.00th=[ 148], 90.00th=[ 165], 95.00th=[ 184], 00:20:03.539 | 99.00th=[ 279], 99.50th=[ 288], 99.90th=[ 305], 99.95th=[ 305], 00:20:03.539 | 99.99th=[ 326] 00:20:03.539 bw ( KiB/s): min=95232, max=262656, per=7.45%, avg=148046.25, stdev=46362.06, samples=20 00:20:03.539 iops : min= 372, max= 1026, avg=578.15, stdev=181.11, samples=20 00:20:03.539 lat (msec) : 2=0.21%, 4=0.63%, 10=2.22%, 20=2.74%, 50=9.24% 00:20:03.539 lat (msec) : 100=23.94%, 250=59.60%, 500=1.42% 00:20:03.539 cpu : usr=0.30%, sys=1.96%, ctx=1180, majf=0, minf=4097 00:20:03.539 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:20:03.539 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:03.539 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:03.539 issued rwts: total=5847,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:03.539 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:03.539 job4: (groupid=0, jobs=1): err= 0: pid=156826: Fri Nov 29 02:25:05 2024 00:20:03.539 read: IOPS=600, BW=150MiB/s (157MB/s)(1516MiB/10094msec) 00:20:03.539 slat (usec): min=9, max=149720, avg=1281.68, stdev=4869.34 00:20:03.539 clat (msec): min=3, max=305, avg=105.16, stdev=42.65 00:20:03.539 lat (msec): min=3, max=358, avg=106.44, stdev=43.31 00:20:03.539 clat percentiles (msec): 00:20:03.539 | 1.00th=[ 14], 5.00th=[ 37], 10.00th=[ 51], 20.00th=[ 62], 00:20:03.539 | 30.00th=[ 84], 40.00th=[ 96], 50.00th=[ 109], 60.00th=[ 118], 00:20:03.539 | 70.00th=[ 128], 80.00th=[ 140], 90.00th=[ 157], 95.00th=[ 171], 00:20:03.539 | 99.00th=[ 211], 99.50th=[ 222], 99.90th=[ 296], 99.95th=[ 296], 00:20:03.539 | 99.99th=[ 305] 00:20:03.539 bw ( KiB/s): min=93696, max=222720, per=7.72%, avg=153594.15, stdev=36125.15, samples=20 00:20:03.539 iops : min= 366, max= 870, avg=599.90, stdev=141.12, samples=20 00:20:03.539 lat (msec) : 4=0.02%, 10=0.40%, 20=1.22%, 50=8.34%, 100=32.77% 00:20:03.539 lat (msec) : 250=57.07%, 500=0.18% 00:20:03.539 cpu : usr=0.34%, sys=1.75%, ctx=1375, majf=0, minf=4097 00:20:03.539 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:03.539 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:03.539 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:03.539 issued rwts: total=6064,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:03.539 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:03.539 job5: (groupid=0, jobs=1): err= 0: pid=156866: Fri Nov 29 02:25:05 2024 00:20:03.539 read: IOPS=816, BW=204MiB/s (214MB/s)(2045MiB/10018msec) 00:20:03.539 slat (usec): min=9, max=205694, avg=899.01, stdev=5010.67 00:20:03.539 clat (usec): min=1103, max=495734, avg=77428.06, stdev=54385.14 00:20:03.539 lat (usec): min=1123, max=495768, avg=78327.07, stdev=55243.38 00:20:03.539 clat percentiles (msec): 00:20:03.539 | 1.00th=[ 4], 5.00th=[ 9], 10.00th=[ 19], 20.00th=[ 28], 00:20:03.539 | 30.00th=[ 35], 40.00th=[ 52], 50.00th=[ 67], 60.00th=[ 85], 00:20:03.539 | 70.00th=[ 112], 80.00th=[ 128], 90.00th=[ 146], 95.00th=[ 161], 00:20:03.539 | 99.00th=[ 271], 99.50th=[ 279], 99.90th=[ 296], 99.95th=[ 296], 00:20:03.539 | 99.99th=[ 498] 00:20:03.539 bw ( KiB/s): min=73216, max=541696, per=10.45%, avg=207703.65, stdev=111196.04, samples=20 00:20:03.539 iops : min= 286, max= 2116, avg=811.25, stdev=434.34, samples=20 00:20:03.539 lat (msec) : 2=0.22%, 4=1.77%, 10=3.72%, 20=4.79%, 50=28.79% 00:20:03.539 lat (msec) : 100=26.49%, 250=32.90%, 500=1.31% 00:20:03.539 cpu : usr=0.42%, sys=2.34%, ctx=1804, majf=0, minf=4097 00:20:03.539 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:03.539 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:03.539 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:03.539 issued rwts: total=8179,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:03.539 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:03.539 job6: (groupid=0, jobs=1): err= 0: pid=156885: Fri Nov 29 02:25:05 2024 00:20:03.539 read: IOPS=540, BW=135MiB/s (142MB/s)(1360MiB/10075msec) 00:20:03.539 slat (usec): min=11, max=69311, avg=1596.74, stdev=5147.66 00:20:03.539 clat (usec): min=830, max=319070, avg=116819.58, stdev=52972.68 00:20:03.539 lat (usec): min=873, max=331353, avg=118416.31, stdev=53845.79 00:20:03.539 clat percentiles (msec): 00:20:03.539 | 1.00th=[ 3], 5.00th=[ 21], 10.00th=[ 51], 20.00th=[ 66], 00:20:03.539 | 30.00th=[ 90], 40.00th=[ 113], 50.00th=[ 127], 60.00th=[ 134], 00:20:03.539 | 70.00th=[ 142], 80.00th=[ 153], 90.00th=[ 174], 95.00th=[ 197], 00:20:03.539 | 99.00th=[ 284], 99.50th=[ 292], 99.90th=[ 309], 99.95th=[ 317], 00:20:03.539 | 99.99th=[ 321] 00:20:03.539 bw ( KiB/s): min=61440, max=281088, per=6.92%, avg=137627.15, stdev=56297.67, samples=20 00:20:03.539 iops : min= 240, max= 1098, avg=537.60, stdev=219.91, samples=20 00:20:03.539 lat (usec) : 1000=0.04% 00:20:03.539 lat (msec) : 2=0.35%, 4=1.07%, 10=1.54%, 20=1.97%, 50=4.87% 00:20:03.539 lat (msec) : 100=25.01%, 250=63.57%, 500=1.58% 00:20:03.539 cpu : usr=0.37%, sys=1.89%, ctx=1165, majf=0, minf=4097 00:20:03.539 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:03.539 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:03.539 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:03.539 issued rwts: total=5441,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:03.539 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:03.539 job7: (groupid=0, jobs=1): err= 0: pid=156902: Fri Nov 29 02:25:05 2024 00:20:03.539 read: IOPS=711, BW=178MiB/s (187MB/s)(1792MiB/10075msec) 00:20:03.539 slat (usec): min=12, max=103327, avg=1330.71, stdev=4227.94 00:20:03.539 clat (msec): min=3, max=315, avg=88.55, stdev=48.61 00:20:03.539 lat (msec): min=3, max=332, avg=89.88, stdev=49.35 00:20:03.539 clat percentiles (msec): 00:20:03.539 | 1.00th=[ 8], 5.00th=[ 28], 10.00th=[ 36], 20.00th=[ 55], 00:20:03.539 | 30.00th=[ 63], 40.00th=[ 69], 50.00th=[ 77], 60.00th=[ 88], 00:20:03.539 | 70.00th=[ 107], 80.00th=[ 124], 90.00th=[ 146], 95.00th=[ 178], 00:20:03.539 | 99.00th=[ 271], 99.50th=[ 292], 99.90th=[ 305], 99.95th=[ 317], 00:20:03.539 | 99.99th=[ 317] 00:20:03.539 bw ( KiB/s): min=62976, max=339456, per=9.14%, avg=181823.10, stdev=67934.77, samples=20 00:20:03.539 iops : min= 246, max= 1326, avg=710.15, stdev=265.34, samples=20 00:20:03.539 lat (msec) : 4=0.07%, 10=1.51%, 20=1.98%, 50=13.73%, 100=48.52% 00:20:03.539 lat (msec) : 250=33.02%, 500=1.17% 00:20:03.539 cpu : usr=0.40%, sys=2.30%, ctx=1304, majf=0, minf=3721 00:20:03.539 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:20:03.539 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:03.539 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:03.539 issued rwts: total=7168,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:03.539 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:03.539 job8: (groupid=0, jobs=1): err= 0: pid=156936: Fri Nov 29 02:25:05 2024 00:20:03.539 read: IOPS=607, BW=152MiB/s (159MB/s)(1534MiB/10097msec) 00:20:03.539 slat (usec): min=9, max=104052, avg=1033.65, stdev=4608.94 00:20:03.539 clat (usec): min=1008, max=324095, avg=104191.95, stdev=57819.01 00:20:03.539 lat (usec): min=1029, max=324161, avg=105225.60, stdev=58394.57 00:20:03.539 clat percentiles (msec): 00:20:03.539 | 1.00th=[ 4], 5.00th=[ 9], 10.00th=[ 21], 20.00th=[ 53], 00:20:03.539 | 30.00th=[ 65], 40.00th=[ 84], 50.00th=[ 113], 60.00th=[ 132], 00:20:03.539 | 70.00th=[ 140], 80.00th=[ 148], 90.00th=[ 167], 95.00th=[ 192], 00:20:03.539 | 99.00th=[ 288], 99.50th=[ 292], 99.90th=[ 313], 99.95th=[ 321], 00:20:03.539 | 99.99th=[ 326] 00:20:03.539 bw ( KiB/s): min=61440, max=248335, per=7.81%, avg=155383.55, stdev=53381.98, samples=20 00:20:03.539 iops : min= 240, max= 970, avg=606.90, stdev=208.56, samples=20 00:20:03.539 lat (msec) : 2=0.33%, 4=1.29%, 10=4.78%, 20=3.51%, 50=7.87% 00:20:03.539 lat (msec) : 100=27.36%, 250=53.62%, 500=1.26% 00:20:03.539 cpu : usr=0.33%, sys=1.78%, ctx=1525, majf=0, minf=4097 00:20:03.539 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:03.539 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:03.539 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:03.539 issued rwts: total=6134,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:03.539 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:03.539 job9: (groupid=0, jobs=1): err= 0: pid=156937: Fri Nov 29 02:25:05 2024 00:20:03.540 read: IOPS=498, BW=125MiB/s (131MB/s)(1259MiB/10093msec) 00:20:03.540 slat (usec): min=9, max=68515, avg=1598.97, stdev=5371.87 00:20:03.540 clat (usec): min=789, max=336928, avg=126544.36, stdev=46930.11 00:20:03.540 lat (usec): min=811, max=337027, avg=128143.33, stdev=47699.79 00:20:03.540 clat percentiles (msec): 00:20:03.540 | 1.00th=[ 4], 5.00th=[ 36], 10.00th=[ 86], 20.00th=[ 99], 00:20:03.540 | 30.00th=[ 109], 40.00th=[ 116], 50.00th=[ 125], 60.00th=[ 134], 00:20:03.540 | 70.00th=[ 144], 80.00th=[ 157], 90.00th=[ 178], 95.00th=[ 199], 00:20:03.540 | 99.00th=[ 288], 99.50th=[ 296], 99.90th=[ 326], 99.95th=[ 334], 00:20:03.540 | 99.99th=[ 338] 00:20:03.540 bw ( KiB/s): min=59392, max=175104, per=6.40%, avg=127243.45, stdev=28396.38, samples=20 00:20:03.540 iops : min= 232, max= 684, avg=497.00, stdev=110.88, samples=20 00:20:03.540 lat (usec) : 1000=0.02% 00:20:03.540 lat (msec) : 2=0.44%, 4=1.05%, 10=1.15%, 20=0.50%, 50=3.54% 00:20:03.540 lat (msec) : 100=14.72%, 250=76.60%, 500=1.99% 00:20:03.540 cpu : usr=0.23%, sys=1.55%, ctx=1203, majf=0, minf=4097 00:20:03.540 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:20:03.540 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:03.540 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:03.540 issued rwts: total=5035,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:03.540 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:03.540 job10: (groupid=0, jobs=1): err= 0: pid=156940: Fri Nov 29 02:25:05 2024 00:20:03.540 read: IOPS=840, BW=210MiB/s (220MB/s)(2121MiB/10100msec) 00:20:03.540 slat (usec): min=13, max=78154, avg=1071.05, stdev=3668.46 00:20:03.540 clat (msec): min=4, max=233, avg=75.03, stdev=42.84 00:20:03.540 lat (msec): min=7, max=233, avg=76.10, stdev=43.44 00:20:03.540 clat percentiles (msec): 00:20:03.540 | 1.00th=[ 24], 5.00th=[ 27], 10.00th=[ 29], 20.00th=[ 31], 00:20:03.540 | 30.00th=[ 40], 40.00th=[ 53], 50.00th=[ 65], 60.00th=[ 79], 00:20:03.540 | 70.00th=[ 104], 80.00th=[ 121], 90.00th=[ 140], 95.00th=[ 148], 00:20:03.540 | 99.00th=[ 167], 99.50th=[ 176], 99.90th=[ 226], 99.95th=[ 226], 00:20:03.540 | 99.99th=[ 234] 00:20:03.540 bw ( KiB/s): min=97596, max=516608, per=10.84%, avg=215540.25, stdev=126140.65, samples=20 00:20:03.540 iops : min= 381, max= 2018, avg=841.85, stdev=492.81, samples=20 00:20:03.540 lat (msec) : 10=0.07%, 20=0.34%, 50=37.53%, 100=30.63%, 250=31.43% 00:20:03.540 cpu : usr=0.57%, sys=2.89%, ctx=1625, majf=0, minf=4097 00:20:03.540 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:20:03.540 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:03.540 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:03.540 issued rwts: total=8485,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:03.540 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:03.540 00:20:03.540 Run status group 0 (all jobs): 00:20:03.540 READ: bw=1942MiB/s (2036MB/s), 125MiB/s-307MiB/s (131MB/s-322MB/s), io=19.2GiB (20.6GB), run=10018-10100msec 00:20:03.540 00:20:03.540 Disk stats (read/write): 00:20:03.540 nvme0n1: ios=16543/0, merge=0/0, ticks=1232963/0, in_queue=1232963, util=97.15% 00:20:03.540 nvme10n1: ios=10663/0, merge=0/0, ticks=1230836/0, in_queue=1230836, util=97.35% 00:20:03.540 nvme1n1: ios=24186/0, merge=0/0, ticks=1236572/0, in_queue=1236572, util=97.63% 00:20:03.540 nvme2n1: ios=11467/0, merge=0/0, ticks=1236100/0, in_queue=1236100, util=97.78% 00:20:03.540 nvme3n1: ios=11899/0, merge=0/0, ticks=1234555/0, in_queue=1234555, util=97.84% 00:20:03.540 nvme4n1: ios=16038/0, merge=0/0, ticks=1237785/0, in_queue=1237785, util=98.21% 00:20:03.540 nvme5n1: ios=10662/0, merge=0/0, ticks=1233873/0, in_queue=1233873, util=98.40% 00:20:03.540 nvme6n1: ios=14138/0, merge=0/0, ticks=1234033/0, in_queue=1234033, util=98.52% 00:20:03.540 nvme7n1: ios=12035/0, merge=0/0, ticks=1236110/0, in_queue=1236110, util=98.94% 00:20:03.540 nvme8n1: ios=9901/0, merge=0/0, ticks=1229793/0, in_queue=1229793, util=99.13% 00:20:03.540 nvme9n1: ios=16785/0, merge=0/0, ticks=1230674/0, in_queue=1230674, util=99.22% 00:20:03.540 02:25:05 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:20:03.540 [global] 00:20:03.540 thread=1 00:20:03.540 invalidate=1 00:20:03.540 rw=randwrite 00:20:03.540 time_based=1 00:20:03.540 runtime=10 00:20:03.540 ioengine=libaio 00:20:03.540 direct=1 00:20:03.540 bs=262144 00:20:03.540 iodepth=64 00:20:03.540 norandommap=1 00:20:03.540 numjobs=1 00:20:03.540 00:20:03.540 [job0] 00:20:03.540 filename=/dev/nvme0n1 00:20:03.540 [job1] 00:20:03.540 filename=/dev/nvme10n1 00:20:03.540 [job2] 00:20:03.540 filename=/dev/nvme1n1 00:20:03.540 [job3] 00:20:03.540 filename=/dev/nvme2n1 00:20:03.540 [job4] 00:20:03.540 filename=/dev/nvme3n1 00:20:03.540 [job5] 00:20:03.540 filename=/dev/nvme4n1 00:20:03.540 [job6] 00:20:03.540 filename=/dev/nvme5n1 00:20:03.540 [job7] 00:20:03.540 filename=/dev/nvme6n1 00:20:03.540 [job8] 00:20:03.540 filename=/dev/nvme7n1 00:20:03.540 [job9] 00:20:03.540 filename=/dev/nvme8n1 00:20:03.540 [job10] 00:20:03.540 filename=/dev/nvme9n1 00:20:03.540 Could not set queue depth (nvme0n1) 00:20:03.540 Could not set queue depth (nvme10n1) 00:20:03.540 Could not set queue depth (nvme1n1) 00:20:03.540 Could not set queue depth (nvme2n1) 00:20:03.540 Could not set queue depth (nvme3n1) 00:20:03.540 Could not set queue depth (nvme4n1) 00:20:03.540 Could not set queue depth (nvme5n1) 00:20:03.540 Could not set queue depth (nvme6n1) 00:20:03.540 Could not set queue depth (nvme7n1) 00:20:03.540 Could not set queue depth (nvme8n1) 00:20:03.540 Could not set queue depth (nvme9n1) 00:20:03.540 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.540 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.540 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.540 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.540 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.540 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.540 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.540 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.540 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.540 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.540 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.540 fio-3.35 00:20:03.540 Starting 11 threads 00:20:13.514 00:20:13.514 job0: (groupid=0, jobs=1): err= 0: pid=157991: Fri Nov 29 02:25:16 2024 00:20:13.514 write: IOPS=577, BW=144MiB/s (151MB/s)(1459MiB/10112msec); 0 zone resets 00:20:13.514 slat (usec): min=23, max=72913, avg=1195.45, stdev=3319.72 00:20:13.514 clat (usec): min=1093, max=238993, avg=109664.05, stdev=53886.26 00:20:13.514 lat (usec): min=1160, max=241956, avg=110859.50, stdev=54579.98 00:20:13.514 clat percentiles (msec): 00:20:13.514 | 1.00th=[ 9], 5.00th=[ 22], 10.00th=[ 45], 20.00th=[ 72], 00:20:13.514 | 30.00th=[ 77], 40.00th=[ 82], 50.00th=[ 97], 60.00th=[ 118], 00:20:13.514 | 70.00th=[ 142], 80.00th=[ 163], 90.00th=[ 190], 95.00th=[ 203], 00:20:13.514 | 99.00th=[ 228], 99.50th=[ 232], 99.90th=[ 236], 99.95th=[ 239], 00:20:13.514 | 99.99th=[ 239] 00:20:13.514 bw ( KiB/s): min=73875, max=218624, per=10.03%, avg=147748.95, stdev=46565.56, samples=20 00:20:13.514 iops : min= 288, max= 854, avg=577.10, stdev=181.96, samples=20 00:20:13.514 lat (msec) : 2=0.10%, 4=0.15%, 10=1.10%, 20=2.86%, 50=6.82% 00:20:13.514 lat (msec) : 100=40.60%, 250=48.36% 00:20:13.514 cpu : usr=1.64%, sys=2.33%, ctx=3020, majf=0, minf=1 00:20:13.514 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:20:13.514 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:13.514 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:13.514 issued rwts: total=0,5835,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:13.514 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:13.514 job1: (groupid=0, jobs=1): err= 0: pid=157992: Fri Nov 29 02:25:16 2024 00:20:13.514 write: IOPS=473, BW=118MiB/s (124MB/s)(1197MiB/10115msec); 0 zone resets 00:20:13.514 slat (usec): min=19, max=52742, avg=1858.30, stdev=3925.83 00:20:13.514 clat (msec): min=2, max=298, avg=133.34, stdev=56.69 00:20:13.514 lat (msec): min=2, max=298, avg=135.20, stdev=57.41 00:20:13.514 clat percentiles (msec): 00:20:13.514 | 1.00th=[ 9], 5.00th=[ 59], 10.00th=[ 75], 20.00th=[ 80], 00:20:13.514 | 30.00th=[ 81], 40.00th=[ 110], 50.00th=[ 146], 60.00th=[ 159], 00:20:13.514 | 70.00th=[ 169], 80.00th=[ 184], 90.00th=[ 203], 95.00th=[ 218], 00:20:13.514 | 99.00th=[ 275], 99.50th=[ 292], 99.90th=[ 296], 99.95th=[ 300], 00:20:13.514 | 99.99th=[ 300] 00:20:13.514 bw ( KiB/s): min=71680, max=210432, per=8.21%, avg=120908.80, stdev=43648.14, samples=20 00:20:13.514 iops : min= 280, max= 822, avg=472.30, stdev=170.50, samples=20 00:20:13.514 lat (msec) : 4=0.06%, 10=1.34%, 20=1.15%, 50=1.38%, 100=33.81% 00:20:13.514 lat (msec) : 250=60.34%, 500=1.92% 00:20:13.514 cpu : usr=1.36%, sys=1.72%, ctx=1651, majf=0, minf=2 00:20:13.514 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:13.514 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:13.514 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:13.514 issued rwts: total=0,4786,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:13.514 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:13.514 job2: (groupid=0, jobs=1): err= 0: pid=157993: Fri Nov 29 02:25:16 2024 00:20:13.514 write: IOPS=520, BW=130MiB/s (137MB/s)(1309MiB/10052msec); 0 zone resets 00:20:13.514 slat (usec): min=24, max=73663, avg=1744.23, stdev=4227.77 00:20:13.514 clat (msec): min=9, max=314, avg=121.10, stdev=76.06 00:20:13.514 lat (msec): min=9, max=314, avg=122.84, stdev=77.07 00:20:13.514 clat percentiles (msec): 00:20:13.514 | 1.00th=[ 29], 5.00th=[ 43], 10.00th=[ 44], 20.00th=[ 45], 00:20:13.514 | 30.00th=[ 50], 40.00th=[ 63], 50.00th=[ 106], 60.00th=[ 146], 00:20:13.514 | 70.00th=[ 178], 80.00th=[ 197], 90.00th=[ 230], 95.00th=[ 249], 00:20:13.514 | 99.00th=[ 296], 99.50th=[ 309], 99.90th=[ 313], 99.95th=[ 313], 00:20:13.514 | 99.99th=[ 313] 00:20:13.514 bw ( KiB/s): min=63488, max=366080, per=8.99%, avg=132383.45, stdev=96295.47, samples=20 00:20:13.514 iops : min= 248, max= 1430, avg=517.10, stdev=376.14, samples=20 00:20:13.514 lat (msec) : 10=0.02%, 20=0.57%, 50=32.09%, 100=15.05%, 250=47.39% 00:20:13.514 lat (msec) : 500=4.87% 00:20:13.514 cpu : usr=1.70%, sys=1.81%, ctx=1698, majf=0, minf=1 00:20:13.514 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:13.514 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:13.514 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:13.514 issued rwts: total=0,5235,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:13.514 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:13.514 job3: (groupid=0, jobs=1): err= 0: pid=158006: Fri Nov 29 02:25:16 2024 00:20:13.514 write: IOPS=450, BW=113MiB/s (118MB/s)(1145MiB/10151msec); 0 zone resets 00:20:13.514 slat (usec): min=15, max=106389, avg=1738.13, stdev=4495.56 00:20:13.514 clat (usec): min=838, max=359211, avg=139714.19, stdev=63668.09 00:20:13.514 lat (usec): min=914, max=359267, avg=141452.32, stdev=64571.21 00:20:13.514 clat percentiles (msec): 00:20:13.514 | 1.00th=[ 3], 5.00th=[ 17], 10.00th=[ 40], 20.00th=[ 84], 00:20:13.514 | 30.00th=[ 104], 40.00th=[ 140], 50.00th=[ 155], 60.00th=[ 165], 00:20:13.514 | 70.00th=[ 178], 80.00th=[ 197], 90.00th=[ 211], 95.00th=[ 224], 00:20:13.514 | 99.00th=[ 259], 99.50th=[ 292], 99.90th=[ 351], 99.95th=[ 351], 00:20:13.514 | 99.99th=[ 359] 00:20:13.514 bw ( KiB/s): min=62976, max=232960, per=7.85%, avg=115584.00, stdev=44588.08, samples=20 00:20:13.514 iops : min= 246, max= 910, avg=451.50, stdev=174.17, samples=20 00:20:13.514 lat (usec) : 1000=0.11% 00:20:13.514 lat (msec) : 2=0.48%, 4=0.70%, 10=1.79%, 20=2.71%, 50=6.40% 00:20:13.514 lat (msec) : 100=16.40%, 250=70.10%, 500=1.31% 00:20:13.514 cpu : usr=1.22%, sys=1.67%, ctx=2234, majf=0, minf=1 00:20:13.514 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.6% 00:20:13.514 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:13.514 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:13.514 issued rwts: total=0,4578,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:13.514 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:13.514 job4: (groupid=0, jobs=1): err= 0: pid=158009: Fri Nov 29 02:25:16 2024 00:20:13.514 write: IOPS=556, BW=139MiB/s (146MB/s)(1402MiB/10071msec); 0 zone resets 00:20:13.515 slat (usec): min=23, max=132134, avg=1170.19, stdev=4014.34 00:20:13.515 clat (usec): min=1211, max=275451, avg=113698.79, stdev=57156.21 00:20:13.515 lat (usec): min=1850, max=275493, avg=114868.98, stdev=57763.77 00:20:13.515 clat percentiles (msec): 00:20:13.515 | 1.00th=[ 10], 5.00th=[ 21], 10.00th=[ 38], 20.00th=[ 66], 00:20:13.515 | 30.00th=[ 77], 40.00th=[ 83], 50.00th=[ 117], 60.00th=[ 131], 00:20:13.515 | 70.00th=[ 153], 80.00th=[ 169], 90.00th=[ 186], 95.00th=[ 207], 00:20:13.515 | 99.00th=[ 241], 99.50th=[ 249], 99.90th=[ 275], 99.95th=[ 275], 00:20:13.515 | 99.99th=[ 275] 00:20:13.515 bw ( KiB/s): min=82944, max=230912, per=9.64%, avg=141926.40, stdev=40086.90, samples=20 00:20:13.515 iops : min= 324, max= 902, avg=554.40, stdev=156.59, samples=20 00:20:13.515 lat (msec) : 2=0.07%, 4=0.39%, 10=0.61%, 20=3.64%, 50=9.26% 00:20:13.515 lat (msec) : 100=31.50%, 250=54.13%, 500=0.41% 00:20:13.515 cpu : usr=1.60%, sys=2.26%, ctx=3078, majf=0, minf=1 00:20:13.515 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:13.515 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:13.515 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:13.515 issued rwts: total=0,5607,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:13.515 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:13.515 job5: (groupid=0, jobs=1): err= 0: pid=158010: Fri Nov 29 02:25:16 2024 00:20:13.515 write: IOPS=639, BW=160MiB/s (168MB/s)(1616MiB/10108msec); 0 zone resets 00:20:13.515 slat (usec): min=18, max=38047, avg=906.41, stdev=2730.13 00:20:13.515 clat (usec): min=804, max=268997, avg=99146.12, stdev=57815.63 00:20:13.515 lat (usec): min=847, max=269049, avg=100052.53, stdev=58543.61 00:20:13.515 clat percentiles (msec): 00:20:13.515 | 1.00th=[ 7], 5.00th=[ 21], 10.00th=[ 30], 20.00th=[ 44], 00:20:13.515 | 30.00th=[ 56], 40.00th=[ 75], 50.00th=[ 88], 60.00th=[ 116], 00:20:13.515 | 70.00th=[ 131], 80.00th=[ 155], 90.00th=[ 180], 95.00th=[ 201], 00:20:13.515 | 99.00th=[ 234], 99.50th=[ 239], 99.90th=[ 257], 99.95th=[ 257], 00:20:13.515 | 99.99th=[ 271] 00:20:13.515 bw ( KiB/s): min=79872, max=315392, per=11.12%, avg=163840.00, stdev=66773.78, samples=20 00:20:13.515 iops : min= 312, max= 1232, avg=640.00, stdev=260.84, samples=20 00:20:13.515 lat (usec) : 1000=0.06% 00:20:13.515 lat (msec) : 2=0.08%, 4=0.17%, 10=1.72%, 20=3.02%, 50=21.72% 00:20:13.515 lat (msec) : 100=26.83%, 250=46.28%, 500=0.12% 00:20:13.515 cpu : usr=2.14%, sys=2.17%, ctx=4104, majf=0, minf=1 00:20:13.515 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:20:13.515 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:13.515 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:13.515 issued rwts: total=0,6463,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:13.515 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:13.515 job6: (groupid=0, jobs=1): err= 0: pid=158011: Fri Nov 29 02:25:16 2024 00:20:13.515 write: IOPS=496, BW=124MiB/s (130MB/s)(1259MiB/10150msec); 0 zone resets 00:20:13.515 slat (usec): min=16, max=73750, avg=1386.52, stdev=3940.68 00:20:13.515 clat (usec): min=980, max=310114, avg=127524.47, stdev=65828.39 00:20:13.515 lat (usec): min=1010, max=310162, avg=128911.00, stdev=66759.50 00:20:13.515 clat percentiles (msec): 00:20:13.515 | 1.00th=[ 5], 5.00th=[ 17], 10.00th=[ 32], 20.00th=[ 63], 00:20:13.515 | 30.00th=[ 89], 40.00th=[ 106], 50.00th=[ 132], 60.00th=[ 157], 00:20:13.515 | 70.00th=[ 174], 80.00th=[ 190], 90.00th=[ 211], 95.00th=[ 226], 00:20:13.515 | 99.00th=[ 247], 99.50th=[ 255], 99.90th=[ 305], 99.95th=[ 309], 00:20:13.515 | 99.99th=[ 309] 00:20:13.515 bw ( KiB/s): min=75776, max=310272, per=8.64%, avg=127313.80, stdev=57152.82, samples=20 00:20:13.515 iops : min= 296, max= 1212, avg=497.20, stdev=223.25, samples=20 00:20:13.515 lat (usec) : 1000=0.02% 00:20:13.515 lat (msec) : 2=0.26%, 4=0.64%, 10=2.20%, 20=2.64%, 50=10.11% 00:20:13.515 lat (msec) : 100=20.29%, 250=63.09%, 500=0.75% 00:20:13.515 cpu : usr=1.63%, sys=1.77%, ctx=2933, majf=0, minf=1 00:20:13.515 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:20:13.515 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:13.515 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:13.515 issued rwts: total=0,5037,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:13.515 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:13.515 job7: (groupid=0, jobs=1): err= 0: pid=158018: Fri Nov 29 02:25:16 2024 00:20:13.515 write: IOPS=615, BW=154MiB/s (161MB/s)(1550MiB/10074msec); 0 zone resets 00:20:13.515 slat (usec): min=18, max=44733, avg=1171.83, stdev=3149.75 00:20:13.515 clat (usec): min=1011, max=289990, avg=102769.35, stdev=61412.68 00:20:13.515 lat (usec): min=1056, max=290055, avg=103941.18, stdev=62178.28 00:20:13.515 clat percentiles (msec): 00:20:13.515 | 1.00th=[ 4], 5.00th=[ 18], 10.00th=[ 38], 20.00th=[ 46], 00:20:13.515 | 30.00th=[ 61], 40.00th=[ 77], 50.00th=[ 82], 60.00th=[ 114], 00:20:13.515 | 70.00th=[ 136], 80.00th=[ 167], 90.00th=[ 194], 95.00th=[ 211], 00:20:13.515 | 99.00th=[ 249], 99.50th=[ 275], 99.90th=[ 284], 99.95th=[ 288], 00:20:13.515 | 99.99th=[ 292] 00:20:13.515 bw ( KiB/s): min=63488, max=307712, per=10.67%, avg=157081.85, stdev=62678.50, samples=20 00:20:13.515 iops : min= 248, max= 1202, avg=613.55, stdev=244.86, samples=20 00:20:13.515 lat (msec) : 2=0.42%, 4=0.87%, 10=1.82%, 20=2.27%, 50=19.15% 00:20:13.515 lat (msec) : 100=31.34%, 250=43.13%, 500=1.00% 00:20:13.515 cpu : usr=1.99%, sys=2.31%, ctx=3157, majf=0, minf=1 00:20:13.515 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:13.515 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:13.515 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:13.515 issued rwts: total=0,6200,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:13.515 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:13.515 job8: (groupid=0, jobs=1): err= 0: pid=158048: Fri Nov 29 02:25:16 2024 00:20:13.515 write: IOPS=405, BW=101MiB/s (106MB/s)(1030MiB/10158msec); 0 zone resets 00:20:13.515 slat (usec): min=22, max=41320, avg=2246.17, stdev=4525.01 00:20:13.515 clat (usec): min=1252, max=353798, avg=155460.48, stdev=51802.97 00:20:13.515 lat (usec): min=1929, max=353832, avg=157706.65, stdev=52366.57 00:20:13.515 clat percentiles (msec): 00:20:13.515 | 1.00th=[ 14], 5.00th=[ 72], 10.00th=[ 87], 20.00th=[ 107], 00:20:13.515 | 30.00th=[ 136], 40.00th=[ 148], 50.00th=[ 161], 60.00th=[ 176], 00:20:13.515 | 70.00th=[ 184], 80.00th=[ 197], 90.00th=[ 220], 95.00th=[ 226], 00:20:13.515 | 99.00th=[ 253], 99.50th=[ 296], 99.90th=[ 342], 99.95th=[ 342], 00:20:13.515 | 99.99th=[ 355] 00:20:13.515 bw ( KiB/s): min=74240, max=203776, per=7.05%, avg=103859.20, stdev=29996.60, samples=20 00:20:13.515 iops : min= 290, max= 796, avg=405.70, stdev=117.17, samples=20 00:20:13.515 lat (msec) : 2=0.05%, 4=0.24%, 10=0.36%, 20=0.75%, 50=1.77% 00:20:13.515 lat (msec) : 100=15.05%, 250=80.68%, 500=1.09% 00:20:13.515 cpu : usr=1.28%, sys=1.48%, ctx=1365, majf=0, minf=1 00:20:13.515 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.5% 00:20:13.515 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:13.515 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:13.515 issued rwts: total=0,4120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:13.515 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:13.515 job9: (groupid=0, jobs=1): err= 0: pid=158064: Fri Nov 29 02:25:16 2024 00:20:13.515 write: IOPS=525, BW=131MiB/s (138MB/s)(1329MiB/10112msec); 0 zone resets 00:20:13.515 slat (usec): min=18, max=85767, avg=1633.87, stdev=4200.04 00:20:13.515 clat (usec): min=873, max=344029, avg=120073.09, stdev=69983.65 00:20:13.515 lat (usec): min=906, max=344098, avg=121706.96, stdev=70913.08 00:20:13.515 clat percentiles (msec): 00:20:13.515 | 1.00th=[ 4], 5.00th=[ 18], 10.00th=[ 35], 20.00th=[ 40], 00:20:13.515 | 30.00th=[ 55], 40.00th=[ 112], 50.00th=[ 130], 60.00th=[ 155], 00:20:13.515 | 70.00th=[ 167], 80.00th=[ 180], 90.00th=[ 197], 95.00th=[ 224], 00:20:13.515 | 99.00th=[ 288], 99.50th=[ 296], 99.90th=[ 321], 99.95th=[ 347], 00:20:13.515 | 99.99th=[ 347] 00:20:13.515 bw ( KiB/s): min=71680, max=374272, per=9.13%, avg=134431.00, stdev=74781.21, samples=20 00:20:13.515 iops : min= 280, max= 1462, avg=525.10, stdev=292.12, samples=20 00:20:13.515 lat (usec) : 1000=0.09% 00:20:13.515 lat (msec) : 2=0.26%, 4=0.66%, 10=1.90%, 20=3.14%, 50=22.86% 00:20:13.515 lat (msec) : 100=8.67%, 250=59.00%, 500=3.41% 00:20:13.515 cpu : usr=1.68%, sys=1.68%, ctx=2066, majf=0, minf=1 00:20:13.515 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:13.515 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:13.515 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:13.515 issued rwts: total=0,5315,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:13.515 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:13.515 job10: (groupid=0, jobs=1): err= 0: pid=158083: Fri Nov 29 02:25:16 2024 00:20:13.515 write: IOPS=518, BW=130MiB/s (136MB/s)(1315MiB/10151msec); 0 zone resets 00:20:13.515 slat (usec): min=18, max=55816, avg=1331.70, stdev=3560.31 00:20:13.515 clat (usec): min=1249, max=345772, avg=122094.51, stdev=60206.11 00:20:13.515 lat (usec): min=1291, max=345823, avg=123426.21, stdev=61114.64 00:20:13.515 clat percentiles (msec): 00:20:13.515 | 1.00th=[ 8], 5.00th=[ 25], 10.00th=[ 46], 20.00th=[ 60], 00:20:13.515 | 30.00th=[ 81], 40.00th=[ 103], 50.00th=[ 125], 60.00th=[ 144], 00:20:13.515 | 70.00th=[ 167], 80.00th=[ 184], 90.00th=[ 197], 95.00th=[ 205], 00:20:13.515 | 99.00th=[ 239], 99.50th=[ 257], 99.90th=[ 334], 99.95th=[ 334], 00:20:13.515 | 99.99th=[ 347] 00:20:13.515 bw ( KiB/s): min=77312, max=288768, per=9.04%, avg=133068.80, stdev=60571.07, samples=20 00:20:13.515 iops : min= 302, max= 1128, avg=519.80, stdev=236.61, samples=20 00:20:13.515 lat (msec) : 2=0.08%, 4=0.34%, 10=1.20%, 20=2.32%, 50=8.02% 00:20:13.515 lat (msec) : 100=27.26%, 250=60.12%, 500=0.67% 00:20:13.515 cpu : usr=1.59%, sys=1.70%, ctx=2925, majf=0, minf=2 00:20:13.515 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:13.515 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:13.516 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:13.516 issued rwts: total=0,5261,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:13.516 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:13.516 00:20:13.516 Run status group 0 (all jobs): 00:20:13.516 WRITE: bw=1438MiB/s (1508MB/s), 101MiB/s-160MiB/s (106MB/s-168MB/s), io=14.3GiB (15.3GB), run=10052-10158msec 00:20:13.516 00:20:13.516 Disk stats (read/write): 00:20:13.516 nvme0n1: ios=44/11466, merge=0/0, ticks=1377/1219586, in_queue=1220963, util=99.46% 00:20:13.516 nvme10n1: ios=49/9374, merge=0/0, ticks=342/1211624, in_queue=1211966, util=98.36% 00:20:13.516 nvme1n1: ios=49/10150, merge=0/0, ticks=44/1213692, in_queue=1213736, util=97.69% 00:20:13.516 nvme2n1: ios=41/8995, merge=0/0, ticks=1529/1208167, in_queue=1209696, util=100.00% 00:20:13.516 nvme3n1: ios=48/10969, merge=0/0, ticks=2228/1203633, in_queue=1205861, util=99.99% 00:20:13.516 nvme4n1: ios=13/12688, merge=0/0, ticks=538/1222017, in_queue=1222555, util=98.63% 00:20:13.516 nvme5n1: ios=43/9884, merge=0/0, ticks=1021/1215114, in_queue=1216135, util=100.00% 00:20:13.516 nvme6n1: ios=0/12148, merge=0/0, ticks=0/1220458, in_queue=1220458, util=98.27% 00:20:13.516 nvme7n1: ios=47/8078, merge=0/0, ticks=195/1206560, in_queue=1206755, util=100.00% 00:20:13.516 nvme8n1: ios=39/10429, merge=0/0, ticks=1108/1201550, in_queue=1202658, util=99.98% 00:20:13.516 nvme9n1: ios=0/10342, merge=0/0, ticks=0/1215058, in_queue=1215058, util=99.11% 00:20:13.516 02:25:16 -- target/multiconnection.sh@36 -- # sync 00:20:13.516 02:25:16 -- target/multiconnection.sh@37 -- # seq 1 11 00:20:13.516 02:25:16 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:13.516 02:25:16 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:20:13.516 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:20:13.516 02:25:16 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:20:13.516 02:25:16 -- common/autotest_common.sh@1208 -- # local i=0 00:20:13.516 02:25:16 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:13.516 02:25:16 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:20:13.516 02:25:16 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:13.516 02:25:16 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:20:13.516 02:25:16 -- common/autotest_common.sh@1220 -- # return 0 00:20:13.516 02:25:16 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:13.516 02:25:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:13.516 02:25:16 -- common/autotest_common.sh@10 -- # set +x 00:20:13.516 02:25:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:13.516 02:25:16 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:13.516 02:25:16 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:20:13.516 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:20:13.516 02:25:16 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:20:13.516 02:25:16 -- common/autotest_common.sh@1208 -- # local i=0 00:20:13.516 02:25:16 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:13.516 02:25:16 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:20:13.516 02:25:16 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:13.516 02:25:16 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:20:13.516 02:25:16 -- common/autotest_common.sh@1220 -- # return 0 00:20:13.516 02:25:16 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:20:13.516 02:25:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:13.516 02:25:16 -- common/autotest_common.sh@10 -- # set +x 00:20:13.516 02:25:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:13.516 02:25:16 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:13.516 02:25:16 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:20:13.775 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:20:13.775 02:25:17 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:20:13.775 02:25:17 -- common/autotest_common.sh@1208 -- # local i=0 00:20:13.775 02:25:17 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:13.775 02:25:17 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:20:13.775 02:25:17 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:13.775 02:25:17 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:20:13.775 02:25:17 -- common/autotest_common.sh@1220 -- # return 0 00:20:13.775 02:25:17 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:20:13.775 02:25:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:13.775 02:25:17 -- common/autotest_common.sh@10 -- # set +x 00:20:13.775 02:25:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:13.775 02:25:17 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:13.775 02:25:17 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:20:14.034 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:20:14.034 02:25:17 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:20:14.034 02:25:17 -- common/autotest_common.sh@1208 -- # local i=0 00:20:14.034 02:25:17 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:14.034 02:25:17 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:20:14.034 02:25:17 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:14.034 02:25:17 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:20:14.034 02:25:17 -- common/autotest_common.sh@1220 -- # return 0 00:20:14.034 02:25:17 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:20:14.034 02:25:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:14.034 02:25:17 -- common/autotest_common.sh@10 -- # set +x 00:20:14.034 02:25:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:14.034 02:25:17 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:14.034 02:25:17 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:20:14.293 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:20:14.293 02:25:17 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:20:14.293 02:25:17 -- common/autotest_common.sh@1208 -- # local i=0 00:20:14.293 02:25:17 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:14.293 02:25:17 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:20:14.293 02:25:17 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:14.293 02:25:17 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:20:14.293 02:25:17 -- common/autotest_common.sh@1220 -- # return 0 00:20:14.293 02:25:17 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:20:14.293 02:25:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:14.293 02:25:17 -- common/autotest_common.sh@10 -- # set +x 00:20:14.293 02:25:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:14.293 02:25:17 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:14.293 02:25:17 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:20:14.553 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:20:14.553 02:25:18 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:20:14.553 02:25:18 -- common/autotest_common.sh@1208 -- # local i=0 00:20:14.553 02:25:18 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:14.553 02:25:18 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:20:14.553 02:25:18 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:14.553 02:25:18 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:20:14.553 02:25:18 -- common/autotest_common.sh@1220 -- # return 0 00:20:14.553 02:25:18 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:20:14.553 02:25:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:14.553 02:25:18 -- common/autotest_common.sh@10 -- # set +x 00:20:14.553 02:25:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:14.553 02:25:18 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:14.553 02:25:18 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:20:14.812 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:20:14.812 02:25:18 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:20:14.813 02:25:18 -- common/autotest_common.sh@1208 -- # local i=0 00:20:14.813 02:25:18 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:14.813 02:25:18 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:20:14.813 02:25:18 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:14.813 02:25:18 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:20:14.813 02:25:18 -- common/autotest_common.sh@1220 -- # return 0 00:20:14.813 02:25:18 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:20:14.813 02:25:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:14.813 02:25:18 -- common/autotest_common.sh@10 -- # set +x 00:20:14.813 02:25:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:14.813 02:25:18 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:14.813 02:25:18 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:20:15.072 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:20:15.072 02:25:18 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:20:15.072 02:25:18 -- common/autotest_common.sh@1208 -- # local i=0 00:20:15.072 02:25:18 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:15.072 02:25:18 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:20:15.072 02:25:18 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:15.072 02:25:18 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:20:15.072 02:25:18 -- common/autotest_common.sh@1220 -- # return 0 00:20:15.072 02:25:18 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:20:15.072 02:25:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:15.072 02:25:18 -- common/autotest_common.sh@10 -- # set +x 00:20:15.072 02:25:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:15.072 02:25:18 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:15.072 02:25:18 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:20:15.072 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:20:15.072 02:25:18 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:20:15.072 02:25:18 -- common/autotest_common.sh@1208 -- # local i=0 00:20:15.072 02:25:18 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:15.072 02:25:18 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:20:15.072 02:25:18 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:15.072 02:25:18 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:20:15.072 02:25:18 -- common/autotest_common.sh@1220 -- # return 0 00:20:15.072 02:25:18 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:20:15.072 02:25:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:15.072 02:25:18 -- common/autotest_common.sh@10 -- # set +x 00:20:15.331 02:25:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:15.331 02:25:18 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:15.332 02:25:18 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:20:15.332 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:20:15.332 02:25:18 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:20:15.332 02:25:18 -- common/autotest_common.sh@1208 -- # local i=0 00:20:15.332 02:25:18 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:15.332 02:25:18 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:20:15.332 02:25:18 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:15.332 02:25:18 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:20:15.332 02:25:18 -- common/autotest_common.sh@1220 -- # return 0 00:20:15.332 02:25:18 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:20:15.332 02:25:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:15.332 02:25:18 -- common/autotest_common.sh@10 -- # set +x 00:20:15.332 02:25:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:15.332 02:25:18 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:15.332 02:25:18 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:20:15.332 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:20:15.332 02:25:18 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:20:15.332 02:25:18 -- common/autotest_common.sh@1208 -- # local i=0 00:20:15.332 02:25:18 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:15.332 02:25:18 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:20:15.332 02:25:18 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:15.332 02:25:18 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:20:15.332 02:25:18 -- common/autotest_common.sh@1220 -- # return 0 00:20:15.332 02:25:18 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:20:15.332 02:25:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:15.332 02:25:18 -- common/autotest_common.sh@10 -- # set +x 00:20:15.332 02:25:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:15.332 02:25:19 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:20:15.332 02:25:19 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:20:15.332 02:25:19 -- target/multiconnection.sh@47 -- # nvmftestfini 00:20:15.332 02:25:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:15.332 02:25:19 -- nvmf/common.sh@116 -- # sync 00:20:15.332 02:25:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:15.332 02:25:19 -- nvmf/common.sh@119 -- # set +e 00:20:15.332 02:25:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:15.332 02:25:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:15.590 rmmod nvme_tcp 00:20:15.590 rmmod nvme_fabrics 00:20:15.590 rmmod nvme_keyring 00:20:15.590 02:25:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:15.590 02:25:19 -- nvmf/common.sh@123 -- # set -e 00:20:15.590 02:25:19 -- nvmf/common.sh@124 -- # return 0 00:20:15.590 02:25:19 -- nvmf/common.sh@477 -- # '[' -n 152413 ']' 00:20:15.590 02:25:19 -- nvmf/common.sh@478 -- # killprocess 152413 00:20:15.590 02:25:19 -- common/autotest_common.sh@936 -- # '[' -z 152413 ']' 00:20:15.590 02:25:19 -- common/autotest_common.sh@940 -- # kill -0 152413 00:20:15.590 02:25:19 -- common/autotest_common.sh@941 -- # uname 00:20:15.590 02:25:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:15.590 02:25:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 152413 00:20:15.590 02:25:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:15.590 02:25:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:15.590 02:25:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 152413' 00:20:15.590 killing process with pid 152413 00:20:15.590 02:25:19 -- common/autotest_common.sh@955 -- # kill 152413 00:20:15.590 02:25:19 -- common/autotest_common.sh@960 -- # wait 152413 00:20:16.157 02:25:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:16.157 02:25:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:16.157 02:25:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:16.157 02:25:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:16.157 02:25:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:16.157 02:25:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:16.157 02:25:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:16.157 02:25:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:18.069 02:25:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:18.069 00:20:18.069 real 1m1.720s 00:20:18.069 user 3m30.352s 00:20:18.069 sys 0m24.696s 00:20:18.069 02:25:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:18.069 02:25:21 -- common/autotest_common.sh@10 -- # set +x 00:20:18.069 ************************************ 00:20:18.069 END TEST nvmf_multiconnection 00:20:18.069 ************************************ 00:20:18.069 02:25:21 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:18.069 02:25:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:18.069 02:25:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:18.069 02:25:21 -- common/autotest_common.sh@10 -- # set +x 00:20:18.069 ************************************ 00:20:18.069 START TEST nvmf_initiator_timeout 00:20:18.069 ************************************ 00:20:18.069 02:25:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:18.329 * Looking for test storage... 00:20:18.329 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:18.329 02:25:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:18.329 02:25:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:18.329 02:25:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:18.329 02:25:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:18.329 02:25:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:18.329 02:25:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:18.329 02:25:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:18.329 02:25:21 -- scripts/common.sh@335 -- # IFS=.-: 00:20:18.329 02:25:21 -- scripts/common.sh@335 -- # read -ra ver1 00:20:18.329 02:25:21 -- scripts/common.sh@336 -- # IFS=.-: 00:20:18.329 02:25:21 -- scripts/common.sh@336 -- # read -ra ver2 00:20:18.329 02:25:21 -- scripts/common.sh@337 -- # local 'op=<' 00:20:18.329 02:25:21 -- scripts/common.sh@339 -- # ver1_l=2 00:20:18.329 02:25:21 -- scripts/common.sh@340 -- # ver2_l=1 00:20:18.329 02:25:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:18.329 02:25:21 -- scripts/common.sh@343 -- # case "$op" in 00:20:18.329 02:25:21 -- scripts/common.sh@344 -- # : 1 00:20:18.329 02:25:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:18.329 02:25:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:18.329 02:25:21 -- scripts/common.sh@364 -- # decimal 1 00:20:18.329 02:25:21 -- scripts/common.sh@352 -- # local d=1 00:20:18.329 02:25:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:18.329 02:25:21 -- scripts/common.sh@354 -- # echo 1 00:20:18.329 02:25:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:18.329 02:25:21 -- scripts/common.sh@365 -- # decimal 2 00:20:18.329 02:25:21 -- scripts/common.sh@352 -- # local d=2 00:20:18.329 02:25:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:18.329 02:25:21 -- scripts/common.sh@354 -- # echo 2 00:20:18.329 02:25:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:18.329 02:25:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:18.329 02:25:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:18.329 02:25:21 -- scripts/common.sh@367 -- # return 0 00:20:18.329 02:25:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:18.329 02:25:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:18.329 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:18.329 --rc genhtml_branch_coverage=1 00:20:18.329 --rc genhtml_function_coverage=1 00:20:18.329 --rc genhtml_legend=1 00:20:18.329 --rc geninfo_all_blocks=1 00:20:18.329 --rc geninfo_unexecuted_blocks=1 00:20:18.329 00:20:18.329 ' 00:20:18.329 02:25:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:18.329 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:18.329 --rc genhtml_branch_coverage=1 00:20:18.329 --rc genhtml_function_coverage=1 00:20:18.329 --rc genhtml_legend=1 00:20:18.329 --rc geninfo_all_blocks=1 00:20:18.329 --rc geninfo_unexecuted_blocks=1 00:20:18.329 00:20:18.329 ' 00:20:18.329 02:25:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:18.329 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:18.329 --rc genhtml_branch_coverage=1 00:20:18.329 --rc genhtml_function_coverage=1 00:20:18.329 --rc genhtml_legend=1 00:20:18.329 --rc geninfo_all_blocks=1 00:20:18.329 --rc geninfo_unexecuted_blocks=1 00:20:18.329 00:20:18.329 ' 00:20:18.329 02:25:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:18.329 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:18.329 --rc genhtml_branch_coverage=1 00:20:18.329 --rc genhtml_function_coverage=1 00:20:18.329 --rc genhtml_legend=1 00:20:18.329 --rc geninfo_all_blocks=1 00:20:18.329 --rc geninfo_unexecuted_blocks=1 00:20:18.329 00:20:18.329 ' 00:20:18.329 02:25:21 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:18.329 02:25:21 -- nvmf/common.sh@7 -- # uname -s 00:20:18.330 02:25:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:18.330 02:25:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:18.330 02:25:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:18.330 02:25:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:18.330 02:25:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:18.330 02:25:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:18.330 02:25:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:18.330 02:25:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:18.330 02:25:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:18.330 02:25:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:18.330 02:25:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:18.330 02:25:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:18.330 02:25:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:18.330 02:25:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:18.330 02:25:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:18.330 02:25:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:18.330 02:25:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:18.330 02:25:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:18.330 02:25:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:18.330 02:25:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:18.330 02:25:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:18.330 02:25:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:18.330 02:25:21 -- paths/export.sh@5 -- # export PATH 00:20:18.330 02:25:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:18.330 02:25:21 -- nvmf/common.sh@46 -- # : 0 00:20:18.330 02:25:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:18.330 02:25:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:18.330 02:25:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:18.330 02:25:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:18.330 02:25:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:18.330 02:25:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:18.330 02:25:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:18.330 02:25:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:18.330 02:25:21 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:18.330 02:25:21 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:18.330 02:25:21 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:20:18.330 02:25:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:18.330 02:25:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:18.330 02:25:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:18.330 02:25:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:18.330 02:25:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:18.330 02:25:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:18.330 02:25:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:18.330 02:25:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:18.330 02:25:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:18.330 02:25:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:18.330 02:25:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:18.330 02:25:21 -- common/autotest_common.sh@10 -- # set +x 00:20:20.259 02:25:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:20.259 02:25:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:20.259 02:25:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:20.259 02:25:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:20.259 02:25:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:20.259 02:25:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:20.259 02:25:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:20.259 02:25:23 -- nvmf/common.sh@294 -- # net_devs=() 00:20:20.259 02:25:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:20.259 02:25:23 -- nvmf/common.sh@295 -- # e810=() 00:20:20.259 02:25:23 -- nvmf/common.sh@295 -- # local -ga e810 00:20:20.259 02:25:23 -- nvmf/common.sh@296 -- # x722=() 00:20:20.259 02:25:23 -- nvmf/common.sh@296 -- # local -ga x722 00:20:20.259 02:25:23 -- nvmf/common.sh@297 -- # mlx=() 00:20:20.259 02:25:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:20.259 02:25:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:20.259 02:25:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:20.259 02:25:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:20.259 02:25:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:20.259 02:25:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:20.259 02:25:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:20.259 02:25:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:20.259 02:25:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:20.259 02:25:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:20.260 02:25:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:20.260 02:25:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:20.260 02:25:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:20.260 02:25:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:20.260 02:25:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:20.260 02:25:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:20.260 02:25:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:20.260 02:25:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:20.260 02:25:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:20.260 02:25:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:20.260 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:20.260 02:25:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:20.260 02:25:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:20.260 02:25:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:20.260 02:25:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:20.260 02:25:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:20.260 02:25:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:20.260 02:25:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:20.260 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:20.260 02:25:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:20.260 02:25:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:20.260 02:25:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:20.260 02:25:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:20.260 02:25:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:20.260 02:25:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:20.260 02:25:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:20.260 02:25:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:20.260 02:25:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:20.260 02:25:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:20.260 02:25:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:20.260 02:25:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:20.260 02:25:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:20.260 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:20.260 02:25:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:20.260 02:25:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:20.260 02:25:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:20.260 02:25:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:20.260 02:25:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:20.260 02:25:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:20.260 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:20.260 02:25:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:20.260 02:25:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:20.260 02:25:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:20.260 02:25:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:20.260 02:25:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:20.260 02:25:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:20.260 02:25:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:20.260 02:25:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:20.260 02:25:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:20.260 02:25:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:20.260 02:25:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:20.260 02:25:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:20.260 02:25:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:20.260 02:25:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:20.260 02:25:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:20.260 02:25:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:20.260 02:25:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:20.260 02:25:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:20.260 02:25:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:20.528 02:25:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:20.528 02:25:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:20.528 02:25:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:20.528 02:25:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:20.528 02:25:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:20.528 02:25:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:20.528 02:25:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:20.528 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:20.528 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.198 ms 00:20:20.528 00:20:20.528 --- 10.0.0.2 ping statistics --- 00:20:20.528 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:20.528 rtt min/avg/max/mdev = 0.198/0.198/0.198/0.000 ms 00:20:20.528 02:25:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:20.528 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:20.528 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:20:20.528 00:20:20.528 --- 10.0.0.1 ping statistics --- 00:20:20.528 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:20.528 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:20:20.528 02:25:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:20.528 02:25:24 -- nvmf/common.sh@410 -- # return 0 00:20:20.528 02:25:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:20.528 02:25:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:20.528 02:25:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:20.528 02:25:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:20.528 02:25:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:20.528 02:25:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:20.528 02:25:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:20.528 02:25:24 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:20:20.528 02:25:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:20.528 02:25:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:20.528 02:25:24 -- common/autotest_common.sh@10 -- # set +x 00:20:20.528 02:25:24 -- nvmf/common.sh@469 -- # nvmfpid=161555 00:20:20.528 02:25:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:20.528 02:25:24 -- nvmf/common.sh@470 -- # waitforlisten 161555 00:20:20.528 02:25:24 -- common/autotest_common.sh@829 -- # '[' -z 161555 ']' 00:20:20.528 02:25:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:20.528 02:25:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:20.528 02:25:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:20.528 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:20.528 02:25:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:20.528 02:25:24 -- common/autotest_common.sh@10 -- # set +x 00:20:20.528 [2024-11-29 02:25:24.085142] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:20.528 [2024-11-29 02:25:24.085219] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:20.528 EAL: No free 2048 kB hugepages reported on node 1 00:20:20.528 [2024-11-29 02:25:24.154200] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:20.844 [2024-11-29 02:25:24.275705] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:20.844 [2024-11-29 02:25:24.275867] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:20.844 [2024-11-29 02:25:24.275887] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:20.844 [2024-11-29 02:25:24.275902] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:20.844 [2024-11-29 02:25:24.275977] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:20.844 [2024-11-29 02:25:24.276034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:20.844 [2024-11-29 02:25:24.276087] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:20.844 [2024-11-29 02:25:24.276090] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:21.414 02:25:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:21.414 02:25:25 -- common/autotest_common.sh@862 -- # return 0 00:20:21.414 02:25:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:21.414 02:25:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:21.414 02:25:25 -- common/autotest_common.sh@10 -- # set +x 00:20:21.414 02:25:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:21.414 02:25:25 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:20:21.414 02:25:25 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:21.414 02:25:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:21.414 02:25:25 -- common/autotest_common.sh@10 -- # set +x 00:20:21.414 Malloc0 00:20:21.414 02:25:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:21.415 02:25:25 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:20:21.415 02:25:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:21.415 02:25:25 -- common/autotest_common.sh@10 -- # set +x 00:20:21.673 Delay0 00:20:21.673 02:25:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:21.673 02:25:25 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:21.673 02:25:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:21.673 02:25:25 -- common/autotest_common.sh@10 -- # set +x 00:20:21.673 [2024-11-29 02:25:25.104928] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:21.673 02:25:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:21.673 02:25:25 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:20:21.673 02:25:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:21.673 02:25:25 -- common/autotest_common.sh@10 -- # set +x 00:20:21.673 02:25:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:21.673 02:25:25 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:20:21.673 02:25:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:21.673 02:25:25 -- common/autotest_common.sh@10 -- # set +x 00:20:21.673 02:25:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:21.673 02:25:25 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:21.673 02:25:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:21.673 02:25:25 -- common/autotest_common.sh@10 -- # set +x 00:20:21.673 [2024-11-29 02:25:25.133181] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:21.673 02:25:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:21.673 02:25:25 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:20:22.240 02:25:25 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:20:22.240 02:25:25 -- common/autotest_common.sh@1187 -- # local i=0 00:20:22.240 02:25:25 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:22.240 02:25:25 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:22.240 02:25:25 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:24.145 02:25:27 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:24.405 02:25:27 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:24.405 02:25:27 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:20:24.405 02:25:27 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:24.405 02:25:27 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:24.405 02:25:27 -- common/autotest_common.sh@1197 -- # return 0 00:20:24.405 02:25:27 -- target/initiator_timeout.sh@35 -- # fio_pid=162137 00:20:24.405 02:25:27 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:20:24.405 02:25:27 -- target/initiator_timeout.sh@37 -- # sleep 3 00:20:24.405 [global] 00:20:24.405 thread=1 00:20:24.405 invalidate=1 00:20:24.405 rw=write 00:20:24.405 time_based=1 00:20:24.405 runtime=60 00:20:24.405 ioengine=libaio 00:20:24.405 direct=1 00:20:24.405 bs=4096 00:20:24.405 iodepth=1 00:20:24.405 norandommap=0 00:20:24.405 numjobs=1 00:20:24.405 00:20:24.405 verify_dump=1 00:20:24.405 verify_backlog=512 00:20:24.405 verify_state_save=0 00:20:24.405 do_verify=1 00:20:24.405 verify=crc32c-intel 00:20:24.405 [job0] 00:20:24.405 filename=/dev/nvme0n1 00:20:24.405 Could not set queue depth (nvme0n1) 00:20:24.405 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:24.405 fio-3.35 00:20:24.405 Starting 1 thread 00:20:27.712 02:25:30 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:20:27.712 02:25:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:27.712 02:25:30 -- common/autotest_common.sh@10 -- # set +x 00:20:27.712 true 00:20:27.712 02:25:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:27.712 02:25:30 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:20:27.712 02:25:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:27.712 02:25:30 -- common/autotest_common.sh@10 -- # set +x 00:20:27.712 true 00:20:27.712 02:25:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:27.712 02:25:30 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:20:27.712 02:25:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:27.712 02:25:30 -- common/autotest_common.sh@10 -- # set +x 00:20:27.712 true 00:20:27.712 02:25:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:27.712 02:25:30 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:20:27.712 02:25:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:27.712 02:25:30 -- common/autotest_common.sh@10 -- # set +x 00:20:27.712 true 00:20:27.712 02:25:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:27.712 02:25:30 -- target/initiator_timeout.sh@45 -- # sleep 3 00:20:30.240 02:25:33 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:20:30.240 02:25:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.240 02:25:33 -- common/autotest_common.sh@10 -- # set +x 00:20:30.240 true 00:20:30.240 02:25:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.240 02:25:33 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:20:30.240 02:25:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.240 02:25:33 -- common/autotest_common.sh@10 -- # set +x 00:20:30.240 true 00:20:30.240 02:25:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.240 02:25:33 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:20:30.240 02:25:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.240 02:25:33 -- common/autotest_common.sh@10 -- # set +x 00:20:30.240 true 00:20:30.240 02:25:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.240 02:25:33 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:20:30.240 02:25:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.240 02:25:33 -- common/autotest_common.sh@10 -- # set +x 00:20:30.240 true 00:20:30.240 02:25:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.240 02:25:33 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:20:30.240 02:25:33 -- target/initiator_timeout.sh@54 -- # wait 162137 00:21:26.456 00:21:26.456 job0: (groupid=0, jobs=1): err= 0: pid=162207: Fri Nov 29 02:26:28 2024 00:21:26.456 read: IOPS=47, BW=190KiB/s (195kB/s)(11.1MiB/60019msec) 00:21:26.456 slat (usec): min=4, max=8888, avg=17.34, stdev=166.40 00:21:26.456 clat (usec): min=221, max=41226k, avg=20782.30, stdev=772109.00 00:21:26.456 lat (usec): min=226, max=41226k, avg=20799.64, stdev=772109.19 00:21:26.456 clat percentiles (usec): 00:21:26.456 | 1.00th=[ 231], 5.00th=[ 243], 10.00th=[ 249], 00:21:26.456 | 20.00th=[ 258], 30.00th=[ 269], 40.00th=[ 277], 00:21:26.456 | 50.00th=[ 281], 60.00th=[ 289], 70.00th=[ 297], 00:21:26.456 | 80.00th=[ 318], 90.00th=[ 41157], 95.00th=[ 41157], 00:21:26.456 | 99.00th=[ 41157], 99.50th=[ 41681], 99.90th=[ 42730], 00:21:26.456 | 99.95th=[ 43779], 99.99th=[17112761] 00:21:26.456 write: IOPS=51, BW=205KiB/s (210kB/s)(12.0MiB/60019msec); 0 zone resets 00:21:26.456 slat (nsec): min=6660, max=65289, avg=14076.09, stdev=7157.66 00:21:26.456 clat (usec): min=160, max=405, avg=212.27, stdev=39.67 00:21:26.456 lat (usec): min=167, max=419, avg=226.35, stdev=43.07 00:21:26.456 clat percentiles (usec): 00:21:26.456 | 1.00th=[ 167], 5.00th=[ 176], 10.00th=[ 178], 20.00th=[ 184], 00:21:26.456 | 30.00th=[ 188], 40.00th=[ 194], 50.00th=[ 202], 60.00th=[ 215], 00:21:26.456 | 70.00th=[ 223], 80.00th=[ 231], 90.00th=[ 245], 95.00th=[ 310], 00:21:26.456 | 99.00th=[ 359], 99.50th=[ 367], 99.90th=[ 388], 99.95th=[ 400], 00:21:26.456 | 99.99th=[ 404] 00:21:26.456 bw ( KiB/s): min= 112, max= 8080, per=100.00%, avg=4096.00, stdev=2519.70, samples=6 00:21:26.456 iops : min= 28, max= 2020, avg=1024.00, stdev=629.93, samples=6 00:21:26.456 lat (usec) : 250=52.47%, 500=40.15%, 750=0.22% 00:21:26.456 lat (msec) : 50=7.14%, >=2000=0.02% 00:21:26.456 cpu : usr=0.09%, sys=0.18%, ctx=5925, majf=0, minf=1 00:21:26.456 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:21:26.456 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:26.456 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:26.456 issued rwts: total=2851,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:26.456 latency : target=0, window=0, percentile=100.00%, depth=1 00:21:26.456 00:21:26.456 Run status group 0 (all jobs): 00:21:26.456 READ: bw=190KiB/s (195kB/s), 190KiB/s-190KiB/s (195kB/s-195kB/s), io=11.1MiB (11.7MB), run=60019-60019msec 00:21:26.456 WRITE: bw=205KiB/s (210kB/s), 205KiB/s-205KiB/s (210kB/s-210kB/s), io=12.0MiB (12.6MB), run=60019-60019msec 00:21:26.456 00:21:26.456 Disk stats (read/write): 00:21:26.456 nvme0n1: ios=2947/3072, merge=0/0, ticks=19317/576, in_queue=19893, util=99.90% 00:21:26.456 02:26:28 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:21:26.456 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:21:26.456 02:26:28 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:21:26.456 02:26:28 -- common/autotest_common.sh@1208 -- # local i=0 00:21:26.456 02:26:28 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:26.456 02:26:28 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:26.456 02:26:28 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:26.456 02:26:28 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:26.456 02:26:28 -- common/autotest_common.sh@1220 -- # return 0 00:21:26.456 02:26:28 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:21:26.456 02:26:28 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:21:26.456 nvmf hotplug test: fio successful as expected 00:21:26.456 02:26:28 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:26.456 02:26:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:26.456 02:26:28 -- common/autotest_common.sh@10 -- # set +x 00:21:26.456 02:26:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:26.456 02:26:28 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:21:26.456 02:26:28 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:21:26.456 02:26:28 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:21:26.456 02:26:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:26.456 02:26:28 -- nvmf/common.sh@116 -- # sync 00:21:26.456 02:26:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:26.456 02:26:28 -- nvmf/common.sh@119 -- # set +e 00:21:26.456 02:26:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:26.456 02:26:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:26.456 rmmod nvme_tcp 00:21:26.456 rmmod nvme_fabrics 00:21:26.456 rmmod nvme_keyring 00:21:26.456 02:26:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:26.456 02:26:28 -- nvmf/common.sh@123 -- # set -e 00:21:26.456 02:26:28 -- nvmf/common.sh@124 -- # return 0 00:21:26.456 02:26:28 -- nvmf/common.sh@477 -- # '[' -n 161555 ']' 00:21:26.456 02:26:28 -- nvmf/common.sh@478 -- # killprocess 161555 00:21:26.456 02:26:28 -- common/autotest_common.sh@936 -- # '[' -z 161555 ']' 00:21:26.456 02:26:28 -- common/autotest_common.sh@940 -- # kill -0 161555 00:21:26.456 02:26:28 -- common/autotest_common.sh@941 -- # uname 00:21:26.456 02:26:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:26.456 02:26:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 161555 00:21:26.456 02:26:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:26.456 02:26:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:26.456 02:26:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 161555' 00:21:26.456 killing process with pid 161555 00:21:26.456 02:26:28 -- common/autotest_common.sh@955 -- # kill 161555 00:21:26.456 02:26:28 -- common/autotest_common.sh@960 -- # wait 161555 00:21:26.456 02:26:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:26.456 02:26:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:26.456 02:26:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:26.456 02:26:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:26.456 02:26:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:26.456 02:26:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:26.456 02:26:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:26.456 02:26:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:27.396 02:26:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:27.396 00:21:27.396 real 1m8.998s 00:21:27.396 user 4m14.197s 00:21:27.396 sys 0m6.263s 00:21:27.396 02:26:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:27.396 02:26:30 -- common/autotest_common.sh@10 -- # set +x 00:21:27.396 ************************************ 00:21:27.396 END TEST nvmf_initiator_timeout 00:21:27.396 ************************************ 00:21:27.396 02:26:30 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:21:27.396 02:26:30 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:21:27.396 02:26:30 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:21:27.396 02:26:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:27.396 02:26:30 -- common/autotest_common.sh@10 -- # set +x 00:21:29.304 02:26:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:29.304 02:26:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:29.304 02:26:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:29.304 02:26:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:29.304 02:26:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:29.304 02:26:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:29.304 02:26:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:29.304 02:26:32 -- nvmf/common.sh@294 -- # net_devs=() 00:21:29.304 02:26:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:29.304 02:26:32 -- nvmf/common.sh@295 -- # e810=() 00:21:29.304 02:26:32 -- nvmf/common.sh@295 -- # local -ga e810 00:21:29.304 02:26:32 -- nvmf/common.sh@296 -- # x722=() 00:21:29.304 02:26:32 -- nvmf/common.sh@296 -- # local -ga x722 00:21:29.304 02:26:32 -- nvmf/common.sh@297 -- # mlx=() 00:21:29.304 02:26:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:29.304 02:26:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:29.304 02:26:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:29.304 02:26:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:29.304 02:26:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:29.304 02:26:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:29.304 02:26:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:29.304 02:26:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:29.304 02:26:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:29.304 02:26:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:29.304 02:26:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:29.304 02:26:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:29.304 02:26:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:29.304 02:26:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:29.304 02:26:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:29.304 02:26:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:29.304 02:26:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:29.304 02:26:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:29.304 02:26:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:29.304 02:26:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:29.304 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:29.304 02:26:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:29.304 02:26:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:29.304 02:26:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:29.304 02:26:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:29.304 02:26:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:29.304 02:26:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:29.304 02:26:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:29.304 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:29.304 02:26:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:29.304 02:26:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:29.304 02:26:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:29.304 02:26:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:29.304 02:26:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:29.304 02:26:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:29.304 02:26:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:29.304 02:26:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:29.304 02:26:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:29.304 02:26:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:29.304 02:26:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:29.304 02:26:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:29.304 02:26:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:29.304 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:29.304 02:26:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:29.304 02:26:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:29.304 02:26:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:29.304 02:26:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:29.304 02:26:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:29.304 02:26:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:29.304 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:29.304 02:26:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:29.304 02:26:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:29.304 02:26:32 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:29.304 02:26:32 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:21:29.304 02:26:32 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:29.304 02:26:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:29.304 02:26:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:29.304 02:26:32 -- common/autotest_common.sh@10 -- # set +x 00:21:29.304 ************************************ 00:21:29.304 START TEST nvmf_perf_adq 00:21:29.304 ************************************ 00:21:29.304 02:26:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:29.304 * Looking for test storage... 00:21:29.304 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:29.304 02:26:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:29.304 02:26:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:29.304 02:26:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:29.304 02:26:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:29.304 02:26:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:29.304 02:26:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:29.304 02:26:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:29.304 02:26:32 -- scripts/common.sh@335 -- # IFS=.-: 00:21:29.304 02:26:32 -- scripts/common.sh@335 -- # read -ra ver1 00:21:29.304 02:26:32 -- scripts/common.sh@336 -- # IFS=.-: 00:21:29.304 02:26:32 -- scripts/common.sh@336 -- # read -ra ver2 00:21:29.304 02:26:32 -- scripts/common.sh@337 -- # local 'op=<' 00:21:29.305 02:26:32 -- scripts/common.sh@339 -- # ver1_l=2 00:21:29.305 02:26:32 -- scripts/common.sh@340 -- # ver2_l=1 00:21:29.305 02:26:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:29.305 02:26:32 -- scripts/common.sh@343 -- # case "$op" in 00:21:29.305 02:26:32 -- scripts/common.sh@344 -- # : 1 00:21:29.305 02:26:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:29.305 02:26:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:29.305 02:26:32 -- scripts/common.sh@364 -- # decimal 1 00:21:29.305 02:26:32 -- scripts/common.sh@352 -- # local d=1 00:21:29.305 02:26:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:29.305 02:26:32 -- scripts/common.sh@354 -- # echo 1 00:21:29.305 02:26:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:29.305 02:26:32 -- scripts/common.sh@365 -- # decimal 2 00:21:29.305 02:26:32 -- scripts/common.sh@352 -- # local d=2 00:21:29.305 02:26:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:29.305 02:26:32 -- scripts/common.sh@354 -- # echo 2 00:21:29.305 02:26:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:29.305 02:26:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:29.305 02:26:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:29.305 02:26:32 -- scripts/common.sh@367 -- # return 0 00:21:29.305 02:26:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:29.305 02:26:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:29.305 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:29.305 --rc genhtml_branch_coverage=1 00:21:29.305 --rc genhtml_function_coverage=1 00:21:29.305 --rc genhtml_legend=1 00:21:29.305 --rc geninfo_all_blocks=1 00:21:29.305 --rc geninfo_unexecuted_blocks=1 00:21:29.305 00:21:29.305 ' 00:21:29.305 02:26:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:29.305 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:29.305 --rc genhtml_branch_coverage=1 00:21:29.305 --rc genhtml_function_coverage=1 00:21:29.305 --rc genhtml_legend=1 00:21:29.305 --rc geninfo_all_blocks=1 00:21:29.305 --rc geninfo_unexecuted_blocks=1 00:21:29.305 00:21:29.305 ' 00:21:29.305 02:26:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:29.305 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:29.305 --rc genhtml_branch_coverage=1 00:21:29.305 --rc genhtml_function_coverage=1 00:21:29.305 --rc genhtml_legend=1 00:21:29.305 --rc geninfo_all_blocks=1 00:21:29.305 --rc geninfo_unexecuted_blocks=1 00:21:29.305 00:21:29.305 ' 00:21:29.305 02:26:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:29.305 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:29.305 --rc genhtml_branch_coverage=1 00:21:29.305 --rc genhtml_function_coverage=1 00:21:29.305 --rc genhtml_legend=1 00:21:29.305 --rc geninfo_all_blocks=1 00:21:29.305 --rc geninfo_unexecuted_blocks=1 00:21:29.305 00:21:29.305 ' 00:21:29.305 02:26:32 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:29.305 02:26:32 -- nvmf/common.sh@7 -- # uname -s 00:21:29.305 02:26:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:29.305 02:26:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:29.305 02:26:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:29.305 02:26:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:29.305 02:26:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:29.305 02:26:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:29.305 02:26:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:29.305 02:26:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:29.305 02:26:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:29.305 02:26:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:29.305 02:26:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:29.305 02:26:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:29.305 02:26:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:29.305 02:26:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:29.305 02:26:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:29.305 02:26:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:29.305 02:26:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:29.305 02:26:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:29.305 02:26:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:29.305 02:26:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:29.305 02:26:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:29.305 02:26:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:29.305 02:26:32 -- paths/export.sh@5 -- # export PATH 00:21:29.305 02:26:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:29.305 02:26:32 -- nvmf/common.sh@46 -- # : 0 00:21:29.305 02:26:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:29.305 02:26:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:29.305 02:26:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:29.305 02:26:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:29.305 02:26:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:29.305 02:26:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:29.305 02:26:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:29.305 02:26:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:29.305 02:26:32 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:21:29.305 02:26:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:29.305 02:26:32 -- common/autotest_common.sh@10 -- # set +x 00:21:31.214 02:26:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:31.214 02:26:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:31.214 02:26:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:31.214 02:26:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:31.214 02:26:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:31.214 02:26:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:31.214 02:26:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:31.214 02:26:34 -- nvmf/common.sh@294 -- # net_devs=() 00:21:31.214 02:26:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:31.214 02:26:34 -- nvmf/common.sh@295 -- # e810=() 00:21:31.214 02:26:34 -- nvmf/common.sh@295 -- # local -ga e810 00:21:31.214 02:26:34 -- nvmf/common.sh@296 -- # x722=() 00:21:31.214 02:26:34 -- nvmf/common.sh@296 -- # local -ga x722 00:21:31.214 02:26:34 -- nvmf/common.sh@297 -- # mlx=() 00:21:31.214 02:26:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:31.214 02:26:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:31.214 02:26:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:31.214 02:26:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:31.214 02:26:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:31.214 02:26:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:31.214 02:26:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:31.214 02:26:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:31.214 02:26:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:31.214 02:26:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:31.214 02:26:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:31.214 02:26:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:31.214 02:26:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:31.214 02:26:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:31.214 02:26:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:31.214 02:26:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:31.214 02:26:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:31.214 02:26:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:31.214 02:26:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:31.214 02:26:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:31.214 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:31.214 02:26:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:31.214 02:26:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:31.214 02:26:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:31.214 02:26:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:31.214 02:26:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:31.214 02:26:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:31.214 02:26:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:31.214 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:31.214 02:26:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:31.214 02:26:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:31.214 02:26:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:31.214 02:26:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:31.214 02:26:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:31.214 02:26:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:31.214 02:26:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:31.214 02:26:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:31.214 02:26:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:31.214 02:26:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:31.214 02:26:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:31.214 02:26:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:31.214 02:26:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:31.214 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:31.214 02:26:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:31.214 02:26:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:31.214 02:26:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:31.214 02:26:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:31.214 02:26:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:31.214 02:26:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:31.214 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:31.214 02:26:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:31.214 02:26:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:31.214 02:26:34 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:31.214 02:26:34 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:21:31.214 02:26:34 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:21:31.214 02:26:34 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:21:31.214 02:26:34 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:31.781 02:26:35 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:34.317 02:26:37 -- target/perf_adq.sh@54 -- # sleep 5 00:21:39.603 02:26:42 -- target/perf_adq.sh@67 -- # nvmftestinit 00:21:39.603 02:26:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:39.603 02:26:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:39.603 02:26:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:39.603 02:26:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:39.603 02:26:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:39.603 02:26:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:39.603 02:26:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:39.603 02:26:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:39.603 02:26:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:39.603 02:26:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:39.603 02:26:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:39.603 02:26:42 -- common/autotest_common.sh@10 -- # set +x 00:21:39.603 02:26:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:39.603 02:26:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:39.603 02:26:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:39.603 02:26:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:39.603 02:26:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:39.603 02:26:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:39.603 02:26:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:39.603 02:26:42 -- nvmf/common.sh@294 -- # net_devs=() 00:21:39.603 02:26:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:39.603 02:26:42 -- nvmf/common.sh@295 -- # e810=() 00:21:39.603 02:26:42 -- nvmf/common.sh@295 -- # local -ga e810 00:21:39.603 02:26:42 -- nvmf/common.sh@296 -- # x722=() 00:21:39.603 02:26:42 -- nvmf/common.sh@296 -- # local -ga x722 00:21:39.603 02:26:42 -- nvmf/common.sh@297 -- # mlx=() 00:21:39.603 02:26:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:39.604 02:26:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:39.604 02:26:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:39.604 02:26:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:39.604 02:26:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:39.604 02:26:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:39.604 02:26:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:39.604 02:26:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:39.604 02:26:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:39.604 02:26:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:39.604 02:26:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:39.604 02:26:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:39.604 02:26:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:39.604 02:26:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:39.604 02:26:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:39.604 02:26:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:39.604 02:26:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:39.604 02:26:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:39.604 02:26:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:39.604 02:26:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:39.604 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:39.604 02:26:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:39.604 02:26:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:39.604 02:26:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:39.604 02:26:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:39.604 02:26:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:39.604 02:26:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:39.604 02:26:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:39.604 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:39.604 02:26:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:39.604 02:26:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:39.604 02:26:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:39.604 02:26:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:39.604 02:26:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:39.604 02:26:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:39.604 02:26:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:39.604 02:26:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:39.604 02:26:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:39.604 02:26:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:39.604 02:26:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:39.604 02:26:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:39.604 02:26:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:39.604 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:39.604 02:26:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:39.604 02:26:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:39.604 02:26:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:39.604 02:26:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:39.604 02:26:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:39.604 02:26:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:39.604 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:39.604 02:26:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:39.604 02:26:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:39.604 02:26:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:39.604 02:26:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:39.604 02:26:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:39.604 02:26:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:39.604 02:26:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:39.604 02:26:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:39.604 02:26:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:39.604 02:26:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:39.604 02:26:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:39.604 02:26:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:39.604 02:26:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:39.604 02:26:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:39.604 02:26:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:39.604 02:26:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:39.604 02:26:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:39.604 02:26:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:39.604 02:26:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:39.604 02:26:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:39.604 02:26:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:39.604 02:26:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:39.604 02:26:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:39.604 02:26:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:39.604 02:26:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:39.604 02:26:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:39.604 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:39.604 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.219 ms 00:21:39.604 00:21:39.604 --- 10.0.0.2 ping statistics --- 00:21:39.604 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:39.604 rtt min/avg/max/mdev = 0.219/0.219/0.219/0.000 ms 00:21:39.604 02:26:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:39.604 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:39.604 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.109 ms 00:21:39.604 00:21:39.604 --- 10.0.0.1 ping statistics --- 00:21:39.604 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:39.604 rtt min/avg/max/mdev = 0.109/0.109/0.109/0.000 ms 00:21:39.604 02:26:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:39.604 02:26:42 -- nvmf/common.sh@410 -- # return 0 00:21:39.604 02:26:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:39.604 02:26:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:39.604 02:26:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:39.604 02:26:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:39.604 02:26:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:39.604 02:26:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:39.604 02:26:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:39.604 02:26:42 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:39.604 02:26:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:39.604 02:26:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:39.604 02:26:42 -- common/autotest_common.sh@10 -- # set +x 00:21:39.604 02:26:42 -- nvmf/common.sh@469 -- # nvmfpid=174010 00:21:39.604 02:26:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:39.604 02:26:42 -- nvmf/common.sh@470 -- # waitforlisten 174010 00:21:39.604 02:26:42 -- common/autotest_common.sh@829 -- # '[' -z 174010 ']' 00:21:39.604 02:26:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:39.604 02:26:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:39.604 02:26:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:39.604 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:39.604 02:26:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:39.604 02:26:42 -- common/autotest_common.sh@10 -- # set +x 00:21:39.604 [2024-11-29 02:26:42.958358] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:39.604 [2024-11-29 02:26:42.958479] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:39.604 EAL: No free 2048 kB hugepages reported on node 1 00:21:39.604 [2024-11-29 02:26:43.023649] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:39.604 [2024-11-29 02:26:43.132205] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:39.604 [2024-11-29 02:26:43.132366] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:39.604 [2024-11-29 02:26:43.132384] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:39.604 [2024-11-29 02:26:43.132403] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:39.604 [2024-11-29 02:26:43.132467] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:39.604 [2024-11-29 02:26:43.132529] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:39.604 [2024-11-29 02:26:43.132594] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:39.604 [2024-11-29 02:26:43.132597] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:39.604 02:26:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:39.604 02:26:43 -- common/autotest_common.sh@862 -- # return 0 00:21:39.604 02:26:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:39.604 02:26:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:39.604 02:26:43 -- common/autotest_common.sh@10 -- # set +x 00:21:39.604 02:26:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:39.604 02:26:43 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:21:39.604 02:26:43 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:21:39.604 02:26:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:39.604 02:26:43 -- common/autotest_common.sh@10 -- # set +x 00:21:39.604 02:26:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:39.605 02:26:43 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:39.605 02:26:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:39.605 02:26:43 -- common/autotest_common.sh@10 -- # set +x 00:21:39.865 02:26:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:39.865 02:26:43 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:21:39.865 02:26:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:39.865 02:26:43 -- common/autotest_common.sh@10 -- # set +x 00:21:39.865 [2024-11-29 02:26:43.335334] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:39.865 02:26:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:39.865 02:26:43 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:39.865 02:26:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:39.865 02:26:43 -- common/autotest_common.sh@10 -- # set +x 00:21:39.865 Malloc1 00:21:39.865 02:26:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:39.865 02:26:43 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:39.865 02:26:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:39.865 02:26:43 -- common/autotest_common.sh@10 -- # set +x 00:21:39.865 02:26:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:39.865 02:26:43 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:39.865 02:26:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:39.865 02:26:43 -- common/autotest_common.sh@10 -- # set +x 00:21:39.865 02:26:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:39.865 02:26:43 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:39.865 02:26:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:39.865 02:26:43 -- common/autotest_common.sh@10 -- # set +x 00:21:39.865 [2024-11-29 02:26:43.388814] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:39.865 02:26:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:39.865 02:26:43 -- target/perf_adq.sh@73 -- # perfpid=174157 00:21:39.865 02:26:43 -- target/perf_adq.sh@74 -- # sleep 2 00:21:39.865 02:26:43 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:39.865 EAL: No free 2048 kB hugepages reported on node 1 00:21:41.767 02:26:45 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:21:41.767 02:26:45 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:21:41.767 02:26:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:41.767 02:26:45 -- target/perf_adq.sh@76 -- # wc -l 00:21:41.767 02:26:45 -- common/autotest_common.sh@10 -- # set +x 00:21:41.767 02:26:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:41.767 02:26:45 -- target/perf_adq.sh@76 -- # count=4 00:21:41.767 02:26:45 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:21:41.767 02:26:45 -- target/perf_adq.sh@81 -- # wait 174157 00:21:49.923 Initializing NVMe Controllers 00:21:49.923 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:49.923 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:21:49.923 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:21:49.923 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:21:49.923 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:21:49.923 Initialization complete. Launching workers. 00:21:49.923 ======================================================== 00:21:49.923 Latency(us) 00:21:49.923 Device Information : IOPS MiB/s Average min max 00:21:49.923 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 10883.60 42.51 5881.92 1821.60 8906.46 00:21:49.923 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 10549.70 41.21 6066.98 1569.23 10453.28 00:21:49.923 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11718.20 45.77 5462.75 1618.20 9046.59 00:21:49.923 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11367.80 44.41 5630.61 2124.07 9312.99 00:21:49.923 ======================================================== 00:21:49.923 Total : 44519.29 173.90 5751.27 1569.23 10453.28 00:21:49.923 00:21:49.923 02:26:53 -- target/perf_adq.sh@82 -- # nvmftestfini 00:21:49.923 02:26:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:49.923 02:26:53 -- nvmf/common.sh@116 -- # sync 00:21:49.923 02:26:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:49.923 02:26:53 -- nvmf/common.sh@119 -- # set +e 00:21:49.923 02:26:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:49.923 02:26:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:49.923 rmmod nvme_tcp 00:21:49.923 rmmod nvme_fabrics 00:21:49.923 rmmod nvme_keyring 00:21:49.923 02:26:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:49.923 02:26:53 -- nvmf/common.sh@123 -- # set -e 00:21:49.923 02:26:53 -- nvmf/common.sh@124 -- # return 0 00:21:49.923 02:26:53 -- nvmf/common.sh@477 -- # '[' -n 174010 ']' 00:21:49.923 02:26:53 -- nvmf/common.sh@478 -- # killprocess 174010 00:21:49.923 02:26:53 -- common/autotest_common.sh@936 -- # '[' -z 174010 ']' 00:21:49.923 02:26:53 -- common/autotest_common.sh@940 -- # kill -0 174010 00:21:49.923 02:26:53 -- common/autotest_common.sh@941 -- # uname 00:21:49.923 02:26:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:49.923 02:26:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 174010 00:21:50.182 02:26:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:50.182 02:26:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:50.182 02:26:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 174010' 00:21:50.182 killing process with pid 174010 00:21:50.182 02:26:53 -- common/autotest_common.sh@955 -- # kill 174010 00:21:50.182 02:26:53 -- common/autotest_common.sh@960 -- # wait 174010 00:21:50.441 02:26:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:50.441 02:26:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:50.441 02:26:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:50.441 02:26:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:50.441 02:26:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:50.441 02:26:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:50.441 02:26:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:50.441 02:26:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:52.342 02:26:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:52.342 02:26:55 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:21:52.342 02:26:55 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:53.278 02:26:56 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:55.819 02:26:59 -- target/perf_adq.sh@54 -- # sleep 5 00:22:01.094 02:27:04 -- target/perf_adq.sh@87 -- # nvmftestinit 00:22:01.094 02:27:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:01.094 02:27:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:01.094 02:27:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:01.094 02:27:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:01.094 02:27:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:01.094 02:27:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:01.094 02:27:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:01.094 02:27:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:01.094 02:27:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:01.094 02:27:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:01.094 02:27:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:01.094 02:27:04 -- common/autotest_common.sh@10 -- # set +x 00:22:01.094 02:27:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:01.094 02:27:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:01.094 02:27:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:01.094 02:27:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:01.094 02:27:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:01.094 02:27:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:01.094 02:27:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:01.094 02:27:04 -- nvmf/common.sh@294 -- # net_devs=() 00:22:01.094 02:27:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:01.094 02:27:04 -- nvmf/common.sh@295 -- # e810=() 00:22:01.094 02:27:04 -- nvmf/common.sh@295 -- # local -ga e810 00:22:01.094 02:27:04 -- nvmf/common.sh@296 -- # x722=() 00:22:01.094 02:27:04 -- nvmf/common.sh@296 -- # local -ga x722 00:22:01.094 02:27:04 -- nvmf/common.sh@297 -- # mlx=() 00:22:01.094 02:27:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:01.094 02:27:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:01.094 02:27:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:01.094 02:27:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:01.094 02:27:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:01.094 02:27:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:01.094 02:27:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:01.094 02:27:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:01.094 02:27:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:01.094 02:27:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:01.094 02:27:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:01.094 02:27:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:01.094 02:27:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:01.094 02:27:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:01.094 02:27:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:01.094 02:27:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:01.094 02:27:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:01.094 02:27:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:01.094 02:27:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:01.094 02:27:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:01.094 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:01.094 02:27:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:01.094 02:27:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:01.094 02:27:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:01.094 02:27:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:01.094 02:27:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:01.094 02:27:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:01.094 02:27:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:01.094 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:01.094 02:27:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:01.094 02:27:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:01.094 02:27:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:01.094 02:27:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:01.094 02:27:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:01.094 02:27:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:01.094 02:27:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:01.094 02:27:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:01.094 02:27:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:01.094 02:27:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:01.094 02:27:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:01.094 02:27:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:01.094 02:27:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:01.094 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:01.094 02:27:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:01.094 02:27:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:01.094 02:27:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:01.094 02:27:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:01.094 02:27:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:01.094 02:27:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:01.094 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:01.094 02:27:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:01.094 02:27:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:01.094 02:27:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:01.094 02:27:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:01.094 02:27:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:01.094 02:27:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:01.094 02:27:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:01.094 02:27:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:01.094 02:27:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:01.094 02:27:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:01.094 02:27:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:01.094 02:27:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:01.094 02:27:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:01.094 02:27:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:01.094 02:27:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:01.094 02:27:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:01.094 02:27:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:01.094 02:27:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:01.094 02:27:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:01.094 02:27:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:01.094 02:27:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:01.094 02:27:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:01.094 02:27:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:01.094 02:27:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:01.094 02:27:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:01.094 02:27:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:01.094 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:01.094 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.291 ms 00:22:01.094 00:22:01.094 --- 10.0.0.2 ping statistics --- 00:22:01.094 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:01.094 rtt min/avg/max/mdev = 0.291/0.291/0.291/0.000 ms 00:22:01.094 02:27:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:01.094 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:01.094 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:22:01.094 00:22:01.094 --- 10.0.0.1 ping statistics --- 00:22:01.094 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:01.094 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:22:01.094 02:27:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:01.094 02:27:04 -- nvmf/common.sh@410 -- # return 0 00:22:01.094 02:27:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:01.094 02:27:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:01.094 02:27:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:01.094 02:27:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:01.094 02:27:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:01.094 02:27:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:01.094 02:27:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:01.094 02:27:04 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:22:01.094 02:27:04 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:22:01.094 02:27:04 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:22:01.094 02:27:04 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:22:01.094 net.core.busy_poll = 1 00:22:01.094 02:27:04 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:22:01.094 net.core.busy_read = 1 00:22:01.095 02:27:04 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:22:01.095 02:27:04 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:22:01.095 02:27:04 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:22:01.095 02:27:04 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:22:01.095 02:27:04 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:22:01.095 02:27:04 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:22:01.095 02:27:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:01.095 02:27:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:01.095 02:27:04 -- common/autotest_common.sh@10 -- # set +x 00:22:01.095 02:27:04 -- nvmf/common.sh@469 -- # nvmfpid=176966 00:22:01.095 02:27:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:22:01.095 02:27:04 -- nvmf/common.sh@470 -- # waitforlisten 176966 00:22:01.095 02:27:04 -- common/autotest_common.sh@829 -- # '[' -z 176966 ']' 00:22:01.095 02:27:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:01.095 02:27:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:01.095 02:27:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:01.095 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:01.095 02:27:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:01.095 02:27:04 -- common/autotest_common.sh@10 -- # set +x 00:22:01.095 [2024-11-29 02:27:04.479207] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:01.095 [2024-11-29 02:27:04.479290] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:01.095 EAL: No free 2048 kB hugepages reported on node 1 00:22:01.095 [2024-11-29 02:27:04.551231] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:01.095 [2024-11-29 02:27:04.667580] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:01.095 [2024-11-29 02:27:04.667728] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:01.095 [2024-11-29 02:27:04.667746] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:01.095 [2024-11-29 02:27:04.667768] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:01.095 [2024-11-29 02:27:04.667823] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:01.095 [2024-11-29 02:27:04.667857] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:01.095 [2024-11-29 02:27:04.667915] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:01.095 [2024-11-29 02:27:04.667918] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:01.095 02:27:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:01.095 02:27:04 -- common/autotest_common.sh@862 -- # return 0 00:22:01.095 02:27:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:01.095 02:27:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:01.095 02:27:04 -- common/autotest_common.sh@10 -- # set +x 00:22:01.095 02:27:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:01.095 02:27:04 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:22:01.095 02:27:04 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:22:01.095 02:27:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:01.095 02:27:04 -- common/autotest_common.sh@10 -- # set +x 00:22:01.095 02:27:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:01.095 02:27:04 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:22:01.095 02:27:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:01.095 02:27:04 -- common/autotest_common.sh@10 -- # set +x 00:22:01.354 02:27:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:01.354 02:27:04 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:22:01.354 02:27:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:01.354 02:27:04 -- common/autotest_common.sh@10 -- # set +x 00:22:01.354 [2024-11-29 02:27:04.841362] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:01.354 02:27:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:01.354 02:27:04 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:01.354 02:27:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:01.354 02:27:04 -- common/autotest_common.sh@10 -- # set +x 00:22:01.354 Malloc1 00:22:01.354 02:27:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:01.354 02:27:04 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:01.354 02:27:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:01.354 02:27:04 -- common/autotest_common.sh@10 -- # set +x 00:22:01.354 02:27:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:01.354 02:27:04 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:01.354 02:27:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:01.354 02:27:04 -- common/autotest_common.sh@10 -- # set +x 00:22:01.354 02:27:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:01.354 02:27:04 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:01.354 02:27:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:01.354 02:27:04 -- common/autotest_common.sh@10 -- # set +x 00:22:01.354 [2024-11-29 02:27:04.894197] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:01.354 02:27:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:01.354 02:27:04 -- target/perf_adq.sh@94 -- # perfpid=177118 00:22:01.354 02:27:04 -- target/perf_adq.sh@95 -- # sleep 2 00:22:01.354 02:27:04 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:22:01.354 EAL: No free 2048 kB hugepages reported on node 1 00:22:03.255 02:27:06 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:22:03.255 02:27:06 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:22:03.255 02:27:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:03.255 02:27:06 -- common/autotest_common.sh@10 -- # set +x 00:22:03.255 02:27:06 -- target/perf_adq.sh@97 -- # wc -l 00:22:03.255 02:27:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:03.513 02:27:06 -- target/perf_adq.sh@97 -- # count=2 00:22:03.513 02:27:06 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:22:03.513 02:27:06 -- target/perf_adq.sh@103 -- # wait 177118 00:22:11.622 Initializing NVMe Controllers 00:22:11.622 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:11.622 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:22:11.622 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:22:11.622 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:22:11.622 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:22:11.622 Initialization complete. Launching workers. 00:22:11.622 ======================================================== 00:22:11.622 Latency(us) 00:22:11.622 Device Information : IOPS MiB/s Average min max 00:22:11.622 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 8204.30 32.05 7821.83 1537.63 52975.24 00:22:11.622 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 6594.20 25.76 9707.19 1294.54 53798.16 00:22:11.622 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 7885.30 30.80 8131.08 1061.57 52964.90 00:22:11.622 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 6741.10 26.33 9495.00 1363.54 53656.63 00:22:11.622 ======================================================== 00:22:11.622 Total : 29424.90 114.94 8710.53 1061.57 53798.16 00:22:11.622 00:22:11.622 02:27:15 -- target/perf_adq.sh@104 -- # nvmftestfini 00:22:11.622 02:27:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:11.622 02:27:15 -- nvmf/common.sh@116 -- # sync 00:22:11.622 02:27:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:11.622 02:27:15 -- nvmf/common.sh@119 -- # set +e 00:22:11.622 02:27:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:11.622 02:27:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:11.622 rmmod nvme_tcp 00:22:11.622 rmmod nvme_fabrics 00:22:11.622 rmmod nvme_keyring 00:22:11.622 02:27:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:11.622 02:27:15 -- nvmf/common.sh@123 -- # set -e 00:22:11.622 02:27:15 -- nvmf/common.sh@124 -- # return 0 00:22:11.622 02:27:15 -- nvmf/common.sh@477 -- # '[' -n 176966 ']' 00:22:11.622 02:27:15 -- nvmf/common.sh@478 -- # killprocess 176966 00:22:11.622 02:27:15 -- common/autotest_common.sh@936 -- # '[' -z 176966 ']' 00:22:11.622 02:27:15 -- common/autotest_common.sh@940 -- # kill -0 176966 00:22:11.622 02:27:15 -- common/autotest_common.sh@941 -- # uname 00:22:11.622 02:27:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:11.622 02:27:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 176966 00:22:11.622 02:27:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:11.622 02:27:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:11.622 02:27:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 176966' 00:22:11.623 killing process with pid 176966 00:22:11.623 02:27:15 -- common/autotest_common.sh@955 -- # kill 176966 00:22:11.623 02:27:15 -- common/autotest_common.sh@960 -- # wait 176966 00:22:11.882 02:27:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:11.882 02:27:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:11.882 02:27:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:11.882 02:27:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:11.882 02:27:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:11.882 02:27:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:11.882 02:27:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:11.882 02:27:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:15.292 02:27:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:15.292 02:27:18 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:22:15.292 00:22:15.292 real 0m45.790s 00:22:15.292 user 2m38.047s 00:22:15.292 sys 0m10.061s 00:22:15.292 02:27:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:15.292 02:27:18 -- common/autotest_common.sh@10 -- # set +x 00:22:15.292 ************************************ 00:22:15.292 END TEST nvmf_perf_adq 00:22:15.292 ************************************ 00:22:15.292 02:27:18 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:15.292 02:27:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:15.292 02:27:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:15.292 02:27:18 -- common/autotest_common.sh@10 -- # set +x 00:22:15.292 ************************************ 00:22:15.292 START TEST nvmf_shutdown 00:22:15.292 ************************************ 00:22:15.292 02:27:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:15.292 * Looking for test storage... 00:22:15.292 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:15.292 02:27:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:15.292 02:27:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:15.292 02:27:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:15.292 02:27:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:15.292 02:27:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:15.292 02:27:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:15.292 02:27:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:15.292 02:27:18 -- scripts/common.sh@335 -- # IFS=.-: 00:22:15.292 02:27:18 -- scripts/common.sh@335 -- # read -ra ver1 00:22:15.292 02:27:18 -- scripts/common.sh@336 -- # IFS=.-: 00:22:15.292 02:27:18 -- scripts/common.sh@336 -- # read -ra ver2 00:22:15.292 02:27:18 -- scripts/common.sh@337 -- # local 'op=<' 00:22:15.292 02:27:18 -- scripts/common.sh@339 -- # ver1_l=2 00:22:15.292 02:27:18 -- scripts/common.sh@340 -- # ver2_l=1 00:22:15.292 02:27:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:15.292 02:27:18 -- scripts/common.sh@343 -- # case "$op" in 00:22:15.292 02:27:18 -- scripts/common.sh@344 -- # : 1 00:22:15.292 02:27:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:15.292 02:27:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:15.292 02:27:18 -- scripts/common.sh@364 -- # decimal 1 00:22:15.292 02:27:18 -- scripts/common.sh@352 -- # local d=1 00:22:15.292 02:27:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:15.292 02:27:18 -- scripts/common.sh@354 -- # echo 1 00:22:15.292 02:27:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:15.292 02:27:18 -- scripts/common.sh@365 -- # decimal 2 00:22:15.292 02:27:18 -- scripts/common.sh@352 -- # local d=2 00:22:15.292 02:27:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:15.292 02:27:18 -- scripts/common.sh@354 -- # echo 2 00:22:15.292 02:27:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:15.292 02:27:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:15.292 02:27:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:15.292 02:27:18 -- scripts/common.sh@367 -- # return 0 00:22:15.293 02:27:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:15.293 02:27:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:15.293 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:15.293 --rc genhtml_branch_coverage=1 00:22:15.293 --rc genhtml_function_coverage=1 00:22:15.293 --rc genhtml_legend=1 00:22:15.293 --rc geninfo_all_blocks=1 00:22:15.293 --rc geninfo_unexecuted_blocks=1 00:22:15.293 00:22:15.293 ' 00:22:15.293 02:27:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:15.293 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:15.293 --rc genhtml_branch_coverage=1 00:22:15.293 --rc genhtml_function_coverage=1 00:22:15.293 --rc genhtml_legend=1 00:22:15.293 --rc geninfo_all_blocks=1 00:22:15.293 --rc geninfo_unexecuted_blocks=1 00:22:15.293 00:22:15.293 ' 00:22:15.293 02:27:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:15.293 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:15.293 --rc genhtml_branch_coverage=1 00:22:15.293 --rc genhtml_function_coverage=1 00:22:15.293 --rc genhtml_legend=1 00:22:15.293 --rc geninfo_all_blocks=1 00:22:15.293 --rc geninfo_unexecuted_blocks=1 00:22:15.293 00:22:15.293 ' 00:22:15.293 02:27:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:15.293 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:15.293 --rc genhtml_branch_coverage=1 00:22:15.293 --rc genhtml_function_coverage=1 00:22:15.293 --rc genhtml_legend=1 00:22:15.293 --rc geninfo_all_blocks=1 00:22:15.293 --rc geninfo_unexecuted_blocks=1 00:22:15.293 00:22:15.293 ' 00:22:15.293 02:27:18 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:15.293 02:27:18 -- nvmf/common.sh@7 -- # uname -s 00:22:15.293 02:27:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:15.293 02:27:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:15.293 02:27:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:15.293 02:27:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:15.293 02:27:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:15.293 02:27:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:15.293 02:27:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:15.293 02:27:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:15.293 02:27:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:15.293 02:27:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:15.293 02:27:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:15.293 02:27:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:15.293 02:27:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:15.293 02:27:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:15.293 02:27:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:15.293 02:27:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:15.293 02:27:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:15.293 02:27:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:15.293 02:27:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:15.293 02:27:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:15.293 02:27:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:15.293 02:27:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:15.293 02:27:18 -- paths/export.sh@5 -- # export PATH 00:22:15.293 02:27:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:15.293 02:27:18 -- nvmf/common.sh@46 -- # : 0 00:22:15.293 02:27:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:15.293 02:27:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:15.293 02:27:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:15.293 02:27:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:15.293 02:27:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:15.293 02:27:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:15.293 02:27:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:15.293 02:27:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:15.293 02:27:18 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:15.293 02:27:18 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:15.293 02:27:18 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:22:15.293 02:27:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:15.293 02:27:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:15.293 02:27:18 -- common/autotest_common.sh@10 -- # set +x 00:22:15.293 ************************************ 00:22:15.293 START TEST nvmf_shutdown_tc1 00:22:15.293 ************************************ 00:22:15.293 02:27:18 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:22:15.293 02:27:18 -- target/shutdown.sh@74 -- # starttarget 00:22:15.293 02:27:18 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:15.293 02:27:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:15.293 02:27:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:15.293 02:27:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:15.293 02:27:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:15.293 02:27:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:15.293 02:27:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:15.293 02:27:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:15.293 02:27:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:15.293 02:27:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:15.293 02:27:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:15.293 02:27:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:15.293 02:27:18 -- common/autotest_common.sh@10 -- # set +x 00:22:17.196 02:27:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:17.196 02:27:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:17.196 02:27:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:17.196 02:27:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:17.196 02:27:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:17.196 02:27:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:17.196 02:27:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:17.196 02:27:20 -- nvmf/common.sh@294 -- # net_devs=() 00:22:17.196 02:27:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:17.196 02:27:20 -- nvmf/common.sh@295 -- # e810=() 00:22:17.196 02:27:20 -- nvmf/common.sh@295 -- # local -ga e810 00:22:17.196 02:27:20 -- nvmf/common.sh@296 -- # x722=() 00:22:17.196 02:27:20 -- nvmf/common.sh@296 -- # local -ga x722 00:22:17.196 02:27:20 -- nvmf/common.sh@297 -- # mlx=() 00:22:17.196 02:27:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:17.196 02:27:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:17.196 02:27:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:17.196 02:27:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:17.196 02:27:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:17.196 02:27:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:17.196 02:27:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:17.196 02:27:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:17.196 02:27:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:17.196 02:27:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:17.196 02:27:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:17.196 02:27:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:17.196 02:27:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:17.196 02:27:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:17.196 02:27:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:17.196 02:27:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:17.196 02:27:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:17.196 02:27:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:17.196 02:27:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:17.196 02:27:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:17.196 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:17.196 02:27:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:17.196 02:27:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:17.196 02:27:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:17.196 02:27:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:17.196 02:27:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:17.196 02:27:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:17.196 02:27:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:17.196 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:17.196 02:27:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:17.196 02:27:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:17.196 02:27:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:17.196 02:27:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:17.196 02:27:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:17.196 02:27:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:17.196 02:27:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:17.196 02:27:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:17.196 02:27:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:17.196 02:27:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:17.196 02:27:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:17.196 02:27:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:17.196 02:27:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:17.196 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:17.196 02:27:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:17.196 02:27:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:17.196 02:27:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:17.196 02:27:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:17.196 02:27:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:17.196 02:27:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:17.196 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:17.196 02:27:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:17.196 02:27:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:17.196 02:27:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:17.196 02:27:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:17.196 02:27:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:17.196 02:27:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:17.196 02:27:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:17.196 02:27:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:17.196 02:27:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:17.196 02:27:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:17.196 02:27:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:17.196 02:27:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:17.196 02:27:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:17.196 02:27:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:17.196 02:27:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:17.196 02:27:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:17.197 02:27:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:17.197 02:27:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:17.197 02:27:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:17.197 02:27:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:17.197 02:27:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:17.197 02:27:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:17.197 02:27:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:17.197 02:27:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:17.197 02:27:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:17.197 02:27:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:17.197 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:17.197 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.238 ms 00:22:17.197 00:22:17.197 --- 10.0.0.2 ping statistics --- 00:22:17.197 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:17.197 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:22:17.197 02:27:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:17.197 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:17.197 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.055 ms 00:22:17.197 00:22:17.197 --- 10.0.0.1 ping statistics --- 00:22:17.197 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:17.197 rtt min/avg/max/mdev = 0.055/0.055/0.055/0.000 ms 00:22:17.197 02:27:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:17.197 02:27:20 -- nvmf/common.sh@410 -- # return 0 00:22:17.197 02:27:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:17.197 02:27:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:17.197 02:27:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:17.197 02:27:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:17.197 02:27:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:17.197 02:27:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:17.197 02:27:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:17.197 02:27:20 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:17.197 02:27:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:17.197 02:27:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:17.197 02:27:20 -- common/autotest_common.sh@10 -- # set +x 00:22:17.197 02:27:20 -- nvmf/common.sh@469 -- # nvmfpid=180969 00:22:17.197 02:27:20 -- nvmf/common.sh@470 -- # waitforlisten 180969 00:22:17.197 02:27:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:17.197 02:27:20 -- common/autotest_common.sh@829 -- # '[' -z 180969 ']' 00:22:17.197 02:27:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:17.197 02:27:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:17.197 02:27:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:17.197 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:17.197 02:27:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:17.197 02:27:20 -- common/autotest_common.sh@10 -- # set +x 00:22:17.197 [2024-11-29 02:27:20.800479] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:17.197 [2024-11-29 02:27:20.800550] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:17.197 EAL: No free 2048 kB hugepages reported on node 1 00:22:17.197 [2024-11-29 02:27:20.869011] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:17.457 [2024-11-29 02:27:20.984756] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:17.457 [2024-11-29 02:27:20.984904] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:17.458 [2024-11-29 02:27:20.984924] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:17.458 [2024-11-29 02:27:20.984940] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:17.458 [2024-11-29 02:27:20.985039] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:17.458 [2024-11-29 02:27:20.985097] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:17.458 [2024-11-29 02:27:20.985166] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:17.458 [2024-11-29 02:27:20.985169] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:18.392 02:27:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:18.392 02:27:21 -- common/autotest_common.sh@862 -- # return 0 00:22:18.392 02:27:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:18.392 02:27:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:18.392 02:27:21 -- common/autotest_common.sh@10 -- # set +x 00:22:18.392 02:27:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:18.392 02:27:21 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:18.392 02:27:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.392 02:27:21 -- common/autotest_common.sh@10 -- # set +x 00:22:18.392 [2024-11-29 02:27:21.808993] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:18.393 02:27:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.393 02:27:21 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:18.393 02:27:21 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:18.393 02:27:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:18.393 02:27:21 -- common/autotest_common.sh@10 -- # set +x 00:22:18.393 02:27:21 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:18.393 02:27:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:18.393 02:27:21 -- target/shutdown.sh@28 -- # cat 00:22:18.393 02:27:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:18.393 02:27:21 -- target/shutdown.sh@28 -- # cat 00:22:18.393 02:27:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:18.393 02:27:21 -- target/shutdown.sh@28 -- # cat 00:22:18.393 02:27:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:18.393 02:27:21 -- target/shutdown.sh@28 -- # cat 00:22:18.393 02:27:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:18.393 02:27:21 -- target/shutdown.sh@28 -- # cat 00:22:18.393 02:27:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:18.393 02:27:21 -- target/shutdown.sh@28 -- # cat 00:22:18.393 02:27:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:18.393 02:27:21 -- target/shutdown.sh@28 -- # cat 00:22:18.393 02:27:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:18.393 02:27:21 -- target/shutdown.sh@28 -- # cat 00:22:18.393 02:27:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:18.393 02:27:21 -- target/shutdown.sh@28 -- # cat 00:22:18.393 02:27:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:18.393 02:27:21 -- target/shutdown.sh@28 -- # cat 00:22:18.393 02:27:21 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:18.393 02:27:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.393 02:27:21 -- common/autotest_common.sh@10 -- # set +x 00:22:18.393 Malloc1 00:22:18.393 [2024-11-29 02:27:21.884047] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:18.393 Malloc2 00:22:18.393 Malloc3 00:22:18.393 Malloc4 00:22:18.393 Malloc5 00:22:18.652 Malloc6 00:22:18.652 Malloc7 00:22:18.652 Malloc8 00:22:18.652 Malloc9 00:22:18.652 Malloc10 00:22:18.652 02:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.652 02:27:22 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:18.652 02:27:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:18.652 02:27:22 -- common/autotest_common.sh@10 -- # set +x 00:22:18.912 02:27:22 -- target/shutdown.sh@78 -- # perfpid=181166 00:22:18.912 02:27:22 -- target/shutdown.sh@79 -- # waitforlisten 181166 /var/tmp/bdevperf.sock 00:22:18.912 02:27:22 -- common/autotest_common.sh@829 -- # '[' -z 181166 ']' 00:22:18.912 02:27:22 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:22:18.912 02:27:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:18.912 02:27:22 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:18.912 02:27:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:18.912 02:27:22 -- nvmf/common.sh@520 -- # config=() 00:22:18.912 02:27:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:18.912 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:18.912 02:27:22 -- nvmf/common.sh@520 -- # local subsystem config 00:22:18.912 02:27:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:18.912 02:27:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:18.912 02:27:22 -- common/autotest_common.sh@10 -- # set +x 00:22:18.912 02:27:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:18.912 { 00:22:18.912 "params": { 00:22:18.912 "name": "Nvme$subsystem", 00:22:18.912 "trtype": "$TEST_TRANSPORT", 00:22:18.912 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:18.912 "adrfam": "ipv4", 00:22:18.912 "trsvcid": "$NVMF_PORT", 00:22:18.912 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:18.912 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:18.912 "hdgst": ${hdgst:-false}, 00:22:18.912 "ddgst": ${ddgst:-false} 00:22:18.912 }, 00:22:18.912 "method": "bdev_nvme_attach_controller" 00:22:18.912 } 00:22:18.912 EOF 00:22:18.912 )") 00:22:18.912 02:27:22 -- nvmf/common.sh@542 -- # cat 00:22:18.912 02:27:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:18.912 02:27:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:18.912 { 00:22:18.912 "params": { 00:22:18.912 "name": "Nvme$subsystem", 00:22:18.912 "trtype": "$TEST_TRANSPORT", 00:22:18.912 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:18.912 "adrfam": "ipv4", 00:22:18.912 "trsvcid": "$NVMF_PORT", 00:22:18.912 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:18.912 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:18.912 "hdgst": ${hdgst:-false}, 00:22:18.912 "ddgst": ${ddgst:-false} 00:22:18.912 }, 00:22:18.912 "method": "bdev_nvme_attach_controller" 00:22:18.912 } 00:22:18.912 EOF 00:22:18.912 )") 00:22:18.912 02:27:22 -- nvmf/common.sh@542 -- # cat 00:22:18.912 02:27:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:18.912 02:27:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:18.912 { 00:22:18.912 "params": { 00:22:18.912 "name": "Nvme$subsystem", 00:22:18.912 "trtype": "$TEST_TRANSPORT", 00:22:18.912 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:18.912 "adrfam": "ipv4", 00:22:18.912 "trsvcid": "$NVMF_PORT", 00:22:18.912 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:18.912 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:18.912 "hdgst": ${hdgst:-false}, 00:22:18.912 "ddgst": ${ddgst:-false} 00:22:18.912 }, 00:22:18.912 "method": "bdev_nvme_attach_controller" 00:22:18.912 } 00:22:18.912 EOF 00:22:18.912 )") 00:22:18.912 02:27:22 -- nvmf/common.sh@542 -- # cat 00:22:18.912 02:27:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:18.912 02:27:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:18.912 { 00:22:18.912 "params": { 00:22:18.912 "name": "Nvme$subsystem", 00:22:18.912 "trtype": "$TEST_TRANSPORT", 00:22:18.912 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:18.912 "adrfam": "ipv4", 00:22:18.912 "trsvcid": "$NVMF_PORT", 00:22:18.912 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:18.912 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:18.912 "hdgst": ${hdgst:-false}, 00:22:18.912 "ddgst": ${ddgst:-false} 00:22:18.912 }, 00:22:18.912 "method": "bdev_nvme_attach_controller" 00:22:18.912 } 00:22:18.912 EOF 00:22:18.912 )") 00:22:18.912 02:27:22 -- nvmf/common.sh@542 -- # cat 00:22:18.912 02:27:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:18.912 02:27:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:18.912 { 00:22:18.912 "params": { 00:22:18.912 "name": "Nvme$subsystem", 00:22:18.912 "trtype": "$TEST_TRANSPORT", 00:22:18.912 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:18.912 "adrfam": "ipv4", 00:22:18.912 "trsvcid": "$NVMF_PORT", 00:22:18.912 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:18.912 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:18.912 "hdgst": ${hdgst:-false}, 00:22:18.912 "ddgst": ${ddgst:-false} 00:22:18.912 }, 00:22:18.912 "method": "bdev_nvme_attach_controller" 00:22:18.912 } 00:22:18.912 EOF 00:22:18.912 )") 00:22:18.912 02:27:22 -- nvmf/common.sh@542 -- # cat 00:22:18.912 02:27:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:18.912 02:27:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:18.912 { 00:22:18.912 "params": { 00:22:18.912 "name": "Nvme$subsystem", 00:22:18.912 "trtype": "$TEST_TRANSPORT", 00:22:18.912 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:18.912 "adrfam": "ipv4", 00:22:18.912 "trsvcid": "$NVMF_PORT", 00:22:18.912 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:18.912 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:18.912 "hdgst": ${hdgst:-false}, 00:22:18.912 "ddgst": ${ddgst:-false} 00:22:18.912 }, 00:22:18.912 "method": "bdev_nvme_attach_controller" 00:22:18.912 } 00:22:18.912 EOF 00:22:18.912 )") 00:22:18.912 02:27:22 -- nvmf/common.sh@542 -- # cat 00:22:18.912 02:27:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:18.912 02:27:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:18.912 { 00:22:18.912 "params": { 00:22:18.912 "name": "Nvme$subsystem", 00:22:18.912 "trtype": "$TEST_TRANSPORT", 00:22:18.912 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:18.912 "adrfam": "ipv4", 00:22:18.912 "trsvcid": "$NVMF_PORT", 00:22:18.912 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:18.912 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:18.912 "hdgst": ${hdgst:-false}, 00:22:18.912 "ddgst": ${ddgst:-false} 00:22:18.912 }, 00:22:18.912 "method": "bdev_nvme_attach_controller" 00:22:18.912 } 00:22:18.912 EOF 00:22:18.912 )") 00:22:18.912 02:27:22 -- nvmf/common.sh@542 -- # cat 00:22:18.912 02:27:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:18.912 02:27:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:18.912 { 00:22:18.912 "params": { 00:22:18.912 "name": "Nvme$subsystem", 00:22:18.912 "trtype": "$TEST_TRANSPORT", 00:22:18.912 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:18.912 "adrfam": "ipv4", 00:22:18.912 "trsvcid": "$NVMF_PORT", 00:22:18.912 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:18.912 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:18.913 "hdgst": ${hdgst:-false}, 00:22:18.913 "ddgst": ${ddgst:-false} 00:22:18.913 }, 00:22:18.913 "method": "bdev_nvme_attach_controller" 00:22:18.913 } 00:22:18.913 EOF 00:22:18.913 )") 00:22:18.913 02:27:22 -- nvmf/common.sh@542 -- # cat 00:22:18.913 02:27:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:18.913 02:27:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:18.913 { 00:22:18.913 "params": { 00:22:18.913 "name": "Nvme$subsystem", 00:22:18.913 "trtype": "$TEST_TRANSPORT", 00:22:18.913 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:18.913 "adrfam": "ipv4", 00:22:18.913 "trsvcid": "$NVMF_PORT", 00:22:18.913 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:18.913 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:18.913 "hdgst": ${hdgst:-false}, 00:22:18.913 "ddgst": ${ddgst:-false} 00:22:18.913 }, 00:22:18.913 "method": "bdev_nvme_attach_controller" 00:22:18.913 } 00:22:18.913 EOF 00:22:18.913 )") 00:22:18.913 02:27:22 -- nvmf/common.sh@542 -- # cat 00:22:18.913 02:27:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:18.913 02:27:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:18.913 { 00:22:18.913 "params": { 00:22:18.913 "name": "Nvme$subsystem", 00:22:18.913 "trtype": "$TEST_TRANSPORT", 00:22:18.913 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:18.913 "adrfam": "ipv4", 00:22:18.913 "trsvcid": "$NVMF_PORT", 00:22:18.913 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:18.913 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:18.913 "hdgst": ${hdgst:-false}, 00:22:18.913 "ddgst": ${ddgst:-false} 00:22:18.913 }, 00:22:18.913 "method": "bdev_nvme_attach_controller" 00:22:18.913 } 00:22:18.913 EOF 00:22:18.913 )") 00:22:18.913 02:27:22 -- nvmf/common.sh@542 -- # cat 00:22:18.913 02:27:22 -- nvmf/common.sh@544 -- # jq . 00:22:18.913 02:27:22 -- nvmf/common.sh@545 -- # IFS=, 00:22:18.913 02:27:22 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:18.913 "params": { 00:22:18.913 "name": "Nvme1", 00:22:18.913 "trtype": "tcp", 00:22:18.913 "traddr": "10.0.0.2", 00:22:18.913 "adrfam": "ipv4", 00:22:18.913 "trsvcid": "4420", 00:22:18.913 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:18.913 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:18.913 "hdgst": false, 00:22:18.913 "ddgst": false 00:22:18.913 }, 00:22:18.913 "method": "bdev_nvme_attach_controller" 00:22:18.913 },{ 00:22:18.913 "params": { 00:22:18.913 "name": "Nvme2", 00:22:18.913 "trtype": "tcp", 00:22:18.913 "traddr": "10.0.0.2", 00:22:18.913 "adrfam": "ipv4", 00:22:18.913 "trsvcid": "4420", 00:22:18.913 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:18.913 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:18.913 "hdgst": false, 00:22:18.913 "ddgst": false 00:22:18.913 }, 00:22:18.913 "method": "bdev_nvme_attach_controller" 00:22:18.913 },{ 00:22:18.913 "params": { 00:22:18.913 "name": "Nvme3", 00:22:18.913 "trtype": "tcp", 00:22:18.913 "traddr": "10.0.0.2", 00:22:18.913 "adrfam": "ipv4", 00:22:18.913 "trsvcid": "4420", 00:22:18.913 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:18.913 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:18.913 "hdgst": false, 00:22:18.913 "ddgst": false 00:22:18.913 }, 00:22:18.913 "method": "bdev_nvme_attach_controller" 00:22:18.913 },{ 00:22:18.913 "params": { 00:22:18.913 "name": "Nvme4", 00:22:18.913 "trtype": "tcp", 00:22:18.913 "traddr": "10.0.0.2", 00:22:18.913 "adrfam": "ipv4", 00:22:18.913 "trsvcid": "4420", 00:22:18.913 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:18.913 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:18.913 "hdgst": false, 00:22:18.913 "ddgst": false 00:22:18.913 }, 00:22:18.913 "method": "bdev_nvme_attach_controller" 00:22:18.913 },{ 00:22:18.913 "params": { 00:22:18.913 "name": "Nvme5", 00:22:18.913 "trtype": "tcp", 00:22:18.913 "traddr": "10.0.0.2", 00:22:18.913 "adrfam": "ipv4", 00:22:18.913 "trsvcid": "4420", 00:22:18.913 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:18.913 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:18.913 "hdgst": false, 00:22:18.913 "ddgst": false 00:22:18.913 }, 00:22:18.913 "method": "bdev_nvme_attach_controller" 00:22:18.913 },{ 00:22:18.913 "params": { 00:22:18.913 "name": "Nvme6", 00:22:18.913 "trtype": "tcp", 00:22:18.913 "traddr": "10.0.0.2", 00:22:18.913 "adrfam": "ipv4", 00:22:18.913 "trsvcid": "4420", 00:22:18.913 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:18.913 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:18.913 "hdgst": false, 00:22:18.913 "ddgst": false 00:22:18.913 }, 00:22:18.913 "method": "bdev_nvme_attach_controller" 00:22:18.913 },{ 00:22:18.913 "params": { 00:22:18.913 "name": "Nvme7", 00:22:18.913 "trtype": "tcp", 00:22:18.913 "traddr": "10.0.0.2", 00:22:18.913 "adrfam": "ipv4", 00:22:18.913 "trsvcid": "4420", 00:22:18.913 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:18.913 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:18.913 "hdgst": false, 00:22:18.913 "ddgst": false 00:22:18.913 }, 00:22:18.913 "method": "bdev_nvme_attach_controller" 00:22:18.913 },{ 00:22:18.913 "params": { 00:22:18.913 "name": "Nvme8", 00:22:18.913 "trtype": "tcp", 00:22:18.913 "traddr": "10.0.0.2", 00:22:18.913 "adrfam": "ipv4", 00:22:18.913 "trsvcid": "4420", 00:22:18.913 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:18.913 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:18.913 "hdgst": false, 00:22:18.913 "ddgst": false 00:22:18.913 }, 00:22:18.913 "method": "bdev_nvme_attach_controller" 00:22:18.913 },{ 00:22:18.913 "params": { 00:22:18.913 "name": "Nvme9", 00:22:18.913 "trtype": "tcp", 00:22:18.913 "traddr": "10.0.0.2", 00:22:18.913 "adrfam": "ipv4", 00:22:18.913 "trsvcid": "4420", 00:22:18.913 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:18.913 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:18.913 "hdgst": false, 00:22:18.913 "ddgst": false 00:22:18.913 }, 00:22:18.913 "method": "bdev_nvme_attach_controller" 00:22:18.913 },{ 00:22:18.913 "params": { 00:22:18.913 "name": "Nvme10", 00:22:18.913 "trtype": "tcp", 00:22:18.913 "traddr": "10.0.0.2", 00:22:18.913 "adrfam": "ipv4", 00:22:18.913 "trsvcid": "4420", 00:22:18.913 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:18.913 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:18.913 "hdgst": false, 00:22:18.913 "ddgst": false 00:22:18.913 }, 00:22:18.913 "method": "bdev_nvme_attach_controller" 00:22:18.913 }' 00:22:18.913 [2024-11-29 02:27:22.391303] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:18.913 [2024-11-29 02:27:22.391373] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:22:18.913 EAL: No free 2048 kB hugepages reported on node 1 00:22:18.913 [2024-11-29 02:27:22.456494] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:18.913 [2024-11-29 02:27:22.564525] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:21.448 02:27:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:21.448 02:27:24 -- common/autotest_common.sh@862 -- # return 0 00:22:21.448 02:27:24 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:21.448 02:27:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:21.448 02:27:24 -- common/autotest_common.sh@10 -- # set +x 00:22:21.448 02:27:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:21.448 02:27:24 -- target/shutdown.sh@83 -- # kill -9 181166 00:22:21.448 02:27:24 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:22:21.448 02:27:24 -- target/shutdown.sh@87 -- # sleep 1 00:22:22.386 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 181166 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:22:22.386 02:27:25 -- target/shutdown.sh@88 -- # kill -0 180969 00:22:22.386 02:27:25 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:22:22.386 02:27:25 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:22.386 02:27:25 -- nvmf/common.sh@520 -- # config=() 00:22:22.386 02:27:25 -- nvmf/common.sh@520 -- # local subsystem config 00:22:22.386 02:27:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:22.386 02:27:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:22.386 { 00:22:22.386 "params": { 00:22:22.386 "name": "Nvme$subsystem", 00:22:22.386 "trtype": "$TEST_TRANSPORT", 00:22:22.386 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:22.386 "adrfam": "ipv4", 00:22:22.386 "trsvcid": "$NVMF_PORT", 00:22:22.386 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:22.386 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:22.386 "hdgst": ${hdgst:-false}, 00:22:22.386 "ddgst": ${ddgst:-false} 00:22:22.386 }, 00:22:22.386 "method": "bdev_nvme_attach_controller" 00:22:22.386 } 00:22:22.386 EOF 00:22:22.386 )") 00:22:22.386 02:27:25 -- nvmf/common.sh@542 -- # cat 00:22:22.386 02:27:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:22.386 02:27:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:22.386 { 00:22:22.386 "params": { 00:22:22.386 "name": "Nvme$subsystem", 00:22:22.386 "trtype": "$TEST_TRANSPORT", 00:22:22.386 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:22.386 "adrfam": "ipv4", 00:22:22.386 "trsvcid": "$NVMF_PORT", 00:22:22.386 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:22.386 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:22.386 "hdgst": ${hdgst:-false}, 00:22:22.386 "ddgst": ${ddgst:-false} 00:22:22.386 }, 00:22:22.386 "method": "bdev_nvme_attach_controller" 00:22:22.386 } 00:22:22.386 EOF 00:22:22.386 )") 00:22:22.386 02:27:25 -- nvmf/common.sh@542 -- # cat 00:22:22.386 02:27:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:22.386 02:27:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:22.386 { 00:22:22.386 "params": { 00:22:22.386 "name": "Nvme$subsystem", 00:22:22.386 "trtype": "$TEST_TRANSPORT", 00:22:22.386 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:22.386 "adrfam": "ipv4", 00:22:22.386 "trsvcid": "$NVMF_PORT", 00:22:22.386 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:22.386 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:22.386 "hdgst": ${hdgst:-false}, 00:22:22.386 "ddgst": ${ddgst:-false} 00:22:22.386 }, 00:22:22.386 "method": "bdev_nvme_attach_controller" 00:22:22.386 } 00:22:22.386 EOF 00:22:22.386 )") 00:22:22.386 02:27:25 -- nvmf/common.sh@542 -- # cat 00:22:22.386 02:27:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:22.386 02:27:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:22.386 { 00:22:22.386 "params": { 00:22:22.386 "name": "Nvme$subsystem", 00:22:22.386 "trtype": "$TEST_TRANSPORT", 00:22:22.386 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:22.386 "adrfam": "ipv4", 00:22:22.386 "trsvcid": "$NVMF_PORT", 00:22:22.386 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:22.386 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:22.386 "hdgst": ${hdgst:-false}, 00:22:22.386 "ddgst": ${ddgst:-false} 00:22:22.386 }, 00:22:22.386 "method": "bdev_nvme_attach_controller" 00:22:22.386 } 00:22:22.386 EOF 00:22:22.386 )") 00:22:22.386 02:27:25 -- nvmf/common.sh@542 -- # cat 00:22:22.386 02:27:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:22.386 02:27:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:22.386 { 00:22:22.386 "params": { 00:22:22.386 "name": "Nvme$subsystem", 00:22:22.386 "trtype": "$TEST_TRANSPORT", 00:22:22.386 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:22.386 "adrfam": "ipv4", 00:22:22.386 "trsvcid": "$NVMF_PORT", 00:22:22.386 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:22.386 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:22.386 "hdgst": ${hdgst:-false}, 00:22:22.386 "ddgst": ${ddgst:-false} 00:22:22.386 }, 00:22:22.386 "method": "bdev_nvme_attach_controller" 00:22:22.386 } 00:22:22.386 EOF 00:22:22.386 )") 00:22:22.386 02:27:25 -- nvmf/common.sh@542 -- # cat 00:22:22.386 02:27:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:22.386 02:27:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:22.386 { 00:22:22.386 "params": { 00:22:22.386 "name": "Nvme$subsystem", 00:22:22.386 "trtype": "$TEST_TRANSPORT", 00:22:22.386 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:22.386 "adrfam": "ipv4", 00:22:22.386 "trsvcid": "$NVMF_PORT", 00:22:22.386 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:22.386 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:22.386 "hdgst": ${hdgst:-false}, 00:22:22.386 "ddgst": ${ddgst:-false} 00:22:22.386 }, 00:22:22.386 "method": "bdev_nvme_attach_controller" 00:22:22.386 } 00:22:22.386 EOF 00:22:22.386 )") 00:22:22.386 02:27:25 -- nvmf/common.sh@542 -- # cat 00:22:22.386 02:27:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:22.386 02:27:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:22.386 { 00:22:22.386 "params": { 00:22:22.386 "name": "Nvme$subsystem", 00:22:22.386 "trtype": "$TEST_TRANSPORT", 00:22:22.386 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:22.386 "adrfam": "ipv4", 00:22:22.386 "trsvcid": "$NVMF_PORT", 00:22:22.386 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:22.386 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:22.386 "hdgst": ${hdgst:-false}, 00:22:22.386 "ddgst": ${ddgst:-false} 00:22:22.386 }, 00:22:22.386 "method": "bdev_nvme_attach_controller" 00:22:22.386 } 00:22:22.386 EOF 00:22:22.386 )") 00:22:22.386 02:27:25 -- nvmf/common.sh@542 -- # cat 00:22:22.386 02:27:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:22.386 02:27:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:22.386 { 00:22:22.386 "params": { 00:22:22.386 "name": "Nvme$subsystem", 00:22:22.386 "trtype": "$TEST_TRANSPORT", 00:22:22.386 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:22.386 "adrfam": "ipv4", 00:22:22.386 "trsvcid": "$NVMF_PORT", 00:22:22.386 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:22.386 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:22.386 "hdgst": ${hdgst:-false}, 00:22:22.386 "ddgst": ${ddgst:-false} 00:22:22.387 }, 00:22:22.387 "method": "bdev_nvme_attach_controller" 00:22:22.387 } 00:22:22.387 EOF 00:22:22.387 )") 00:22:22.387 02:27:25 -- nvmf/common.sh@542 -- # cat 00:22:22.387 02:27:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:22.387 02:27:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:22.387 { 00:22:22.387 "params": { 00:22:22.387 "name": "Nvme$subsystem", 00:22:22.387 "trtype": "$TEST_TRANSPORT", 00:22:22.387 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:22.387 "adrfam": "ipv4", 00:22:22.387 "trsvcid": "$NVMF_PORT", 00:22:22.387 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:22.387 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:22.387 "hdgst": ${hdgst:-false}, 00:22:22.387 "ddgst": ${ddgst:-false} 00:22:22.387 }, 00:22:22.387 "method": "bdev_nvme_attach_controller" 00:22:22.387 } 00:22:22.387 EOF 00:22:22.387 )") 00:22:22.387 02:27:25 -- nvmf/common.sh@542 -- # cat 00:22:22.387 02:27:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:22.387 02:27:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:22.387 { 00:22:22.387 "params": { 00:22:22.387 "name": "Nvme$subsystem", 00:22:22.387 "trtype": "$TEST_TRANSPORT", 00:22:22.387 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:22.387 "adrfam": "ipv4", 00:22:22.387 "trsvcid": "$NVMF_PORT", 00:22:22.387 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:22.387 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:22.387 "hdgst": ${hdgst:-false}, 00:22:22.387 "ddgst": ${ddgst:-false} 00:22:22.387 }, 00:22:22.387 "method": "bdev_nvme_attach_controller" 00:22:22.387 } 00:22:22.387 EOF 00:22:22.387 )") 00:22:22.387 02:27:25 -- nvmf/common.sh@542 -- # cat 00:22:22.387 02:27:25 -- nvmf/common.sh@544 -- # jq . 00:22:22.387 02:27:25 -- nvmf/common.sh@545 -- # IFS=, 00:22:22.387 02:27:25 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:22.387 "params": { 00:22:22.387 "name": "Nvme1", 00:22:22.387 "trtype": "tcp", 00:22:22.387 "traddr": "10.0.0.2", 00:22:22.387 "adrfam": "ipv4", 00:22:22.387 "trsvcid": "4420", 00:22:22.387 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:22.387 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:22.387 "hdgst": false, 00:22:22.387 "ddgst": false 00:22:22.387 }, 00:22:22.387 "method": "bdev_nvme_attach_controller" 00:22:22.387 },{ 00:22:22.387 "params": { 00:22:22.387 "name": "Nvme2", 00:22:22.387 "trtype": "tcp", 00:22:22.387 "traddr": "10.0.0.2", 00:22:22.387 "adrfam": "ipv4", 00:22:22.387 "trsvcid": "4420", 00:22:22.387 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:22.387 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:22.387 "hdgst": false, 00:22:22.387 "ddgst": false 00:22:22.387 }, 00:22:22.387 "method": "bdev_nvme_attach_controller" 00:22:22.387 },{ 00:22:22.387 "params": { 00:22:22.387 "name": "Nvme3", 00:22:22.387 "trtype": "tcp", 00:22:22.387 "traddr": "10.0.0.2", 00:22:22.387 "adrfam": "ipv4", 00:22:22.387 "trsvcid": "4420", 00:22:22.387 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:22.387 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:22.387 "hdgst": false, 00:22:22.387 "ddgst": false 00:22:22.387 }, 00:22:22.387 "method": "bdev_nvme_attach_controller" 00:22:22.387 },{ 00:22:22.387 "params": { 00:22:22.387 "name": "Nvme4", 00:22:22.387 "trtype": "tcp", 00:22:22.387 "traddr": "10.0.0.2", 00:22:22.387 "adrfam": "ipv4", 00:22:22.387 "trsvcid": "4420", 00:22:22.387 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:22.387 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:22.387 "hdgst": false, 00:22:22.387 "ddgst": false 00:22:22.387 }, 00:22:22.387 "method": "bdev_nvme_attach_controller" 00:22:22.387 },{ 00:22:22.387 "params": { 00:22:22.387 "name": "Nvme5", 00:22:22.387 "trtype": "tcp", 00:22:22.387 "traddr": "10.0.0.2", 00:22:22.387 "adrfam": "ipv4", 00:22:22.387 "trsvcid": "4420", 00:22:22.387 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:22.387 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:22.387 "hdgst": false, 00:22:22.387 "ddgst": false 00:22:22.387 }, 00:22:22.387 "method": "bdev_nvme_attach_controller" 00:22:22.387 },{ 00:22:22.387 "params": { 00:22:22.387 "name": "Nvme6", 00:22:22.387 "trtype": "tcp", 00:22:22.387 "traddr": "10.0.0.2", 00:22:22.387 "adrfam": "ipv4", 00:22:22.387 "trsvcid": "4420", 00:22:22.387 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:22.387 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:22.387 "hdgst": false, 00:22:22.387 "ddgst": false 00:22:22.387 }, 00:22:22.387 "method": "bdev_nvme_attach_controller" 00:22:22.387 },{ 00:22:22.387 "params": { 00:22:22.387 "name": "Nvme7", 00:22:22.387 "trtype": "tcp", 00:22:22.387 "traddr": "10.0.0.2", 00:22:22.387 "adrfam": "ipv4", 00:22:22.387 "trsvcid": "4420", 00:22:22.387 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:22.387 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:22.387 "hdgst": false, 00:22:22.387 "ddgst": false 00:22:22.387 }, 00:22:22.387 "method": "bdev_nvme_attach_controller" 00:22:22.387 },{ 00:22:22.387 "params": { 00:22:22.387 "name": "Nvme8", 00:22:22.387 "trtype": "tcp", 00:22:22.387 "traddr": "10.0.0.2", 00:22:22.387 "adrfam": "ipv4", 00:22:22.387 "trsvcid": "4420", 00:22:22.387 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:22.387 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:22.387 "hdgst": false, 00:22:22.387 "ddgst": false 00:22:22.387 }, 00:22:22.387 "method": "bdev_nvme_attach_controller" 00:22:22.387 },{ 00:22:22.387 "params": { 00:22:22.387 "name": "Nvme9", 00:22:22.387 "trtype": "tcp", 00:22:22.387 "traddr": "10.0.0.2", 00:22:22.387 "adrfam": "ipv4", 00:22:22.387 "trsvcid": "4420", 00:22:22.387 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:22.387 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:22.387 "hdgst": false, 00:22:22.387 "ddgst": false 00:22:22.387 }, 00:22:22.387 "method": "bdev_nvme_attach_controller" 00:22:22.387 },{ 00:22:22.387 "params": { 00:22:22.387 "name": "Nvme10", 00:22:22.387 "trtype": "tcp", 00:22:22.387 "traddr": "10.0.0.2", 00:22:22.387 "adrfam": "ipv4", 00:22:22.387 "trsvcid": "4420", 00:22:22.387 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:22.387 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:22.387 "hdgst": false, 00:22:22.387 "ddgst": false 00:22:22.387 }, 00:22:22.387 "method": "bdev_nvme_attach_controller" 00:22:22.387 }' 00:22:22.387 [2024-11-29 02:27:25.951765] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:22.387 [2024-11-29 02:27:25.951838] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid181606 ] 00:22:22.387 EAL: No free 2048 kB hugepages reported on node 1 00:22:22.387 [2024-11-29 02:27:26.017368] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:22.647 [2024-11-29 02:27:26.129284] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:24.550 Running I/O for 1 seconds... 00:22:25.487 00:22:25.487 Latency(us) 00:22:25.487 [2024-11-29T01:27:29.168Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:25.487 [2024-11-29T01:27:29.168Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:25.487 Verification LBA range: start 0x0 length 0x400 00:22:25.487 Nvme1n1 : 1.08 370.31 23.14 0.00 0.00 168278.24 31845.64 161558.38 00:22:25.487 [2024-11-29T01:27:29.168Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:25.487 Verification LBA range: start 0x0 length 0x400 00:22:25.487 Nvme2n1 : 1.09 401.64 25.10 0.00 0.00 155454.49 4757.43 119615.34 00:22:25.487 [2024-11-29T01:27:29.168Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:25.488 Verification LBA range: start 0x0 length 0x400 00:22:25.488 Nvme3n1 : 1.09 398.23 24.89 0.00 0.00 155716.06 17961.72 117285.17 00:22:25.488 [2024-11-29T01:27:29.169Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:25.488 Verification LBA range: start 0x0 length 0x400 00:22:25.488 Nvme4n1 : 1.09 396.49 24.78 0.00 0.00 155156.12 19612.25 117285.17 00:22:25.488 [2024-11-29T01:27:29.169Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:25.488 Verification LBA range: start 0x0 length 0x400 00:22:25.488 Nvme5n1 : 1.10 393.06 24.57 0.00 0.00 156203.31 12621.75 125829.12 00:22:25.488 [2024-11-29T01:27:29.169Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:25.488 Verification LBA range: start 0x0 length 0x400 00:22:25.488 Nvme6n1 : 1.10 396.04 24.75 0.00 0.00 153164.42 19320.98 118061.89 00:22:25.488 [2024-11-29T01:27:29.169Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:25.488 Verification LBA range: start 0x0 length 0x400 00:22:25.488 Nvme7n1 : 1.10 394.21 24.64 0.00 0.00 153082.54 17185.00 122722.23 00:22:25.488 [2024-11-29T01:27:29.169Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:25.488 Verification LBA range: start 0x0 length 0x400 00:22:25.488 Nvme8n1 : 1.11 391.71 24.48 0.00 0.00 153789.52 10243.03 125052.40 00:22:25.488 [2024-11-29T01:27:29.169Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:25.488 Verification LBA range: start 0x0 length 0x400 00:22:25.488 Nvme9n1 : 1.12 389.22 24.33 0.00 0.00 154329.42 5024.43 155344.59 00:22:25.488 [2024-11-29T01:27:29.169Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:25.488 Verification LBA range: start 0x0 length 0x400 00:22:25.488 Nvme10n1 : 1.11 390.24 24.39 0.00 0.00 152809.53 5631.24 128159.29 00:22:25.488 [2024-11-29T01:27:29.169Z] =================================================================================================================== 00:22:25.488 [2024-11-29T01:27:29.169Z] Total : 3921.13 245.07 0.00 0.00 155699.65 4757.43 161558.38 00:22:25.488 02:27:29 -- target/shutdown.sh@93 -- # stoptarget 00:22:25.488 02:27:29 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:25.488 02:27:29 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:25.488 02:27:29 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:25.748 02:27:29 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:25.748 02:27:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:25.748 02:27:29 -- nvmf/common.sh@116 -- # sync 00:22:25.748 02:27:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:25.748 02:27:29 -- nvmf/common.sh@119 -- # set +e 00:22:25.748 02:27:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:25.748 02:27:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:25.748 rmmod nvme_tcp 00:22:25.748 rmmod nvme_fabrics 00:22:25.748 rmmod nvme_keyring 00:22:25.748 02:27:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:25.748 02:27:29 -- nvmf/common.sh@123 -- # set -e 00:22:25.748 02:27:29 -- nvmf/common.sh@124 -- # return 0 00:22:25.748 02:27:29 -- nvmf/common.sh@477 -- # '[' -n 180969 ']' 00:22:25.748 02:27:29 -- nvmf/common.sh@478 -- # killprocess 180969 00:22:25.748 02:27:29 -- common/autotest_common.sh@936 -- # '[' -z 180969 ']' 00:22:25.748 02:27:29 -- common/autotest_common.sh@940 -- # kill -0 180969 00:22:25.748 02:27:29 -- common/autotest_common.sh@941 -- # uname 00:22:25.748 02:27:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:25.748 02:27:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 180969 00:22:25.748 02:27:29 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:25.748 02:27:29 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:25.748 02:27:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 180969' 00:22:25.748 killing process with pid 180969 00:22:25.748 02:27:29 -- common/autotest_common.sh@955 -- # kill 180969 00:22:25.748 02:27:29 -- common/autotest_common.sh@960 -- # wait 180969 00:22:26.318 02:27:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:26.318 02:27:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:26.318 02:27:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:26.318 02:27:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:26.318 02:27:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:26.318 02:27:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:26.318 02:27:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:26.318 02:27:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:28.224 02:27:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:28.224 00:22:28.224 real 0m13.207s 00:22:28.224 user 0m41.136s 00:22:28.224 sys 0m3.341s 00:22:28.224 02:27:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:28.224 02:27:31 -- common/autotest_common.sh@10 -- # set +x 00:22:28.224 ************************************ 00:22:28.224 END TEST nvmf_shutdown_tc1 00:22:28.224 ************************************ 00:22:28.224 02:27:31 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:22:28.224 02:27:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:28.224 02:27:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:28.224 02:27:31 -- common/autotest_common.sh@10 -- # set +x 00:22:28.224 ************************************ 00:22:28.224 START TEST nvmf_shutdown_tc2 00:22:28.224 ************************************ 00:22:28.224 02:27:31 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:22:28.224 02:27:31 -- target/shutdown.sh@98 -- # starttarget 00:22:28.224 02:27:31 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:28.224 02:27:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:28.224 02:27:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:28.224 02:27:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:28.224 02:27:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:28.224 02:27:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:28.225 02:27:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:28.225 02:27:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:28.225 02:27:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:28.483 02:27:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:28.483 02:27:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:28.483 02:27:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:28.483 02:27:31 -- common/autotest_common.sh@10 -- # set +x 00:22:28.483 02:27:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:28.483 02:27:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:28.483 02:27:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:28.483 02:27:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:28.483 02:27:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:28.483 02:27:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:28.483 02:27:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:28.483 02:27:31 -- nvmf/common.sh@294 -- # net_devs=() 00:22:28.483 02:27:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:28.483 02:27:31 -- nvmf/common.sh@295 -- # e810=() 00:22:28.483 02:27:31 -- nvmf/common.sh@295 -- # local -ga e810 00:22:28.483 02:27:31 -- nvmf/common.sh@296 -- # x722=() 00:22:28.483 02:27:31 -- nvmf/common.sh@296 -- # local -ga x722 00:22:28.483 02:27:31 -- nvmf/common.sh@297 -- # mlx=() 00:22:28.483 02:27:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:28.483 02:27:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:28.483 02:27:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:28.483 02:27:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:28.483 02:27:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:28.483 02:27:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:28.483 02:27:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:28.483 02:27:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:28.483 02:27:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:28.483 02:27:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:28.483 02:27:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:28.483 02:27:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:28.483 02:27:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:28.483 02:27:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:28.483 02:27:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:28.483 02:27:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:28.483 02:27:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:28.483 02:27:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:28.483 02:27:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:28.483 02:27:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:28.483 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:28.483 02:27:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:28.483 02:27:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:28.483 02:27:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:28.483 02:27:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:28.483 02:27:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:28.483 02:27:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:28.483 02:27:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:28.483 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:28.483 02:27:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:28.483 02:27:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:28.483 02:27:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:28.483 02:27:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:28.484 02:27:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:28.484 02:27:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:28.484 02:27:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:28.484 02:27:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:28.484 02:27:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:28.484 02:27:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:28.484 02:27:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:28.484 02:27:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:28.484 02:27:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:28.484 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:28.484 02:27:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:28.484 02:27:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:28.484 02:27:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:28.484 02:27:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:28.484 02:27:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:28.484 02:27:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:28.484 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:28.484 02:27:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:28.484 02:27:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:28.484 02:27:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:28.484 02:27:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:28.484 02:27:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:28.484 02:27:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:28.484 02:27:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:28.484 02:27:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:28.484 02:27:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:28.484 02:27:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:28.484 02:27:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:28.484 02:27:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:28.484 02:27:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:28.484 02:27:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:28.484 02:27:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:28.484 02:27:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:28.484 02:27:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:28.484 02:27:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:28.484 02:27:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:28.484 02:27:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:28.484 02:27:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:28.484 02:27:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:28.484 02:27:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:28.484 02:27:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:28.484 02:27:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:28.484 02:27:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:28.484 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:28.484 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.246 ms 00:22:28.484 00:22:28.484 --- 10.0.0.2 ping statistics --- 00:22:28.484 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:28.484 rtt min/avg/max/mdev = 0.246/0.246/0.246/0.000 ms 00:22:28.484 02:27:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:28.484 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:28.484 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.091 ms 00:22:28.484 00:22:28.484 --- 10.0.0.1 ping statistics --- 00:22:28.484 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:28.484 rtt min/avg/max/mdev = 0.091/0.091/0.091/0.000 ms 00:22:28.484 02:27:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:28.484 02:27:32 -- nvmf/common.sh@410 -- # return 0 00:22:28.484 02:27:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:28.484 02:27:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:28.484 02:27:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:28.484 02:27:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:28.484 02:27:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:28.484 02:27:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:28.484 02:27:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:28.484 02:27:32 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:28.484 02:27:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:28.484 02:27:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:28.484 02:27:32 -- common/autotest_common.sh@10 -- # set +x 00:22:28.484 02:27:32 -- nvmf/common.sh@469 -- # nvmfpid=182512 00:22:28.484 02:27:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:28.484 02:27:32 -- nvmf/common.sh@470 -- # waitforlisten 182512 00:22:28.484 02:27:32 -- common/autotest_common.sh@829 -- # '[' -z 182512 ']' 00:22:28.484 02:27:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:28.484 02:27:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:28.484 02:27:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:28.484 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:28.484 02:27:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:28.484 02:27:32 -- common/autotest_common.sh@10 -- # set +x 00:22:28.484 [2024-11-29 02:27:32.133529] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:28.484 [2024-11-29 02:27:32.133606] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:28.745 EAL: No free 2048 kB hugepages reported on node 1 00:22:28.745 [2024-11-29 02:27:32.206827] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:28.745 [2024-11-29 02:27:32.323979] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:28.745 [2024-11-29 02:27:32.324127] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:28.745 [2024-11-29 02:27:32.324144] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:28.745 [2024-11-29 02:27:32.324156] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:28.745 [2024-11-29 02:27:32.324207] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:28.745 [2024-11-29 02:27:32.324266] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:28.745 [2024-11-29 02:27:32.324333] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:28.745 [2024-11-29 02:27:32.324335] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:29.685 02:27:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:29.685 02:27:33 -- common/autotest_common.sh@862 -- # return 0 00:22:29.685 02:27:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:29.685 02:27:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:29.685 02:27:33 -- common/autotest_common.sh@10 -- # set +x 00:22:29.685 02:27:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:29.685 02:27:33 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:29.685 02:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.685 02:27:33 -- common/autotest_common.sh@10 -- # set +x 00:22:29.685 [2024-11-29 02:27:33.133941] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:29.685 02:27:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.685 02:27:33 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:29.685 02:27:33 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:29.685 02:27:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:29.685 02:27:33 -- common/autotest_common.sh@10 -- # set +x 00:22:29.685 02:27:33 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:29.685 02:27:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:29.685 02:27:33 -- target/shutdown.sh@28 -- # cat 00:22:29.685 02:27:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:29.685 02:27:33 -- target/shutdown.sh@28 -- # cat 00:22:29.685 02:27:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:29.685 02:27:33 -- target/shutdown.sh@28 -- # cat 00:22:29.685 02:27:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:29.685 02:27:33 -- target/shutdown.sh@28 -- # cat 00:22:29.685 02:27:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:29.685 02:27:33 -- target/shutdown.sh@28 -- # cat 00:22:29.685 02:27:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:29.685 02:27:33 -- target/shutdown.sh@28 -- # cat 00:22:29.685 02:27:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:29.685 02:27:33 -- target/shutdown.sh@28 -- # cat 00:22:29.685 02:27:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:29.685 02:27:33 -- target/shutdown.sh@28 -- # cat 00:22:29.685 02:27:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:29.685 02:27:33 -- target/shutdown.sh@28 -- # cat 00:22:29.685 02:27:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:29.685 02:27:33 -- target/shutdown.sh@28 -- # cat 00:22:29.685 02:27:33 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:29.685 02:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.685 02:27:33 -- common/autotest_common.sh@10 -- # set +x 00:22:29.685 Malloc1 00:22:29.685 [2024-11-29 02:27:33.223863] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:29.685 Malloc2 00:22:29.685 Malloc3 00:22:29.685 Malloc4 00:22:29.945 Malloc5 00:22:29.945 Malloc6 00:22:29.945 Malloc7 00:22:29.945 Malloc8 00:22:29.945 Malloc9 00:22:30.206 Malloc10 00:22:30.206 02:27:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:30.206 02:27:33 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:30.206 02:27:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:30.206 02:27:33 -- common/autotest_common.sh@10 -- # set +x 00:22:30.206 02:27:33 -- target/shutdown.sh@102 -- # perfpid=182708 00:22:30.206 02:27:33 -- target/shutdown.sh@103 -- # waitforlisten 182708 /var/tmp/bdevperf.sock 00:22:30.206 02:27:33 -- common/autotest_common.sh@829 -- # '[' -z 182708 ']' 00:22:30.206 02:27:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:30.206 02:27:33 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:30.206 02:27:33 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:30.206 02:27:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:30.206 02:27:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:30.206 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:30.206 02:27:33 -- nvmf/common.sh@520 -- # config=() 00:22:30.206 02:27:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:30.206 02:27:33 -- nvmf/common.sh@520 -- # local subsystem config 00:22:30.206 02:27:33 -- common/autotest_common.sh@10 -- # set +x 00:22:30.206 02:27:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.206 02:27:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.206 { 00:22:30.206 "params": { 00:22:30.206 "name": "Nvme$subsystem", 00:22:30.206 "trtype": "$TEST_TRANSPORT", 00:22:30.206 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.206 "adrfam": "ipv4", 00:22:30.206 "trsvcid": "$NVMF_PORT", 00:22:30.206 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.206 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.206 "hdgst": ${hdgst:-false}, 00:22:30.206 "ddgst": ${ddgst:-false} 00:22:30.206 }, 00:22:30.206 "method": "bdev_nvme_attach_controller" 00:22:30.206 } 00:22:30.206 EOF 00:22:30.206 )") 00:22:30.206 02:27:33 -- nvmf/common.sh@542 -- # cat 00:22:30.206 02:27:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.206 02:27:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.206 { 00:22:30.206 "params": { 00:22:30.206 "name": "Nvme$subsystem", 00:22:30.206 "trtype": "$TEST_TRANSPORT", 00:22:30.206 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.206 "adrfam": "ipv4", 00:22:30.206 "trsvcid": "$NVMF_PORT", 00:22:30.206 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.206 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.206 "hdgst": ${hdgst:-false}, 00:22:30.206 "ddgst": ${ddgst:-false} 00:22:30.206 }, 00:22:30.206 "method": "bdev_nvme_attach_controller" 00:22:30.206 } 00:22:30.206 EOF 00:22:30.206 )") 00:22:30.206 02:27:33 -- nvmf/common.sh@542 -- # cat 00:22:30.206 02:27:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.206 02:27:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.206 { 00:22:30.206 "params": { 00:22:30.206 "name": "Nvme$subsystem", 00:22:30.206 "trtype": "$TEST_TRANSPORT", 00:22:30.206 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.206 "adrfam": "ipv4", 00:22:30.206 "trsvcid": "$NVMF_PORT", 00:22:30.206 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.206 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.206 "hdgst": ${hdgst:-false}, 00:22:30.206 "ddgst": ${ddgst:-false} 00:22:30.206 }, 00:22:30.206 "method": "bdev_nvme_attach_controller" 00:22:30.206 } 00:22:30.206 EOF 00:22:30.206 )") 00:22:30.206 02:27:33 -- nvmf/common.sh@542 -- # cat 00:22:30.206 02:27:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.206 02:27:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.206 { 00:22:30.206 "params": { 00:22:30.206 "name": "Nvme$subsystem", 00:22:30.206 "trtype": "$TEST_TRANSPORT", 00:22:30.206 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.206 "adrfam": "ipv4", 00:22:30.206 "trsvcid": "$NVMF_PORT", 00:22:30.206 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.206 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.206 "hdgst": ${hdgst:-false}, 00:22:30.206 "ddgst": ${ddgst:-false} 00:22:30.206 }, 00:22:30.206 "method": "bdev_nvme_attach_controller" 00:22:30.206 } 00:22:30.206 EOF 00:22:30.206 )") 00:22:30.206 02:27:33 -- nvmf/common.sh@542 -- # cat 00:22:30.206 02:27:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.206 02:27:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.206 { 00:22:30.206 "params": { 00:22:30.206 "name": "Nvme$subsystem", 00:22:30.206 "trtype": "$TEST_TRANSPORT", 00:22:30.206 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.206 "adrfam": "ipv4", 00:22:30.206 "trsvcid": "$NVMF_PORT", 00:22:30.206 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.206 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.206 "hdgst": ${hdgst:-false}, 00:22:30.206 "ddgst": ${ddgst:-false} 00:22:30.206 }, 00:22:30.206 "method": "bdev_nvme_attach_controller" 00:22:30.206 } 00:22:30.206 EOF 00:22:30.206 )") 00:22:30.206 02:27:33 -- nvmf/common.sh@542 -- # cat 00:22:30.206 02:27:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.206 02:27:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.206 { 00:22:30.206 "params": { 00:22:30.206 "name": "Nvme$subsystem", 00:22:30.206 "trtype": "$TEST_TRANSPORT", 00:22:30.206 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.206 "adrfam": "ipv4", 00:22:30.206 "trsvcid": "$NVMF_PORT", 00:22:30.206 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.206 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.206 "hdgst": ${hdgst:-false}, 00:22:30.206 "ddgst": ${ddgst:-false} 00:22:30.206 }, 00:22:30.206 "method": "bdev_nvme_attach_controller" 00:22:30.206 } 00:22:30.206 EOF 00:22:30.206 )") 00:22:30.206 02:27:33 -- nvmf/common.sh@542 -- # cat 00:22:30.206 02:27:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.206 02:27:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.206 { 00:22:30.206 "params": { 00:22:30.206 "name": "Nvme$subsystem", 00:22:30.206 "trtype": "$TEST_TRANSPORT", 00:22:30.206 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.206 "adrfam": "ipv4", 00:22:30.206 "trsvcid": "$NVMF_PORT", 00:22:30.206 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.206 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.206 "hdgst": ${hdgst:-false}, 00:22:30.206 "ddgst": ${ddgst:-false} 00:22:30.206 }, 00:22:30.206 "method": "bdev_nvme_attach_controller" 00:22:30.206 } 00:22:30.206 EOF 00:22:30.206 )") 00:22:30.206 02:27:33 -- nvmf/common.sh@542 -- # cat 00:22:30.206 02:27:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.206 02:27:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.206 { 00:22:30.206 "params": { 00:22:30.206 "name": "Nvme$subsystem", 00:22:30.206 "trtype": "$TEST_TRANSPORT", 00:22:30.206 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.206 "adrfam": "ipv4", 00:22:30.206 "trsvcid": "$NVMF_PORT", 00:22:30.207 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.207 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.207 "hdgst": ${hdgst:-false}, 00:22:30.207 "ddgst": ${ddgst:-false} 00:22:30.207 }, 00:22:30.207 "method": "bdev_nvme_attach_controller" 00:22:30.207 } 00:22:30.207 EOF 00:22:30.207 )") 00:22:30.207 02:27:33 -- nvmf/common.sh@542 -- # cat 00:22:30.207 02:27:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.207 02:27:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.207 { 00:22:30.207 "params": { 00:22:30.207 "name": "Nvme$subsystem", 00:22:30.207 "trtype": "$TEST_TRANSPORT", 00:22:30.207 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.207 "adrfam": "ipv4", 00:22:30.207 "trsvcid": "$NVMF_PORT", 00:22:30.207 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.207 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.207 "hdgst": ${hdgst:-false}, 00:22:30.207 "ddgst": ${ddgst:-false} 00:22:30.207 }, 00:22:30.207 "method": "bdev_nvme_attach_controller" 00:22:30.207 } 00:22:30.207 EOF 00:22:30.207 )") 00:22:30.207 02:27:33 -- nvmf/common.sh@542 -- # cat 00:22:30.207 02:27:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.207 02:27:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.207 { 00:22:30.207 "params": { 00:22:30.207 "name": "Nvme$subsystem", 00:22:30.207 "trtype": "$TEST_TRANSPORT", 00:22:30.207 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.207 "adrfam": "ipv4", 00:22:30.207 "trsvcid": "$NVMF_PORT", 00:22:30.207 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.207 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.207 "hdgst": ${hdgst:-false}, 00:22:30.207 "ddgst": ${ddgst:-false} 00:22:30.207 }, 00:22:30.207 "method": "bdev_nvme_attach_controller" 00:22:30.207 } 00:22:30.207 EOF 00:22:30.207 )") 00:22:30.207 02:27:33 -- nvmf/common.sh@542 -- # cat 00:22:30.207 02:27:33 -- nvmf/common.sh@544 -- # jq . 00:22:30.207 02:27:33 -- nvmf/common.sh@545 -- # IFS=, 00:22:30.207 02:27:33 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:30.207 "params": { 00:22:30.207 "name": "Nvme1", 00:22:30.207 "trtype": "tcp", 00:22:30.207 "traddr": "10.0.0.2", 00:22:30.207 "adrfam": "ipv4", 00:22:30.207 "trsvcid": "4420", 00:22:30.207 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:30.207 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:30.207 "hdgst": false, 00:22:30.207 "ddgst": false 00:22:30.207 }, 00:22:30.207 "method": "bdev_nvme_attach_controller" 00:22:30.207 },{ 00:22:30.207 "params": { 00:22:30.207 "name": "Nvme2", 00:22:30.207 "trtype": "tcp", 00:22:30.207 "traddr": "10.0.0.2", 00:22:30.207 "adrfam": "ipv4", 00:22:30.207 "trsvcid": "4420", 00:22:30.207 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:30.207 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:30.207 "hdgst": false, 00:22:30.207 "ddgst": false 00:22:30.207 }, 00:22:30.207 "method": "bdev_nvme_attach_controller" 00:22:30.207 },{ 00:22:30.207 "params": { 00:22:30.207 "name": "Nvme3", 00:22:30.207 "trtype": "tcp", 00:22:30.207 "traddr": "10.0.0.2", 00:22:30.207 "adrfam": "ipv4", 00:22:30.207 "trsvcid": "4420", 00:22:30.207 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:30.207 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:30.207 "hdgst": false, 00:22:30.207 "ddgst": false 00:22:30.207 }, 00:22:30.207 "method": "bdev_nvme_attach_controller" 00:22:30.207 },{ 00:22:30.207 "params": { 00:22:30.207 "name": "Nvme4", 00:22:30.207 "trtype": "tcp", 00:22:30.207 "traddr": "10.0.0.2", 00:22:30.207 "adrfam": "ipv4", 00:22:30.207 "trsvcid": "4420", 00:22:30.207 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:30.207 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:30.207 "hdgst": false, 00:22:30.207 "ddgst": false 00:22:30.207 }, 00:22:30.207 "method": "bdev_nvme_attach_controller" 00:22:30.207 },{ 00:22:30.207 "params": { 00:22:30.207 "name": "Nvme5", 00:22:30.207 "trtype": "tcp", 00:22:30.207 "traddr": "10.0.0.2", 00:22:30.207 "adrfam": "ipv4", 00:22:30.207 "trsvcid": "4420", 00:22:30.207 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:30.207 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:30.207 "hdgst": false, 00:22:30.207 "ddgst": false 00:22:30.207 }, 00:22:30.207 "method": "bdev_nvme_attach_controller" 00:22:30.207 },{ 00:22:30.207 "params": { 00:22:30.207 "name": "Nvme6", 00:22:30.207 "trtype": "tcp", 00:22:30.207 "traddr": "10.0.0.2", 00:22:30.207 "adrfam": "ipv4", 00:22:30.207 "trsvcid": "4420", 00:22:30.207 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:30.207 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:30.207 "hdgst": false, 00:22:30.207 "ddgst": false 00:22:30.207 }, 00:22:30.207 "method": "bdev_nvme_attach_controller" 00:22:30.207 },{ 00:22:30.207 "params": { 00:22:30.207 "name": "Nvme7", 00:22:30.207 "trtype": "tcp", 00:22:30.207 "traddr": "10.0.0.2", 00:22:30.207 "adrfam": "ipv4", 00:22:30.207 "trsvcid": "4420", 00:22:30.207 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:30.207 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:30.207 "hdgst": false, 00:22:30.207 "ddgst": false 00:22:30.207 }, 00:22:30.207 "method": "bdev_nvme_attach_controller" 00:22:30.207 },{ 00:22:30.207 "params": { 00:22:30.207 "name": "Nvme8", 00:22:30.207 "trtype": "tcp", 00:22:30.207 "traddr": "10.0.0.2", 00:22:30.207 "adrfam": "ipv4", 00:22:30.207 "trsvcid": "4420", 00:22:30.207 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:30.207 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:30.207 "hdgst": false, 00:22:30.207 "ddgst": false 00:22:30.207 }, 00:22:30.207 "method": "bdev_nvme_attach_controller" 00:22:30.207 },{ 00:22:30.207 "params": { 00:22:30.207 "name": "Nvme9", 00:22:30.207 "trtype": "tcp", 00:22:30.207 "traddr": "10.0.0.2", 00:22:30.207 "adrfam": "ipv4", 00:22:30.207 "trsvcid": "4420", 00:22:30.207 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:30.207 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:30.207 "hdgst": false, 00:22:30.207 "ddgst": false 00:22:30.207 }, 00:22:30.207 "method": "bdev_nvme_attach_controller" 00:22:30.207 },{ 00:22:30.207 "params": { 00:22:30.207 "name": "Nvme10", 00:22:30.207 "trtype": "tcp", 00:22:30.207 "traddr": "10.0.0.2", 00:22:30.207 "adrfam": "ipv4", 00:22:30.207 "trsvcid": "4420", 00:22:30.207 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:30.207 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:30.207 "hdgst": false, 00:22:30.207 "ddgst": false 00:22:30.207 }, 00:22:30.207 "method": "bdev_nvme_attach_controller" 00:22:30.207 }' 00:22:30.207 [2024-11-29 02:27:33.737924] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:30.207 [2024-11-29 02:27:33.738013] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid182708 ] 00:22:30.207 EAL: No free 2048 kB hugepages reported on node 1 00:22:30.207 [2024-11-29 02:27:33.802414] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:30.466 [2024-11-29 02:27:33.911389] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:31.846 Running I/O for 10 seconds... 00:22:31.846 02:27:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:31.846 02:27:35 -- common/autotest_common.sh@862 -- # return 0 00:22:31.846 02:27:35 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:31.846 02:27:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:31.846 02:27:35 -- common/autotest_common.sh@10 -- # set +x 00:22:32.105 02:27:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:32.105 02:27:35 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:32.105 02:27:35 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:32.105 02:27:35 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:32.105 02:27:35 -- target/shutdown.sh@57 -- # local ret=1 00:22:32.105 02:27:35 -- target/shutdown.sh@58 -- # local i 00:22:32.105 02:27:35 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:32.105 02:27:35 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:32.105 02:27:35 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:32.105 02:27:35 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:32.105 02:27:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:32.105 02:27:35 -- common/autotest_common.sh@10 -- # set +x 00:22:32.105 02:27:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:32.105 02:27:35 -- target/shutdown.sh@60 -- # read_io_count=3 00:22:32.105 02:27:35 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:22:32.105 02:27:35 -- target/shutdown.sh@67 -- # sleep 0.25 00:22:32.365 02:27:35 -- target/shutdown.sh@59 -- # (( i-- )) 00:22:32.365 02:27:35 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:32.365 02:27:35 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:32.365 02:27:35 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:32.365 02:27:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:32.365 02:27:35 -- common/autotest_common.sh@10 -- # set +x 00:22:32.365 02:27:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:32.365 02:27:35 -- target/shutdown.sh@60 -- # read_io_count=129 00:22:32.365 02:27:35 -- target/shutdown.sh@63 -- # '[' 129 -ge 100 ']' 00:22:32.365 02:27:35 -- target/shutdown.sh@64 -- # ret=0 00:22:32.365 02:27:35 -- target/shutdown.sh@65 -- # break 00:22:32.365 02:27:35 -- target/shutdown.sh@69 -- # return 0 00:22:32.365 02:27:35 -- target/shutdown.sh@109 -- # killprocess 182708 00:22:32.365 02:27:35 -- common/autotest_common.sh@936 -- # '[' -z 182708 ']' 00:22:32.365 02:27:35 -- common/autotest_common.sh@940 -- # kill -0 182708 00:22:32.365 02:27:35 -- common/autotest_common.sh@941 -- # uname 00:22:32.365 02:27:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:32.365 02:27:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 182708 00:22:32.365 02:27:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:32.365 02:27:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:32.365 02:27:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 182708' 00:22:32.365 killing process with pid 182708 00:22:32.365 02:27:35 -- common/autotest_common.sh@955 -- # kill 182708 00:22:32.365 02:27:35 -- common/autotest_common.sh@960 -- # wait 182708 00:22:32.365 Received shutdown signal, test time was about 0.537044 seconds 00:22:32.365 00:22:32.365 Latency(us) 00:22:32.365 [2024-11-29T01:27:36.046Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:32.365 [2024-11-29T01:27:36.046Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:32.365 Verification LBA range: start 0x0 length 0x400 00:22:32.365 Nvme1n1 : 0.53 432.48 27.03 0.00 0.00 143306.24 16893.72 153014.42 00:22:32.365 [2024-11-29T01:27:36.046Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:32.365 Verification LBA range: start 0x0 length 0x400 00:22:32.365 Nvme2n1 : 0.53 431.07 26.94 0.00 0.00 141635.69 17573.36 117285.17 00:22:32.365 [2024-11-29T01:27:36.046Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:32.365 Verification LBA range: start 0x0 length 0x400 00:22:32.365 Nvme3n1 : 0.53 430.02 26.88 0.00 0.00 139887.64 16990.81 116508.44 00:22:32.365 [2024-11-29T01:27:36.046Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:32.365 Verification LBA range: start 0x0 length 0x400 00:22:32.365 Nvme4n1 : 0.53 428.96 26.81 0.00 0.00 138126.81 16796.63 114955.00 00:22:32.365 [2024-11-29T01:27:36.046Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:32.365 Verification LBA range: start 0x0 length 0x400 00:22:32.365 Nvme5n1 : 0.53 427.91 26.74 0.00 0.00 136514.17 17282.09 114955.00 00:22:32.365 [2024-11-29T01:27:36.046Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:32.365 Verification LBA range: start 0x0 length 0x400 00:22:32.365 Nvme6n1 : 0.54 425.22 26.58 0.00 0.00 135059.52 18058.81 114955.00 00:22:32.365 [2024-11-29T01:27:36.046Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:32.365 Verification LBA range: start 0x0 length 0x400 00:22:32.365 Nvme7n1 : 0.50 382.28 23.89 0.00 0.00 146214.52 17282.09 118061.89 00:22:32.365 [2024-11-29T01:27:36.046Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:32.365 Verification LBA range: start 0x0 length 0x400 00:22:32.365 Nvme8n1 : 0.50 379.53 23.72 0.00 0.00 144969.72 22816.24 121168.78 00:22:32.365 [2024-11-29T01:27:36.046Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:32.365 Verification LBA range: start 0x0 length 0x400 00:22:32.365 Nvme9n1 : 0.51 375.61 23.48 0.00 0.00 143980.93 18155.90 121945.51 00:22:32.365 [2024-11-29T01:27:36.046Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:32.365 Verification LBA range: start 0x0 length 0x400 00:22:32.365 Nvme10n1 : 0.52 366.22 22.89 0.00 0.00 144200.66 32428.18 123498.95 00:22:32.365 [2024-11-29T01:27:36.046Z] =================================================================================================================== 00:22:32.365 [2024-11-29T01:27:36.046Z] Total : 4079.30 254.96 0.00 0.00 141143.03 16796.63 153014.42 00:22:32.624 02:27:36 -- target/shutdown.sh@112 -- # sleep 1 00:22:34.005 02:27:37 -- target/shutdown.sh@113 -- # kill -0 182512 00:22:34.005 02:27:37 -- target/shutdown.sh@115 -- # stoptarget 00:22:34.005 02:27:37 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:34.005 02:27:37 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:34.005 02:27:37 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:34.005 02:27:37 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:34.005 02:27:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:34.005 02:27:37 -- nvmf/common.sh@116 -- # sync 00:22:34.005 02:27:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:34.005 02:27:37 -- nvmf/common.sh@119 -- # set +e 00:22:34.005 02:27:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:34.005 02:27:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:34.005 rmmod nvme_tcp 00:22:34.005 rmmod nvme_fabrics 00:22:34.005 rmmod nvme_keyring 00:22:34.005 02:27:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:34.005 02:27:37 -- nvmf/common.sh@123 -- # set -e 00:22:34.005 02:27:37 -- nvmf/common.sh@124 -- # return 0 00:22:34.005 02:27:37 -- nvmf/common.sh@477 -- # '[' -n 182512 ']' 00:22:34.005 02:27:37 -- nvmf/common.sh@478 -- # killprocess 182512 00:22:34.005 02:27:37 -- common/autotest_common.sh@936 -- # '[' -z 182512 ']' 00:22:34.005 02:27:37 -- common/autotest_common.sh@940 -- # kill -0 182512 00:22:34.005 02:27:37 -- common/autotest_common.sh@941 -- # uname 00:22:34.005 02:27:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:34.005 02:27:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 182512 00:22:34.005 02:27:37 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:34.005 02:27:37 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:34.005 02:27:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 182512' 00:22:34.005 killing process with pid 182512 00:22:34.005 02:27:37 -- common/autotest_common.sh@955 -- # kill 182512 00:22:34.005 02:27:37 -- common/autotest_common.sh@960 -- # wait 182512 00:22:34.263 02:27:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:34.263 02:27:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:34.263 02:27:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:34.263 02:27:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:34.263 02:27:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:34.263 02:27:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:34.263 02:27:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:34.263 02:27:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:36.800 02:27:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:36.800 00:22:36.800 real 0m8.063s 00:22:36.800 user 0m24.773s 00:22:36.800 sys 0m1.405s 00:22:36.800 02:27:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:36.800 02:27:39 -- common/autotest_common.sh@10 -- # set +x 00:22:36.800 ************************************ 00:22:36.800 END TEST nvmf_shutdown_tc2 00:22:36.800 ************************************ 00:22:36.800 02:27:39 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:22:36.800 02:27:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:36.800 02:27:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:36.800 02:27:39 -- common/autotest_common.sh@10 -- # set +x 00:22:36.800 ************************************ 00:22:36.800 START TEST nvmf_shutdown_tc3 00:22:36.800 ************************************ 00:22:36.800 02:27:39 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:22:36.800 02:27:39 -- target/shutdown.sh@120 -- # starttarget 00:22:36.800 02:27:39 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:36.800 02:27:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:36.800 02:27:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:36.800 02:27:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:36.800 02:27:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:36.800 02:27:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:36.800 02:27:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:36.800 02:27:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:36.800 02:27:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:36.800 02:27:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:36.800 02:27:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:36.800 02:27:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:36.800 02:27:40 -- common/autotest_common.sh@10 -- # set +x 00:22:36.800 02:27:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:36.800 02:27:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:36.800 02:27:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:36.800 02:27:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:36.800 02:27:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:36.800 02:27:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:36.800 02:27:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:36.800 02:27:40 -- nvmf/common.sh@294 -- # net_devs=() 00:22:36.800 02:27:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:36.800 02:27:40 -- nvmf/common.sh@295 -- # e810=() 00:22:36.800 02:27:40 -- nvmf/common.sh@295 -- # local -ga e810 00:22:36.800 02:27:40 -- nvmf/common.sh@296 -- # x722=() 00:22:36.800 02:27:40 -- nvmf/common.sh@296 -- # local -ga x722 00:22:36.800 02:27:40 -- nvmf/common.sh@297 -- # mlx=() 00:22:36.800 02:27:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:36.800 02:27:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:36.800 02:27:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:36.800 02:27:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:36.800 02:27:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:36.800 02:27:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:36.800 02:27:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:36.800 02:27:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:36.800 02:27:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:36.800 02:27:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:36.800 02:27:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:36.800 02:27:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:36.800 02:27:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:36.800 02:27:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:36.800 02:27:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:36.800 02:27:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:36.800 02:27:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:36.800 02:27:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:36.800 02:27:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:36.800 02:27:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:36.800 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:36.800 02:27:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:36.800 02:27:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:36.800 02:27:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:36.800 02:27:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:36.800 02:27:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:36.800 02:27:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:36.800 02:27:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:36.800 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:36.800 02:27:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:36.800 02:27:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:36.800 02:27:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:36.800 02:27:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:36.800 02:27:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:36.800 02:27:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:36.800 02:27:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:36.800 02:27:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:36.800 02:27:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:36.800 02:27:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:36.800 02:27:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:36.800 02:27:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:36.800 02:27:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:36.800 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:36.800 02:27:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:36.800 02:27:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:36.800 02:27:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:36.800 02:27:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:36.800 02:27:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:36.800 02:27:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:36.800 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:36.800 02:27:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:36.800 02:27:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:36.800 02:27:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:36.800 02:27:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:36.800 02:27:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:36.800 02:27:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:36.800 02:27:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:36.800 02:27:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:36.800 02:27:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:36.800 02:27:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:36.800 02:27:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:36.800 02:27:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:36.800 02:27:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:36.800 02:27:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:36.800 02:27:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:36.800 02:27:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:36.800 02:27:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:36.800 02:27:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:36.800 02:27:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:36.800 02:27:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:36.800 02:27:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:36.800 02:27:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:36.800 02:27:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:36.800 02:27:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:36.800 02:27:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:36.800 02:27:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:36.800 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:36.800 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.151 ms 00:22:36.800 00:22:36.800 --- 10.0.0.2 ping statistics --- 00:22:36.800 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:36.800 rtt min/avg/max/mdev = 0.151/0.151/0.151/0.000 ms 00:22:36.800 02:27:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:36.800 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:36.800 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:22:36.800 00:22:36.800 --- 10.0.0.1 ping statistics --- 00:22:36.800 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:36.800 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:22:36.800 02:27:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:36.800 02:27:40 -- nvmf/common.sh@410 -- # return 0 00:22:36.800 02:27:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:36.800 02:27:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:36.800 02:27:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:36.800 02:27:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:36.800 02:27:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:36.800 02:27:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:36.800 02:27:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:36.800 02:27:40 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:36.800 02:27:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:36.801 02:27:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:36.801 02:27:40 -- common/autotest_common.sh@10 -- # set +x 00:22:36.801 02:27:40 -- nvmf/common.sh@469 -- # nvmfpid=183633 00:22:36.801 02:27:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:36.801 02:27:40 -- nvmf/common.sh@470 -- # waitforlisten 183633 00:22:36.801 02:27:40 -- common/autotest_common.sh@829 -- # '[' -z 183633 ']' 00:22:36.801 02:27:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:36.801 02:27:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:36.801 02:27:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:36.801 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:36.801 02:27:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:36.801 02:27:40 -- common/autotest_common.sh@10 -- # set +x 00:22:36.801 [2024-11-29 02:27:40.213496] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:36.801 [2024-11-29 02:27:40.213568] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:36.801 EAL: No free 2048 kB hugepages reported on node 1 00:22:36.801 [2024-11-29 02:27:40.285838] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:36.801 [2024-11-29 02:27:40.402628] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:36.801 [2024-11-29 02:27:40.402814] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:36.801 [2024-11-29 02:27:40.402834] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:36.801 [2024-11-29 02:27:40.402854] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:36.801 [2024-11-29 02:27:40.402954] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:36.801 [2024-11-29 02:27:40.403048] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:36.801 [2024-11-29 02:27:40.403130] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:36.801 [2024-11-29 02:27:40.403127] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:37.738 02:27:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:37.738 02:27:41 -- common/autotest_common.sh@862 -- # return 0 00:22:37.738 02:27:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:37.738 02:27:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:37.738 02:27:41 -- common/autotest_common.sh@10 -- # set +x 00:22:37.738 02:27:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:37.738 02:27:41 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:37.738 02:27:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:37.738 02:27:41 -- common/autotest_common.sh@10 -- # set +x 00:22:37.738 [2024-11-29 02:27:41.203914] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:37.738 02:27:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:37.738 02:27:41 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:37.738 02:27:41 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:37.738 02:27:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:37.738 02:27:41 -- common/autotest_common.sh@10 -- # set +x 00:22:37.738 02:27:41 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:37.738 02:27:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:37.738 02:27:41 -- target/shutdown.sh@28 -- # cat 00:22:37.738 02:27:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:37.738 02:27:41 -- target/shutdown.sh@28 -- # cat 00:22:37.738 02:27:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:37.738 02:27:41 -- target/shutdown.sh@28 -- # cat 00:22:37.738 02:27:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:37.738 02:27:41 -- target/shutdown.sh@28 -- # cat 00:22:37.738 02:27:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:37.738 02:27:41 -- target/shutdown.sh@28 -- # cat 00:22:37.738 02:27:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:37.738 02:27:41 -- target/shutdown.sh@28 -- # cat 00:22:37.738 02:27:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:37.738 02:27:41 -- target/shutdown.sh@28 -- # cat 00:22:37.738 02:27:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:37.738 02:27:41 -- target/shutdown.sh@28 -- # cat 00:22:37.738 02:27:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:37.738 02:27:41 -- target/shutdown.sh@28 -- # cat 00:22:37.738 02:27:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:37.739 02:27:41 -- target/shutdown.sh@28 -- # cat 00:22:37.739 02:27:41 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:37.739 02:27:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:37.739 02:27:41 -- common/autotest_common.sh@10 -- # set +x 00:22:37.739 Malloc1 00:22:37.739 [2024-11-29 02:27:41.289665] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:37.739 Malloc2 00:22:37.739 Malloc3 00:22:37.739 Malloc4 00:22:37.999 Malloc5 00:22:37.999 Malloc6 00:22:37.999 Malloc7 00:22:37.999 Malloc8 00:22:37.999 Malloc9 00:22:38.286 Malloc10 00:22:38.286 02:27:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:38.286 02:27:41 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:38.286 02:27:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:38.286 02:27:41 -- common/autotest_common.sh@10 -- # set +x 00:22:38.286 02:27:41 -- target/shutdown.sh@124 -- # perfpid=183826 00:22:38.286 02:27:41 -- target/shutdown.sh@125 -- # waitforlisten 183826 /var/tmp/bdevperf.sock 00:22:38.286 02:27:41 -- common/autotest_common.sh@829 -- # '[' -z 183826 ']' 00:22:38.286 02:27:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:38.286 02:27:41 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:38.286 02:27:41 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:38.286 02:27:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:38.286 02:27:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:38.286 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:38.286 02:27:41 -- nvmf/common.sh@520 -- # config=() 00:22:38.286 02:27:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:38.286 02:27:41 -- nvmf/common.sh@520 -- # local subsystem config 00:22:38.286 02:27:41 -- common/autotest_common.sh@10 -- # set +x 00:22:38.286 02:27:41 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.286 02:27:41 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.286 { 00:22:38.286 "params": { 00:22:38.286 "name": "Nvme$subsystem", 00:22:38.286 "trtype": "$TEST_TRANSPORT", 00:22:38.286 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.286 "adrfam": "ipv4", 00:22:38.286 "trsvcid": "$NVMF_PORT", 00:22:38.286 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.286 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.286 "hdgst": ${hdgst:-false}, 00:22:38.286 "ddgst": ${ddgst:-false} 00:22:38.286 }, 00:22:38.286 "method": "bdev_nvme_attach_controller" 00:22:38.286 } 00:22:38.286 EOF 00:22:38.286 )") 00:22:38.286 02:27:41 -- nvmf/common.sh@542 -- # cat 00:22:38.286 02:27:41 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.286 02:27:41 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.286 { 00:22:38.286 "params": { 00:22:38.286 "name": "Nvme$subsystem", 00:22:38.286 "trtype": "$TEST_TRANSPORT", 00:22:38.286 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.286 "adrfam": "ipv4", 00:22:38.286 "trsvcid": "$NVMF_PORT", 00:22:38.286 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.286 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.286 "hdgst": ${hdgst:-false}, 00:22:38.286 "ddgst": ${ddgst:-false} 00:22:38.286 }, 00:22:38.286 "method": "bdev_nvme_attach_controller" 00:22:38.286 } 00:22:38.286 EOF 00:22:38.286 )") 00:22:38.286 02:27:41 -- nvmf/common.sh@542 -- # cat 00:22:38.286 02:27:41 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.286 02:27:41 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.286 { 00:22:38.286 "params": { 00:22:38.286 "name": "Nvme$subsystem", 00:22:38.286 "trtype": "$TEST_TRANSPORT", 00:22:38.286 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.286 "adrfam": "ipv4", 00:22:38.286 "trsvcid": "$NVMF_PORT", 00:22:38.286 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.286 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.286 "hdgst": ${hdgst:-false}, 00:22:38.286 "ddgst": ${ddgst:-false} 00:22:38.286 }, 00:22:38.286 "method": "bdev_nvme_attach_controller" 00:22:38.286 } 00:22:38.286 EOF 00:22:38.286 )") 00:22:38.286 02:27:41 -- nvmf/common.sh@542 -- # cat 00:22:38.286 02:27:41 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.286 02:27:41 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.286 { 00:22:38.286 "params": { 00:22:38.286 "name": "Nvme$subsystem", 00:22:38.286 "trtype": "$TEST_TRANSPORT", 00:22:38.286 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.286 "adrfam": "ipv4", 00:22:38.286 "trsvcid": "$NVMF_PORT", 00:22:38.286 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.286 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.286 "hdgst": ${hdgst:-false}, 00:22:38.286 "ddgst": ${ddgst:-false} 00:22:38.286 }, 00:22:38.287 "method": "bdev_nvme_attach_controller" 00:22:38.287 } 00:22:38.287 EOF 00:22:38.287 )") 00:22:38.287 02:27:41 -- nvmf/common.sh@542 -- # cat 00:22:38.287 02:27:41 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.287 02:27:41 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.287 { 00:22:38.287 "params": { 00:22:38.287 "name": "Nvme$subsystem", 00:22:38.287 "trtype": "$TEST_TRANSPORT", 00:22:38.287 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.287 "adrfam": "ipv4", 00:22:38.287 "trsvcid": "$NVMF_PORT", 00:22:38.287 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.287 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.287 "hdgst": ${hdgst:-false}, 00:22:38.287 "ddgst": ${ddgst:-false} 00:22:38.287 }, 00:22:38.287 "method": "bdev_nvme_attach_controller" 00:22:38.287 } 00:22:38.287 EOF 00:22:38.287 )") 00:22:38.287 02:27:41 -- nvmf/common.sh@542 -- # cat 00:22:38.287 02:27:41 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.287 02:27:41 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.287 { 00:22:38.287 "params": { 00:22:38.287 "name": "Nvme$subsystem", 00:22:38.287 "trtype": "$TEST_TRANSPORT", 00:22:38.287 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.287 "adrfam": "ipv4", 00:22:38.287 "trsvcid": "$NVMF_PORT", 00:22:38.287 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.287 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.287 "hdgst": ${hdgst:-false}, 00:22:38.287 "ddgst": ${ddgst:-false} 00:22:38.287 }, 00:22:38.287 "method": "bdev_nvme_attach_controller" 00:22:38.287 } 00:22:38.287 EOF 00:22:38.287 )") 00:22:38.287 02:27:41 -- nvmf/common.sh@542 -- # cat 00:22:38.287 02:27:41 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.287 02:27:41 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.287 { 00:22:38.287 "params": { 00:22:38.287 "name": "Nvme$subsystem", 00:22:38.287 "trtype": "$TEST_TRANSPORT", 00:22:38.287 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.287 "adrfam": "ipv4", 00:22:38.287 "trsvcid": "$NVMF_PORT", 00:22:38.287 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.287 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.287 "hdgst": ${hdgst:-false}, 00:22:38.287 "ddgst": ${ddgst:-false} 00:22:38.287 }, 00:22:38.287 "method": "bdev_nvme_attach_controller" 00:22:38.287 } 00:22:38.287 EOF 00:22:38.287 )") 00:22:38.287 02:27:41 -- nvmf/common.sh@542 -- # cat 00:22:38.287 02:27:41 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.287 02:27:41 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.287 { 00:22:38.287 "params": { 00:22:38.287 "name": "Nvme$subsystem", 00:22:38.287 "trtype": "$TEST_TRANSPORT", 00:22:38.287 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.287 "adrfam": "ipv4", 00:22:38.287 "trsvcid": "$NVMF_PORT", 00:22:38.287 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.287 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.287 "hdgst": ${hdgst:-false}, 00:22:38.287 "ddgst": ${ddgst:-false} 00:22:38.287 }, 00:22:38.287 "method": "bdev_nvme_attach_controller" 00:22:38.287 } 00:22:38.287 EOF 00:22:38.287 )") 00:22:38.287 02:27:41 -- nvmf/common.sh@542 -- # cat 00:22:38.287 02:27:41 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.287 02:27:41 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.287 { 00:22:38.287 "params": { 00:22:38.287 "name": "Nvme$subsystem", 00:22:38.287 "trtype": "$TEST_TRANSPORT", 00:22:38.287 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.287 "adrfam": "ipv4", 00:22:38.287 "trsvcid": "$NVMF_PORT", 00:22:38.287 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.287 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.287 "hdgst": ${hdgst:-false}, 00:22:38.287 "ddgst": ${ddgst:-false} 00:22:38.287 }, 00:22:38.287 "method": "bdev_nvme_attach_controller" 00:22:38.287 } 00:22:38.287 EOF 00:22:38.287 )") 00:22:38.287 02:27:41 -- nvmf/common.sh@542 -- # cat 00:22:38.287 02:27:41 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.287 02:27:41 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.287 { 00:22:38.287 "params": { 00:22:38.287 "name": "Nvme$subsystem", 00:22:38.287 "trtype": "$TEST_TRANSPORT", 00:22:38.287 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.287 "adrfam": "ipv4", 00:22:38.287 "trsvcid": "$NVMF_PORT", 00:22:38.287 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.287 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.287 "hdgst": ${hdgst:-false}, 00:22:38.287 "ddgst": ${ddgst:-false} 00:22:38.287 }, 00:22:38.287 "method": "bdev_nvme_attach_controller" 00:22:38.287 } 00:22:38.287 EOF 00:22:38.287 )") 00:22:38.287 02:27:41 -- nvmf/common.sh@542 -- # cat 00:22:38.287 02:27:41 -- nvmf/common.sh@544 -- # jq . 00:22:38.287 02:27:41 -- nvmf/common.sh@545 -- # IFS=, 00:22:38.287 02:27:41 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:38.287 "params": { 00:22:38.287 "name": "Nvme1", 00:22:38.287 "trtype": "tcp", 00:22:38.287 "traddr": "10.0.0.2", 00:22:38.287 "adrfam": "ipv4", 00:22:38.287 "trsvcid": "4420", 00:22:38.287 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:38.287 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:38.287 "hdgst": false, 00:22:38.287 "ddgst": false 00:22:38.287 }, 00:22:38.287 "method": "bdev_nvme_attach_controller" 00:22:38.287 },{ 00:22:38.287 "params": { 00:22:38.287 "name": "Nvme2", 00:22:38.287 "trtype": "tcp", 00:22:38.287 "traddr": "10.0.0.2", 00:22:38.287 "adrfam": "ipv4", 00:22:38.287 "trsvcid": "4420", 00:22:38.287 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:38.287 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:38.287 "hdgst": false, 00:22:38.287 "ddgst": false 00:22:38.287 }, 00:22:38.287 "method": "bdev_nvme_attach_controller" 00:22:38.287 },{ 00:22:38.287 "params": { 00:22:38.287 "name": "Nvme3", 00:22:38.287 "trtype": "tcp", 00:22:38.287 "traddr": "10.0.0.2", 00:22:38.287 "adrfam": "ipv4", 00:22:38.287 "trsvcid": "4420", 00:22:38.287 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:38.287 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:38.287 "hdgst": false, 00:22:38.287 "ddgst": false 00:22:38.287 }, 00:22:38.287 "method": "bdev_nvme_attach_controller" 00:22:38.287 },{ 00:22:38.287 "params": { 00:22:38.287 "name": "Nvme4", 00:22:38.287 "trtype": "tcp", 00:22:38.287 "traddr": "10.0.0.2", 00:22:38.287 "adrfam": "ipv4", 00:22:38.287 "trsvcid": "4420", 00:22:38.287 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:38.287 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:38.287 "hdgst": false, 00:22:38.287 "ddgst": false 00:22:38.287 }, 00:22:38.287 "method": "bdev_nvme_attach_controller" 00:22:38.287 },{ 00:22:38.287 "params": { 00:22:38.287 "name": "Nvme5", 00:22:38.287 "trtype": "tcp", 00:22:38.287 "traddr": "10.0.0.2", 00:22:38.287 "adrfam": "ipv4", 00:22:38.287 "trsvcid": "4420", 00:22:38.287 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:38.287 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:38.287 "hdgst": false, 00:22:38.287 "ddgst": false 00:22:38.287 }, 00:22:38.287 "method": "bdev_nvme_attach_controller" 00:22:38.287 },{ 00:22:38.287 "params": { 00:22:38.287 "name": "Nvme6", 00:22:38.287 "trtype": "tcp", 00:22:38.287 "traddr": "10.0.0.2", 00:22:38.287 "adrfam": "ipv4", 00:22:38.287 "trsvcid": "4420", 00:22:38.287 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:38.287 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:38.287 "hdgst": false, 00:22:38.287 "ddgst": false 00:22:38.287 }, 00:22:38.287 "method": "bdev_nvme_attach_controller" 00:22:38.287 },{ 00:22:38.287 "params": { 00:22:38.287 "name": "Nvme7", 00:22:38.287 "trtype": "tcp", 00:22:38.287 "traddr": "10.0.0.2", 00:22:38.287 "adrfam": "ipv4", 00:22:38.287 "trsvcid": "4420", 00:22:38.287 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:38.287 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:38.288 "hdgst": false, 00:22:38.288 "ddgst": false 00:22:38.288 }, 00:22:38.288 "method": "bdev_nvme_attach_controller" 00:22:38.288 },{ 00:22:38.288 "params": { 00:22:38.288 "name": "Nvme8", 00:22:38.288 "trtype": "tcp", 00:22:38.288 "traddr": "10.0.0.2", 00:22:38.288 "adrfam": "ipv4", 00:22:38.288 "trsvcid": "4420", 00:22:38.288 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:38.288 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:38.288 "hdgst": false, 00:22:38.288 "ddgst": false 00:22:38.288 }, 00:22:38.288 "method": "bdev_nvme_attach_controller" 00:22:38.288 },{ 00:22:38.288 "params": { 00:22:38.288 "name": "Nvme9", 00:22:38.288 "trtype": "tcp", 00:22:38.288 "traddr": "10.0.0.2", 00:22:38.288 "adrfam": "ipv4", 00:22:38.288 "trsvcid": "4420", 00:22:38.288 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:38.288 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:38.288 "hdgst": false, 00:22:38.288 "ddgst": false 00:22:38.288 }, 00:22:38.288 "method": "bdev_nvme_attach_controller" 00:22:38.288 },{ 00:22:38.288 "params": { 00:22:38.288 "name": "Nvme10", 00:22:38.288 "trtype": "tcp", 00:22:38.288 "traddr": "10.0.0.2", 00:22:38.288 "adrfam": "ipv4", 00:22:38.288 "trsvcid": "4420", 00:22:38.288 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:38.288 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:38.288 "hdgst": false, 00:22:38.288 "ddgst": false 00:22:38.288 }, 00:22:38.288 "method": "bdev_nvme_attach_controller" 00:22:38.288 }' 00:22:38.288 [2024-11-29 02:27:41.810569] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:38.288 [2024-11-29 02:27:41.810644] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid183826 ] 00:22:38.288 EAL: No free 2048 kB hugepages reported on node 1 00:22:38.288 [2024-11-29 02:27:41.873583] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:38.547 [2024-11-29 02:27:41.984756] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:40.449 Running I/O for 10 seconds... 00:22:40.707 02:27:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:40.707 02:27:44 -- common/autotest_common.sh@862 -- # return 0 00:22:40.707 02:27:44 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:40.707 02:27:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.707 02:27:44 -- common/autotest_common.sh@10 -- # set +x 00:22:40.707 02:27:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.707 02:27:44 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:40.707 02:27:44 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:40.707 02:27:44 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:40.707 02:27:44 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:40.707 02:27:44 -- target/shutdown.sh@57 -- # local ret=1 00:22:40.707 02:27:44 -- target/shutdown.sh@58 -- # local i 00:22:40.707 02:27:44 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:40.707 02:27:44 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:40.707 02:27:44 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:40.707 02:27:44 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:40.707 02:27:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.707 02:27:44 -- common/autotest_common.sh@10 -- # set +x 00:22:40.707 02:27:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.983 02:27:44 -- target/shutdown.sh@60 -- # read_io_count=254 00:22:40.983 02:27:44 -- target/shutdown.sh@63 -- # '[' 254 -ge 100 ']' 00:22:40.983 02:27:44 -- target/shutdown.sh@64 -- # ret=0 00:22:40.983 02:27:44 -- target/shutdown.sh@65 -- # break 00:22:40.983 02:27:44 -- target/shutdown.sh@69 -- # return 0 00:22:40.983 02:27:44 -- target/shutdown.sh@134 -- # killprocess 183633 00:22:40.983 02:27:44 -- common/autotest_common.sh@936 -- # '[' -z 183633 ']' 00:22:40.983 02:27:44 -- common/autotest_common.sh@940 -- # kill -0 183633 00:22:40.983 02:27:44 -- common/autotest_common.sh@941 -- # uname 00:22:40.983 02:27:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:40.983 02:27:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 183633 00:22:40.983 02:27:44 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:40.983 02:27:44 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:40.983 02:27:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 183633' 00:22:40.983 killing process with pid 183633 00:22:40.983 02:27:44 -- common/autotest_common.sh@955 -- # kill 183633 00:22:40.983 02:27:44 -- common/autotest_common.sh@960 -- # wait 183633 00:22:40.983 [2024-11-29 02:27:44.432023] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432142] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432155] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432180] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432192] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432205] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432216] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432239] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432252] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432263] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432298] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432382] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432418] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432430] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432442] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432454] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432466] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432478] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432489] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432501] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432513] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432525] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432537] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432549] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432577] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432590] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432613] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432625] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432636] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432648] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432687] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432745] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432781] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432805] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432829] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432841] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.432888] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd522e0 is same with the state(5) to be set 00:22:40.983 [2024-11-29 02:27:44.433288] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.983 [2024-11-29 02:27:44.433326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.983 [2024-11-29 02:27:44.433343] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.983 [2024-11-29 02:27:44.433357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.433370] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.984 [2024-11-29 02:27:44.433384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.433406] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.984 [2024-11-29 02:27:44.433421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.433434] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1117f70 is same with the state(5) to be set 00:22:40.984 [2024-11-29 02:27:44.436324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.436356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.436403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.436421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.436437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.436452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.436468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.436482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.436497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.436510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.436525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.436539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.436554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.436567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.436582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.436596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.436611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.436631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.436647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.436661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.436676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.436693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.436709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.436722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.436737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.436751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.436766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.436780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.436795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.436808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.436824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.436838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.436854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.436867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.436883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.436896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.436911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.436924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.436938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.436951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.436966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.436979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.436998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.437012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.437028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.437041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.437056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.437069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.437084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.437098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.437113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.437126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.437142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.437155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.437170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.437183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.437198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.437211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.437226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.437239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.437255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.437268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.437284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.437297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.437313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.437326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.437341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.437358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.437375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.437388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.437412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.437427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.437442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.984 [2024-11-29 02:27:44.437456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.984 [2024-11-29 02:27:44.437471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.437484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.437499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.437513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.437529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.437542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.437558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.437571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.437587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.437600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.437616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.437629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.437645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.437659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.437674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.437688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.437703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.437716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.437736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.437750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.437765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.437780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.437795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.437809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.437824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.437838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.437853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.437866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.437882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.437895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.437911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.437924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.437940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.437954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.437969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.437982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.437998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.438011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.438026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.438040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.438055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.438069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.438084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.438101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.438117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.438131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.438147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.438160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.438175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.438189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.438204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.438218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.438233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.985 [2024-11-29 02:27:44.438247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.985 [2024-11-29 02:27:44.438261] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1176080 is same with the state(5) to be set 00:22:40.985 [2024-11-29 02:27:44.438342] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1176080 was disconnected and freed. reset controller. 00:22:40.985 [2024-11-29 02:27:44.439422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.985 [2024-11-29 02:27:44.439456] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.985 [2024-11-29 02:27:44.439471] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.985 [2024-11-29 02:27:44.439484] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.985 [2024-11-29 02:27:44.439497] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.985 [2024-11-29 02:27:44.439510] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.985 [2024-11-29 02:27:44.439522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.985 [2024-11-29 02:27:44.439535] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.985 [2024-11-29 02:27:44.439546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.985 [2024-11-29 02:27:44.439559] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.985 [2024-11-29 02:27:44.439571] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.985 [2024-11-29 02:27:44.439583] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.985 [2024-11-29 02:27:44.439595] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.985 [2024-11-29 02:27:44.439613] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.985 [2024-11-29 02:27:44.439626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.985 [2024-11-29 02:27:44.439639] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.985 [2024-11-29 02:27:44.439651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.985 [2024-11-29 02:27:44.439663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.985 [2024-11-29 02:27:44.439686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.985 [2024-11-29 02:27:44.439698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.985 [2024-11-29 02:27:44.439710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.985 [2024-11-29 02:27:44.439722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.985 [2024-11-29 02:27:44.439734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.985 [2024-11-29 02:27:44.439746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.985 [2024-11-29 02:27:44.439758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.985 [2024-11-29 02:27:44.439770] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.439782] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.439794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.439805] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.439817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.439829] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.439841] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.439853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.439865] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.439878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.439890] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.439902] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.439914] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.439926] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.439938] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.439954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.439967] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.439979] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.439991] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.440003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.440015] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.440027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.440039] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.440051] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.440063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.440074] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.440087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.440098] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.440110] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.440122] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.440134] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.440147] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.440158] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.440170] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.440182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.440193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.440205] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.440217] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54cb0 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.441802] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:40.986 [2024-11-29 02:27:44.441855] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1117f70 (9): Bad file descriptor 00:22:40.986 [2024-11-29 02:27:44.442006] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442033] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442047] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442091] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442106] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442119] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442176] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442188] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442200] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442212] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442292] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442303] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442315] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442327] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442338] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442350] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442362] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442374] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442401] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442428] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442451] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442499] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442523] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442535] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442547] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442559] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442571] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442583] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442607] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442620] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442631] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442643] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.986 [2024-11-29 02:27:44.442655] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.442667] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.442679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.442692] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.442703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.442715] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.442727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.442739] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.442750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.442762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.442773] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.442785] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.442801] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.442813] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.442825] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.442836] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.442849] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.442861] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52790 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.443590] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.987 [2024-11-29 02:27:44.443624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.987 [2024-11-29 02:27:44.443649] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.987 [2024-11-29 02:27:44.443664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.987 [2024-11-29 02:27:44.443678] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.987 [2024-11-29 02:27:44.443691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.987 [2024-11-29 02:27:44.443704] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.987 [2024-11-29 02:27:44.443717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.987 [2024-11-29 02:27:44.443729] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1170770 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.444906] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:40.987 [2024-11-29 02:27:44.446030] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:40.987 [2024-11-29 02:27:44.446042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446078] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446095] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446108] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446120] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446133] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446145] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446158] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446170] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446183] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446195] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446214] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446239] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446252] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446264] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446276] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446289] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446301] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446314] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446326] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446338] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446363] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446384] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446402] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446417] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446429] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446442] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446455] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446467] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446479] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446491] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446503] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446528] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446542] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446571] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446584] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446596] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446609] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.987 [2024-11-29 02:27:44.446621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.446633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.446646] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.446658] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.446670] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.446686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.446698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.446711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.446723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.446735] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.446747] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.446760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.446773] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.446786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.446798] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.446810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.446823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.446836] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.446848] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.446860] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.446872] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd52c40 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.449703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.449761] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.449822] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.449838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.449851] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.449863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.449876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.449888] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.449900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.449912] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.449924] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.449936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.449974] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.449989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450028] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450054] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450112] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:40.988 [2024-11-29 02:27:44.450122] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450165] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450178] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450263] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450288] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450329] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450400] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450418] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450448] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450465] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450489] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450501] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450513] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450564] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450577] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450616] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450630] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450670] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450689] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450700] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450744] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450770] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450812] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450945] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450957] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450981] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.450997] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.451009] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.451021] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd530d0 is same with the state(5) to be set 00:22:40.988 [2024-11-29 02:27:44.452591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.452621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.452647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.452663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.452681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.452696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.452712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.452726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.452742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.452756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.452772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.452786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.452801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.452815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.452830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.452844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.452859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.452873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.452889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.452908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.452924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.452938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.452953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.452967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.452982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.452996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.453011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.453025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.453040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.453054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.453069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.453082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.453097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.453111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.453126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.453140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.453155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.453168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.453184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.453198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.453201] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with t[2024-11-29 02:27:44.453213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37760 len:12he state(5) to be set 00:22:40.989 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.453230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.453233] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with t[2024-11-29 02:27:44.453245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:37888 len:12he state(5) to be set 00:22:40.989 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.453260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.453260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.989 [2024-11-29 02:27:44.453276] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with t[2024-11-29 02:27:44.453276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:38016 len:128he state(5) to be set 00:22:40.989 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.453291] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with t[2024-11-29 02:27:44.453292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:22:40.989 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.453306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.989 [2024-11-29 02:27:44.453310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.453318] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.989 [2024-11-29 02:27:44.453323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.453331] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.989 [2024-11-29 02:27:44.453339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.453343] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.989 [2024-11-29 02:27:44.453353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.453356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.989 [2024-11-29 02:27:44.453368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:41600 len:1[2024-11-29 02:27:44.453369] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with t28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 he state(5) to be set 00:22:40.989 [2024-11-29 02:27:44.453384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-29 02:27:44.453384] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 he state(5) to be set 00:22:40.989 [2024-11-29 02:27:44.453409] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.989 [2024-11-29 02:27:44.453412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.453423] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.989 [2024-11-29 02:27:44.453427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.453436] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.989 [2024-11-29 02:27:44.453443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.453449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.989 [2024-11-29 02:27:44.453461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-29 02:27:44.453462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 he state(5) to be set 00:22:40.989 [2024-11-29 02:27:44.453476] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.989 [2024-11-29 02:27:44.453479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.453489] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.989 [2024-11-29 02:27:44.453493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.453501] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.989 [2024-11-29 02:27:44.453508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.989 [2024-11-29 02:27:44.453514] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.989 [2024-11-29 02:27:44.453523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.989 [2024-11-29 02:27:44.453526] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453539] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with t[2024-11-29 02:27:44.453538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:42240 len:12he state(5) to be set 00:22:40.990 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.990 [2024-11-29 02:27:44.453553] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.990 [2024-11-29 02:27:44.453565] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.990 [2024-11-29 02:27:44.453578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.990 [2024-11-29 02:27:44.453590] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:42496 len:12[2024-11-29 02:27:44.453602] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.990 he state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-29 02:27:44.453616] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.990 he state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.990 [2024-11-29 02:27:44.453648] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.990 [2024-11-29 02:27:44.453661] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.990 [2024-11-29 02:27:44.453681] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with t[2024-11-29 02:27:44.453681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:22:40.990 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.990 [2024-11-29 02:27:44.453695] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.990 [2024-11-29 02:27:44.453708] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.990 [2024-11-29 02:27:44.453720] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.990 [2024-11-29 02:27:44.453733] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-29 02:27:44.453745] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.990 he state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453759] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.990 [2024-11-29 02:27:44.453771] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.990 [2024-11-29 02:27:44.453784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.990 [2024-11-29 02:27:44.453796] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.990 [2024-11-29 02:27:44.453808] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453821] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with t[2024-11-29 02:27:44.453821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:43392 len:12he state(5) to be set 00:22:40.990 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.990 [2024-11-29 02:27:44.453838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.990 [2024-11-29 02:27:44.453851] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.990 [2024-11-29 02:27:44.453863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.990 [2024-11-29 02:27:44.453876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:43648 len:1[2024-11-29 02:27:44.453888] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with t28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.990 he state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-29 02:27:44.453902] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.990 he state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.990 [2024-11-29 02:27:44.453929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.990 [2024-11-29 02:27:44.453941] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.990 [2024-11-29 02:27:44.453953] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-29 02:27:44.453965] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.990 he state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453979] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.990 [2024-11-29 02:27:44.453990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.453995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.990 [2024-11-29 02:27:44.454003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.454010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:38656 len:12[2024-11-29 02:27:44.454015] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.990 he state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.454029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with t[2024-11-29 02:27:44.454029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:22:40.990 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.990 [2024-11-29 02:27:44.454043] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.454048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.990 [2024-11-29 02:27:44.454055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.454062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.990 [2024-11-29 02:27:44.454067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53580 is same with the state(5) to be set 00:22:40.990 [2024-11-29 02:27:44.454078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.990 [2024-11-29 02:27:44.454092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.990 [2024-11-29 02:27:44.454107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.990 [2024-11-29 02:27:44.454121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.990 [2024-11-29 02:27:44.454136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.990 [2024-11-29 02:27:44.454150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.990 [2024-11-29 02:27:44.454166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.991 [2024-11-29 02:27:44.454180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.991 [2024-11-29 02:27:44.454195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.991 [2024-11-29 02:27:44.454209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.991 [2024-11-29 02:27:44.454225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.991 [2024-11-29 02:27:44.454238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.991 [2024-11-29 02:27:44.454254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.991 [2024-11-29 02:27:44.454268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.991 [2024-11-29 02:27:44.454283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.991 [2024-11-29 02:27:44.454297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.991 [2024-11-29 02:27:44.454312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.991 [2024-11-29 02:27:44.454329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.991 [2024-11-29 02:27:44.454346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.991 [2024-11-29 02:27:44.454359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.991 [2024-11-29 02:27:44.454385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.991 [2024-11-29 02:27:44.454411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.991 [2024-11-29 02:27:44.454428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.991 [2024-11-29 02:27:44.454442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.991 [2024-11-29 02:27:44.454457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.991 [2024-11-29 02:27:44.454471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.991 [2024-11-29 02:27:44.454486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.991 [2024-11-29 02:27:44.454500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.991 [2024-11-29 02:27:44.454515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.991 [2024-11-29 02:27:44.454529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.991 [2024-11-29 02:27:44.454544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.991 [2024-11-29 02:27:44.454557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.991 [2024-11-29 02:27:44.454572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.991 [2024-11-29 02:27:44.454586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.991 [2024-11-29 02:27:44.454600] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x136c5b0 is same with the state(5) to be set 00:22:40.991 [2024-11-29 02:27:44.454691] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x136c5b0 was disconnected and freed. reset controller. 00:22:40.991 [2024-11-29 02:27:44.455067] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.991 [2024-11-29 02:27:44.455091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.991 [2024-11-29 02:27:44.455107] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.991 [2024-11-29 02:27:44.455120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.991 [2024-11-29 02:27:44.455116] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.991 [2024-11-29 02:27:44.455134] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.991 [2024-11-29 02:27:44.455146] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with t[2024-11-29 02:27:44.455148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 che state(5) to be set 00:22:40.991 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.991 [2024-11-29 02:27:44.455169] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 ns[2024-11-29 02:27:44.455169] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with tid:0 cdw10:00000000 cdw11:00000000 00:22:40.991 he state(5) to be set 00:22:40.991 [2024-11-29 02:27:44.455184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-11-29 02:27:44.455185] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.991 he state(5) to be set 00:22:40.991 [2024-11-29 02:27:44.455199] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x113a1b0 is same [2024-11-29 02:27:44.455199] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with twith the state(5) to be set 00:22:40.991 he state(5) to be set 00:22:40.991 [2024-11-29 02:27:44.455215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.991 [2024-11-29 02:27:44.455228] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.991 [2024-11-29 02:27:44.455240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.991 [2024-11-29 02:27:44.455255] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with t[2024-11-29 02:27:44.455257] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nshe state(5) to be set 00:22:40.991 id:0 cdw10:00000000 cdw11:00000000 00:22:40.991 [2024-11-29 02:27:44.455279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.991 [2024-11-29 02:27:44.455279] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.991 [2024-11-29 02:27:44.455294] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.991 [2024-11-29 02:27:44.455306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with t[2024-11-29 02:27:44.455307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 che state(5) to be set 00:22:40.991 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.991 [2024-11-29 02:27:44.455321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.991 [2024-11-29 02:27:44.455323] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.991 [2024-11-29 02:27:44.455334] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.991 [2024-11-29 02:27:44.455336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.991 [2024-11-29 02:27:44.455346] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.991 [2024-11-29 02:27:44.455350] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.991 [2024-11-29 02:27:44.455359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.991 [2024-11-29 02:27:44.455363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.991 [2024-11-29 02:27:44.455372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.991 [2024-11-29 02:27:44.455376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1143690 is same with the state(5) to be set 00:22:40.991 [2024-11-29 02:27:44.455403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.991 [2024-11-29 02:27:44.455419] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.991 [2024-11-29 02:27:44.455431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.991 [2024-11-29 02:27:44.455443] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with t[2024-11-29 02:27:44.455437] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nshe state(5) to be set 00:22:40.991 id:0 cdw10:00000000 cdw11:00000000 00:22:40.991 [2024-11-29 02:27:44.455459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.991 [2024-11-29 02:27:44.455474] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.991 [2024-11-29 02:27:44.455478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.991 [2024-11-29 02:27:44.455485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.991 [2024-11-29 02:27:44.455498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with t[2024-11-29 02:27:44.455498] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nshe state(5) to be set 00:22:40.991 id:0 cdw10:00000000 cdw11:00000000 00:22:40.991 [2024-11-29 02:27:44.455512] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.991 [2024-11-29 02:27:44.455514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.991 [2024-11-29 02:27:44.455524] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.991 [2024-11-29 02:27:44.455528] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.991 [2024-11-29 02:27:44.455537] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.992 [2024-11-29 02:27:44.455549] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455556] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.992 [2024-11-29 02:27:44.455572] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with t[2024-11-29 02:27:44.455574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 che state(5) to be set 00:22:40.992 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.992 [2024-11-29 02:27:44.455587] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with t[2024-11-29 02:27:44.455588] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12de600 is same he state(5) to be set 00:22:40.992 with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455614] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455620] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1170770 (9): [2024-11-29 02:27:44.455626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with tBad file descriptor 00:22:40.992 he state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455643] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455655] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455669] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455704] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455715] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455728] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with t[2024-11-29 02:27:44.455725] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nshe state(5) to be set 00:22:40.992 id:0 cdw10:00000000 cdw11:00000000 00:22:40.992 [2024-11-29 02:27:44.455743] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.992 [2024-11-29 02:27:44.455755] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455762] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.992 [2024-11-29 02:27:44.455768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.992 [2024-11-29 02:27:44.455790] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with t[2024-11-29 02:27:44.455791] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nshe state(5) to be set 00:22:40.992 id:0 cdw10:00000000 cdw11:00000000 00:22:40.992 [2024-11-29 02:27:44.455804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.992 [2024-11-29 02:27:44.455817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455821] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.992 [2024-11-29 02:27:44.455829] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.992 [2024-11-29 02:27:44.455841] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455848] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12ce150 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455869] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455882] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455893] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455905] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455941] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455953] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455964] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455976] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.455988] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.456000] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.456011] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.456023] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53a30 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.457281] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:40.992 [2024-11-29 02:27:44.457298] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53ee0 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.457317] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1143690 (9): Bad file descriptor 00:22:40.992 [2024-11-29 02:27:44.457327] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53ee0 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.457342] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53ee0 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.457355] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53ee0 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.457367] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53ee0 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.457388] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53ee0 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.457411] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53ee0 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.457424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53ee0 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.457437] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53ee0 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.457449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53ee0 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.457461] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53ee0 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.457472] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53ee0 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.457489] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53ee0 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.457502] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53ee0 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.457523] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53ee0 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.457535] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53ee0 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.457547] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53ee0 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.457558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53ee0 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.457570] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53ee0 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.457582] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53ee0 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.457594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53ee0 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.457606] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53ee0 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.457618] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd53ee0 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.458410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54370 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.458438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54370 is same with the state(5) to be set 00:22:40.992 [2024-11-29 02:27:44.458452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54370 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.458464] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54370 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.458476] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54370 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.458488] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54370 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.458489] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:40.993 [2024-11-29 02:27:44.458501] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54370 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.458513] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54370 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.458525] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54370 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.458537] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54370 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.458549] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54370 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.458560] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54370 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.458572] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54370 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.458584] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54370 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.458596] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54370 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.458615] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54370 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.458628] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54370 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.458641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54370 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.458653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54370 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.458665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54370 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.458677] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54370 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.458691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54370 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.458703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54370 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.458873] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:40.993 [2024-11-29 02:27:44.459151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54820 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.459179] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54820 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.459228] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54820 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.459323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:40192 len:12[2024-11-29 02:27:44.459248] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54820 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.993 he state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.459351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.993 [2024-11-29 02:27:44.459353] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54820 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.459371] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1370750 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.459376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54820 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.459391] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54820 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.459412] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54820 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.459424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54820 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.459435] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54820 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.459447] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54820 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.459455] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1370750 was disconnected and fr[2024-11-29 02:27:44.459458] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54820 is same with teed. reset controller. 00:22:40.993 he state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.459473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54820 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.459484] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54820 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.459495] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54820 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.459513] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54820 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.459561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54820 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.459581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54820 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.459679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54820 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.459698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54820 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.459710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54820 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.459721] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54820 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.459733] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd54820 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.460581] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:40.993 [2024-11-29 02:27:44.460642] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12c8a60 (9): Bad file descriptor 00:22:40.993 [2024-11-29 02:27:44.461187] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:40.993 [2024-11-29 02:27:44.461443] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:3 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:22:40.993 [2024-11-29 02:27:44.461467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.993 [2024-11-29 02:27:44.461482] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1117f70 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.461633] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1117f70 (9): Bad file descriptor 00:22:40.993 [2024-11-29 02:27:44.461753] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:40.993 [2024-11-29 02:27:44.461798] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:40.993 [2024-11-29 02:27:44.461816] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:40.993 [2024-11-29 02:27:44.461833] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:40.993 [2024-11-29 02:27:44.461905] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:40.993 [2024-11-29 02:27:44.462695] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12c8a60 (9): Bad file descriptor 00:22:40.993 [2024-11-29 02:27:44.462722] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1143690 (9): Bad file descriptor 00:22:40.993 [2024-11-29 02:27:44.462775] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:40.993 [2024-11-29 02:27:44.462791] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:40.993 [2024-11-29 02:27:44.462805] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:40.993 [2024-11-29 02:27:44.462823] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:40.993 [2024-11-29 02:27:44.462837] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:40.993 [2024-11-29 02:27:44.462850] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:40.993 [2024-11-29 02:27:44.462904] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:40.993 [2024-11-29 02:27:44.462927] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:40.993 [2024-11-29 02:27:44.465047] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x113a1b0 (9): Bad file descriptor 00:22:40.993 [2024-11-29 02:27:44.465086] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12de600 (9): Bad file descriptor 00:22:40.993 [2024-11-29 02:27:44.465146] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.993 [2024-11-29 02:27:44.465168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.993 [2024-11-29 02:27:44.465184] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.993 [2024-11-29 02:27:44.465197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.993 [2024-11-29 02:27:44.465210] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.993 [2024-11-29 02:27:44.465224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.993 [2024-11-29 02:27:44.465237] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.993 [2024-11-29 02:27:44.465250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.993 [2024-11-29 02:27:44.465263] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1165490 is same with the state(5) to be set 00:22:40.993 [2024-11-29 02:27:44.465309] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.993 [2024-11-29 02:27:44.465330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.993 [2024-11-29 02:27:44.465351] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.993 [2024-11-29 02:27:44.465367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.465380] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.994 [2024-11-29 02:27:44.465400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.465415] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.994 [2024-11-29 02:27:44.465428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.465441] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12cdc70 is same with the state(5) to be set 00:22:40.994 [2024-11-29 02:27:44.465489] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.994 [2024-11-29 02:27:44.465509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.465523] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.994 [2024-11-29 02:27:44.465536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.465549] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.994 [2024-11-29 02:27:44.465568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.465582] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:40.994 [2024-11-29 02:27:44.465594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.465606] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12b90a0 is same with the state(5) to be set 00:22:40.994 [2024-11-29 02:27:44.465633] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12ce150 (9): Bad file descriptor 00:22:40.994 [2024-11-29 02:27:44.465817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.465840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.465862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.465877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.465893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.465907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.465922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.465935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.465951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.465965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.465980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.465993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.466022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.466050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.466078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.466106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.466141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.466169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.466198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.466226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.466255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.466283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.466311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.466340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.466377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.466415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.466444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.466472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.466509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.466540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.466569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.466597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.466626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.466654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.466690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.466719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.466749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.994 [2024-11-29 02:27:44.466777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.994 [2024-11-29 02:27:44.466793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.466806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.466822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.466835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.466850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.466864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.466883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.466897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.466912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.466926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.466941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.466954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.466970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.466983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.466999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.467012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.467027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.467041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.467056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.467070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.467085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.467098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.467114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.467127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.467142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.467156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.467171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.467185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.467201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.467214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.467229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.467247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.467263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.467277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.467293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.467306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.467321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.467335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.467351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.467364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.467380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.467399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.467416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.467430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.467446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.467459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.467475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.467488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.467504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.467517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.467532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.467546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.467561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.467574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.467589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.467603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.467622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.467637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.467653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.467667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.467682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.467696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.467711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.995 [2024-11-29 02:27:44.467725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.995 [2024-11-29 02:27:44.467739] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11799f0 is same with the state(5) to be set 00:22:40.995 [2024-11-29 02:27:44.469407] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:40.995 [2024-11-29 02:27:44.469440] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:40.995 [2024-11-29 02:27:44.469687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:40.995 [2024-11-29 02:27:44.469802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:40.995 [2024-11-29 02:27:44.469829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1117f70 with addr=10.0.0.2, port=4420 00:22:40.995 [2024-11-29 02:27:44.469847] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1117f70 is same with the state(5) to be set 00:22:40.995 [2024-11-29 02:27:44.469929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:40.995 [2024-11-29 02:27:44.470028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:40.995 [2024-11-29 02:27:44.470053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1170770 with addr=10.0.0.2, port=4420 00:22:40.995 [2024-11-29 02:27:44.470069] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1170770 is same with the state(5) to be set 00:22:40.995 [2024-11-29 02:27:44.470404] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:40.995 [2024-11-29 02:27:44.470445] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1117f70 (9): Bad file descriptor 00:22:40.995 [2024-11-29 02:27:44.470469] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1170770 (9): Bad file descriptor 00:22:40.995 [2024-11-29 02:27:44.470625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:40.995 [2024-11-29 02:27:44.470748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:40.995 [2024-11-29 02:27:44.470774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1143690 with addr=10.0.0.2, port=4420 00:22:40.995 [2024-11-29 02:27:44.470790] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1143690 is same with the state(5) to be set 00:22:40.995 [2024-11-29 02:27:44.470805] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:40.996 [2024-11-29 02:27:44.470818] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:40.996 [2024-11-29 02:27:44.470835] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:40.996 [2024-11-29 02:27:44.470862] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:40.996 [2024-11-29 02:27:44.470877] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:40.996 [2024-11-29 02:27:44.470890] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:40.996 [2024-11-29 02:27:44.470957] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:40.996 [2024-11-29 02:27:44.470976] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:40.996 [2024-11-29 02:27:44.470993] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1143690 (9): Bad file descriptor 00:22:40.996 [2024-11-29 02:27:44.471059] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:40.996 [2024-11-29 02:27:44.471078] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:40.996 [2024-11-29 02:27:44.471092] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:40.996 [2024-11-29 02:27:44.471144] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:40.996 [2024-11-29 02:27:44.471165] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:40.996 [2024-11-29 02:27:44.471298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:40.996 [2024-11-29 02:27:44.471399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:40.996 [2024-11-29 02:27:44.471425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x12c8a60 with addr=10.0.0.2, port=4420 00:22:40.996 [2024-11-29 02:27:44.471441] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12c8a60 is same with the state(5) to be set 00:22:40.996 [2024-11-29 02:27:44.471494] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12c8a60 (9): Bad file descriptor 00:22:40.996 [2024-11-29 02:27:44.471547] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:40.996 [2024-11-29 02:27:44.471563] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:40.996 [2024-11-29 02:27:44.471577] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:40.996 [2024-11-29 02:27:44.471630] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:40.996 [2024-11-29 02:27:44.475095] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1165490 (9): Bad file descriptor 00:22:40.996 [2024-11-29 02:27:44.475141] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12cdc70 (9): Bad file descriptor 00:22:40.996 [2024-11-29 02:27:44.475172] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12b90a0 (9): Bad file descriptor 00:22:40.996 [2024-11-29 02:27:44.475312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.996 [2024-11-29 02:27:44.475339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.996 [2024-11-29 02:27:44.475369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.996 [2024-11-29 02:27:44.475385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.996 [2024-11-29 02:27:44.475409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.996 [2024-11-29 02:27:44.475424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.996 [2024-11-29 02:27:44.475440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.996 [2024-11-29 02:27:44.475461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.996 [2024-11-29 02:27:44.475477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.996 [2024-11-29 02:27:44.475491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.996 [2024-11-29 02:27:44.475506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.996 [2024-11-29 02:27:44.475520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.996 [2024-11-29 02:27:44.475536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.996 [2024-11-29 02:27:44.475549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.996 [2024-11-29 02:27:44.475564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.996 [2024-11-29 02:27:44.475578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.996 [2024-11-29 02:27:44.475593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.996 [2024-11-29 02:27:44.475607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.996 [2024-11-29 02:27:44.475622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.996 [2024-11-29 02:27:44.475636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.996 [2024-11-29 02:27:44.475651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.996 [2024-11-29 02:27:44.475664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.996 [2024-11-29 02:27:44.475679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.996 [2024-11-29 02:27:44.475693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.996 [2024-11-29 02:27:44.475708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.996 [2024-11-29 02:27:44.475722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.996 [2024-11-29 02:27:44.475737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.996 [2024-11-29 02:27:44.475750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.996 [2024-11-29 02:27:44.475766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.996 [2024-11-29 02:27:44.475779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.996 [2024-11-29 02:27:44.475795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.996 [2024-11-29 02:27:44.475808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.996 [2024-11-29 02:27:44.475827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.996 [2024-11-29 02:27:44.475842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.996 [2024-11-29 02:27:44.475858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.996 [2024-11-29 02:27:44.475871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.996 [2024-11-29 02:27:44.475887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.996 [2024-11-29 02:27:44.475900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.996 [2024-11-29 02:27:44.475916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.996 [2024-11-29 02:27:44.475930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.996 [2024-11-29 02:27:44.475946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.996 [2024-11-29 02:27:44.475959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.996 [2024-11-29 02:27:44.475975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.996 [2024-11-29 02:27:44.475988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.996 [2024-11-29 02:27:44.476003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.996 [2024-11-29 02:27:44.476017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.996 [2024-11-29 02:27:44.476032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.996 [2024-11-29 02:27:44.476046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.996 [2024-11-29 02:27:44.476061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.476973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.476988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.477002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.477017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.477031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.477047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.477060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.477076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.477090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.477105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.477119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.477134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.477148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.477163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.477177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.477193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.477206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.477222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.997 [2024-11-29 02:27:44.477236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.997 [2024-11-29 02:27:44.477250] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11084f0 is same with the state(5) to be set 00:22:40.998 [2024-11-29 02:27:44.478500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.478523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.478544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.478564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.478581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.478595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.478611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.478625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.478641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.478654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.478669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.478683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.478699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.478713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.478728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.478741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.478757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.478770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.478786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.478800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.478815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.478828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.478844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.478858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.478873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.478887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.478902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.478915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.478935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.478950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.478965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.478978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.478994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.479008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.479024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.479038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.479054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.479068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.479085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.479099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.479115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.479128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.479143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.479157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.479172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.479186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.479202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.479216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.479232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.479245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.479261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.479275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.479290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.479307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.479324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.479338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.479353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.479367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.479382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.479403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.479420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.479434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.479450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.479464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.479479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.479493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.479509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.479523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.479539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.479553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.479568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.479582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.479597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.479611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.479627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.479641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.479657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.479670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.998 [2024-11-29 02:27:44.479690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.998 [2024-11-29 02:27:44.479705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.479720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.479734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.479749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.479763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.479778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.479792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.479808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.479821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.479837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.479850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.479865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.479879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.479895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.479908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.479924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.479938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.479953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.479967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.479983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.479996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.480012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.480025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.480041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.480058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.480074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.480087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.480103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.480117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.480132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.480145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.480160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.480174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.480189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.480202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.480218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.480231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.480246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.480260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.480275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.480288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.480303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.480317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.480332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.480346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.480362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.480375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.480400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.480416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.480454] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12850a0 is same with the state(5) to be set 00:22:40.999 [2024-11-29 02:27:44.481695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.481718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.481739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.481754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.481770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.481784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.481800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.481813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.481829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.481843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.481859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.481872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.481888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.481901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.481917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.481931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.481947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.481960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.481976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.481990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.482005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.482019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.482034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.482048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.482068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.482082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.482098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.482111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.482126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:40.999 [2024-11-29 02:27:44.482140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:40.999 [2024-11-29 02:27:44.482156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.482982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.482998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.483012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.483028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.483041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.483057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.483071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.483087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.483101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.483116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.483130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.483145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.483159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.000 [2024-11-29 02:27:44.483174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.000 [2024-11-29 02:27:44.483191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.001 [2024-11-29 02:27:44.483207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.001 [2024-11-29 02:27:44.483221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.001 [2024-11-29 02:27:44.483236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.001 [2024-11-29 02:27:44.483249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.001 [2024-11-29 02:27:44.483264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.001 [2024-11-29 02:27:44.483277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.001 [2024-11-29 02:27:44.483293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.001 [2024-11-29 02:27:44.483306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.001 [2024-11-29 02:27:44.483322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.001 [2024-11-29 02:27:44.483335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.001 [2024-11-29 02:27:44.483350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.001 [2024-11-29 02:27:44.483364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.001 [2024-11-29 02:27:44.483379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.001 [2024-11-29 02:27:44.483398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.001 [2024-11-29 02:27:44.483415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.001 [2024-11-29 02:27:44.483429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.001 [2024-11-29 02:27:44.483444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.001 [2024-11-29 02:27:44.483458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.001 [2024-11-29 02:27:44.483473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.001 [2024-11-29 02:27:44.483486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.001 [2024-11-29 02:27:44.483501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.001 [2024-11-29 02:27:44.483515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.001 [2024-11-29 02:27:44.483530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.001 [2024-11-29 02:27:44.483543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.001 [2024-11-29 02:27:44.483562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.001 [2024-11-29 02:27:44.483576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.001 [2024-11-29 02:27:44.483592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.001 [2024-11-29 02:27:44.483606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.001 [2024-11-29 02:27:44.483620] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x136db90 is same with the state(5) to be set 00:22:41.001 [2024-11-29 02:27:44.484832] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:41.001 [2024-11-29 02:27:44.484862] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:41.001 [2024-11-29 02:27:44.484880] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:41.001 [2024-11-29 02:27:44.485269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.001 [2024-11-29 02:27:44.485389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.001 [2024-11-29 02:27:44.485424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x12de600 with addr=10.0.0.2, port=4420 00:22:41.001 [2024-11-29 02:27:44.485440] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12de600 is same with the state(5) to be set 00:22:41.001 [2024-11-29 02:27:44.485531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.001 [2024-11-29 02:27:44.485617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.001 [2024-11-29 02:27:44.485642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x113a1b0 with addr=10.0.0.2, port=4420 00:22:41.001 [2024-11-29 02:27:44.485658] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x113a1b0 is same with the state(5) to be set 00:22:41.001 [2024-11-29 02:27:44.485768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.001 [2024-11-29 02:27:44.485860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.001 [2024-11-29 02:27:44.485882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x12ce150 with addr=10.0.0.2, port=4420 00:22:41.001 [2024-11-29 02:27:44.485899] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12ce150 is same with the state(5) to be set 00:22:41.001 [2024-11-29 02:27:44.486736] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:41.001 [2024-11-29 02:27:44.486765] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:41.001 [2024-11-29 02:27:44.486784] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:41.001 [2024-11-29 02:27:44.486801] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:41.001 [2024-11-29 02:27:44.486849] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12de600 (9): Bad file descriptor 00:22:41.001 [2024-11-29 02:27:44.486873] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x113a1b0 (9): Bad file descriptor 00:22:41.001 [2024-11-29 02:27:44.486891] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12ce150 (9): Bad file descriptor 00:22:41.001 [2024-11-29 02:27:44.487074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.001 [2024-11-29 02:27:44.487180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.001 [2024-11-29 02:27:44.487205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1170770 with addr=10.0.0.2, port=4420 00:22:41.001 [2024-11-29 02:27:44.487227] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1170770 is same with the state(5) to be set 00:22:41.001 [2024-11-29 02:27:44.487309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.001 [2024-11-29 02:27:44.487404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.001 [2024-11-29 02:27:44.487431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1117f70 with addr=10.0.0.2, port=4420 00:22:41.001 [2024-11-29 02:27:44.487447] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1117f70 is same with the state(5) to be set 00:22:41.001 [2024-11-29 02:27:44.487530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.001 [2024-11-29 02:27:44.487619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.001 [2024-11-29 02:27:44.487643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1143690 with addr=10.0.0.2, port=4420 00:22:41.001 [2024-11-29 02:27:44.487658] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1143690 is same with the state(5) to be set 00:22:41.001 [2024-11-29 02:27:44.487739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.001 [2024-11-29 02:27:44.487835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.001 [2024-11-29 02:27:44.487860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x12c8a60 with addr=10.0.0.2, port=4420 00:22:41.001 [2024-11-29 02:27:44.487875] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12c8a60 is same with the state(5) to be set 00:22:41.001 [2024-11-29 02:27:44.487890] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:41.001 [2024-11-29 02:27:44.487903] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:41.001 [2024-11-29 02:27:44.487919] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:41.001 [2024-11-29 02:27:44.487939] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:41.001 [2024-11-29 02:27:44.487954] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:41.001 [2024-11-29 02:27:44.487966] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:41.001 [2024-11-29 02:27:44.487982] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:41.001 [2024-11-29 02:27:44.487996] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:41.001 [2024-11-29 02:27:44.488009] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:41.001 [2024-11-29 02:27:44.488100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.001 [2024-11-29 02:27:44.488122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.001 [2024-11-29 02:27:44.488147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.001 [2024-11-29 02:27:44.488162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.001 [2024-11-29 02:27:44.488178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.001 [2024-11-29 02:27:44.488192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.001 [2024-11-29 02:27:44.488208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.001 [2024-11-29 02:27:44.488221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.001 [2024-11-29 02:27:44.488242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.001 [2024-11-29 02:27:44.488256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.001 [2024-11-29 02:27:44.488271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.488285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.488300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.488314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.488329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.488343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.488358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.488372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.488387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.488412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.488429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.488442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.488458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.488472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.488487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.488501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.488517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.488530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.488546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.488559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.488575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.488589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.488604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.488622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.488638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.488651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.488667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.488681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.488696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.488710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.488725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.488739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.488754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.488768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.488783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.488796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.488812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.488825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.488841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.488855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.488871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.488884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.488900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.488914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.488929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.488943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.488958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.488971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.488991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.489006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.489021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.489036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.489051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.489065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.489082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.489096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.489111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.489125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.489141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.489155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.489171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.489185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.489200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.489214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.489230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.489244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.489259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.489273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.489289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.489302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.489318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.489332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.489348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.489365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.489382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.489407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.489424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.489438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.002 [2024-11-29 02:27:44.489453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.002 [2024-11-29 02:27:44.489467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.489483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.489497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.489512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.489525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.489541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.489555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.489570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.489585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.489600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.489614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.489629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.489643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.489659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.489672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.489687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.489701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.489717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.489730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.489751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.489767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.489782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.489796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.489811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.489825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.489841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.489855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.489870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.489883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.489899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.489912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.489928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.489942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.489957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.489970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.489986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.490000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.490016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.490029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.490044] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x136f170 is same with the state(5) to be set 00:22:41.003 [2024-11-29 02:27:44.491299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.491322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.491342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.491357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.491378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.491399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.491416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.491430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.491446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.491459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.491475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.491489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.491504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.491518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.491533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.491547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.491562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.491576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.491592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.491606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.491622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.491636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.491651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.491665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.491680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.491694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.491709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.491723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.491738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.491756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.491773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.491787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.491803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.491817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.491832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.491846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.491862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.491876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.491891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.003 [2024-11-29 02:27:44.491905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.003 [2024-11-29 02:27:44.491921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.491934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.491950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.491963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.491979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.491993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.492008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.492022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.492036] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1176f00 is same with the state(5) to be set 00:22:41.004 [2024-11-29 02:27:44.493086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.493109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.493129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.493144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.493160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.493178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.493194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.493208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.493223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.493237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.493255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.493268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.493284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.493297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.493313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.493327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.493342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.493356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.493372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.493385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.493415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.493430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.493445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.493459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.493474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.493487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.493503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.493516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.493531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.493544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.493571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.493585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.493600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.493614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.493629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.493643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.493658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.493671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.493687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.493700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.493716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.493729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.493744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.493758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.493774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.493787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.493803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.004 [2024-11-29 02:27:44.493817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.004 [2024-11-29 02:27:44.493831] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1178410 is same with the state(5) to be set 00:22:41.004 [2024-11-29 02:27:44.495196] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.004 [2024-11-29 02:27:44.495220] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.004 [2024-11-29 02:27:44.495234] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.004 [2024-11-29 02:27:44.495250] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:41.004 [2024-11-29 02:27:44.495271] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:41.004 task offset: 40320 on job bdev=Nvme1n1 fails 00:22:41.004 00:22:41.004 Latency(us) 00:22:41.004 [2024-11-29T01:27:44.685Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:41.004 [2024-11-29T01:27:44.685Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.004 [2024-11-29T01:27:44.685Z] Job: Nvme1n1 ended in about 0.82 seconds with error 00:22:41.004 Verification LBA range: start 0x0 length 0x400 00:22:41.004 Nvme1n1 : 0.82 355.32 22.21 78.15 0.00 146708.75 24175.50 134373.07 00:22:41.004 [2024-11-29T01:27:44.685Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.004 [2024-11-29T01:27:44.685Z] Job: Nvme2n1 ended in about 0.86 seconds with error 00:22:41.004 Verification LBA range: start 0x0 length 0x400 00:22:41.004 Nvme2n1 : 0.86 339.57 21.22 74.68 0.00 152217.46 86216.25 118061.89 00:22:41.004 [2024-11-29T01:27:44.685Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.004 [2024-11-29T01:27:44.685Z] Job: Nvme3n1 ended in about 0.86 seconds with error 00:22:41.004 Verification LBA range: start 0x0 length 0x400 00:22:41.004 Nvme3n1 : 0.86 338.31 21.14 74.41 0.00 151448.94 81944.27 116508.44 00:22:41.004 [2024-11-29T01:27:44.685Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.004 [2024-11-29T01:27:44.685Z] Job: Nvme4n1 ended in about 0.84 seconds with error 00:22:41.004 Verification LBA range: start 0x0 length 0x400 00:22:41.004 Nvme4n1 : 0.84 348.24 21.77 76.59 0.00 145696.82 41554.68 134373.07 00:22:41.004 [2024-11-29T01:27:44.685Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.004 [2024-11-29T01:27:44.685Z] Job: Nvme5n1 ended in about 0.86 seconds with error 00:22:41.004 Verification LBA range: start 0x0 length 0x400 00:22:41.004 Nvme5n1 : 0.86 337.08 21.07 74.13 0.00 149353.98 60584.39 117285.17 00:22:41.004 [2024-11-29T01:27:44.685Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.004 [2024-11-29T01:27:44.685Z] Job: Nvme6n1 ended in about 0.87 seconds with error 00:22:41.004 Verification LBA range: start 0x0 length 0x400 00:22:41.004 Nvme6n1 : 0.87 334.59 20.91 73.59 0.00 149151.59 57089.14 118838.61 00:22:41.004 [2024-11-29T01:27:44.685Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.004 [2024-11-29T01:27:44.685Z] Job: Nvme7n1 ended in about 0.84 seconds with error 00:22:41.004 Verification LBA range: start 0x0 length 0x400 00:22:41.005 Nvme7n1 : 0.84 374.21 23.39 1.19 0.00 158059.42 17767.54 119615.34 00:22:41.005 [2024-11-29T01:27:44.686Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.005 [2024-11-29T01:27:44.686Z] Job: Nvme8n1 ended in about 0.87 seconds with error 00:22:41.005 Verification LBA range: start 0x0 length 0x400 00:22:41.005 Nvme8n1 : 0.87 333.89 20.87 27.54 0.00 159831.09 44467.39 123498.95 00:22:41.005 [2024-11-29T01:27:44.686Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.005 [2024-11-29T01:27:44.686Z] Job: Nvme9n1 ended in about 0.87 seconds with error 00:22:41.005 Verification LBA range: start 0x0 length 0x400 00:22:41.005 Nvme9n1 : 0.87 333.21 20.83 27.48 0.00 158701.76 44467.39 126605.84 00:22:41.005 [2024-11-29T01:27:44.686Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.005 [2024-11-29T01:27:44.686Z] Job: Nvme10n1 ended in about 0.85 seconds with error 00:22:41.005 Verification LBA range: start 0x0 length 0x400 00:22:41.005 Nvme10n1 : 0.85 296.18 18.51 75.52 0.00 157589.08 98643.82 123498.95 00:22:41.005 [2024-11-29T01:27:44.686Z] =================================================================================================================== 00:22:41.005 [2024-11-29T01:27:44.686Z] Total : 3390.61 211.91 583.27 0.00 152608.31 17767.54 134373.07 00:22:41.005 [2024-11-29 02:27:44.520455] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:22:41.005 [2024-11-29 02:27:44.520589] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1170770 (9): Bad file descriptor 00:22:41.005 [2024-11-29 02:27:44.520621] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1117f70 (9): Bad file descriptor 00:22:41.005 [2024-11-29 02:27:44.520640] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1143690 (9): Bad file descriptor 00:22:41.005 [2024-11-29 02:27:44.520660] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12c8a60 (9): Bad file descriptor 00:22:41.005 [2024-11-29 02:27:44.520827] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:22:41.005 [2024-11-29 02:27:44.521107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.005 [2024-11-29 02:27:44.521222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.005 [2024-11-29 02:27:44.521250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x12b90a0 with addr=10.0.0.2, port=4420 00:22:41.005 [2024-11-29 02:27:44.521279] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12b90a0 is same with the state(5) to be set 00:22:41.005 [2024-11-29 02:27:44.521379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.005 [2024-11-29 02:27:44.521479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.005 [2024-11-29 02:27:44.521505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x12cdc70 with addr=10.0.0.2, port=4420 00:22:41.005 [2024-11-29 02:27:44.521521] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12cdc70 is same with the state(5) to be set 00:22:41.005 [2024-11-29 02:27:44.521537] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:41.005 [2024-11-29 02:27:44.521551] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:41.005 [2024-11-29 02:27:44.521566] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:41.005 [2024-11-29 02:27:44.521586] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:41.005 [2024-11-29 02:27:44.521601] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:41.005 [2024-11-29 02:27:44.521614] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:41.005 [2024-11-29 02:27:44.521631] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:41.005 [2024-11-29 02:27:44.521645] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:41.005 [2024-11-29 02:27:44.521659] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:41.005 [2024-11-29 02:27:44.521675] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:41.005 [2024-11-29 02:27:44.521688] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:41.005 [2024-11-29 02:27:44.521701] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:41.005 [2024-11-29 02:27:44.521728] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:41.005 [2024-11-29 02:27:44.521750] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:41.005 [2024-11-29 02:27:44.521770] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:41.005 [2024-11-29 02:27:44.521791] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:41.005 [2024-11-29 02:27:44.521821] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:41.005 [2024-11-29 02:27:44.521842] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:41.005 [2024-11-29 02:27:44.521861] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:41.005 [2024-11-29 02:27:44.522695] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:41.005 [2024-11-29 02:27:44.522723] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:41.005 [2024-11-29 02:27:44.522741] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:41.005 [2024-11-29 02:27:44.522780] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.005 [2024-11-29 02:27:44.522798] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.005 [2024-11-29 02:27:44.522810] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.005 [2024-11-29 02:27:44.522827] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.005 [2024-11-29 02:27:44.522939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.005 [2024-11-29 02:27:44.523028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.005 [2024-11-29 02:27:44.523054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1165490 with addr=10.0.0.2, port=4420 00:22:41.005 [2024-11-29 02:27:44.523071] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1165490 is same with the state(5) to be set 00:22:41.005 [2024-11-29 02:27:44.523089] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12b90a0 (9): Bad file descriptor 00:22:41.005 [2024-11-29 02:27:44.523108] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12cdc70 (9): Bad file descriptor 00:22:41.005 [2024-11-29 02:27:44.523263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.005 [2024-11-29 02:27:44.523353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.005 [2024-11-29 02:27:44.523377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x12ce150 with addr=10.0.0.2, port=4420 00:22:41.005 [2024-11-29 02:27:44.523400] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12ce150 is same with the state(5) to be set 00:22:41.005 [2024-11-29 02:27:44.523504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.005 [2024-11-29 02:27:44.523588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.005 [2024-11-29 02:27:44.523611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x113a1b0 with addr=10.0.0.2, port=4420 00:22:41.005 [2024-11-29 02:27:44.523627] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x113a1b0 is same with the state(5) to be set 00:22:41.005 [2024-11-29 02:27:44.523730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.005 [2024-11-29 02:27:44.523815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.005 [2024-11-29 02:27:44.523839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x12de600 with addr=10.0.0.2, port=4420 00:22:41.005 [2024-11-29 02:27:44.523854] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12de600 is same with the state(5) to be set 00:22:41.005 [2024-11-29 02:27:44.523871] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1165490 (9): Bad file descriptor 00:22:41.005 [2024-11-29 02:27:44.523888] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:41.005 [2024-11-29 02:27:44.523900] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:41.005 [2024-11-29 02:27:44.523913] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:41.005 [2024-11-29 02:27:44.523931] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:41.005 [2024-11-29 02:27:44.523945] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:41.005 [2024-11-29 02:27:44.523957] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:41.005 [2024-11-29 02:27:44.524021] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.005 [2024-11-29 02:27:44.524041] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.005 [2024-11-29 02:27:44.524057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12ce150 (9): Bad file descriptor 00:22:41.006 [2024-11-29 02:27:44.524076] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x113a1b0 (9): Bad file descriptor 00:22:41.006 [2024-11-29 02:27:44.524094] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12de600 (9): Bad file descriptor 00:22:41.006 [2024-11-29 02:27:44.524115] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:22:41.006 [2024-11-29 02:27:44.524128] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:22:41.006 [2024-11-29 02:27:44.524141] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:22:41.006 [2024-11-29 02:27:44.524179] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.006 [2024-11-29 02:27:44.524197] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:41.006 [2024-11-29 02:27:44.524210] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:41.006 [2024-11-29 02:27:44.524223] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:41.006 [2024-11-29 02:27:44.524238] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:41.006 [2024-11-29 02:27:44.524252] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:41.006 [2024-11-29 02:27:44.524264] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:41.006 [2024-11-29 02:27:44.524280] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:41.006 [2024-11-29 02:27:44.524293] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:41.006 [2024-11-29 02:27:44.524305] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:41.006 [2024-11-29 02:27:44.524343] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.006 [2024-11-29 02:27:44.524360] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.006 [2024-11-29 02:27:44.524373] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.583 02:27:45 -- target/shutdown.sh@135 -- # nvmfpid= 00:22:41.583 02:27:45 -- target/shutdown.sh@138 -- # sleep 1 00:22:42.521 02:27:46 -- target/shutdown.sh@141 -- # kill -9 183826 00:22:42.521 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (183826) - No such process 00:22:42.521 02:27:46 -- target/shutdown.sh@141 -- # true 00:22:42.521 02:27:46 -- target/shutdown.sh@143 -- # stoptarget 00:22:42.521 02:27:46 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:42.521 02:27:46 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:42.521 02:27:46 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:42.521 02:27:46 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:42.521 02:27:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:42.521 02:27:46 -- nvmf/common.sh@116 -- # sync 00:22:42.521 02:27:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:42.521 02:27:46 -- nvmf/common.sh@119 -- # set +e 00:22:42.521 02:27:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:42.521 02:27:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:42.521 rmmod nvme_tcp 00:22:42.521 rmmod nvme_fabrics 00:22:42.521 rmmod nvme_keyring 00:22:42.521 02:27:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:42.521 02:27:46 -- nvmf/common.sh@123 -- # set -e 00:22:42.521 02:27:46 -- nvmf/common.sh@124 -- # return 0 00:22:42.521 02:27:46 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:22:42.521 02:27:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:42.521 02:27:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:42.521 02:27:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:42.521 02:27:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:42.521 02:27:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:42.521 02:27:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:42.521 02:27:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:42.521 02:27:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:45.064 02:27:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:45.064 00:22:45.064 real 0m8.148s 00:22:45.064 user 0m21.426s 00:22:45.064 sys 0m1.531s 00:22:45.064 02:27:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:45.064 02:27:48 -- common/autotest_common.sh@10 -- # set +x 00:22:45.064 ************************************ 00:22:45.064 END TEST nvmf_shutdown_tc3 00:22:45.064 ************************************ 00:22:45.064 02:27:48 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:22:45.064 00:22:45.064 real 0m29.654s 00:22:45.064 user 1m27.464s 00:22:45.064 sys 0m6.404s 00:22:45.064 02:27:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:45.064 02:27:48 -- common/autotest_common.sh@10 -- # set +x 00:22:45.065 ************************************ 00:22:45.065 END TEST nvmf_shutdown 00:22:45.065 ************************************ 00:22:45.065 02:27:48 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:22:45.065 02:27:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:45.065 02:27:48 -- common/autotest_common.sh@10 -- # set +x 00:22:45.065 02:27:48 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:22:45.065 02:27:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:45.065 02:27:48 -- common/autotest_common.sh@10 -- # set +x 00:22:45.065 02:27:48 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:22:45.065 02:27:48 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:45.065 02:27:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:45.065 02:27:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:45.065 02:27:48 -- common/autotest_common.sh@10 -- # set +x 00:22:45.065 ************************************ 00:22:45.065 START TEST nvmf_multicontroller 00:22:45.065 ************************************ 00:22:45.065 02:27:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:45.065 * Looking for test storage... 00:22:45.065 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:45.065 02:27:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:45.065 02:27:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:45.065 02:27:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:45.065 02:27:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:45.065 02:27:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:45.065 02:27:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:45.065 02:27:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:45.065 02:27:48 -- scripts/common.sh@335 -- # IFS=.-: 00:22:45.065 02:27:48 -- scripts/common.sh@335 -- # read -ra ver1 00:22:45.065 02:27:48 -- scripts/common.sh@336 -- # IFS=.-: 00:22:45.065 02:27:48 -- scripts/common.sh@336 -- # read -ra ver2 00:22:45.065 02:27:48 -- scripts/common.sh@337 -- # local 'op=<' 00:22:45.065 02:27:48 -- scripts/common.sh@339 -- # ver1_l=2 00:22:45.065 02:27:48 -- scripts/common.sh@340 -- # ver2_l=1 00:22:45.065 02:27:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:45.065 02:27:48 -- scripts/common.sh@343 -- # case "$op" in 00:22:45.065 02:27:48 -- scripts/common.sh@344 -- # : 1 00:22:45.065 02:27:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:45.065 02:27:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:45.065 02:27:48 -- scripts/common.sh@364 -- # decimal 1 00:22:45.065 02:27:48 -- scripts/common.sh@352 -- # local d=1 00:22:45.065 02:27:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:45.065 02:27:48 -- scripts/common.sh@354 -- # echo 1 00:22:45.065 02:27:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:45.065 02:27:48 -- scripts/common.sh@365 -- # decimal 2 00:22:45.065 02:27:48 -- scripts/common.sh@352 -- # local d=2 00:22:45.065 02:27:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:45.065 02:27:48 -- scripts/common.sh@354 -- # echo 2 00:22:45.065 02:27:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:45.065 02:27:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:45.065 02:27:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:45.065 02:27:48 -- scripts/common.sh@367 -- # return 0 00:22:45.065 02:27:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:45.065 02:27:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:45.065 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:45.065 --rc genhtml_branch_coverage=1 00:22:45.065 --rc genhtml_function_coverage=1 00:22:45.065 --rc genhtml_legend=1 00:22:45.065 --rc geninfo_all_blocks=1 00:22:45.065 --rc geninfo_unexecuted_blocks=1 00:22:45.065 00:22:45.065 ' 00:22:45.065 02:27:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:45.065 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:45.065 --rc genhtml_branch_coverage=1 00:22:45.065 --rc genhtml_function_coverage=1 00:22:45.065 --rc genhtml_legend=1 00:22:45.065 --rc geninfo_all_blocks=1 00:22:45.065 --rc geninfo_unexecuted_blocks=1 00:22:45.065 00:22:45.065 ' 00:22:45.065 02:27:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:45.065 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:45.065 --rc genhtml_branch_coverage=1 00:22:45.065 --rc genhtml_function_coverage=1 00:22:45.065 --rc genhtml_legend=1 00:22:45.065 --rc geninfo_all_blocks=1 00:22:45.065 --rc geninfo_unexecuted_blocks=1 00:22:45.065 00:22:45.065 ' 00:22:45.065 02:27:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:45.065 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:45.065 --rc genhtml_branch_coverage=1 00:22:45.065 --rc genhtml_function_coverage=1 00:22:45.065 --rc genhtml_legend=1 00:22:45.065 --rc geninfo_all_blocks=1 00:22:45.065 --rc geninfo_unexecuted_blocks=1 00:22:45.065 00:22:45.065 ' 00:22:45.065 02:27:48 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:45.065 02:27:48 -- nvmf/common.sh@7 -- # uname -s 00:22:45.065 02:27:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:45.065 02:27:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:45.065 02:27:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:45.065 02:27:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:45.065 02:27:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:45.065 02:27:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:45.065 02:27:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:45.065 02:27:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:45.065 02:27:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:45.065 02:27:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:45.065 02:27:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:45.065 02:27:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:45.065 02:27:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:45.065 02:27:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:45.065 02:27:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:45.065 02:27:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:45.065 02:27:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:45.065 02:27:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:45.065 02:27:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:45.065 02:27:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.065 02:27:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.065 02:27:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.065 02:27:48 -- paths/export.sh@5 -- # export PATH 00:22:45.065 02:27:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.065 02:27:48 -- nvmf/common.sh@46 -- # : 0 00:22:45.065 02:27:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:45.065 02:27:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:45.065 02:27:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:45.065 02:27:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:45.065 02:27:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:45.065 02:27:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:45.065 02:27:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:45.065 02:27:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:45.065 02:27:48 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:45.065 02:27:48 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:45.065 02:27:48 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:22:45.065 02:27:48 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:22:45.065 02:27:48 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:22:45.065 02:27:48 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:22:45.065 02:27:48 -- host/multicontroller.sh@23 -- # nvmftestinit 00:22:45.065 02:27:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:45.065 02:27:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:45.065 02:27:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:45.065 02:27:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:45.065 02:27:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:45.065 02:27:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:45.065 02:27:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:45.065 02:27:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:45.065 02:27:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:45.065 02:27:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:45.065 02:27:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:45.065 02:27:48 -- common/autotest_common.sh@10 -- # set +x 00:22:46.969 02:27:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:46.969 02:27:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:46.969 02:27:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:46.969 02:27:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:46.969 02:27:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:46.969 02:27:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:46.969 02:27:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:46.969 02:27:50 -- nvmf/common.sh@294 -- # net_devs=() 00:22:46.969 02:27:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:46.969 02:27:50 -- nvmf/common.sh@295 -- # e810=() 00:22:46.969 02:27:50 -- nvmf/common.sh@295 -- # local -ga e810 00:22:46.969 02:27:50 -- nvmf/common.sh@296 -- # x722=() 00:22:46.969 02:27:50 -- nvmf/common.sh@296 -- # local -ga x722 00:22:46.969 02:27:50 -- nvmf/common.sh@297 -- # mlx=() 00:22:46.969 02:27:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:46.969 02:27:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:46.969 02:27:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:46.969 02:27:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:46.969 02:27:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:46.970 02:27:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:46.970 02:27:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:46.970 02:27:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:46.970 02:27:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:46.970 02:27:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:46.970 02:27:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:46.970 02:27:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:46.970 02:27:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:46.970 02:27:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:46.970 02:27:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:46.970 02:27:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:46.970 02:27:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:46.970 02:27:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:46.970 02:27:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:46.970 02:27:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:46.970 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:46.970 02:27:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:46.970 02:27:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:46.970 02:27:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:46.970 02:27:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:46.970 02:27:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:46.970 02:27:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:46.970 02:27:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:46.970 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:46.970 02:27:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:46.970 02:27:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:46.970 02:27:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:46.970 02:27:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:46.970 02:27:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:46.970 02:27:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:46.970 02:27:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:46.970 02:27:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:46.970 02:27:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:46.970 02:27:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:46.970 02:27:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:46.970 02:27:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:46.970 02:27:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:46.970 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:46.970 02:27:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:46.970 02:27:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:46.970 02:27:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:46.970 02:27:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:46.970 02:27:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:46.970 02:27:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:46.970 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:46.970 02:27:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:46.970 02:27:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:46.970 02:27:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:46.970 02:27:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:46.970 02:27:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:46.970 02:27:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:46.970 02:27:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:46.970 02:27:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:46.970 02:27:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:46.970 02:27:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:46.970 02:27:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:46.970 02:27:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:46.970 02:27:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:46.970 02:27:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:46.970 02:27:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:46.970 02:27:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:46.970 02:27:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:46.970 02:27:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:46.970 02:27:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:46.970 02:27:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:46.970 02:27:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:46.970 02:27:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:46.970 02:27:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:46.970 02:27:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:46.970 02:27:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:46.970 02:27:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:46.970 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:46.970 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.355 ms 00:22:46.970 00:22:46.970 --- 10.0.0.2 ping statistics --- 00:22:46.970 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:46.970 rtt min/avg/max/mdev = 0.355/0.355/0.355/0.000 ms 00:22:46.970 02:27:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:46.970 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:46.970 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.141 ms 00:22:46.970 00:22:46.970 --- 10.0.0.1 ping statistics --- 00:22:46.970 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:46.970 rtt min/avg/max/mdev = 0.141/0.141/0.141/0.000 ms 00:22:46.970 02:27:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:46.970 02:27:50 -- nvmf/common.sh@410 -- # return 0 00:22:46.970 02:27:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:46.970 02:27:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:46.970 02:27:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:46.970 02:27:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:46.970 02:27:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:46.970 02:27:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:46.970 02:27:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:47.229 02:27:50 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:22:47.229 02:27:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:47.229 02:27:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:47.229 02:27:50 -- common/autotest_common.sh@10 -- # set +x 00:22:47.229 02:27:50 -- nvmf/common.sh@469 -- # nvmfpid=186380 00:22:47.229 02:27:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:22:47.229 02:27:50 -- nvmf/common.sh@470 -- # waitforlisten 186380 00:22:47.229 02:27:50 -- common/autotest_common.sh@829 -- # '[' -z 186380 ']' 00:22:47.229 02:27:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:47.229 02:27:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:47.229 02:27:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:47.229 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:47.229 02:27:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:47.229 02:27:50 -- common/autotest_common.sh@10 -- # set +x 00:22:47.229 [2024-11-29 02:27:50.700674] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:47.229 [2024-11-29 02:27:50.700781] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:47.229 EAL: No free 2048 kB hugepages reported on node 1 00:22:47.229 [2024-11-29 02:27:50.767485] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:22:47.229 [2024-11-29 02:27:50.876126] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:47.229 [2024-11-29 02:27:50.876290] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:47.229 [2024-11-29 02:27:50.876307] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:47.229 [2024-11-29 02:27:50.876320] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:47.229 [2024-11-29 02:27:50.876417] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:47.229 [2024-11-29 02:27:50.876469] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:47.229 [2024-11-29 02:27:50.876473] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:48.164 02:27:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:48.164 02:27:51 -- common/autotest_common.sh@862 -- # return 0 00:22:48.164 02:27:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:48.164 02:27:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:48.164 02:27:51 -- common/autotest_common.sh@10 -- # set +x 00:22:48.164 02:27:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:48.164 02:27:51 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:48.164 02:27:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.164 02:27:51 -- common/autotest_common.sh@10 -- # set +x 00:22:48.164 [2024-11-29 02:27:51.698848] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:48.164 02:27:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.164 02:27:51 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:48.164 02:27:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.164 02:27:51 -- common/autotest_common.sh@10 -- # set +x 00:22:48.164 Malloc0 00:22:48.164 02:27:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.164 02:27:51 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:48.164 02:27:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.164 02:27:51 -- common/autotest_common.sh@10 -- # set +x 00:22:48.164 02:27:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.164 02:27:51 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:48.164 02:27:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.164 02:27:51 -- common/autotest_common.sh@10 -- # set +x 00:22:48.164 02:27:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.164 02:27:51 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:48.164 02:27:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.164 02:27:51 -- common/autotest_common.sh@10 -- # set +x 00:22:48.164 [2024-11-29 02:27:51.763315] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:48.164 02:27:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.164 02:27:51 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:22:48.164 02:27:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.164 02:27:51 -- common/autotest_common.sh@10 -- # set +x 00:22:48.164 [2024-11-29 02:27:51.771184] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:22:48.164 02:27:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.164 02:27:51 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:48.164 02:27:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.164 02:27:51 -- common/autotest_common.sh@10 -- # set +x 00:22:48.164 Malloc1 00:22:48.164 02:27:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.164 02:27:51 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:22:48.164 02:27:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.164 02:27:51 -- common/autotest_common.sh@10 -- # set +x 00:22:48.164 02:27:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.164 02:27:51 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:22:48.164 02:27:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.164 02:27:51 -- common/autotest_common.sh@10 -- # set +x 00:22:48.164 02:27:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.164 02:27:51 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:48.164 02:27:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.164 02:27:51 -- common/autotest_common.sh@10 -- # set +x 00:22:48.164 02:27:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.165 02:27:51 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:22:48.165 02:27:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.165 02:27:51 -- common/autotest_common.sh@10 -- # set +x 00:22:48.165 02:27:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.165 02:27:51 -- host/multicontroller.sh@44 -- # bdevperf_pid=186540 00:22:48.165 02:27:51 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:48.165 02:27:51 -- host/multicontroller.sh@47 -- # waitforlisten 186540 /var/tmp/bdevperf.sock 00:22:48.165 02:27:51 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:22:48.165 02:27:51 -- common/autotest_common.sh@829 -- # '[' -z 186540 ']' 00:22:48.165 02:27:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:48.165 02:27:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:48.165 02:27:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:48.165 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:48.165 02:27:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:48.165 02:27:51 -- common/autotest_common.sh@10 -- # set +x 00:22:49.545 02:27:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:49.545 02:27:52 -- common/autotest_common.sh@862 -- # return 0 00:22:49.545 02:27:52 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:49.545 02:27:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.545 02:27:52 -- common/autotest_common.sh@10 -- # set +x 00:22:49.545 NVMe0n1 00:22:49.545 02:27:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.545 02:27:52 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:49.545 02:27:52 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:22:49.545 02:27:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.545 02:27:52 -- common/autotest_common.sh@10 -- # set +x 00:22:49.545 02:27:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.545 1 00:22:49.545 02:27:52 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:49.545 02:27:52 -- common/autotest_common.sh@650 -- # local es=0 00:22:49.545 02:27:52 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:49.545 02:27:52 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:49.545 02:27:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:49.545 02:27:52 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:49.545 02:27:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:49.545 02:27:52 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:49.545 02:27:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.545 02:27:52 -- common/autotest_common.sh@10 -- # set +x 00:22:49.545 request: 00:22:49.545 { 00:22:49.545 "name": "NVMe0", 00:22:49.545 "trtype": "tcp", 00:22:49.545 "traddr": "10.0.0.2", 00:22:49.545 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:22:49.545 "hostaddr": "10.0.0.2", 00:22:49.545 "hostsvcid": "60000", 00:22:49.545 "adrfam": "ipv4", 00:22:49.545 "trsvcid": "4420", 00:22:49.545 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:49.545 "method": "bdev_nvme_attach_controller", 00:22:49.545 "req_id": 1 00:22:49.545 } 00:22:49.545 Got JSON-RPC error response 00:22:49.545 response: 00:22:49.545 { 00:22:49.545 "code": -114, 00:22:49.545 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:49.545 } 00:22:49.545 02:27:52 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:49.545 02:27:52 -- common/autotest_common.sh@653 -- # es=1 00:22:49.545 02:27:52 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:49.545 02:27:52 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:49.545 02:27:52 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:49.545 02:27:52 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:49.545 02:27:52 -- common/autotest_common.sh@650 -- # local es=0 00:22:49.545 02:27:52 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:49.545 02:27:52 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:49.545 02:27:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:49.545 02:27:52 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:49.545 02:27:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:49.545 02:27:52 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:49.545 02:27:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.545 02:27:52 -- common/autotest_common.sh@10 -- # set +x 00:22:49.545 request: 00:22:49.545 { 00:22:49.545 "name": "NVMe0", 00:22:49.545 "trtype": "tcp", 00:22:49.545 "traddr": "10.0.0.2", 00:22:49.545 "hostaddr": "10.0.0.2", 00:22:49.545 "hostsvcid": "60000", 00:22:49.545 "adrfam": "ipv4", 00:22:49.545 "trsvcid": "4420", 00:22:49.545 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:49.545 "method": "bdev_nvme_attach_controller", 00:22:49.545 "req_id": 1 00:22:49.545 } 00:22:49.545 Got JSON-RPC error response 00:22:49.545 response: 00:22:49.545 { 00:22:49.545 "code": -114, 00:22:49.545 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:49.545 } 00:22:49.545 02:27:52 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:49.545 02:27:52 -- common/autotest_common.sh@653 -- # es=1 00:22:49.545 02:27:52 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:49.545 02:27:52 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:49.545 02:27:52 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:49.545 02:27:52 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:49.545 02:27:52 -- common/autotest_common.sh@650 -- # local es=0 00:22:49.545 02:27:52 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:49.545 02:27:52 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:49.545 02:27:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:49.545 02:27:52 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:49.545 02:27:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:49.545 02:27:52 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:49.545 02:27:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.545 02:27:52 -- common/autotest_common.sh@10 -- # set +x 00:22:49.545 request: 00:22:49.545 { 00:22:49.545 "name": "NVMe0", 00:22:49.545 "trtype": "tcp", 00:22:49.545 "traddr": "10.0.0.2", 00:22:49.545 "hostaddr": "10.0.0.2", 00:22:49.545 "hostsvcid": "60000", 00:22:49.545 "adrfam": "ipv4", 00:22:49.545 "trsvcid": "4420", 00:22:49.545 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:49.545 "multipath": "disable", 00:22:49.545 "method": "bdev_nvme_attach_controller", 00:22:49.545 "req_id": 1 00:22:49.545 } 00:22:49.545 Got JSON-RPC error response 00:22:49.545 response: 00:22:49.545 { 00:22:49.545 "code": -114, 00:22:49.545 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:22:49.545 } 00:22:49.545 02:27:52 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:49.545 02:27:52 -- common/autotest_common.sh@653 -- # es=1 00:22:49.545 02:27:52 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:49.545 02:27:52 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:49.545 02:27:52 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:49.546 02:27:52 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:49.546 02:27:52 -- common/autotest_common.sh@650 -- # local es=0 00:22:49.546 02:27:52 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:49.546 02:27:52 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:49.546 02:27:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:49.546 02:27:52 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:49.546 02:27:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:49.546 02:27:52 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:49.546 02:27:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.546 02:27:52 -- common/autotest_common.sh@10 -- # set +x 00:22:49.546 request: 00:22:49.546 { 00:22:49.546 "name": "NVMe0", 00:22:49.546 "trtype": "tcp", 00:22:49.546 "traddr": "10.0.0.2", 00:22:49.546 "hostaddr": "10.0.0.2", 00:22:49.546 "hostsvcid": "60000", 00:22:49.546 "adrfam": "ipv4", 00:22:49.546 "trsvcid": "4420", 00:22:49.546 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:49.546 "multipath": "failover", 00:22:49.546 "method": "bdev_nvme_attach_controller", 00:22:49.546 "req_id": 1 00:22:49.546 } 00:22:49.546 Got JSON-RPC error response 00:22:49.546 response: 00:22:49.546 { 00:22:49.546 "code": -114, 00:22:49.546 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:49.546 } 00:22:49.546 02:27:52 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:49.546 02:27:52 -- common/autotest_common.sh@653 -- # es=1 00:22:49.546 02:27:52 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:49.546 02:27:52 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:49.546 02:27:52 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:49.546 02:27:52 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:49.546 02:27:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.546 02:27:52 -- common/autotest_common.sh@10 -- # set +x 00:22:49.546 00:22:49.546 02:27:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.546 02:27:53 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:49.546 02:27:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.546 02:27:53 -- common/autotest_common.sh@10 -- # set +x 00:22:49.546 02:27:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.546 02:27:53 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:49.546 02:27:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.546 02:27:53 -- common/autotest_common.sh@10 -- # set +x 00:22:49.806 00:22:49.806 02:27:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.806 02:27:53 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:49.806 02:27:53 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:22:49.806 02:27:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.806 02:27:53 -- common/autotest_common.sh@10 -- # set +x 00:22:49.806 02:27:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.806 02:27:53 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:22:49.806 02:27:53 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:22:51.188 0 00:22:51.188 02:27:54 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:22:51.189 02:27:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.189 02:27:54 -- common/autotest_common.sh@10 -- # set +x 00:22:51.189 02:27:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.189 02:27:54 -- host/multicontroller.sh@100 -- # killprocess 186540 00:22:51.189 02:27:54 -- common/autotest_common.sh@936 -- # '[' -z 186540 ']' 00:22:51.189 02:27:54 -- common/autotest_common.sh@940 -- # kill -0 186540 00:22:51.189 02:27:54 -- common/autotest_common.sh@941 -- # uname 00:22:51.189 02:27:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:51.189 02:27:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 186540 00:22:51.189 02:27:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:51.189 02:27:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:51.189 02:27:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 186540' 00:22:51.189 killing process with pid 186540 00:22:51.189 02:27:54 -- common/autotest_common.sh@955 -- # kill 186540 00:22:51.189 02:27:54 -- common/autotest_common.sh@960 -- # wait 186540 00:22:51.189 02:27:54 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:51.189 02:27:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.189 02:27:54 -- common/autotest_common.sh@10 -- # set +x 00:22:51.189 02:27:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.189 02:27:54 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:22:51.189 02:27:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.189 02:27:54 -- common/autotest_common.sh@10 -- # set +x 00:22:51.189 02:27:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.189 02:27:54 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:22:51.189 02:27:54 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:51.189 02:27:54 -- common/autotest_common.sh@1607 -- # read -r file 00:22:51.189 02:27:54 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:22:51.189 02:27:54 -- common/autotest_common.sh@1606 -- # sort -u 00:22:51.189 02:27:54 -- common/autotest_common.sh@1608 -- # cat 00:22:51.189 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:22:51.189 [2024-11-29 02:27:51.870320] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:51.189 [2024-11-29 02:27:51.870416] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid186540 ] 00:22:51.189 EAL: No free 2048 kB hugepages reported on node 1 00:22:51.189 [2024-11-29 02:27:51.929992] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:51.189 [2024-11-29 02:27:52.036323] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:51.189 [2024-11-29 02:27:53.334168] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name 6fd5d2e9-8c10-46a6-ab6b-1afc889ae290 already exists 00:22:51.189 [2024-11-29 02:27:53.334211] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:6fd5d2e9-8c10-46a6-ab6b-1afc889ae290 alias for bdev NVMe1n1 00:22:51.189 [2024-11-29 02:27:53.334228] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:22:51.189 Running I/O for 1 seconds... 00:22:51.189 00:22:51.189 Latency(us) 00:22:51.189 [2024-11-29T01:27:54.870Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:51.189 [2024-11-29T01:27:54.870Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:22:51.189 NVMe0n1 : 1.00 19660.40 76.80 0.00 0.00 6500.99 2524.35 15631.55 00:22:51.189 [2024-11-29T01:27:54.870Z] =================================================================================================================== 00:22:51.189 [2024-11-29T01:27:54.870Z] Total : 19660.40 76.80 0.00 0.00 6500.99 2524.35 15631.55 00:22:51.189 Received shutdown signal, test time was about 1.000000 seconds 00:22:51.189 00:22:51.189 Latency(us) 00:22:51.189 [2024-11-29T01:27:54.870Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:51.189 [2024-11-29T01:27:54.870Z] =================================================================================================================== 00:22:51.189 [2024-11-29T01:27:54.870Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:22:51.189 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:22:51.189 02:27:54 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:51.189 02:27:54 -- common/autotest_common.sh@1607 -- # read -r file 00:22:51.189 02:27:54 -- host/multicontroller.sh@108 -- # nvmftestfini 00:22:51.189 02:27:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:51.189 02:27:54 -- nvmf/common.sh@116 -- # sync 00:22:51.189 02:27:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:51.189 02:27:54 -- nvmf/common.sh@119 -- # set +e 00:22:51.189 02:27:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:51.189 02:27:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:51.189 rmmod nvme_tcp 00:22:51.189 rmmod nvme_fabrics 00:22:51.189 rmmod nvme_keyring 00:22:51.189 02:27:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:51.189 02:27:54 -- nvmf/common.sh@123 -- # set -e 00:22:51.189 02:27:54 -- nvmf/common.sh@124 -- # return 0 00:22:51.189 02:27:54 -- nvmf/common.sh@477 -- # '[' -n 186380 ']' 00:22:51.189 02:27:54 -- nvmf/common.sh@478 -- # killprocess 186380 00:22:51.189 02:27:54 -- common/autotest_common.sh@936 -- # '[' -z 186380 ']' 00:22:51.189 02:27:54 -- common/autotest_common.sh@940 -- # kill -0 186380 00:22:51.189 02:27:54 -- common/autotest_common.sh@941 -- # uname 00:22:51.189 02:27:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:51.189 02:27:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 186380 00:22:51.450 02:27:54 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:51.450 02:27:54 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:51.450 02:27:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 186380' 00:22:51.450 killing process with pid 186380 00:22:51.450 02:27:54 -- common/autotest_common.sh@955 -- # kill 186380 00:22:51.450 02:27:54 -- common/autotest_common.sh@960 -- # wait 186380 00:22:51.710 02:27:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:51.710 02:27:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:51.710 02:27:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:51.710 02:27:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:51.710 02:27:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:51.710 02:27:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:51.710 02:27:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:51.710 02:27:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:53.618 02:27:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:53.618 00:22:53.618 real 0m9.047s 00:22:53.618 user 0m17.193s 00:22:53.618 sys 0m2.355s 00:22:53.618 02:27:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:53.618 02:27:57 -- common/autotest_common.sh@10 -- # set +x 00:22:53.618 ************************************ 00:22:53.618 END TEST nvmf_multicontroller 00:22:53.618 ************************************ 00:22:53.878 02:27:57 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:22:53.878 02:27:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:53.878 02:27:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:53.878 02:27:57 -- common/autotest_common.sh@10 -- # set +x 00:22:53.878 ************************************ 00:22:53.878 START TEST nvmf_aer 00:22:53.878 ************************************ 00:22:53.878 02:27:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:22:53.878 * Looking for test storage... 00:22:53.878 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:53.878 02:27:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:53.878 02:27:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:53.878 02:27:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:53.878 02:27:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:53.878 02:27:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:53.878 02:27:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:53.878 02:27:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:53.878 02:27:57 -- scripts/common.sh@335 -- # IFS=.-: 00:22:53.878 02:27:57 -- scripts/common.sh@335 -- # read -ra ver1 00:22:53.878 02:27:57 -- scripts/common.sh@336 -- # IFS=.-: 00:22:53.878 02:27:57 -- scripts/common.sh@336 -- # read -ra ver2 00:22:53.878 02:27:57 -- scripts/common.sh@337 -- # local 'op=<' 00:22:53.878 02:27:57 -- scripts/common.sh@339 -- # ver1_l=2 00:22:53.878 02:27:57 -- scripts/common.sh@340 -- # ver2_l=1 00:22:53.878 02:27:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:53.878 02:27:57 -- scripts/common.sh@343 -- # case "$op" in 00:22:53.878 02:27:57 -- scripts/common.sh@344 -- # : 1 00:22:53.878 02:27:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:53.878 02:27:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:53.878 02:27:57 -- scripts/common.sh@364 -- # decimal 1 00:22:53.878 02:27:57 -- scripts/common.sh@352 -- # local d=1 00:22:53.878 02:27:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:53.878 02:27:57 -- scripts/common.sh@354 -- # echo 1 00:22:53.878 02:27:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:53.878 02:27:57 -- scripts/common.sh@365 -- # decimal 2 00:22:53.878 02:27:57 -- scripts/common.sh@352 -- # local d=2 00:22:53.878 02:27:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:53.878 02:27:57 -- scripts/common.sh@354 -- # echo 2 00:22:53.878 02:27:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:53.878 02:27:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:53.878 02:27:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:53.878 02:27:57 -- scripts/common.sh@367 -- # return 0 00:22:53.878 02:27:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:53.878 02:27:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:53.878 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:53.878 --rc genhtml_branch_coverage=1 00:22:53.878 --rc genhtml_function_coverage=1 00:22:53.878 --rc genhtml_legend=1 00:22:53.878 --rc geninfo_all_blocks=1 00:22:53.878 --rc geninfo_unexecuted_blocks=1 00:22:53.878 00:22:53.878 ' 00:22:53.878 02:27:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:53.878 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:53.878 --rc genhtml_branch_coverage=1 00:22:53.878 --rc genhtml_function_coverage=1 00:22:53.878 --rc genhtml_legend=1 00:22:53.878 --rc geninfo_all_blocks=1 00:22:53.878 --rc geninfo_unexecuted_blocks=1 00:22:53.878 00:22:53.878 ' 00:22:53.878 02:27:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:53.878 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:53.878 --rc genhtml_branch_coverage=1 00:22:53.878 --rc genhtml_function_coverage=1 00:22:53.878 --rc genhtml_legend=1 00:22:53.878 --rc geninfo_all_blocks=1 00:22:53.878 --rc geninfo_unexecuted_blocks=1 00:22:53.878 00:22:53.878 ' 00:22:53.878 02:27:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:53.878 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:53.878 --rc genhtml_branch_coverage=1 00:22:53.878 --rc genhtml_function_coverage=1 00:22:53.878 --rc genhtml_legend=1 00:22:53.878 --rc geninfo_all_blocks=1 00:22:53.878 --rc geninfo_unexecuted_blocks=1 00:22:53.878 00:22:53.878 ' 00:22:53.878 02:27:57 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:53.878 02:27:57 -- nvmf/common.sh@7 -- # uname -s 00:22:53.878 02:27:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:53.878 02:27:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:53.878 02:27:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:53.878 02:27:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:53.878 02:27:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:53.878 02:27:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:53.878 02:27:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:53.878 02:27:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:53.878 02:27:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:53.878 02:27:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:53.878 02:27:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:53.878 02:27:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:53.878 02:27:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:53.878 02:27:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:53.878 02:27:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:53.878 02:27:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:53.878 02:27:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:53.878 02:27:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:53.878 02:27:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:53.878 02:27:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:53.878 02:27:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:53.878 02:27:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:53.878 02:27:57 -- paths/export.sh@5 -- # export PATH 00:22:53.879 02:27:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:53.879 02:27:57 -- nvmf/common.sh@46 -- # : 0 00:22:53.879 02:27:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:53.879 02:27:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:53.879 02:27:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:53.879 02:27:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:53.879 02:27:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:53.879 02:27:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:53.879 02:27:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:53.879 02:27:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:53.879 02:27:57 -- host/aer.sh@11 -- # nvmftestinit 00:22:53.879 02:27:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:53.879 02:27:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:53.879 02:27:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:53.879 02:27:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:53.879 02:27:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:53.879 02:27:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:53.879 02:27:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:53.879 02:27:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:53.879 02:27:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:53.879 02:27:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:53.879 02:27:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:53.879 02:27:57 -- common/autotest_common.sh@10 -- # set +x 00:22:55.784 02:27:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:55.784 02:27:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:55.784 02:27:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:55.784 02:27:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:55.784 02:27:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:55.784 02:27:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:55.784 02:27:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:55.784 02:27:59 -- nvmf/common.sh@294 -- # net_devs=() 00:22:55.784 02:27:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:55.784 02:27:59 -- nvmf/common.sh@295 -- # e810=() 00:22:55.784 02:27:59 -- nvmf/common.sh@295 -- # local -ga e810 00:22:55.784 02:27:59 -- nvmf/common.sh@296 -- # x722=() 00:22:55.784 02:27:59 -- nvmf/common.sh@296 -- # local -ga x722 00:22:55.784 02:27:59 -- nvmf/common.sh@297 -- # mlx=() 00:22:55.784 02:27:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:55.784 02:27:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:55.784 02:27:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:55.784 02:27:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:55.784 02:27:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:55.784 02:27:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:55.784 02:27:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:55.784 02:27:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:55.784 02:27:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:55.784 02:27:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:55.784 02:27:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:55.784 02:27:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:55.784 02:27:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:55.784 02:27:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:55.784 02:27:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:55.784 02:27:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:55.784 02:27:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:55.784 02:27:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:55.784 02:27:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:55.784 02:27:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:55.784 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:55.784 02:27:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:55.784 02:27:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:55.784 02:27:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:55.784 02:27:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:55.784 02:27:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:55.784 02:27:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:55.784 02:27:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:55.784 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:55.784 02:27:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:55.784 02:27:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:55.784 02:27:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:55.784 02:27:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:55.784 02:27:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:55.784 02:27:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:55.784 02:27:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:55.784 02:27:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:55.784 02:27:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:55.784 02:27:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:55.784 02:27:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:55.784 02:27:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:55.784 02:27:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:55.784 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:55.784 02:27:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:55.784 02:27:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:55.784 02:27:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:55.784 02:27:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:55.784 02:27:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:55.784 02:27:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:55.784 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:55.784 02:27:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:55.784 02:27:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:55.784 02:27:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:55.784 02:27:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:55.784 02:27:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:55.784 02:27:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:55.784 02:27:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:55.784 02:27:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:55.784 02:27:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:55.784 02:27:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:55.784 02:27:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:55.784 02:27:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:55.784 02:27:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:55.784 02:27:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:55.784 02:27:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:55.784 02:27:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:55.784 02:27:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:55.784 02:27:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:55.784 02:27:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:56.042 02:27:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:56.042 02:27:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:56.042 02:27:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:56.042 02:27:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:56.042 02:27:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:56.042 02:27:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:56.042 02:27:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:56.042 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:56.042 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.296 ms 00:22:56.042 00:22:56.042 --- 10.0.0.2 ping statistics --- 00:22:56.042 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:56.042 rtt min/avg/max/mdev = 0.296/0.296/0.296/0.000 ms 00:22:56.042 02:27:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:56.042 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:56.042 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.082 ms 00:22:56.042 00:22:56.042 --- 10.0.0.1 ping statistics --- 00:22:56.042 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:56.042 rtt min/avg/max/mdev = 0.082/0.082/0.082/0.000 ms 00:22:56.042 02:27:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:56.042 02:27:59 -- nvmf/common.sh@410 -- # return 0 00:22:56.042 02:27:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:56.042 02:27:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:56.042 02:27:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:56.042 02:27:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:56.042 02:27:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:56.042 02:27:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:56.042 02:27:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:56.042 02:27:59 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:22:56.042 02:27:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:56.042 02:27:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:56.042 02:27:59 -- common/autotest_common.sh@10 -- # set +x 00:22:56.042 02:27:59 -- nvmf/common.sh@469 -- # nvmfpid=188913 00:22:56.042 02:27:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:56.042 02:27:59 -- nvmf/common.sh@470 -- # waitforlisten 188913 00:22:56.042 02:27:59 -- common/autotest_common.sh@829 -- # '[' -z 188913 ']' 00:22:56.042 02:27:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:56.042 02:27:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:56.042 02:27:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:56.042 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:56.042 02:27:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:56.042 02:27:59 -- common/autotest_common.sh@10 -- # set +x 00:22:56.042 [2024-11-29 02:27:59.624463] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:56.042 [2024-11-29 02:27:59.624531] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:56.042 EAL: No free 2048 kB hugepages reported on node 1 00:22:56.042 [2024-11-29 02:27:59.689404] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:56.300 [2024-11-29 02:27:59.795116] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:56.300 [2024-11-29 02:27:59.795276] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:56.300 [2024-11-29 02:27:59.795293] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:56.300 [2024-11-29 02:27:59.795305] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:56.300 [2024-11-29 02:27:59.795365] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:56.300 [2024-11-29 02:27:59.797425] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:56.300 [2024-11-29 02:27:59.797455] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:56.300 [2024-11-29 02:27:59.797458] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:57.239 02:28:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:57.239 02:28:00 -- common/autotest_common.sh@862 -- # return 0 00:22:57.239 02:28:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:57.239 02:28:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:57.239 02:28:00 -- common/autotest_common.sh@10 -- # set +x 00:22:57.239 02:28:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:57.239 02:28:00 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:57.239 02:28:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.239 02:28:00 -- common/autotest_common.sh@10 -- # set +x 00:22:57.239 [2024-11-29 02:28:00.694290] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:57.239 02:28:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.239 02:28:00 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:22:57.239 02:28:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.239 02:28:00 -- common/autotest_common.sh@10 -- # set +x 00:22:57.239 Malloc0 00:22:57.239 02:28:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.239 02:28:00 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:22:57.239 02:28:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.239 02:28:00 -- common/autotest_common.sh@10 -- # set +x 00:22:57.239 02:28:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.239 02:28:00 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:57.239 02:28:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.239 02:28:00 -- common/autotest_common.sh@10 -- # set +x 00:22:57.239 02:28:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.239 02:28:00 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:57.239 02:28:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.239 02:28:00 -- common/autotest_common.sh@10 -- # set +x 00:22:57.239 [2024-11-29 02:28:00.747990] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:57.239 02:28:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.239 02:28:00 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:22:57.239 02:28:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.239 02:28:00 -- common/autotest_common.sh@10 -- # set +x 00:22:57.239 [2024-11-29 02:28:00.755699] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:22:57.239 [ 00:22:57.239 { 00:22:57.239 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:57.239 "subtype": "Discovery", 00:22:57.239 "listen_addresses": [], 00:22:57.239 "allow_any_host": true, 00:22:57.239 "hosts": [] 00:22:57.239 }, 00:22:57.239 { 00:22:57.239 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:57.239 "subtype": "NVMe", 00:22:57.239 "listen_addresses": [ 00:22:57.239 { 00:22:57.239 "transport": "TCP", 00:22:57.239 "trtype": "TCP", 00:22:57.239 "adrfam": "IPv4", 00:22:57.239 "traddr": "10.0.0.2", 00:22:57.239 "trsvcid": "4420" 00:22:57.239 } 00:22:57.239 ], 00:22:57.239 "allow_any_host": true, 00:22:57.239 "hosts": [], 00:22:57.239 "serial_number": "SPDK00000000000001", 00:22:57.239 "model_number": "SPDK bdev Controller", 00:22:57.239 "max_namespaces": 2, 00:22:57.239 "min_cntlid": 1, 00:22:57.239 "max_cntlid": 65519, 00:22:57.239 "namespaces": [ 00:22:57.239 { 00:22:57.239 "nsid": 1, 00:22:57.239 "bdev_name": "Malloc0", 00:22:57.239 "name": "Malloc0", 00:22:57.239 "nguid": "C4CB7E9A330B4FFBA9174BC79456F96C", 00:22:57.239 "uuid": "c4cb7e9a-330b-4ffb-a917-4bc79456f96c" 00:22:57.239 } 00:22:57.239 ] 00:22:57.239 } 00:22:57.239 ] 00:22:57.239 02:28:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.239 02:28:00 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:22:57.239 02:28:00 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:22:57.239 02:28:00 -- host/aer.sh@33 -- # aerpid=189069 00:22:57.239 02:28:00 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:22:57.239 02:28:00 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:22:57.239 02:28:00 -- common/autotest_common.sh@1254 -- # local i=0 00:22:57.239 02:28:00 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:57.239 02:28:00 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:22:57.239 02:28:00 -- common/autotest_common.sh@1257 -- # i=1 00:22:57.239 02:28:00 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:22:57.239 EAL: No free 2048 kB hugepages reported on node 1 00:22:57.239 02:28:00 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:57.239 02:28:00 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:22:57.239 02:28:00 -- common/autotest_common.sh@1257 -- # i=2 00:22:57.239 02:28:00 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:22:57.525 02:28:00 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:57.525 02:28:00 -- common/autotest_common.sh@1256 -- # '[' 2 -lt 200 ']' 00:22:57.525 02:28:00 -- common/autotest_common.sh@1257 -- # i=3 00:22:57.525 02:28:00 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:22:57.525 02:28:01 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:57.525 02:28:01 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:57.525 02:28:01 -- common/autotest_common.sh@1265 -- # return 0 00:22:57.525 02:28:01 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:22:57.525 02:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.525 02:28:01 -- common/autotest_common.sh@10 -- # set +x 00:22:57.525 Malloc1 00:22:57.525 02:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.525 02:28:01 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:22:57.525 02:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.525 02:28:01 -- common/autotest_common.sh@10 -- # set +x 00:22:57.525 02:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.525 02:28:01 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:22:57.525 02:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.525 02:28:01 -- common/autotest_common.sh@10 -- # set +x 00:22:57.525 Asynchronous Event Request test 00:22:57.525 Attaching to 10.0.0.2 00:22:57.525 Attached to 10.0.0.2 00:22:57.525 Registering asynchronous event callbacks... 00:22:57.525 Starting namespace attribute notice tests for all controllers... 00:22:57.525 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:22:57.525 aer_cb - Changed Namespace 00:22:57.525 Cleaning up... 00:22:57.525 [ 00:22:57.525 { 00:22:57.525 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:57.525 "subtype": "Discovery", 00:22:57.525 "listen_addresses": [], 00:22:57.525 "allow_any_host": true, 00:22:57.525 "hosts": [] 00:22:57.525 }, 00:22:57.525 { 00:22:57.525 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:57.525 "subtype": "NVMe", 00:22:57.525 "listen_addresses": [ 00:22:57.525 { 00:22:57.525 "transport": "TCP", 00:22:57.525 "trtype": "TCP", 00:22:57.525 "adrfam": "IPv4", 00:22:57.525 "traddr": "10.0.0.2", 00:22:57.525 "trsvcid": "4420" 00:22:57.525 } 00:22:57.525 ], 00:22:57.525 "allow_any_host": true, 00:22:57.525 "hosts": [], 00:22:57.525 "serial_number": "SPDK00000000000001", 00:22:57.525 "model_number": "SPDK bdev Controller", 00:22:57.525 "max_namespaces": 2, 00:22:57.525 "min_cntlid": 1, 00:22:57.525 "max_cntlid": 65519, 00:22:57.525 "namespaces": [ 00:22:57.525 { 00:22:57.525 "nsid": 1, 00:22:57.525 "bdev_name": "Malloc0", 00:22:57.525 "name": "Malloc0", 00:22:57.525 "nguid": "C4CB7E9A330B4FFBA9174BC79456F96C", 00:22:57.525 "uuid": "c4cb7e9a-330b-4ffb-a917-4bc79456f96c" 00:22:57.525 }, 00:22:57.525 { 00:22:57.525 "nsid": 2, 00:22:57.525 "bdev_name": "Malloc1", 00:22:57.525 "name": "Malloc1", 00:22:57.525 "nguid": "60B1AAD41A7148178B306E2658A2E49A", 00:22:57.525 "uuid": "60b1aad4-1a71-4817-8b30-6e2658a2e49a" 00:22:57.525 } 00:22:57.525 ] 00:22:57.525 } 00:22:57.525 ] 00:22:57.525 02:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.525 02:28:01 -- host/aer.sh@43 -- # wait 189069 00:22:57.525 02:28:01 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:22:57.525 02:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.525 02:28:01 -- common/autotest_common.sh@10 -- # set +x 00:22:57.525 02:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.525 02:28:01 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:22:57.525 02:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.525 02:28:01 -- common/autotest_common.sh@10 -- # set +x 00:22:57.782 02:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.782 02:28:01 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:57.782 02:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.782 02:28:01 -- common/autotest_common.sh@10 -- # set +x 00:22:57.782 02:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.782 02:28:01 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:22:57.782 02:28:01 -- host/aer.sh@51 -- # nvmftestfini 00:22:57.782 02:28:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:57.782 02:28:01 -- nvmf/common.sh@116 -- # sync 00:22:57.782 02:28:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:57.782 02:28:01 -- nvmf/common.sh@119 -- # set +e 00:22:57.782 02:28:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:57.782 02:28:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:57.782 rmmod nvme_tcp 00:22:57.782 rmmod nvme_fabrics 00:22:57.782 rmmod nvme_keyring 00:22:57.782 02:28:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:57.783 02:28:01 -- nvmf/common.sh@123 -- # set -e 00:22:57.783 02:28:01 -- nvmf/common.sh@124 -- # return 0 00:22:57.783 02:28:01 -- nvmf/common.sh@477 -- # '[' -n 188913 ']' 00:22:57.783 02:28:01 -- nvmf/common.sh@478 -- # killprocess 188913 00:22:57.783 02:28:01 -- common/autotest_common.sh@936 -- # '[' -z 188913 ']' 00:22:57.783 02:28:01 -- common/autotest_common.sh@940 -- # kill -0 188913 00:22:57.783 02:28:01 -- common/autotest_common.sh@941 -- # uname 00:22:57.783 02:28:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:57.783 02:28:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 188913 00:22:57.783 02:28:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:57.783 02:28:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:57.783 02:28:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 188913' 00:22:57.783 killing process with pid 188913 00:22:57.783 02:28:01 -- common/autotest_common.sh@955 -- # kill 188913 00:22:57.783 [2024-11-29 02:28:01.319462] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:22:57.783 02:28:01 -- common/autotest_common.sh@960 -- # wait 188913 00:22:58.040 02:28:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:58.040 02:28:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:58.040 02:28:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:58.040 02:28:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:58.040 02:28:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:58.040 02:28:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:58.040 02:28:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:58.040 02:28:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:59.948 02:28:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:59.948 00:22:59.948 real 0m6.312s 00:22:59.948 user 0m7.916s 00:22:59.948 sys 0m1.993s 00:22:59.948 02:28:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:59.948 02:28:03 -- common/autotest_common.sh@10 -- # set +x 00:22:59.948 ************************************ 00:22:59.948 END TEST nvmf_aer 00:22:59.948 ************************************ 00:23:00.208 02:28:03 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:00.208 02:28:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:00.208 02:28:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:00.208 02:28:03 -- common/autotest_common.sh@10 -- # set +x 00:23:00.208 ************************************ 00:23:00.208 START TEST nvmf_async_init 00:23:00.208 ************************************ 00:23:00.208 02:28:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:00.208 * Looking for test storage... 00:23:00.208 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:00.208 02:28:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:00.208 02:28:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:00.208 02:28:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:00.208 02:28:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:00.208 02:28:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:00.208 02:28:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:00.208 02:28:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:00.208 02:28:03 -- scripts/common.sh@335 -- # IFS=.-: 00:23:00.208 02:28:03 -- scripts/common.sh@335 -- # read -ra ver1 00:23:00.208 02:28:03 -- scripts/common.sh@336 -- # IFS=.-: 00:23:00.208 02:28:03 -- scripts/common.sh@336 -- # read -ra ver2 00:23:00.208 02:28:03 -- scripts/common.sh@337 -- # local 'op=<' 00:23:00.208 02:28:03 -- scripts/common.sh@339 -- # ver1_l=2 00:23:00.208 02:28:03 -- scripts/common.sh@340 -- # ver2_l=1 00:23:00.208 02:28:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:00.208 02:28:03 -- scripts/common.sh@343 -- # case "$op" in 00:23:00.208 02:28:03 -- scripts/common.sh@344 -- # : 1 00:23:00.208 02:28:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:00.208 02:28:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:00.208 02:28:03 -- scripts/common.sh@364 -- # decimal 1 00:23:00.208 02:28:03 -- scripts/common.sh@352 -- # local d=1 00:23:00.208 02:28:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:00.208 02:28:03 -- scripts/common.sh@354 -- # echo 1 00:23:00.208 02:28:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:00.208 02:28:03 -- scripts/common.sh@365 -- # decimal 2 00:23:00.208 02:28:03 -- scripts/common.sh@352 -- # local d=2 00:23:00.208 02:28:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:00.208 02:28:03 -- scripts/common.sh@354 -- # echo 2 00:23:00.208 02:28:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:00.208 02:28:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:00.208 02:28:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:00.208 02:28:03 -- scripts/common.sh@367 -- # return 0 00:23:00.208 02:28:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:00.208 02:28:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:00.208 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:00.208 --rc genhtml_branch_coverage=1 00:23:00.208 --rc genhtml_function_coverage=1 00:23:00.208 --rc genhtml_legend=1 00:23:00.208 --rc geninfo_all_blocks=1 00:23:00.208 --rc geninfo_unexecuted_blocks=1 00:23:00.208 00:23:00.208 ' 00:23:00.208 02:28:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:00.208 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:00.208 --rc genhtml_branch_coverage=1 00:23:00.208 --rc genhtml_function_coverage=1 00:23:00.208 --rc genhtml_legend=1 00:23:00.208 --rc geninfo_all_blocks=1 00:23:00.208 --rc geninfo_unexecuted_blocks=1 00:23:00.208 00:23:00.208 ' 00:23:00.208 02:28:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:00.208 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:00.208 --rc genhtml_branch_coverage=1 00:23:00.208 --rc genhtml_function_coverage=1 00:23:00.208 --rc genhtml_legend=1 00:23:00.208 --rc geninfo_all_blocks=1 00:23:00.208 --rc geninfo_unexecuted_blocks=1 00:23:00.208 00:23:00.208 ' 00:23:00.208 02:28:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:00.208 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:00.208 --rc genhtml_branch_coverage=1 00:23:00.208 --rc genhtml_function_coverage=1 00:23:00.208 --rc genhtml_legend=1 00:23:00.208 --rc geninfo_all_blocks=1 00:23:00.208 --rc geninfo_unexecuted_blocks=1 00:23:00.208 00:23:00.208 ' 00:23:00.208 02:28:03 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:00.208 02:28:03 -- nvmf/common.sh@7 -- # uname -s 00:23:00.208 02:28:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:00.208 02:28:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:00.208 02:28:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:00.208 02:28:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:00.208 02:28:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:00.208 02:28:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:00.208 02:28:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:00.208 02:28:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:00.208 02:28:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:00.208 02:28:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:00.208 02:28:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:00.208 02:28:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:00.208 02:28:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:00.208 02:28:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:00.208 02:28:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:00.208 02:28:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:00.208 02:28:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:00.208 02:28:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:00.208 02:28:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:00.208 02:28:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.208 02:28:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.208 02:28:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.208 02:28:03 -- paths/export.sh@5 -- # export PATH 00:23:00.208 02:28:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.208 02:28:03 -- nvmf/common.sh@46 -- # : 0 00:23:00.208 02:28:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:00.208 02:28:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:00.208 02:28:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:00.208 02:28:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:00.208 02:28:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:00.208 02:28:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:00.208 02:28:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:00.208 02:28:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:00.208 02:28:03 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:23:00.208 02:28:03 -- host/async_init.sh@14 -- # null_block_size=512 00:23:00.208 02:28:03 -- host/async_init.sh@15 -- # null_bdev=null0 00:23:00.208 02:28:03 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:23:00.208 02:28:03 -- host/async_init.sh@20 -- # uuidgen 00:23:00.208 02:28:03 -- host/async_init.sh@20 -- # tr -d - 00:23:00.208 02:28:03 -- host/async_init.sh@20 -- # nguid=f04473e22e2e43f4b4c267ab48172678 00:23:00.208 02:28:03 -- host/async_init.sh@22 -- # nvmftestinit 00:23:00.208 02:28:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:00.208 02:28:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:00.208 02:28:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:00.208 02:28:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:00.208 02:28:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:00.208 02:28:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:00.208 02:28:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:00.208 02:28:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:00.208 02:28:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:00.208 02:28:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:00.208 02:28:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:00.208 02:28:03 -- common/autotest_common.sh@10 -- # set +x 00:23:02.110 02:28:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:02.110 02:28:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:02.110 02:28:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:02.110 02:28:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:02.110 02:28:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:02.110 02:28:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:02.110 02:28:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:02.110 02:28:05 -- nvmf/common.sh@294 -- # net_devs=() 00:23:02.110 02:28:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:02.110 02:28:05 -- nvmf/common.sh@295 -- # e810=() 00:23:02.110 02:28:05 -- nvmf/common.sh@295 -- # local -ga e810 00:23:02.110 02:28:05 -- nvmf/common.sh@296 -- # x722=() 00:23:02.110 02:28:05 -- nvmf/common.sh@296 -- # local -ga x722 00:23:02.110 02:28:05 -- nvmf/common.sh@297 -- # mlx=() 00:23:02.110 02:28:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:02.110 02:28:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:02.110 02:28:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:02.110 02:28:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:02.110 02:28:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:02.110 02:28:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:02.110 02:28:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:02.110 02:28:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:02.110 02:28:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:02.110 02:28:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:02.110 02:28:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:02.110 02:28:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:02.110 02:28:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:02.110 02:28:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:02.110 02:28:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:02.110 02:28:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:02.110 02:28:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:02.110 02:28:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:02.110 02:28:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:02.110 02:28:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:02.110 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:02.110 02:28:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:02.110 02:28:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:02.110 02:28:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:02.110 02:28:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:02.110 02:28:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:02.110 02:28:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:02.110 02:28:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:02.110 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:02.111 02:28:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:02.111 02:28:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:02.111 02:28:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:02.111 02:28:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:02.111 02:28:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:02.111 02:28:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:02.111 02:28:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:02.111 02:28:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:02.111 02:28:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:02.111 02:28:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:02.111 02:28:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:02.111 02:28:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:02.111 02:28:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:02.111 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:02.111 02:28:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:02.370 02:28:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:02.370 02:28:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:02.370 02:28:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:02.370 02:28:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:02.370 02:28:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:02.370 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:02.370 02:28:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:02.370 02:28:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:02.370 02:28:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:02.370 02:28:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:02.370 02:28:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:02.370 02:28:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:02.370 02:28:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:02.370 02:28:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:02.370 02:28:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:02.370 02:28:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:02.370 02:28:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:02.370 02:28:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:02.370 02:28:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:02.370 02:28:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:02.370 02:28:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:02.370 02:28:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:02.370 02:28:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:02.370 02:28:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:02.370 02:28:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:02.370 02:28:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:02.370 02:28:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:02.370 02:28:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:02.370 02:28:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:02.370 02:28:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:02.370 02:28:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:02.370 02:28:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:02.370 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:02.370 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.189 ms 00:23:02.370 00:23:02.370 --- 10.0.0.2 ping statistics --- 00:23:02.370 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:02.370 rtt min/avg/max/mdev = 0.189/0.189/0.189/0.000 ms 00:23:02.370 02:28:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:02.370 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:02.370 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.105 ms 00:23:02.370 00:23:02.370 --- 10.0.0.1 ping statistics --- 00:23:02.370 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:02.370 rtt min/avg/max/mdev = 0.105/0.105/0.105/0.000 ms 00:23:02.370 02:28:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:02.370 02:28:05 -- nvmf/common.sh@410 -- # return 0 00:23:02.370 02:28:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:02.370 02:28:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:02.370 02:28:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:02.370 02:28:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:02.370 02:28:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:02.370 02:28:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:02.370 02:28:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:02.370 02:28:05 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:23:02.370 02:28:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:02.370 02:28:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:02.370 02:28:05 -- common/autotest_common.sh@10 -- # set +x 00:23:02.370 02:28:05 -- nvmf/common.sh@469 -- # nvmfpid=191144 00:23:02.370 02:28:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:23:02.370 02:28:05 -- nvmf/common.sh@470 -- # waitforlisten 191144 00:23:02.370 02:28:05 -- common/autotest_common.sh@829 -- # '[' -z 191144 ']' 00:23:02.370 02:28:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:02.370 02:28:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:02.370 02:28:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:02.370 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:02.370 02:28:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:02.370 02:28:05 -- common/autotest_common.sh@10 -- # set +x 00:23:02.370 [2024-11-29 02:28:06.013258] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:02.370 [2024-11-29 02:28:06.013340] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:02.370 EAL: No free 2048 kB hugepages reported on node 1 00:23:02.629 [2024-11-29 02:28:06.080986] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:02.629 [2024-11-29 02:28:06.195725] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:02.629 [2024-11-29 02:28:06.195891] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:02.629 [2024-11-29 02:28:06.195910] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:02.629 [2024-11-29 02:28:06.195924] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:02.629 [2024-11-29 02:28:06.195965] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:03.566 02:28:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:03.566 02:28:06 -- common/autotest_common.sh@862 -- # return 0 00:23:03.566 02:28:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:03.566 02:28:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:03.566 02:28:06 -- common/autotest_common.sh@10 -- # set +x 00:23:03.566 02:28:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:03.566 02:28:06 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:23:03.566 02:28:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.566 02:28:06 -- common/autotest_common.sh@10 -- # set +x 00:23:03.566 [2024-11-29 02:28:07.000995] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:03.566 02:28:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.566 02:28:07 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:23:03.566 02:28:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.566 02:28:07 -- common/autotest_common.sh@10 -- # set +x 00:23:03.566 null0 00:23:03.566 02:28:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.566 02:28:07 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:23:03.566 02:28:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.566 02:28:07 -- common/autotest_common.sh@10 -- # set +x 00:23:03.566 02:28:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.566 02:28:07 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:23:03.566 02:28:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.566 02:28:07 -- common/autotest_common.sh@10 -- # set +x 00:23:03.566 02:28:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.566 02:28:07 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g f04473e22e2e43f4b4c267ab48172678 00:23:03.566 02:28:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.566 02:28:07 -- common/autotest_common.sh@10 -- # set +x 00:23:03.566 02:28:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.566 02:28:07 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:23:03.566 02:28:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.566 02:28:07 -- common/autotest_common.sh@10 -- # set +x 00:23:03.566 [2024-11-29 02:28:07.041231] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:03.566 02:28:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.566 02:28:07 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:23:03.566 02:28:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.566 02:28:07 -- common/autotest_common.sh@10 -- # set +x 00:23:03.827 nvme0n1 00:23:03.827 02:28:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.827 02:28:07 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:03.827 02:28:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.827 02:28:07 -- common/autotest_common.sh@10 -- # set +x 00:23:03.827 [ 00:23:03.827 { 00:23:03.827 "name": "nvme0n1", 00:23:03.827 "aliases": [ 00:23:03.827 "f04473e2-2e2e-43f4-b4c2-67ab48172678" 00:23:03.827 ], 00:23:03.827 "product_name": "NVMe disk", 00:23:03.827 "block_size": 512, 00:23:03.827 "num_blocks": 2097152, 00:23:03.827 "uuid": "f04473e2-2e2e-43f4-b4c2-67ab48172678", 00:23:03.827 "assigned_rate_limits": { 00:23:03.827 "rw_ios_per_sec": 0, 00:23:03.827 "rw_mbytes_per_sec": 0, 00:23:03.827 "r_mbytes_per_sec": 0, 00:23:03.827 "w_mbytes_per_sec": 0 00:23:03.827 }, 00:23:03.827 "claimed": false, 00:23:03.827 "zoned": false, 00:23:03.827 "supported_io_types": { 00:23:03.827 "read": true, 00:23:03.827 "write": true, 00:23:03.827 "unmap": false, 00:23:03.827 "write_zeroes": true, 00:23:03.827 "flush": true, 00:23:03.827 "reset": true, 00:23:03.827 "compare": true, 00:23:03.827 "compare_and_write": true, 00:23:03.827 "abort": true, 00:23:03.827 "nvme_admin": true, 00:23:03.827 "nvme_io": true 00:23:03.827 }, 00:23:03.827 "driver_specific": { 00:23:03.827 "nvme": [ 00:23:03.827 { 00:23:03.827 "trid": { 00:23:03.827 "trtype": "TCP", 00:23:03.827 "adrfam": "IPv4", 00:23:03.827 "traddr": "10.0.0.2", 00:23:03.827 "trsvcid": "4420", 00:23:03.827 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:03.827 }, 00:23:03.827 "ctrlr_data": { 00:23:03.827 "cntlid": 1, 00:23:03.827 "vendor_id": "0x8086", 00:23:03.827 "model_number": "SPDK bdev Controller", 00:23:03.827 "serial_number": "00000000000000000000", 00:23:03.827 "firmware_revision": "24.01.1", 00:23:03.827 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:03.827 "oacs": { 00:23:03.827 "security": 0, 00:23:03.827 "format": 0, 00:23:03.827 "firmware": 0, 00:23:03.827 "ns_manage": 0 00:23:03.827 }, 00:23:03.827 "multi_ctrlr": true, 00:23:03.827 "ana_reporting": false 00:23:03.827 }, 00:23:03.827 "vs": { 00:23:03.827 "nvme_version": "1.3" 00:23:03.827 }, 00:23:03.827 "ns_data": { 00:23:03.827 "id": 1, 00:23:03.827 "can_share": true 00:23:03.827 } 00:23:03.827 } 00:23:03.827 ], 00:23:03.827 "mp_policy": "active_passive" 00:23:03.827 } 00:23:03.827 } 00:23:03.827 ] 00:23:03.827 02:28:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.827 02:28:07 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:23:03.827 02:28:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.827 02:28:07 -- common/autotest_common.sh@10 -- # set +x 00:23:03.827 [2024-11-29 02:28:07.289939] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:23:03.827 [2024-11-29 02:28:07.290032] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10aaba0 (9): Bad file descriptor 00:23:03.827 [2024-11-29 02:28:07.422547] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:23:03.827 02:28:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.827 02:28:07 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:03.827 02:28:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.827 02:28:07 -- common/autotest_common.sh@10 -- # set +x 00:23:03.827 [ 00:23:03.827 { 00:23:03.827 "name": "nvme0n1", 00:23:03.827 "aliases": [ 00:23:03.827 "f04473e2-2e2e-43f4-b4c2-67ab48172678" 00:23:03.827 ], 00:23:03.827 "product_name": "NVMe disk", 00:23:03.827 "block_size": 512, 00:23:03.827 "num_blocks": 2097152, 00:23:03.827 "uuid": "f04473e2-2e2e-43f4-b4c2-67ab48172678", 00:23:03.827 "assigned_rate_limits": { 00:23:03.827 "rw_ios_per_sec": 0, 00:23:03.827 "rw_mbytes_per_sec": 0, 00:23:03.827 "r_mbytes_per_sec": 0, 00:23:03.827 "w_mbytes_per_sec": 0 00:23:03.827 }, 00:23:03.827 "claimed": false, 00:23:03.827 "zoned": false, 00:23:03.827 "supported_io_types": { 00:23:03.827 "read": true, 00:23:03.827 "write": true, 00:23:03.827 "unmap": false, 00:23:03.827 "write_zeroes": true, 00:23:03.827 "flush": true, 00:23:03.827 "reset": true, 00:23:03.827 "compare": true, 00:23:03.827 "compare_and_write": true, 00:23:03.827 "abort": true, 00:23:03.827 "nvme_admin": true, 00:23:03.827 "nvme_io": true 00:23:03.827 }, 00:23:03.827 "driver_specific": { 00:23:03.827 "nvme": [ 00:23:03.827 { 00:23:03.827 "trid": { 00:23:03.827 "trtype": "TCP", 00:23:03.827 "adrfam": "IPv4", 00:23:03.827 "traddr": "10.0.0.2", 00:23:03.827 "trsvcid": "4420", 00:23:03.828 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:03.828 }, 00:23:03.828 "ctrlr_data": { 00:23:03.828 "cntlid": 2, 00:23:03.828 "vendor_id": "0x8086", 00:23:03.828 "model_number": "SPDK bdev Controller", 00:23:03.828 "serial_number": "00000000000000000000", 00:23:03.828 "firmware_revision": "24.01.1", 00:23:03.828 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:03.828 "oacs": { 00:23:03.828 "security": 0, 00:23:03.828 "format": 0, 00:23:03.828 "firmware": 0, 00:23:03.828 "ns_manage": 0 00:23:03.828 }, 00:23:03.828 "multi_ctrlr": true, 00:23:03.828 "ana_reporting": false 00:23:03.828 }, 00:23:03.828 "vs": { 00:23:03.828 "nvme_version": "1.3" 00:23:03.828 }, 00:23:03.828 "ns_data": { 00:23:03.828 "id": 1, 00:23:03.828 "can_share": true 00:23:03.828 } 00:23:03.828 } 00:23:03.828 ], 00:23:03.828 "mp_policy": "active_passive" 00:23:03.828 } 00:23:03.828 } 00:23:03.828 ] 00:23:03.828 02:28:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.828 02:28:07 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:03.828 02:28:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.828 02:28:07 -- common/autotest_common.sh@10 -- # set +x 00:23:03.828 02:28:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.828 02:28:07 -- host/async_init.sh@53 -- # mktemp 00:23:03.828 02:28:07 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.tmoflZqmyP 00:23:03.828 02:28:07 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:23:03.828 02:28:07 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.tmoflZqmyP 00:23:03.828 02:28:07 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:23:03.828 02:28:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.828 02:28:07 -- common/autotest_common.sh@10 -- # set +x 00:23:03.828 02:28:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.828 02:28:07 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:23:03.828 02:28:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.828 02:28:07 -- common/autotest_common.sh@10 -- # set +x 00:23:03.828 [2024-11-29 02:28:07.470542] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:23:03.828 [2024-11-29 02:28:07.470664] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:23:03.828 02:28:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.828 02:28:07 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.tmoflZqmyP 00:23:03.828 02:28:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.828 02:28:07 -- common/autotest_common.sh@10 -- # set +x 00:23:03.828 02:28:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.828 02:28:07 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.tmoflZqmyP 00:23:03.828 02:28:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.828 02:28:07 -- common/autotest_common.sh@10 -- # set +x 00:23:03.828 [2024-11-29 02:28:07.486562] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:23:04.099 nvme0n1 00:23:04.099 02:28:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.100 02:28:07 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:04.100 02:28:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.100 02:28:07 -- common/autotest_common.sh@10 -- # set +x 00:23:04.100 [ 00:23:04.100 { 00:23:04.100 "name": "nvme0n1", 00:23:04.100 "aliases": [ 00:23:04.100 "f04473e2-2e2e-43f4-b4c2-67ab48172678" 00:23:04.100 ], 00:23:04.100 "product_name": "NVMe disk", 00:23:04.100 "block_size": 512, 00:23:04.100 "num_blocks": 2097152, 00:23:04.100 "uuid": "f04473e2-2e2e-43f4-b4c2-67ab48172678", 00:23:04.100 "assigned_rate_limits": { 00:23:04.100 "rw_ios_per_sec": 0, 00:23:04.100 "rw_mbytes_per_sec": 0, 00:23:04.100 "r_mbytes_per_sec": 0, 00:23:04.100 "w_mbytes_per_sec": 0 00:23:04.100 }, 00:23:04.100 "claimed": false, 00:23:04.100 "zoned": false, 00:23:04.100 "supported_io_types": { 00:23:04.100 "read": true, 00:23:04.100 "write": true, 00:23:04.100 "unmap": false, 00:23:04.100 "write_zeroes": true, 00:23:04.100 "flush": true, 00:23:04.100 "reset": true, 00:23:04.100 "compare": true, 00:23:04.100 "compare_and_write": true, 00:23:04.100 "abort": true, 00:23:04.100 "nvme_admin": true, 00:23:04.100 "nvme_io": true 00:23:04.100 }, 00:23:04.100 "driver_specific": { 00:23:04.100 "nvme": [ 00:23:04.100 { 00:23:04.100 "trid": { 00:23:04.100 "trtype": "TCP", 00:23:04.100 "adrfam": "IPv4", 00:23:04.100 "traddr": "10.0.0.2", 00:23:04.100 "trsvcid": "4421", 00:23:04.100 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:04.100 }, 00:23:04.100 "ctrlr_data": { 00:23:04.100 "cntlid": 3, 00:23:04.100 "vendor_id": "0x8086", 00:23:04.100 "model_number": "SPDK bdev Controller", 00:23:04.100 "serial_number": "00000000000000000000", 00:23:04.100 "firmware_revision": "24.01.1", 00:23:04.100 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:04.100 "oacs": { 00:23:04.100 "security": 0, 00:23:04.100 "format": 0, 00:23:04.100 "firmware": 0, 00:23:04.100 "ns_manage": 0 00:23:04.100 }, 00:23:04.100 "multi_ctrlr": true, 00:23:04.100 "ana_reporting": false 00:23:04.100 }, 00:23:04.100 "vs": { 00:23:04.100 "nvme_version": "1.3" 00:23:04.100 }, 00:23:04.100 "ns_data": { 00:23:04.100 "id": 1, 00:23:04.100 "can_share": true 00:23:04.100 } 00:23:04.100 } 00:23:04.100 ], 00:23:04.100 "mp_policy": "active_passive" 00:23:04.100 } 00:23:04.100 } 00:23:04.100 ] 00:23:04.100 02:28:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.100 02:28:07 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:04.100 02:28:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.100 02:28:07 -- common/autotest_common.sh@10 -- # set +x 00:23:04.100 02:28:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.100 02:28:07 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.tmoflZqmyP 00:23:04.100 02:28:07 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:23:04.100 02:28:07 -- host/async_init.sh@78 -- # nvmftestfini 00:23:04.100 02:28:07 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:04.100 02:28:07 -- nvmf/common.sh@116 -- # sync 00:23:04.100 02:28:07 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:04.100 02:28:07 -- nvmf/common.sh@119 -- # set +e 00:23:04.100 02:28:07 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:04.100 02:28:07 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:04.100 rmmod nvme_tcp 00:23:04.100 rmmod nvme_fabrics 00:23:04.100 rmmod nvme_keyring 00:23:04.100 02:28:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:04.100 02:28:07 -- nvmf/common.sh@123 -- # set -e 00:23:04.100 02:28:07 -- nvmf/common.sh@124 -- # return 0 00:23:04.100 02:28:07 -- nvmf/common.sh@477 -- # '[' -n 191144 ']' 00:23:04.100 02:28:07 -- nvmf/common.sh@478 -- # killprocess 191144 00:23:04.100 02:28:07 -- common/autotest_common.sh@936 -- # '[' -z 191144 ']' 00:23:04.100 02:28:07 -- common/autotest_common.sh@940 -- # kill -0 191144 00:23:04.100 02:28:07 -- common/autotest_common.sh@941 -- # uname 00:23:04.100 02:28:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:04.100 02:28:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 191144 00:23:04.100 02:28:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:04.100 02:28:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:04.100 02:28:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 191144' 00:23:04.100 killing process with pid 191144 00:23:04.100 02:28:07 -- common/autotest_common.sh@955 -- # kill 191144 00:23:04.100 02:28:07 -- common/autotest_common.sh@960 -- # wait 191144 00:23:04.398 02:28:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:04.398 02:28:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:04.398 02:28:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:04.398 02:28:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:04.398 02:28:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:04.398 02:28:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:04.398 02:28:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:04.398 02:28:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:06.364 02:28:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:06.364 00:23:06.364 real 0m6.332s 00:23:06.364 user 0m3.103s 00:23:06.364 sys 0m1.836s 00:23:06.364 02:28:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:06.364 02:28:09 -- common/autotest_common.sh@10 -- # set +x 00:23:06.364 ************************************ 00:23:06.364 END TEST nvmf_async_init 00:23:06.364 ************************************ 00:23:06.364 02:28:10 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:06.364 02:28:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:06.364 02:28:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:06.364 02:28:10 -- common/autotest_common.sh@10 -- # set +x 00:23:06.364 ************************************ 00:23:06.364 START TEST dma 00:23:06.364 ************************************ 00:23:06.364 02:28:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:06.624 * Looking for test storage... 00:23:06.624 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:06.624 02:28:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:06.624 02:28:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:06.624 02:28:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:06.624 02:28:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:06.624 02:28:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:06.624 02:28:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:06.624 02:28:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:06.624 02:28:10 -- scripts/common.sh@335 -- # IFS=.-: 00:23:06.624 02:28:10 -- scripts/common.sh@335 -- # read -ra ver1 00:23:06.624 02:28:10 -- scripts/common.sh@336 -- # IFS=.-: 00:23:06.624 02:28:10 -- scripts/common.sh@336 -- # read -ra ver2 00:23:06.624 02:28:10 -- scripts/common.sh@337 -- # local 'op=<' 00:23:06.624 02:28:10 -- scripts/common.sh@339 -- # ver1_l=2 00:23:06.624 02:28:10 -- scripts/common.sh@340 -- # ver2_l=1 00:23:06.624 02:28:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:06.624 02:28:10 -- scripts/common.sh@343 -- # case "$op" in 00:23:06.624 02:28:10 -- scripts/common.sh@344 -- # : 1 00:23:06.624 02:28:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:06.624 02:28:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:06.624 02:28:10 -- scripts/common.sh@364 -- # decimal 1 00:23:06.624 02:28:10 -- scripts/common.sh@352 -- # local d=1 00:23:06.624 02:28:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:06.624 02:28:10 -- scripts/common.sh@354 -- # echo 1 00:23:06.624 02:28:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:06.624 02:28:10 -- scripts/common.sh@365 -- # decimal 2 00:23:06.624 02:28:10 -- scripts/common.sh@352 -- # local d=2 00:23:06.624 02:28:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:06.624 02:28:10 -- scripts/common.sh@354 -- # echo 2 00:23:06.624 02:28:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:06.624 02:28:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:06.624 02:28:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:06.624 02:28:10 -- scripts/common.sh@367 -- # return 0 00:23:06.624 02:28:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:06.624 02:28:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:06.624 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:06.624 --rc genhtml_branch_coverage=1 00:23:06.624 --rc genhtml_function_coverage=1 00:23:06.624 --rc genhtml_legend=1 00:23:06.624 --rc geninfo_all_blocks=1 00:23:06.624 --rc geninfo_unexecuted_blocks=1 00:23:06.624 00:23:06.624 ' 00:23:06.624 02:28:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:06.624 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:06.624 --rc genhtml_branch_coverage=1 00:23:06.624 --rc genhtml_function_coverage=1 00:23:06.624 --rc genhtml_legend=1 00:23:06.624 --rc geninfo_all_blocks=1 00:23:06.624 --rc geninfo_unexecuted_blocks=1 00:23:06.624 00:23:06.624 ' 00:23:06.624 02:28:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:06.624 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:06.624 --rc genhtml_branch_coverage=1 00:23:06.624 --rc genhtml_function_coverage=1 00:23:06.624 --rc genhtml_legend=1 00:23:06.624 --rc geninfo_all_blocks=1 00:23:06.624 --rc geninfo_unexecuted_blocks=1 00:23:06.624 00:23:06.624 ' 00:23:06.624 02:28:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:06.624 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:06.624 --rc genhtml_branch_coverage=1 00:23:06.624 --rc genhtml_function_coverage=1 00:23:06.624 --rc genhtml_legend=1 00:23:06.624 --rc geninfo_all_blocks=1 00:23:06.624 --rc geninfo_unexecuted_blocks=1 00:23:06.624 00:23:06.624 ' 00:23:06.624 02:28:10 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:06.624 02:28:10 -- nvmf/common.sh@7 -- # uname -s 00:23:06.624 02:28:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:06.624 02:28:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:06.624 02:28:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:06.624 02:28:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:06.624 02:28:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:06.624 02:28:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:06.624 02:28:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:06.624 02:28:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:06.624 02:28:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:06.624 02:28:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:06.624 02:28:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:06.624 02:28:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:06.624 02:28:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:06.624 02:28:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:06.624 02:28:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:06.624 02:28:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:06.624 02:28:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:06.624 02:28:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:06.624 02:28:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:06.624 02:28:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:06.624 02:28:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:06.624 02:28:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:06.624 02:28:10 -- paths/export.sh@5 -- # export PATH 00:23:06.624 02:28:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:06.624 02:28:10 -- nvmf/common.sh@46 -- # : 0 00:23:06.624 02:28:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:06.624 02:28:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:06.624 02:28:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:06.624 02:28:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:06.624 02:28:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:06.624 02:28:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:06.624 02:28:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:06.624 02:28:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:06.624 02:28:10 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:23:06.624 02:28:10 -- host/dma.sh@13 -- # exit 0 00:23:06.624 00:23:06.624 real 0m0.156s 00:23:06.624 user 0m0.109s 00:23:06.624 sys 0m0.057s 00:23:06.624 02:28:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:06.624 02:28:10 -- common/autotest_common.sh@10 -- # set +x 00:23:06.624 ************************************ 00:23:06.624 END TEST dma 00:23:06.624 ************************************ 00:23:06.624 02:28:10 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:06.624 02:28:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:06.624 02:28:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:06.624 02:28:10 -- common/autotest_common.sh@10 -- # set +x 00:23:06.624 ************************************ 00:23:06.624 START TEST nvmf_identify 00:23:06.624 ************************************ 00:23:06.624 02:28:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:06.624 * Looking for test storage... 00:23:06.624 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:06.624 02:28:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:06.624 02:28:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:06.625 02:28:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:06.884 02:28:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:06.884 02:28:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:06.884 02:28:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:06.884 02:28:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:06.884 02:28:10 -- scripts/common.sh@335 -- # IFS=.-: 00:23:06.884 02:28:10 -- scripts/common.sh@335 -- # read -ra ver1 00:23:06.884 02:28:10 -- scripts/common.sh@336 -- # IFS=.-: 00:23:06.884 02:28:10 -- scripts/common.sh@336 -- # read -ra ver2 00:23:06.884 02:28:10 -- scripts/common.sh@337 -- # local 'op=<' 00:23:06.884 02:28:10 -- scripts/common.sh@339 -- # ver1_l=2 00:23:06.884 02:28:10 -- scripts/common.sh@340 -- # ver2_l=1 00:23:06.884 02:28:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:06.884 02:28:10 -- scripts/common.sh@343 -- # case "$op" in 00:23:06.884 02:28:10 -- scripts/common.sh@344 -- # : 1 00:23:06.884 02:28:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:06.884 02:28:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:06.884 02:28:10 -- scripts/common.sh@364 -- # decimal 1 00:23:06.884 02:28:10 -- scripts/common.sh@352 -- # local d=1 00:23:06.884 02:28:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:06.884 02:28:10 -- scripts/common.sh@354 -- # echo 1 00:23:06.884 02:28:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:06.884 02:28:10 -- scripts/common.sh@365 -- # decimal 2 00:23:06.884 02:28:10 -- scripts/common.sh@352 -- # local d=2 00:23:06.884 02:28:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:06.884 02:28:10 -- scripts/common.sh@354 -- # echo 2 00:23:06.884 02:28:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:06.884 02:28:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:06.884 02:28:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:06.884 02:28:10 -- scripts/common.sh@367 -- # return 0 00:23:06.884 02:28:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:06.884 02:28:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:06.884 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:06.884 --rc genhtml_branch_coverage=1 00:23:06.884 --rc genhtml_function_coverage=1 00:23:06.884 --rc genhtml_legend=1 00:23:06.884 --rc geninfo_all_blocks=1 00:23:06.884 --rc geninfo_unexecuted_blocks=1 00:23:06.884 00:23:06.884 ' 00:23:06.884 02:28:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:06.884 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:06.884 --rc genhtml_branch_coverage=1 00:23:06.884 --rc genhtml_function_coverage=1 00:23:06.884 --rc genhtml_legend=1 00:23:06.884 --rc geninfo_all_blocks=1 00:23:06.884 --rc geninfo_unexecuted_blocks=1 00:23:06.884 00:23:06.884 ' 00:23:06.884 02:28:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:06.884 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:06.884 --rc genhtml_branch_coverage=1 00:23:06.884 --rc genhtml_function_coverage=1 00:23:06.884 --rc genhtml_legend=1 00:23:06.884 --rc geninfo_all_blocks=1 00:23:06.884 --rc geninfo_unexecuted_blocks=1 00:23:06.884 00:23:06.884 ' 00:23:06.884 02:28:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:06.884 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:06.884 --rc genhtml_branch_coverage=1 00:23:06.884 --rc genhtml_function_coverage=1 00:23:06.884 --rc genhtml_legend=1 00:23:06.884 --rc geninfo_all_blocks=1 00:23:06.884 --rc geninfo_unexecuted_blocks=1 00:23:06.884 00:23:06.884 ' 00:23:06.884 02:28:10 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:06.884 02:28:10 -- nvmf/common.sh@7 -- # uname -s 00:23:06.884 02:28:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:06.884 02:28:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:06.884 02:28:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:06.884 02:28:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:06.884 02:28:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:06.884 02:28:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:06.884 02:28:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:06.884 02:28:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:06.884 02:28:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:06.884 02:28:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:06.884 02:28:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:06.884 02:28:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:06.884 02:28:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:06.884 02:28:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:06.884 02:28:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:06.884 02:28:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:06.884 02:28:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:06.884 02:28:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:06.884 02:28:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:06.884 02:28:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:06.884 02:28:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:06.884 02:28:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:06.884 02:28:10 -- paths/export.sh@5 -- # export PATH 00:23:06.884 02:28:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:06.884 02:28:10 -- nvmf/common.sh@46 -- # : 0 00:23:06.884 02:28:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:06.884 02:28:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:06.884 02:28:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:06.884 02:28:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:06.884 02:28:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:06.884 02:28:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:06.884 02:28:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:06.884 02:28:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:06.884 02:28:10 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:06.884 02:28:10 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:06.884 02:28:10 -- host/identify.sh@14 -- # nvmftestinit 00:23:06.884 02:28:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:06.884 02:28:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:06.884 02:28:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:06.884 02:28:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:06.884 02:28:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:06.884 02:28:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:06.884 02:28:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:06.885 02:28:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:06.885 02:28:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:06.885 02:28:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:06.885 02:28:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:06.885 02:28:10 -- common/autotest_common.sh@10 -- # set +x 00:23:09.419 02:28:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:09.420 02:28:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:09.420 02:28:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:09.420 02:28:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:09.420 02:28:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:09.420 02:28:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:09.420 02:28:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:09.420 02:28:12 -- nvmf/common.sh@294 -- # net_devs=() 00:23:09.420 02:28:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:09.420 02:28:12 -- nvmf/common.sh@295 -- # e810=() 00:23:09.420 02:28:12 -- nvmf/common.sh@295 -- # local -ga e810 00:23:09.420 02:28:12 -- nvmf/common.sh@296 -- # x722=() 00:23:09.420 02:28:12 -- nvmf/common.sh@296 -- # local -ga x722 00:23:09.420 02:28:12 -- nvmf/common.sh@297 -- # mlx=() 00:23:09.420 02:28:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:09.420 02:28:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:09.420 02:28:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:09.420 02:28:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:09.420 02:28:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:09.420 02:28:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:09.420 02:28:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:09.420 02:28:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:09.420 02:28:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:09.420 02:28:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:09.420 02:28:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:09.420 02:28:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:09.420 02:28:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:09.420 02:28:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:09.420 02:28:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:09.420 02:28:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:09.420 02:28:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:09.420 02:28:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:09.420 02:28:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:09.420 02:28:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:09.420 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:09.420 02:28:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:09.420 02:28:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:09.420 02:28:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:09.420 02:28:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:09.420 02:28:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:09.420 02:28:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:09.420 02:28:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:09.420 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:09.420 02:28:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:09.420 02:28:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:09.420 02:28:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:09.420 02:28:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:09.420 02:28:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:09.420 02:28:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:09.420 02:28:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:09.420 02:28:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:09.420 02:28:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:09.420 02:28:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:09.420 02:28:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:09.420 02:28:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:09.420 02:28:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:09.420 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:09.420 02:28:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:09.420 02:28:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:09.420 02:28:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:09.420 02:28:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:09.420 02:28:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:09.420 02:28:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:09.420 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:09.420 02:28:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:09.420 02:28:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:09.420 02:28:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:09.420 02:28:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:09.420 02:28:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:09.420 02:28:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:09.420 02:28:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:09.420 02:28:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:09.420 02:28:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:09.420 02:28:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:09.420 02:28:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:09.420 02:28:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:09.420 02:28:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:09.420 02:28:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:09.420 02:28:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:09.420 02:28:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:09.420 02:28:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:09.420 02:28:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:09.420 02:28:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:09.420 02:28:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:09.420 02:28:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:09.420 02:28:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:09.420 02:28:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:09.420 02:28:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:09.420 02:28:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:09.420 02:28:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:09.420 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:09.420 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.137 ms 00:23:09.420 00:23:09.420 --- 10.0.0.2 ping statistics --- 00:23:09.420 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:09.420 rtt min/avg/max/mdev = 0.137/0.137/0.137/0.000 ms 00:23:09.420 02:28:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:09.420 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:09.420 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:23:09.420 00:23:09.420 --- 10.0.0.1 ping statistics --- 00:23:09.420 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:09.420 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:23:09.420 02:28:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:09.420 02:28:12 -- nvmf/common.sh@410 -- # return 0 00:23:09.420 02:28:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:09.420 02:28:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:09.420 02:28:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:09.420 02:28:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:09.420 02:28:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:09.420 02:28:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:09.420 02:28:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:09.420 02:28:12 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:23:09.420 02:28:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:09.420 02:28:12 -- common/autotest_common.sh@10 -- # set +x 00:23:09.420 02:28:12 -- host/identify.sh@19 -- # nvmfpid=193453 00:23:09.420 02:28:12 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:09.420 02:28:12 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:09.420 02:28:12 -- host/identify.sh@23 -- # waitforlisten 193453 00:23:09.420 02:28:12 -- common/autotest_common.sh@829 -- # '[' -z 193453 ']' 00:23:09.420 02:28:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:09.420 02:28:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:09.420 02:28:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:09.420 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:09.420 02:28:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:09.420 02:28:12 -- common/autotest_common.sh@10 -- # set +x 00:23:09.420 [2024-11-29 02:28:12.732890] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:09.420 [2024-11-29 02:28:12.732983] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:09.420 EAL: No free 2048 kB hugepages reported on node 1 00:23:09.420 [2024-11-29 02:28:12.799786] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:09.420 [2024-11-29 02:28:12.909794] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:09.420 [2024-11-29 02:28:12.909951] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:09.420 [2024-11-29 02:28:12.909969] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:09.420 [2024-11-29 02:28:12.909981] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:09.420 [2024-11-29 02:28:12.910034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:09.420 [2024-11-29 02:28:12.910092] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:09.420 [2024-11-29 02:28:12.910158] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:09.420 [2024-11-29 02:28:12.910161] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:10.362 02:28:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:10.362 02:28:13 -- common/autotest_common.sh@862 -- # return 0 00:23:10.362 02:28:13 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:10.362 02:28:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.362 02:28:13 -- common/autotest_common.sh@10 -- # set +x 00:23:10.362 [2024-11-29 02:28:13.719998] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:10.362 02:28:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.362 02:28:13 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:23:10.362 02:28:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:10.362 02:28:13 -- common/autotest_common.sh@10 -- # set +x 00:23:10.362 02:28:13 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:10.362 02:28:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.362 02:28:13 -- common/autotest_common.sh@10 -- # set +x 00:23:10.362 Malloc0 00:23:10.362 02:28:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.362 02:28:13 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:10.362 02:28:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.362 02:28:13 -- common/autotest_common.sh@10 -- # set +x 00:23:10.362 02:28:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.362 02:28:13 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:23:10.362 02:28:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.362 02:28:13 -- common/autotest_common.sh@10 -- # set +x 00:23:10.362 02:28:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.362 02:28:13 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:10.362 02:28:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.362 02:28:13 -- common/autotest_common.sh@10 -- # set +x 00:23:10.362 [2024-11-29 02:28:13.791992] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:10.362 02:28:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.362 02:28:13 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:10.362 02:28:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.362 02:28:13 -- common/autotest_common.sh@10 -- # set +x 00:23:10.362 02:28:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.362 02:28:13 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:23:10.362 02:28:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.362 02:28:13 -- common/autotest_common.sh@10 -- # set +x 00:23:10.362 [2024-11-29 02:28:13.807707] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:10.362 [ 00:23:10.362 { 00:23:10.362 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:10.362 "subtype": "Discovery", 00:23:10.362 "listen_addresses": [ 00:23:10.362 { 00:23:10.362 "transport": "TCP", 00:23:10.362 "trtype": "TCP", 00:23:10.362 "adrfam": "IPv4", 00:23:10.362 "traddr": "10.0.0.2", 00:23:10.362 "trsvcid": "4420" 00:23:10.362 } 00:23:10.362 ], 00:23:10.362 "allow_any_host": true, 00:23:10.362 "hosts": [] 00:23:10.362 }, 00:23:10.362 { 00:23:10.362 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:10.362 "subtype": "NVMe", 00:23:10.362 "listen_addresses": [ 00:23:10.362 { 00:23:10.362 "transport": "TCP", 00:23:10.362 "trtype": "TCP", 00:23:10.362 "adrfam": "IPv4", 00:23:10.362 "traddr": "10.0.0.2", 00:23:10.362 "trsvcid": "4420" 00:23:10.362 } 00:23:10.362 ], 00:23:10.362 "allow_any_host": true, 00:23:10.362 "hosts": [], 00:23:10.362 "serial_number": "SPDK00000000000001", 00:23:10.362 "model_number": "SPDK bdev Controller", 00:23:10.362 "max_namespaces": 32, 00:23:10.362 "min_cntlid": 1, 00:23:10.362 "max_cntlid": 65519, 00:23:10.362 "namespaces": [ 00:23:10.362 { 00:23:10.362 "nsid": 1, 00:23:10.362 "bdev_name": "Malloc0", 00:23:10.362 "name": "Malloc0", 00:23:10.362 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:23:10.362 "eui64": "ABCDEF0123456789", 00:23:10.362 "uuid": "7b83d5ae-fdc9-457d-be95-ba46f379dd8d" 00:23:10.362 } 00:23:10.362 ] 00:23:10.362 } 00:23:10.362 ] 00:23:10.362 02:28:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.362 02:28:13 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:23:10.362 [2024-11-29 02:28:13.829284] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:10.363 [2024-11-29 02:28:13.829322] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid193613 ] 00:23:10.363 EAL: No free 2048 kB hugepages reported on node 1 00:23:10.363 [2024-11-29 02:28:13.862640] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:23:10.363 [2024-11-29 02:28:13.862696] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:10.363 [2024-11-29 02:28:13.862706] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:10.363 [2024-11-29 02:28:13.862722] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:10.363 [2024-11-29 02:28:13.862750] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:10.363 [2024-11-29 02:28:13.863065] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:23:10.363 [2024-11-29 02:28:13.863123] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x14d2e10 0 00:23:10.363 [2024-11-29 02:28:13.877407] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:10.363 [2024-11-29 02:28:13.877431] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:10.363 [2024-11-29 02:28:13.877441] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:10.363 [2024-11-29 02:28:13.877447] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:10.363 [2024-11-29 02:28:13.877500] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.363 [2024-11-29 02:28:13.877513] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.363 [2024-11-29 02:28:13.877520] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x14d2e10) 00:23:10.363 [2024-11-29 02:28:13.877540] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:10.363 [2024-11-29 02:28:13.877569] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552b30, cid 0, qid 0 00:23:10.363 [2024-11-29 02:28:13.885410] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.363 [2024-11-29 02:28:13.885428] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.363 [2024-11-29 02:28:13.885436] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.363 [2024-11-29 02:28:13.885444] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1552b30) on tqpair=0x14d2e10 00:23:10.363 [2024-11-29 02:28:13.885462] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:10.363 [2024-11-29 02:28:13.885473] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:23:10.363 [2024-11-29 02:28:13.885483] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:23:10.363 [2024-11-29 02:28:13.885503] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.363 [2024-11-29 02:28:13.885512] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.363 [2024-11-29 02:28:13.885518] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x14d2e10) 00:23:10.363 [2024-11-29 02:28:13.885530] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.363 [2024-11-29 02:28:13.885560] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552b30, cid 0, qid 0 00:23:10.363 [2024-11-29 02:28:13.885749] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.363 [2024-11-29 02:28:13.885764] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.363 [2024-11-29 02:28:13.885771] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.363 [2024-11-29 02:28:13.885778] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1552b30) on tqpair=0x14d2e10 00:23:10.363 [2024-11-29 02:28:13.885789] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:23:10.363 [2024-11-29 02:28:13.885802] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:23:10.363 [2024-11-29 02:28:13.885815] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.363 [2024-11-29 02:28:13.885823] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.363 [2024-11-29 02:28:13.885829] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x14d2e10) 00:23:10.363 [2024-11-29 02:28:13.885840] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.363 [2024-11-29 02:28:13.885876] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552b30, cid 0, qid 0 00:23:10.363 [2024-11-29 02:28:13.885972] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.363 [2024-11-29 02:28:13.885987] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.363 [2024-11-29 02:28:13.885993] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.363 [2024-11-29 02:28:13.886000] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1552b30) on tqpair=0x14d2e10 00:23:10.363 [2024-11-29 02:28:13.886010] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:23:10.363 [2024-11-29 02:28:13.886024] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:23:10.363 [2024-11-29 02:28:13.886037] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.363 [2024-11-29 02:28:13.886044] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.363 [2024-11-29 02:28:13.886051] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x14d2e10) 00:23:10.363 [2024-11-29 02:28:13.886061] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.363 [2024-11-29 02:28:13.886083] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552b30, cid 0, qid 0 00:23:10.363 [2024-11-29 02:28:13.886165] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.363 [2024-11-29 02:28:13.886179] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.363 [2024-11-29 02:28:13.886186] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.363 [2024-11-29 02:28:13.886193] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1552b30) on tqpair=0x14d2e10 00:23:10.363 [2024-11-29 02:28:13.886203] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:10.363 [2024-11-29 02:28:13.886220] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.363 [2024-11-29 02:28:13.886229] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.363 [2024-11-29 02:28:13.886235] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x14d2e10) 00:23:10.363 [2024-11-29 02:28:13.886246] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.363 [2024-11-29 02:28:13.886267] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552b30, cid 0, qid 0 00:23:10.363 [2024-11-29 02:28:13.886364] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.363 [2024-11-29 02:28:13.886380] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.363 [2024-11-29 02:28:13.886388] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.363 [2024-11-29 02:28:13.886403] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1552b30) on tqpair=0x14d2e10 00:23:10.363 [2024-11-29 02:28:13.886414] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:23:10.363 [2024-11-29 02:28:13.886423] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:23:10.363 [2024-11-29 02:28:13.886436] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:10.363 [2024-11-29 02:28:13.886547] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:23:10.363 [2024-11-29 02:28:13.886555] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:10.363 [2024-11-29 02:28:13.886570] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.363 [2024-11-29 02:28:13.886578] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.363 [2024-11-29 02:28:13.886584] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x14d2e10) 00:23:10.363 [2024-11-29 02:28:13.886595] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.363 [2024-11-29 02:28:13.886617] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552b30, cid 0, qid 0 00:23:10.363 [2024-11-29 02:28:13.886746] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.363 [2024-11-29 02:28:13.886759] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.363 [2024-11-29 02:28:13.886765] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.363 [2024-11-29 02:28:13.886772] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1552b30) on tqpair=0x14d2e10 00:23:10.363 [2024-11-29 02:28:13.886782] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:10.363 [2024-11-29 02:28:13.886797] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.363 [2024-11-29 02:28:13.886806] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.363 [2024-11-29 02:28:13.886813] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x14d2e10) 00:23:10.363 [2024-11-29 02:28:13.886823] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.363 [2024-11-29 02:28:13.886845] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552b30, cid 0, qid 0 00:23:10.363 [2024-11-29 02:28:13.886926] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.363 [2024-11-29 02:28:13.886941] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.363 [2024-11-29 02:28:13.886947] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.363 [2024-11-29 02:28:13.886954] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1552b30) on tqpair=0x14d2e10 00:23:10.363 [2024-11-29 02:28:13.886963] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:10.363 [2024-11-29 02:28:13.886971] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:23:10.363 [2024-11-29 02:28:13.886984] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:23:10.363 [2024-11-29 02:28:13.886999] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:23:10.363 [2024-11-29 02:28:13.887019] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.363 [2024-11-29 02:28:13.887027] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.363 [2024-11-29 02:28:13.887033] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x14d2e10) 00:23:10.363 [2024-11-29 02:28:13.887045] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.363 [2024-11-29 02:28:13.887067] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552b30, cid 0, qid 0 00:23:10.364 [2024-11-29 02:28:13.887219] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.364 [2024-11-29 02:28:13.887234] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.364 [2024-11-29 02:28:13.887241] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.887248] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x14d2e10): datao=0, datal=4096, cccid=0 00:23:10.364 [2024-11-29 02:28:13.887256] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1552b30) on tqpair(0x14d2e10): expected_datao=0, payload_size=4096 00:23:10.364 [2024-11-29 02:28:13.887268] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.887277] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.887303] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.364 [2024-11-29 02:28:13.887315] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.364 [2024-11-29 02:28:13.887322] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.887329] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1552b30) on tqpair=0x14d2e10 00:23:10.364 [2024-11-29 02:28:13.887343] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:23:10.364 [2024-11-29 02:28:13.887352] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:23:10.364 [2024-11-29 02:28:13.887360] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:23:10.364 [2024-11-29 02:28:13.887369] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:23:10.364 [2024-11-29 02:28:13.887376] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:23:10.364 [2024-11-29 02:28:13.887384] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:23:10.364 [2024-11-29 02:28:13.887412] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:23:10.364 [2024-11-29 02:28:13.887427] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.887435] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.887441] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x14d2e10) 00:23:10.364 [2024-11-29 02:28:13.887452] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:10.364 [2024-11-29 02:28:13.887475] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552b30, cid 0, qid 0 00:23:10.364 [2024-11-29 02:28:13.887608] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.364 [2024-11-29 02:28:13.887623] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.364 [2024-11-29 02:28:13.887630] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.887637] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1552b30) on tqpair=0x14d2e10 00:23:10.364 [2024-11-29 02:28:13.887651] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.887658] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.887669] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x14d2e10) 00:23:10.364 [2024-11-29 02:28:13.887679] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.364 [2024-11-29 02:28:13.887690] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.887698] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.887704] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x14d2e10) 00:23:10.364 [2024-11-29 02:28:13.887713] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.364 [2024-11-29 02:28:13.887723] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.887730] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.887736] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x14d2e10) 00:23:10.364 [2024-11-29 02:28:13.887745] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.364 [2024-11-29 02:28:13.887756] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.887763] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.887769] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14d2e10) 00:23:10.364 [2024-11-29 02:28:13.887778] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.364 [2024-11-29 02:28:13.887787] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:23:10.364 [2024-11-29 02:28:13.887807] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:10.364 [2024-11-29 02:28:13.887820] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.887843] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.887850] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x14d2e10) 00:23:10.364 [2024-11-29 02:28:13.887860] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.364 [2024-11-29 02:28:13.887884] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552b30, cid 0, qid 0 00:23:10.364 [2024-11-29 02:28:13.887910] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552c90, cid 1, qid 0 00:23:10.364 [2024-11-29 02:28:13.887918] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552df0, cid 2, qid 0 00:23:10.364 [2024-11-29 02:28:13.887926] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552f50, cid 3, qid 0 00:23:10.364 [2024-11-29 02:28:13.887933] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15530b0, cid 4, qid 0 00:23:10.364 [2024-11-29 02:28:13.888112] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.364 [2024-11-29 02:28:13.888124] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.364 [2024-11-29 02:28:13.888130] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.888137] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15530b0) on tqpair=0x14d2e10 00:23:10.364 [2024-11-29 02:28:13.888148] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:23:10.364 [2024-11-29 02:28:13.888156] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:23:10.364 [2024-11-29 02:28:13.888174] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.888183] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.888193] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x14d2e10) 00:23:10.364 [2024-11-29 02:28:13.888204] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.364 [2024-11-29 02:28:13.888226] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15530b0, cid 4, qid 0 00:23:10.364 [2024-11-29 02:28:13.888354] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.364 [2024-11-29 02:28:13.888370] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.364 [2024-11-29 02:28:13.888377] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.888383] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x14d2e10): datao=0, datal=4096, cccid=4 00:23:10.364 [2024-11-29 02:28:13.888391] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x15530b0) on tqpair(0x14d2e10): expected_datao=0, payload_size=4096 00:23:10.364 [2024-11-29 02:28:13.888418] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.888427] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.928536] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.364 [2024-11-29 02:28:13.928559] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.364 [2024-11-29 02:28:13.928567] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.928574] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15530b0) on tqpair=0x14d2e10 00:23:10.364 [2024-11-29 02:28:13.928596] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:23:10.364 [2024-11-29 02:28:13.928636] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.928647] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.928654] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x14d2e10) 00:23:10.364 [2024-11-29 02:28:13.928666] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.364 [2024-11-29 02:28:13.928679] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.928686] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.928693] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x14d2e10) 00:23:10.364 [2024-11-29 02:28:13.928702] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.364 [2024-11-29 02:28:13.928732] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15530b0, cid 4, qid 0 00:23:10.364 [2024-11-29 02:28:13.928760] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1553210, cid 5, qid 0 00:23:10.364 [2024-11-29 02:28:13.928945] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.364 [2024-11-29 02:28:13.928961] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.364 [2024-11-29 02:28:13.928968] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.928974] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x14d2e10): datao=0, datal=1024, cccid=4 00:23:10.364 [2024-11-29 02:28:13.928982] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x15530b0) on tqpair(0x14d2e10): expected_datao=0, payload_size=1024 00:23:10.364 [2024-11-29 02:28:13.928993] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.929000] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.929009] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.364 [2024-11-29 02:28:13.929018] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.364 [2024-11-29 02:28:13.929024] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.929031] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1553210) on tqpair=0x14d2e10 00:23:10.364 [2024-11-29 02:28:13.973426] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.364 [2024-11-29 02:28:13.973444] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.364 [2024-11-29 02:28:13.973451] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.364 [2024-11-29 02:28:13.973458] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15530b0) on tqpair=0x14d2e10 00:23:10.365 [2024-11-29 02:28:13.973478] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.365 [2024-11-29 02:28:13.973487] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.365 [2024-11-29 02:28:13.973493] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x14d2e10) 00:23:10.365 [2024-11-29 02:28:13.973504] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.365 [2024-11-29 02:28:13.973534] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15530b0, cid 4, qid 0 00:23:10.365 [2024-11-29 02:28:13.973691] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.365 [2024-11-29 02:28:13.973708] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.365 [2024-11-29 02:28:13.973714] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.365 [2024-11-29 02:28:13.973721] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x14d2e10): datao=0, datal=3072, cccid=4 00:23:10.365 [2024-11-29 02:28:13.973729] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x15530b0) on tqpair(0x14d2e10): expected_datao=0, payload_size=3072 00:23:10.365 [2024-11-29 02:28:13.973740] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.365 [2024-11-29 02:28:13.973747] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.365 [2024-11-29 02:28:13.973759] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.365 [2024-11-29 02:28:13.973769] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.365 [2024-11-29 02:28:13.973775] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.365 [2024-11-29 02:28:13.973782] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15530b0) on tqpair=0x14d2e10 00:23:10.365 [2024-11-29 02:28:13.973798] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.365 [2024-11-29 02:28:13.973807] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.365 [2024-11-29 02:28:13.973813] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x14d2e10) 00:23:10.365 [2024-11-29 02:28:13.973824] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.365 [2024-11-29 02:28:13.973867] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15530b0, cid 4, qid 0 00:23:10.365 [2024-11-29 02:28:13.974003] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.365 [2024-11-29 02:28:13.974016] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.365 [2024-11-29 02:28:13.974023] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.365 [2024-11-29 02:28:13.974029] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x14d2e10): datao=0, datal=8, cccid=4 00:23:10.365 [2024-11-29 02:28:13.974037] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x15530b0) on tqpair(0x14d2e10): expected_datao=0, payload_size=8 00:23:10.365 [2024-11-29 02:28:13.974047] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.365 [2024-11-29 02:28:13.974055] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.365 [2024-11-29 02:28:14.014553] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.365 [2024-11-29 02:28:14.014572] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.365 [2024-11-29 02:28:14.014580] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.365 [2024-11-29 02:28:14.014587] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15530b0) on tqpair=0x14d2e10 00:23:10.365 ===================================================== 00:23:10.365 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:23:10.365 ===================================================== 00:23:10.365 Controller Capabilities/Features 00:23:10.365 ================================ 00:23:10.365 Vendor ID: 0000 00:23:10.365 Subsystem Vendor ID: 0000 00:23:10.365 Serial Number: .................... 00:23:10.365 Model Number: ........................................ 00:23:10.365 Firmware Version: 24.01.1 00:23:10.365 Recommended Arb Burst: 0 00:23:10.365 IEEE OUI Identifier: 00 00 00 00:23:10.365 Multi-path I/O 00:23:10.365 May have multiple subsystem ports: No 00:23:10.365 May have multiple controllers: No 00:23:10.365 Associated with SR-IOV VF: No 00:23:10.365 Max Data Transfer Size: 131072 00:23:10.365 Max Number of Namespaces: 0 00:23:10.365 Max Number of I/O Queues: 1024 00:23:10.365 NVMe Specification Version (VS): 1.3 00:23:10.365 NVMe Specification Version (Identify): 1.3 00:23:10.365 Maximum Queue Entries: 128 00:23:10.365 Contiguous Queues Required: Yes 00:23:10.365 Arbitration Mechanisms Supported 00:23:10.365 Weighted Round Robin: Not Supported 00:23:10.365 Vendor Specific: Not Supported 00:23:10.365 Reset Timeout: 15000 ms 00:23:10.365 Doorbell Stride: 4 bytes 00:23:10.365 NVM Subsystem Reset: Not Supported 00:23:10.365 Command Sets Supported 00:23:10.365 NVM Command Set: Supported 00:23:10.365 Boot Partition: Not Supported 00:23:10.365 Memory Page Size Minimum: 4096 bytes 00:23:10.365 Memory Page Size Maximum: 4096 bytes 00:23:10.365 Persistent Memory Region: Not Supported 00:23:10.365 Optional Asynchronous Events Supported 00:23:10.365 Namespace Attribute Notices: Not Supported 00:23:10.365 Firmware Activation Notices: Not Supported 00:23:10.365 ANA Change Notices: Not Supported 00:23:10.365 PLE Aggregate Log Change Notices: Not Supported 00:23:10.365 LBA Status Info Alert Notices: Not Supported 00:23:10.365 EGE Aggregate Log Change Notices: Not Supported 00:23:10.365 Normal NVM Subsystem Shutdown event: Not Supported 00:23:10.365 Zone Descriptor Change Notices: Not Supported 00:23:10.365 Discovery Log Change Notices: Supported 00:23:10.365 Controller Attributes 00:23:10.365 128-bit Host Identifier: Not Supported 00:23:10.365 Non-Operational Permissive Mode: Not Supported 00:23:10.365 NVM Sets: Not Supported 00:23:10.365 Read Recovery Levels: Not Supported 00:23:10.365 Endurance Groups: Not Supported 00:23:10.365 Predictable Latency Mode: Not Supported 00:23:10.365 Traffic Based Keep ALive: Not Supported 00:23:10.365 Namespace Granularity: Not Supported 00:23:10.365 SQ Associations: Not Supported 00:23:10.365 UUID List: Not Supported 00:23:10.365 Multi-Domain Subsystem: Not Supported 00:23:10.365 Fixed Capacity Management: Not Supported 00:23:10.365 Variable Capacity Management: Not Supported 00:23:10.365 Delete Endurance Group: Not Supported 00:23:10.365 Delete NVM Set: Not Supported 00:23:10.365 Extended LBA Formats Supported: Not Supported 00:23:10.365 Flexible Data Placement Supported: Not Supported 00:23:10.365 00:23:10.365 Controller Memory Buffer Support 00:23:10.365 ================================ 00:23:10.365 Supported: No 00:23:10.365 00:23:10.365 Persistent Memory Region Support 00:23:10.365 ================================ 00:23:10.365 Supported: No 00:23:10.365 00:23:10.365 Admin Command Set Attributes 00:23:10.365 ============================ 00:23:10.365 Security Send/Receive: Not Supported 00:23:10.365 Format NVM: Not Supported 00:23:10.365 Firmware Activate/Download: Not Supported 00:23:10.365 Namespace Management: Not Supported 00:23:10.365 Device Self-Test: Not Supported 00:23:10.365 Directives: Not Supported 00:23:10.365 NVMe-MI: Not Supported 00:23:10.365 Virtualization Management: Not Supported 00:23:10.365 Doorbell Buffer Config: Not Supported 00:23:10.365 Get LBA Status Capability: Not Supported 00:23:10.365 Command & Feature Lockdown Capability: Not Supported 00:23:10.365 Abort Command Limit: 1 00:23:10.365 Async Event Request Limit: 4 00:23:10.365 Number of Firmware Slots: N/A 00:23:10.365 Firmware Slot 1 Read-Only: N/A 00:23:10.365 Firmware Activation Without Reset: N/A 00:23:10.365 Multiple Update Detection Support: N/A 00:23:10.365 Firmware Update Granularity: No Information Provided 00:23:10.365 Per-Namespace SMART Log: No 00:23:10.365 Asymmetric Namespace Access Log Page: Not Supported 00:23:10.365 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:23:10.365 Command Effects Log Page: Not Supported 00:23:10.365 Get Log Page Extended Data: Supported 00:23:10.365 Telemetry Log Pages: Not Supported 00:23:10.365 Persistent Event Log Pages: Not Supported 00:23:10.365 Supported Log Pages Log Page: May Support 00:23:10.365 Commands Supported & Effects Log Page: Not Supported 00:23:10.365 Feature Identifiers & Effects Log Page:May Support 00:23:10.365 NVMe-MI Commands & Effects Log Page: May Support 00:23:10.365 Data Area 4 for Telemetry Log: Not Supported 00:23:10.365 Error Log Page Entries Supported: 128 00:23:10.365 Keep Alive: Not Supported 00:23:10.365 00:23:10.365 NVM Command Set Attributes 00:23:10.365 ========================== 00:23:10.365 Submission Queue Entry Size 00:23:10.365 Max: 1 00:23:10.365 Min: 1 00:23:10.365 Completion Queue Entry Size 00:23:10.365 Max: 1 00:23:10.365 Min: 1 00:23:10.365 Number of Namespaces: 0 00:23:10.365 Compare Command: Not Supported 00:23:10.365 Write Uncorrectable Command: Not Supported 00:23:10.365 Dataset Management Command: Not Supported 00:23:10.365 Write Zeroes Command: Not Supported 00:23:10.365 Set Features Save Field: Not Supported 00:23:10.365 Reservations: Not Supported 00:23:10.365 Timestamp: Not Supported 00:23:10.365 Copy: Not Supported 00:23:10.365 Volatile Write Cache: Not Present 00:23:10.365 Atomic Write Unit (Normal): 1 00:23:10.365 Atomic Write Unit (PFail): 1 00:23:10.365 Atomic Compare & Write Unit: 1 00:23:10.365 Fused Compare & Write: Supported 00:23:10.365 Scatter-Gather List 00:23:10.365 SGL Command Set: Supported 00:23:10.365 SGL Keyed: Supported 00:23:10.365 SGL Bit Bucket Descriptor: Not Supported 00:23:10.365 SGL Metadata Pointer: Not Supported 00:23:10.365 Oversized SGL: Not Supported 00:23:10.366 SGL Metadata Address: Not Supported 00:23:10.366 SGL Offset: Supported 00:23:10.366 Transport SGL Data Block: Not Supported 00:23:10.366 Replay Protected Memory Block: Not Supported 00:23:10.366 00:23:10.366 Firmware Slot Information 00:23:10.366 ========================= 00:23:10.366 Active slot: 0 00:23:10.366 00:23:10.366 00:23:10.366 Error Log 00:23:10.366 ========= 00:23:10.366 00:23:10.366 Active Namespaces 00:23:10.366 ================= 00:23:10.366 Discovery Log Page 00:23:10.366 ================== 00:23:10.366 Generation Counter: 2 00:23:10.366 Number of Records: 2 00:23:10.366 Record Format: 0 00:23:10.366 00:23:10.366 Discovery Log Entry 0 00:23:10.366 ---------------------- 00:23:10.366 Transport Type: 3 (TCP) 00:23:10.366 Address Family: 1 (IPv4) 00:23:10.366 Subsystem Type: 3 (Current Discovery Subsystem) 00:23:10.366 Entry Flags: 00:23:10.366 Duplicate Returned Information: 1 00:23:10.366 Explicit Persistent Connection Support for Discovery: 1 00:23:10.366 Transport Requirements: 00:23:10.366 Secure Channel: Not Required 00:23:10.366 Port ID: 0 (0x0000) 00:23:10.366 Controller ID: 65535 (0xffff) 00:23:10.366 Admin Max SQ Size: 128 00:23:10.366 Transport Service Identifier: 4420 00:23:10.366 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:23:10.366 Transport Address: 10.0.0.2 00:23:10.366 Discovery Log Entry 1 00:23:10.366 ---------------------- 00:23:10.366 Transport Type: 3 (TCP) 00:23:10.366 Address Family: 1 (IPv4) 00:23:10.366 Subsystem Type: 2 (NVM Subsystem) 00:23:10.366 Entry Flags: 00:23:10.366 Duplicate Returned Information: 0 00:23:10.366 Explicit Persistent Connection Support for Discovery: 0 00:23:10.366 Transport Requirements: 00:23:10.366 Secure Channel: Not Required 00:23:10.366 Port ID: 0 (0x0000) 00:23:10.366 Controller ID: 65535 (0xffff) 00:23:10.366 Admin Max SQ Size: 128 00:23:10.366 Transport Service Identifier: 4420 00:23:10.366 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:23:10.366 Transport Address: 10.0.0.2 [2024-11-29 02:28:14.014720] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:23:10.366 [2024-11-29 02:28:14.014746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:10.366 [2024-11-29 02:28:14.014759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:10.366 [2024-11-29 02:28:14.014769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:10.366 [2024-11-29 02:28:14.014778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:10.366 [2024-11-29 02:28:14.014793] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.366 [2024-11-29 02:28:14.014800] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.366 [2024-11-29 02:28:14.014807] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14d2e10) 00:23:10.366 [2024-11-29 02:28:14.014819] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.366 [2024-11-29 02:28:14.014864] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552f50, cid 3, qid 0 00:23:10.366 [2024-11-29 02:28:14.015052] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.366 [2024-11-29 02:28:14.015067] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.366 [2024-11-29 02:28:14.015074] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.366 [2024-11-29 02:28:14.015081] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1552f50) on tqpair=0x14d2e10 00:23:10.366 [2024-11-29 02:28:14.015095] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.366 [2024-11-29 02:28:14.015102] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.366 [2024-11-29 02:28:14.015109] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14d2e10) 00:23:10.366 [2024-11-29 02:28:14.015120] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.366 [2024-11-29 02:28:14.015148] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552f50, cid 3, qid 0 00:23:10.366 [2024-11-29 02:28:14.015283] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.366 [2024-11-29 02:28:14.015299] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.366 [2024-11-29 02:28:14.015306] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.366 [2024-11-29 02:28:14.015313] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1552f50) on tqpair=0x14d2e10 00:23:10.366 [2024-11-29 02:28:14.015323] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:23:10.366 [2024-11-29 02:28:14.015332] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:23:10.366 [2024-11-29 02:28:14.015348] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.366 [2024-11-29 02:28:14.015357] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.366 [2024-11-29 02:28:14.015363] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14d2e10) 00:23:10.366 [2024-11-29 02:28:14.015374] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.366 [2024-11-29 02:28:14.015415] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552f50, cid 3, qid 0 00:23:10.366 [2024-11-29 02:28:14.015515] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.366 [2024-11-29 02:28:14.015530] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.366 [2024-11-29 02:28:14.015537] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.366 [2024-11-29 02:28:14.015544] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1552f50) on tqpair=0x14d2e10 00:23:10.366 [2024-11-29 02:28:14.015563] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.366 [2024-11-29 02:28:14.015576] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.366 [2024-11-29 02:28:14.015584] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14d2e10) 00:23:10.366 [2024-11-29 02:28:14.015595] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.366 [2024-11-29 02:28:14.015616] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552f50, cid 3, qid 0 00:23:10.366 [2024-11-29 02:28:14.015692] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.366 [2024-11-29 02:28:14.015704] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.366 [2024-11-29 02:28:14.015711] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.366 [2024-11-29 02:28:14.015717] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1552f50) on tqpair=0x14d2e10 00:23:10.366 [2024-11-29 02:28:14.015735] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.366 [2024-11-29 02:28:14.015744] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.366 [2024-11-29 02:28:14.015750] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14d2e10) 00:23:10.366 [2024-11-29 02:28:14.015761] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.366 [2024-11-29 02:28:14.015782] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552f50, cid 3, qid 0 00:23:10.366 [2024-11-29 02:28:14.015862] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.366 [2024-11-29 02:28:14.015877] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.366 [2024-11-29 02:28:14.015884] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.366 [2024-11-29 02:28:14.015891] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1552f50) on tqpair=0x14d2e10 00:23:10.366 [2024-11-29 02:28:14.015908] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.366 [2024-11-29 02:28:14.015918] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.366 [2024-11-29 02:28:14.015924] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14d2e10) 00:23:10.366 [2024-11-29 02:28:14.015935] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.366 [2024-11-29 02:28:14.015957] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552f50, cid 3, qid 0 00:23:10.366 [2024-11-29 02:28:14.016031] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.366 [2024-11-29 02:28:14.016043] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.366 [2024-11-29 02:28:14.016050] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.366 [2024-11-29 02:28:14.016057] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1552f50) on tqpair=0x14d2e10 00:23:10.366 [2024-11-29 02:28:14.016074] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.366 [2024-11-29 02:28:14.016083] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.367 [2024-11-29 02:28:14.016090] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14d2e10) 00:23:10.367 [2024-11-29 02:28:14.016100] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.367 [2024-11-29 02:28:14.016122] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552f50, cid 3, qid 0 00:23:10.367 [2024-11-29 02:28:14.016196] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.367 [2024-11-29 02:28:14.016208] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.367 [2024-11-29 02:28:14.016215] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.367 [2024-11-29 02:28:14.016222] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1552f50) on tqpair=0x14d2e10 00:23:10.367 [2024-11-29 02:28:14.016239] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.367 [2024-11-29 02:28:14.016252] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.367 [2024-11-29 02:28:14.016259] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14d2e10) 00:23:10.367 [2024-11-29 02:28:14.016270] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.367 [2024-11-29 02:28:14.016291] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552f50, cid 3, qid 0 00:23:10.367 [2024-11-29 02:28:14.016373] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.367 [2024-11-29 02:28:14.016400] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.367 [2024-11-29 02:28:14.016409] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.367 [2024-11-29 02:28:14.016416] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1552f50) on tqpair=0x14d2e10 00:23:10.367 [2024-11-29 02:28:14.016446] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.367 [2024-11-29 02:28:14.016456] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.367 [2024-11-29 02:28:14.016462] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14d2e10) 00:23:10.367 [2024-11-29 02:28:14.016473] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.367 [2024-11-29 02:28:14.016495] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552f50, cid 3, qid 0 00:23:10.367 [2024-11-29 02:28:14.016575] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.367 [2024-11-29 02:28:14.016588] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.367 [2024-11-29 02:28:14.016595] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.367 [2024-11-29 02:28:14.016602] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1552f50) on tqpair=0x14d2e10 00:23:10.367 [2024-11-29 02:28:14.016619] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.367 [2024-11-29 02:28:14.016629] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.367 [2024-11-29 02:28:14.016635] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14d2e10) 00:23:10.367 [2024-11-29 02:28:14.016646] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.367 [2024-11-29 02:28:14.016667] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552f50, cid 3, qid 0 00:23:10.367 [2024-11-29 02:28:14.016769] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.367 [2024-11-29 02:28:14.016798] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.367 [2024-11-29 02:28:14.016806] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.367 [2024-11-29 02:28:14.016812] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1552f50) on tqpair=0x14d2e10 00:23:10.367 [2024-11-29 02:28:14.016831] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.367 [2024-11-29 02:28:14.016840] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.367 [2024-11-29 02:28:14.016847] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14d2e10) 00:23:10.367 [2024-11-29 02:28:14.016858] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.367 [2024-11-29 02:28:14.016879] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552f50, cid 3, qid 0 00:23:10.367 [2024-11-29 02:28:14.016959] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.367 [2024-11-29 02:28:14.016974] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.367 [2024-11-29 02:28:14.016981] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.367 [2024-11-29 02:28:14.016988] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1552f50) on tqpair=0x14d2e10 00:23:10.367 [2024-11-29 02:28:14.017006] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.367 [2024-11-29 02:28:14.017015] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.367 [2024-11-29 02:28:14.017026] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14d2e10) 00:23:10.367 [2024-11-29 02:28:14.017037] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.367 [2024-11-29 02:28:14.017058] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552f50, cid 3, qid 0 00:23:10.367 [2024-11-29 02:28:14.017142] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.367 [2024-11-29 02:28:14.017156] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.367 [2024-11-29 02:28:14.017164] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.367 [2024-11-29 02:28:14.017170] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1552f50) on tqpair=0x14d2e10 00:23:10.367 [2024-11-29 02:28:14.017188] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.367 [2024-11-29 02:28:14.017198] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.367 [2024-11-29 02:28:14.017204] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14d2e10) 00:23:10.367 [2024-11-29 02:28:14.017215] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.367 [2024-11-29 02:28:14.017236] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552f50, cid 3, qid 0 00:23:10.367 [2024-11-29 02:28:14.017312] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.367 [2024-11-29 02:28:14.017328] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.367 [2024-11-29 02:28:14.017334] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.367 [2024-11-29 02:28:14.017341] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1552f50) on tqpair=0x14d2e10 00:23:10.367 [2024-11-29 02:28:14.017359] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.367 [2024-11-29 02:28:14.017368] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.367 [2024-11-29 02:28:14.017375] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14d2e10) 00:23:10.367 [2024-11-29 02:28:14.017386] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.367 [2024-11-29 02:28:14.021420] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1552f50, cid 3, qid 0 00:23:10.367 [2024-11-29 02:28:14.021549] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.367 [2024-11-29 02:28:14.021563] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.367 [2024-11-29 02:28:14.021570] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.367 [2024-11-29 02:28:14.021577] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1552f50) on tqpair=0x14d2e10 00:23:10.367 [2024-11-29 02:28:14.021592] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 6 milliseconds 00:23:10.367 00:23:10.632 02:28:14 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:23:10.632 [2024-11-29 02:28:14.052631] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:10.632 [2024-11-29 02:28:14.052686] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid193617 ] 00:23:10.632 EAL: No free 2048 kB hugepages reported on node 1 00:23:10.632 [2024-11-29 02:28:14.082818] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:23:10.632 [2024-11-29 02:28:14.082866] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:10.632 [2024-11-29 02:28:14.082879] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:10.632 [2024-11-29 02:28:14.082898] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:10.632 [2024-11-29 02:28:14.082910] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:10.632 [2024-11-29 02:28:14.086429] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:23:10.632 [2024-11-29 02:28:14.086490] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x2388e10 0 00:23:10.632 [2024-11-29 02:28:14.093406] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:10.632 [2024-11-29 02:28:14.093427] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:10.632 [2024-11-29 02:28:14.093434] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:10.632 [2024-11-29 02:28:14.093440] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:10.632 [2024-11-29 02:28:14.093494] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.632 [2024-11-29 02:28:14.093507] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.632 [2024-11-29 02:28:14.093514] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2388e10) 00:23:10.632 [2024-11-29 02:28:14.093528] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:10.632 [2024-11-29 02:28:14.093555] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408b30, cid 0, qid 0 00:23:10.632 [2024-11-29 02:28:14.101409] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.632 [2024-11-29 02:28:14.101427] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.632 [2024-11-29 02:28:14.101435] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.632 [2024-11-29 02:28:14.101442] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408b30) on tqpair=0x2388e10 00:23:10.632 [2024-11-29 02:28:14.101457] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:10.632 [2024-11-29 02:28:14.101467] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:23:10.632 [2024-11-29 02:28:14.101476] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:23:10.632 [2024-11-29 02:28:14.101493] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.632 [2024-11-29 02:28:14.101502] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.632 [2024-11-29 02:28:14.101508] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2388e10) 00:23:10.632 [2024-11-29 02:28:14.101519] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.632 [2024-11-29 02:28:14.101543] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408b30, cid 0, qid 0 00:23:10.632 [2024-11-29 02:28:14.101658] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.632 [2024-11-29 02:28:14.101670] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.632 [2024-11-29 02:28:14.101677] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.632 [2024-11-29 02:28:14.101684] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408b30) on tqpair=0x2388e10 00:23:10.632 [2024-11-29 02:28:14.101693] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:23:10.632 [2024-11-29 02:28:14.101706] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:23:10.633 [2024-11-29 02:28:14.101718] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.101725] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.101731] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2388e10) 00:23:10.633 [2024-11-29 02:28:14.101746] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.633 [2024-11-29 02:28:14.101768] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408b30, cid 0, qid 0 00:23:10.633 [2024-11-29 02:28:14.101855] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.633 [2024-11-29 02:28:14.101870] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.633 [2024-11-29 02:28:14.101877] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.101884] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408b30) on tqpair=0x2388e10 00:23:10.633 [2024-11-29 02:28:14.101893] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:23:10.633 [2024-11-29 02:28:14.101907] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:23:10.633 [2024-11-29 02:28:14.101920] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.101927] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.101933] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2388e10) 00:23:10.633 [2024-11-29 02:28:14.101944] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.633 [2024-11-29 02:28:14.101965] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408b30, cid 0, qid 0 00:23:10.633 [2024-11-29 02:28:14.102051] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.633 [2024-11-29 02:28:14.102066] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.633 [2024-11-29 02:28:14.102073] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.102079] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408b30) on tqpair=0x2388e10 00:23:10.633 [2024-11-29 02:28:14.102089] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:10.633 [2024-11-29 02:28:14.102106] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.102115] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.102121] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2388e10) 00:23:10.633 [2024-11-29 02:28:14.102132] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.633 [2024-11-29 02:28:14.102153] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408b30, cid 0, qid 0 00:23:10.633 [2024-11-29 02:28:14.102233] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.633 [2024-11-29 02:28:14.102246] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.633 [2024-11-29 02:28:14.102252] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.102259] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408b30) on tqpair=0x2388e10 00:23:10.633 [2024-11-29 02:28:14.102267] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:23:10.633 [2024-11-29 02:28:14.102275] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:23:10.633 [2024-11-29 02:28:14.102288] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:10.633 [2024-11-29 02:28:14.102401] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:23:10.633 [2024-11-29 02:28:14.102411] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:10.633 [2024-11-29 02:28:14.102423] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.102434] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.102441] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2388e10) 00:23:10.633 [2024-11-29 02:28:14.102452] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.633 [2024-11-29 02:28:14.102474] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408b30, cid 0, qid 0 00:23:10.633 [2024-11-29 02:28:14.102590] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.633 [2024-11-29 02:28:14.102605] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.633 [2024-11-29 02:28:14.102612] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.102618] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408b30) on tqpair=0x2388e10 00:23:10.633 [2024-11-29 02:28:14.102627] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:10.633 [2024-11-29 02:28:14.102644] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.102653] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.102660] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2388e10) 00:23:10.633 [2024-11-29 02:28:14.102671] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.633 [2024-11-29 02:28:14.102692] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408b30, cid 0, qid 0 00:23:10.633 [2024-11-29 02:28:14.102776] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.633 [2024-11-29 02:28:14.102791] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.633 [2024-11-29 02:28:14.102798] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.102804] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408b30) on tqpair=0x2388e10 00:23:10.633 [2024-11-29 02:28:14.102813] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:10.633 [2024-11-29 02:28:14.102821] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:23:10.633 [2024-11-29 02:28:14.102835] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:23:10.633 [2024-11-29 02:28:14.102853] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:23:10.633 [2024-11-29 02:28:14.102868] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.102875] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.102881] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2388e10) 00:23:10.633 [2024-11-29 02:28:14.102892] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.633 [2024-11-29 02:28:14.102914] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408b30, cid 0, qid 0 00:23:10.633 [2024-11-29 02:28:14.103044] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.633 [2024-11-29 02:28:14.103057] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.633 [2024-11-29 02:28:14.103063] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.103070] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2388e10): datao=0, datal=4096, cccid=0 00:23:10.633 [2024-11-29 02:28:14.103077] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2408b30) on tqpair(0x2388e10): expected_datao=0, payload_size=4096 00:23:10.633 [2024-11-29 02:28:14.103094] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.103104] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.146417] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.633 [2024-11-29 02:28:14.146447] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.633 [2024-11-29 02:28:14.146456] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.146463] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408b30) on tqpair=0x2388e10 00:23:10.633 [2024-11-29 02:28:14.146476] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:23:10.633 [2024-11-29 02:28:14.146484] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:23:10.633 [2024-11-29 02:28:14.146492] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:23:10.633 [2024-11-29 02:28:14.146499] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:23:10.633 [2024-11-29 02:28:14.146506] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:23:10.633 [2024-11-29 02:28:14.146514] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:23:10.633 [2024-11-29 02:28:14.146534] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:23:10.633 [2024-11-29 02:28:14.146549] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.146557] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.146563] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2388e10) 00:23:10.633 [2024-11-29 02:28:14.146575] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:10.633 [2024-11-29 02:28:14.146601] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408b30, cid 0, qid 0 00:23:10.633 [2024-11-29 02:28:14.146707] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.633 [2024-11-29 02:28:14.146720] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.633 [2024-11-29 02:28:14.146726] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.146733] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408b30) on tqpair=0x2388e10 00:23:10.633 [2024-11-29 02:28:14.146744] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.146751] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.146758] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2388e10) 00:23:10.633 [2024-11-29 02:28:14.146768] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.633 [2024-11-29 02:28:14.146778] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.146785] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.633 [2024-11-29 02:28:14.146791] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x2388e10) 00:23:10.633 [2024-11-29 02:28:14.146800] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.634 [2024-11-29 02:28:14.146810] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.146816] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.146822] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x2388e10) 00:23:10.634 [2024-11-29 02:28:14.146831] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.634 [2024-11-29 02:28:14.146840] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.146847] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.146857] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2388e10) 00:23:10.634 [2024-11-29 02:28:14.146867] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.634 [2024-11-29 02:28:14.146876] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:23:10.634 [2024-11-29 02:28:14.146894] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:10.634 [2024-11-29 02:28:14.146908] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.146915] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.146921] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2388e10) 00:23:10.634 [2024-11-29 02:28:14.146931] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.634 [2024-11-29 02:28:14.146955] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408b30, cid 0, qid 0 00:23:10.634 [2024-11-29 02:28:14.146966] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408c90, cid 1, qid 0 00:23:10.634 [2024-11-29 02:28:14.146974] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408df0, cid 2, qid 0 00:23:10.634 [2024-11-29 02:28:14.146981] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408f50, cid 3, qid 0 00:23:10.634 [2024-11-29 02:28:14.146989] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24090b0, cid 4, qid 0 00:23:10.634 [2024-11-29 02:28:14.147134] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.634 [2024-11-29 02:28:14.147150] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.634 [2024-11-29 02:28:14.147157] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.147163] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24090b0) on tqpair=0x2388e10 00:23:10.634 [2024-11-29 02:28:14.147172] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:23:10.634 [2024-11-29 02:28:14.147181] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:23:10.634 [2024-11-29 02:28:14.147195] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:23:10.634 [2024-11-29 02:28:14.147212] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:23:10.634 [2024-11-29 02:28:14.147224] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.147231] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.147238] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2388e10) 00:23:10.634 [2024-11-29 02:28:14.147248] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:10.634 [2024-11-29 02:28:14.147270] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24090b0, cid 4, qid 0 00:23:10.634 [2024-11-29 02:28:14.147388] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.634 [2024-11-29 02:28:14.147413] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.634 [2024-11-29 02:28:14.147421] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.147427] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24090b0) on tqpair=0x2388e10 00:23:10.634 [2024-11-29 02:28:14.147500] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:23:10.634 [2024-11-29 02:28:14.147519] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:23:10.634 [2024-11-29 02:28:14.147539] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.147548] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.147554] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2388e10) 00:23:10.634 [2024-11-29 02:28:14.147564] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.634 [2024-11-29 02:28:14.147587] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24090b0, cid 4, qid 0 00:23:10.634 [2024-11-29 02:28:14.147731] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.634 [2024-11-29 02:28:14.147746] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.634 [2024-11-29 02:28:14.147753] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.147759] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2388e10): datao=0, datal=4096, cccid=4 00:23:10.634 [2024-11-29 02:28:14.147767] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x24090b0) on tqpair(0x2388e10): expected_datao=0, payload_size=4096 00:23:10.634 [2024-11-29 02:28:14.147778] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.147785] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.147797] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.634 [2024-11-29 02:28:14.147807] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.634 [2024-11-29 02:28:14.147814] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.147820] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24090b0) on tqpair=0x2388e10 00:23:10.634 [2024-11-29 02:28:14.147844] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:23:10.634 [2024-11-29 02:28:14.147862] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:23:10.634 [2024-11-29 02:28:14.147881] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:23:10.634 [2024-11-29 02:28:14.147895] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.147903] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.147909] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2388e10) 00:23:10.634 [2024-11-29 02:28:14.147919] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.634 [2024-11-29 02:28:14.147942] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24090b0, cid 4, qid 0 00:23:10.634 [2024-11-29 02:28:14.148055] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.634 [2024-11-29 02:28:14.148067] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.634 [2024-11-29 02:28:14.148073] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.148079] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2388e10): datao=0, datal=4096, cccid=4 00:23:10.634 [2024-11-29 02:28:14.148087] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x24090b0) on tqpair(0x2388e10): expected_datao=0, payload_size=4096 00:23:10.634 [2024-11-29 02:28:14.148097] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.148105] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.148116] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.634 [2024-11-29 02:28:14.148126] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.634 [2024-11-29 02:28:14.148132] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.148139] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24090b0) on tqpair=0x2388e10 00:23:10.634 [2024-11-29 02:28:14.148169] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:23:10.634 [2024-11-29 02:28:14.148190] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:23:10.634 [2024-11-29 02:28:14.148204] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.148212] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.148218] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2388e10) 00:23:10.634 [2024-11-29 02:28:14.148228] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.634 [2024-11-29 02:28:14.148250] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24090b0, cid 4, qid 0 00:23:10.634 [2024-11-29 02:28:14.148338] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.634 [2024-11-29 02:28:14.148351] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.634 [2024-11-29 02:28:14.148357] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.148363] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2388e10): datao=0, datal=4096, cccid=4 00:23:10.634 [2024-11-29 02:28:14.148371] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x24090b0) on tqpair(0x2388e10): expected_datao=0, payload_size=4096 00:23:10.634 [2024-11-29 02:28:14.148381] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.148389] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.148413] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.634 [2024-11-29 02:28:14.148425] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.634 [2024-11-29 02:28:14.148431] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.634 [2024-11-29 02:28:14.148438] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24090b0) on tqpair=0x2388e10 00:23:10.634 [2024-11-29 02:28:14.148452] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:23:10.634 [2024-11-29 02:28:14.148468] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:23:10.634 [2024-11-29 02:28:14.148485] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:23:10.634 [2024-11-29 02:28:14.148496] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:23:10.634 [2024-11-29 02:28:14.148505] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:23:10.634 [2024-11-29 02:28:14.148513] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:23:10.634 [2024-11-29 02:28:14.148521] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:23:10.635 [2024-11-29 02:28:14.148530] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:23:10.635 [2024-11-29 02:28:14.148549] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.148557] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.148563] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2388e10) 00:23:10.635 [2024-11-29 02:28:14.148574] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.635 [2024-11-29 02:28:14.148585] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.148592] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.148601] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x2388e10) 00:23:10.635 [2024-11-29 02:28:14.148611] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.635 [2024-11-29 02:28:14.148637] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24090b0, cid 4, qid 0 00:23:10.635 [2024-11-29 02:28:14.148649] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2409210, cid 5, qid 0 00:23:10.635 [2024-11-29 02:28:14.148781] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.635 [2024-11-29 02:28:14.148796] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.635 [2024-11-29 02:28:14.148803] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.148809] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24090b0) on tqpair=0x2388e10 00:23:10.635 [2024-11-29 02:28:14.148821] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.635 [2024-11-29 02:28:14.148829] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.635 [2024-11-29 02:28:14.148836] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.148842] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2409210) on tqpair=0x2388e10 00:23:10.635 [2024-11-29 02:28:14.148858] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.148867] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.148874] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x2388e10) 00:23:10.635 [2024-11-29 02:28:14.148884] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.635 [2024-11-29 02:28:14.148906] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2409210, cid 5, qid 0 00:23:10.635 [2024-11-29 02:28:14.148982] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.635 [2024-11-29 02:28:14.148995] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.635 [2024-11-29 02:28:14.149002] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.149008] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2409210) on tqpair=0x2388e10 00:23:10.635 [2024-11-29 02:28:14.149024] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.149033] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.149039] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x2388e10) 00:23:10.635 [2024-11-29 02:28:14.149050] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.635 [2024-11-29 02:28:14.149070] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2409210, cid 5, qid 0 00:23:10.635 [2024-11-29 02:28:14.149156] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.635 [2024-11-29 02:28:14.149171] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.635 [2024-11-29 02:28:14.149178] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.149185] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2409210) on tqpair=0x2388e10 00:23:10.635 [2024-11-29 02:28:14.149202] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.149211] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.149218] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x2388e10) 00:23:10.635 [2024-11-29 02:28:14.149228] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.635 [2024-11-29 02:28:14.149249] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2409210, cid 5, qid 0 00:23:10.635 [2024-11-29 02:28:14.149326] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.635 [2024-11-29 02:28:14.149339] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.635 [2024-11-29 02:28:14.149345] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.149352] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2409210) on tqpair=0x2388e10 00:23:10.635 [2024-11-29 02:28:14.149372] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.149382] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.149388] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x2388e10) 00:23:10.635 [2024-11-29 02:28:14.149409] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.635 [2024-11-29 02:28:14.149424] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.149431] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.149437] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2388e10) 00:23:10.635 [2024-11-29 02:28:14.149447] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.635 [2024-11-29 02:28:14.149459] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.149466] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.149473] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x2388e10) 00:23:10.635 [2024-11-29 02:28:14.149482] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.635 [2024-11-29 02:28:14.149494] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.149501] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.149507] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x2388e10) 00:23:10.635 [2024-11-29 02:28:14.149516] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.635 [2024-11-29 02:28:14.149539] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2409210, cid 5, qid 0 00:23:10.635 [2024-11-29 02:28:14.149550] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24090b0, cid 4, qid 0 00:23:10.635 [2024-11-29 02:28:14.149558] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2409370, cid 6, qid 0 00:23:10.635 [2024-11-29 02:28:14.149565] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24094d0, cid 7, qid 0 00:23:10.635 [2024-11-29 02:28:14.149768] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.635 [2024-11-29 02:28:14.149783] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.635 [2024-11-29 02:28:14.149790] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.149796] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2388e10): datao=0, datal=8192, cccid=5 00:23:10.635 [2024-11-29 02:28:14.149804] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2409210) on tqpair(0x2388e10): expected_datao=0, payload_size=8192 00:23:10.635 [2024-11-29 02:28:14.149826] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.149836] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.149845] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.635 [2024-11-29 02:28:14.149853] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.635 [2024-11-29 02:28:14.149860] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.149866] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2388e10): datao=0, datal=512, cccid=4 00:23:10.635 [2024-11-29 02:28:14.149877] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x24090b0) on tqpair(0x2388e10): expected_datao=0, payload_size=512 00:23:10.635 [2024-11-29 02:28:14.149888] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.149895] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.149903] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.635 [2024-11-29 02:28:14.149911] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.635 [2024-11-29 02:28:14.149918] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.149923] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2388e10): datao=0, datal=512, cccid=6 00:23:10.635 [2024-11-29 02:28:14.149930] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2409370) on tqpair(0x2388e10): expected_datao=0, payload_size=512 00:23:10.635 [2024-11-29 02:28:14.149940] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.149947] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.149955] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.635 [2024-11-29 02:28:14.149964] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.635 [2024-11-29 02:28:14.149970] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.149976] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2388e10): datao=0, datal=4096, cccid=7 00:23:10.635 [2024-11-29 02:28:14.149983] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x24094d0) on tqpair(0x2388e10): expected_datao=0, payload_size=4096 00:23:10.635 [2024-11-29 02:28:14.149993] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.150001] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.150012] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.635 [2024-11-29 02:28:14.150022] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.635 [2024-11-29 02:28:14.150028] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.150034] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2409210) on tqpair=0x2388e10 00:23:10.635 [2024-11-29 02:28:14.150055] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.635 [2024-11-29 02:28:14.150067] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.635 [2024-11-29 02:28:14.150074] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.635 [2024-11-29 02:28:14.150080] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24090b0) on tqpair=0x2388e10 00:23:10.635 [2024-11-29 02:28:14.150095] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.635 [2024-11-29 02:28:14.150106] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.635 [2024-11-29 02:28:14.150112] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.636 [2024-11-29 02:28:14.150118] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2409370) on tqpair=0x2388e10 00:23:10.636 [2024-11-29 02:28:14.150130] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.636 [2024-11-29 02:28:14.150139] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.636 [2024-11-29 02:28:14.150145] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.636 [2024-11-29 02:28:14.150151] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24094d0) on tqpair=0x2388e10 00:23:10.636 ===================================================== 00:23:10.636 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:10.636 ===================================================== 00:23:10.636 Controller Capabilities/Features 00:23:10.636 ================================ 00:23:10.636 Vendor ID: 8086 00:23:10.636 Subsystem Vendor ID: 8086 00:23:10.636 Serial Number: SPDK00000000000001 00:23:10.636 Model Number: SPDK bdev Controller 00:23:10.636 Firmware Version: 24.01.1 00:23:10.636 Recommended Arb Burst: 6 00:23:10.636 IEEE OUI Identifier: e4 d2 5c 00:23:10.636 Multi-path I/O 00:23:10.636 May have multiple subsystem ports: Yes 00:23:10.636 May have multiple controllers: Yes 00:23:10.636 Associated with SR-IOV VF: No 00:23:10.636 Max Data Transfer Size: 131072 00:23:10.636 Max Number of Namespaces: 32 00:23:10.636 Max Number of I/O Queues: 127 00:23:10.636 NVMe Specification Version (VS): 1.3 00:23:10.636 NVMe Specification Version (Identify): 1.3 00:23:10.636 Maximum Queue Entries: 128 00:23:10.636 Contiguous Queues Required: Yes 00:23:10.636 Arbitration Mechanisms Supported 00:23:10.636 Weighted Round Robin: Not Supported 00:23:10.636 Vendor Specific: Not Supported 00:23:10.636 Reset Timeout: 15000 ms 00:23:10.636 Doorbell Stride: 4 bytes 00:23:10.636 NVM Subsystem Reset: Not Supported 00:23:10.636 Command Sets Supported 00:23:10.636 NVM Command Set: Supported 00:23:10.636 Boot Partition: Not Supported 00:23:10.636 Memory Page Size Minimum: 4096 bytes 00:23:10.636 Memory Page Size Maximum: 4096 bytes 00:23:10.636 Persistent Memory Region: Not Supported 00:23:10.636 Optional Asynchronous Events Supported 00:23:10.636 Namespace Attribute Notices: Supported 00:23:10.636 Firmware Activation Notices: Not Supported 00:23:10.636 ANA Change Notices: Not Supported 00:23:10.636 PLE Aggregate Log Change Notices: Not Supported 00:23:10.636 LBA Status Info Alert Notices: Not Supported 00:23:10.636 EGE Aggregate Log Change Notices: Not Supported 00:23:10.636 Normal NVM Subsystem Shutdown event: Not Supported 00:23:10.636 Zone Descriptor Change Notices: Not Supported 00:23:10.636 Discovery Log Change Notices: Not Supported 00:23:10.636 Controller Attributes 00:23:10.636 128-bit Host Identifier: Supported 00:23:10.636 Non-Operational Permissive Mode: Not Supported 00:23:10.636 NVM Sets: Not Supported 00:23:10.636 Read Recovery Levels: Not Supported 00:23:10.636 Endurance Groups: Not Supported 00:23:10.636 Predictable Latency Mode: Not Supported 00:23:10.636 Traffic Based Keep ALive: Not Supported 00:23:10.636 Namespace Granularity: Not Supported 00:23:10.636 SQ Associations: Not Supported 00:23:10.636 UUID List: Not Supported 00:23:10.636 Multi-Domain Subsystem: Not Supported 00:23:10.636 Fixed Capacity Management: Not Supported 00:23:10.636 Variable Capacity Management: Not Supported 00:23:10.636 Delete Endurance Group: Not Supported 00:23:10.636 Delete NVM Set: Not Supported 00:23:10.636 Extended LBA Formats Supported: Not Supported 00:23:10.636 Flexible Data Placement Supported: Not Supported 00:23:10.636 00:23:10.636 Controller Memory Buffer Support 00:23:10.636 ================================ 00:23:10.636 Supported: No 00:23:10.636 00:23:10.636 Persistent Memory Region Support 00:23:10.636 ================================ 00:23:10.636 Supported: No 00:23:10.636 00:23:10.636 Admin Command Set Attributes 00:23:10.636 ============================ 00:23:10.636 Security Send/Receive: Not Supported 00:23:10.636 Format NVM: Not Supported 00:23:10.636 Firmware Activate/Download: Not Supported 00:23:10.636 Namespace Management: Not Supported 00:23:10.636 Device Self-Test: Not Supported 00:23:10.636 Directives: Not Supported 00:23:10.636 NVMe-MI: Not Supported 00:23:10.636 Virtualization Management: Not Supported 00:23:10.636 Doorbell Buffer Config: Not Supported 00:23:10.636 Get LBA Status Capability: Not Supported 00:23:10.636 Command & Feature Lockdown Capability: Not Supported 00:23:10.636 Abort Command Limit: 4 00:23:10.636 Async Event Request Limit: 4 00:23:10.636 Number of Firmware Slots: N/A 00:23:10.636 Firmware Slot 1 Read-Only: N/A 00:23:10.636 Firmware Activation Without Reset: N/A 00:23:10.636 Multiple Update Detection Support: N/A 00:23:10.636 Firmware Update Granularity: No Information Provided 00:23:10.636 Per-Namespace SMART Log: No 00:23:10.636 Asymmetric Namespace Access Log Page: Not Supported 00:23:10.636 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:23:10.636 Command Effects Log Page: Supported 00:23:10.636 Get Log Page Extended Data: Supported 00:23:10.636 Telemetry Log Pages: Not Supported 00:23:10.636 Persistent Event Log Pages: Not Supported 00:23:10.636 Supported Log Pages Log Page: May Support 00:23:10.636 Commands Supported & Effects Log Page: Not Supported 00:23:10.636 Feature Identifiers & Effects Log Page:May Support 00:23:10.636 NVMe-MI Commands & Effects Log Page: May Support 00:23:10.636 Data Area 4 for Telemetry Log: Not Supported 00:23:10.636 Error Log Page Entries Supported: 128 00:23:10.636 Keep Alive: Supported 00:23:10.636 Keep Alive Granularity: 10000 ms 00:23:10.636 00:23:10.636 NVM Command Set Attributes 00:23:10.636 ========================== 00:23:10.636 Submission Queue Entry Size 00:23:10.636 Max: 64 00:23:10.636 Min: 64 00:23:10.636 Completion Queue Entry Size 00:23:10.636 Max: 16 00:23:10.636 Min: 16 00:23:10.636 Number of Namespaces: 32 00:23:10.636 Compare Command: Supported 00:23:10.636 Write Uncorrectable Command: Not Supported 00:23:10.636 Dataset Management Command: Supported 00:23:10.636 Write Zeroes Command: Supported 00:23:10.636 Set Features Save Field: Not Supported 00:23:10.636 Reservations: Supported 00:23:10.636 Timestamp: Not Supported 00:23:10.636 Copy: Supported 00:23:10.636 Volatile Write Cache: Present 00:23:10.636 Atomic Write Unit (Normal): 1 00:23:10.636 Atomic Write Unit (PFail): 1 00:23:10.636 Atomic Compare & Write Unit: 1 00:23:10.636 Fused Compare & Write: Supported 00:23:10.636 Scatter-Gather List 00:23:10.636 SGL Command Set: Supported 00:23:10.636 SGL Keyed: Supported 00:23:10.636 SGL Bit Bucket Descriptor: Not Supported 00:23:10.636 SGL Metadata Pointer: Not Supported 00:23:10.636 Oversized SGL: Not Supported 00:23:10.636 SGL Metadata Address: Not Supported 00:23:10.636 SGL Offset: Supported 00:23:10.636 Transport SGL Data Block: Not Supported 00:23:10.636 Replay Protected Memory Block: Not Supported 00:23:10.636 00:23:10.636 Firmware Slot Information 00:23:10.636 ========================= 00:23:10.636 Active slot: 1 00:23:10.636 Slot 1 Firmware Revision: 24.01.1 00:23:10.636 00:23:10.636 00:23:10.636 Commands Supported and Effects 00:23:10.636 ============================== 00:23:10.636 Admin Commands 00:23:10.636 -------------- 00:23:10.636 Get Log Page (02h): Supported 00:23:10.636 Identify (06h): Supported 00:23:10.636 Abort (08h): Supported 00:23:10.636 Set Features (09h): Supported 00:23:10.636 Get Features (0Ah): Supported 00:23:10.636 Asynchronous Event Request (0Ch): Supported 00:23:10.636 Keep Alive (18h): Supported 00:23:10.636 I/O Commands 00:23:10.636 ------------ 00:23:10.636 Flush (00h): Supported LBA-Change 00:23:10.636 Write (01h): Supported LBA-Change 00:23:10.636 Read (02h): Supported 00:23:10.636 Compare (05h): Supported 00:23:10.636 Write Zeroes (08h): Supported LBA-Change 00:23:10.636 Dataset Management (09h): Supported LBA-Change 00:23:10.636 Copy (19h): Supported LBA-Change 00:23:10.636 Unknown (79h): Supported LBA-Change 00:23:10.636 Unknown (7Ah): Supported 00:23:10.636 00:23:10.636 Error Log 00:23:10.636 ========= 00:23:10.636 00:23:10.636 Arbitration 00:23:10.636 =========== 00:23:10.636 Arbitration Burst: 1 00:23:10.636 00:23:10.636 Power Management 00:23:10.636 ================ 00:23:10.636 Number of Power States: 1 00:23:10.636 Current Power State: Power State #0 00:23:10.636 Power State #0: 00:23:10.636 Max Power: 0.00 W 00:23:10.636 Non-Operational State: Operational 00:23:10.636 Entry Latency: Not Reported 00:23:10.636 Exit Latency: Not Reported 00:23:10.636 Relative Read Throughput: 0 00:23:10.636 Relative Read Latency: 0 00:23:10.636 Relative Write Throughput: 0 00:23:10.636 Relative Write Latency: 0 00:23:10.636 Idle Power: Not Reported 00:23:10.636 Active Power: Not Reported 00:23:10.636 Non-Operational Permissive Mode: Not Supported 00:23:10.636 00:23:10.636 Health Information 00:23:10.636 ================== 00:23:10.636 Critical Warnings: 00:23:10.637 Available Spare Space: OK 00:23:10.637 Temperature: OK 00:23:10.637 Device Reliability: OK 00:23:10.637 Read Only: No 00:23:10.637 Volatile Memory Backup: OK 00:23:10.637 Current Temperature: 0 Kelvin (-273 Celsius) 00:23:10.637 Temperature Threshold: [2024-11-29 02:28:14.150294] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.637 [2024-11-29 02:28:14.150307] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.637 [2024-11-29 02:28:14.150313] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x2388e10) 00:23:10.637 [2024-11-29 02:28:14.150323] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.637 [2024-11-29 02:28:14.150345] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24094d0, cid 7, qid 0 00:23:10.637 [2024-11-29 02:28:14.154409] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.637 [2024-11-29 02:28:14.154426] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.637 [2024-11-29 02:28:14.154433] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.637 [2024-11-29 02:28:14.154439] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24094d0) on tqpair=0x2388e10 00:23:10.637 [2024-11-29 02:28:14.154497] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:23:10.637 [2024-11-29 02:28:14.154520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:10.637 [2024-11-29 02:28:14.154533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:10.637 [2024-11-29 02:28:14.154542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:10.637 [2024-11-29 02:28:14.154551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:10.637 [2024-11-29 02:28:14.154563] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.637 [2024-11-29 02:28:14.154571] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.637 [2024-11-29 02:28:14.154577] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2388e10) 00:23:10.637 [2024-11-29 02:28:14.154588] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.637 [2024-11-29 02:28:14.154611] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408f50, cid 3, qid 0 00:23:10.637 [2024-11-29 02:28:14.154728] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.637 [2024-11-29 02:28:14.154741] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.637 [2024-11-29 02:28:14.154747] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.637 [2024-11-29 02:28:14.154754] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408f50) on tqpair=0x2388e10 00:23:10.637 [2024-11-29 02:28:14.154765] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.637 [2024-11-29 02:28:14.154773] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.637 [2024-11-29 02:28:14.154779] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2388e10) 00:23:10.637 [2024-11-29 02:28:14.154789] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.637 [2024-11-29 02:28:14.154815] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408f50, cid 3, qid 0 00:23:10.637 [2024-11-29 02:28:14.154914] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.637 [2024-11-29 02:28:14.154929] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.637 [2024-11-29 02:28:14.154936] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.637 [2024-11-29 02:28:14.154942] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408f50) on tqpair=0x2388e10 00:23:10.637 [2024-11-29 02:28:14.154951] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:23:10.637 [2024-11-29 02:28:14.154958] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:23:10.637 [2024-11-29 02:28:14.154974] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.637 [2024-11-29 02:28:14.154983] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.637 [2024-11-29 02:28:14.154989] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2388e10) 00:23:10.637 [2024-11-29 02:28:14.155000] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.637 [2024-11-29 02:28:14.155021] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408f50, cid 3, qid 0 00:23:10.637 [2024-11-29 02:28:14.155106] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.637 [2024-11-29 02:28:14.155122] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.637 [2024-11-29 02:28:14.155128] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.637 [2024-11-29 02:28:14.155135] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408f50) on tqpair=0x2388e10 00:23:10.637 [2024-11-29 02:28:14.155153] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.637 [2024-11-29 02:28:14.155162] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.637 [2024-11-29 02:28:14.155168] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2388e10) 00:23:10.637 [2024-11-29 02:28:14.155179] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.637 [2024-11-29 02:28:14.155199] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408f50, cid 3, qid 0 00:23:10.637 [2024-11-29 02:28:14.155280] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.637 [2024-11-29 02:28:14.155295] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.637 [2024-11-29 02:28:14.155301] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.637 [2024-11-29 02:28:14.155308] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408f50) on tqpair=0x2388e10 00:23:10.637 [2024-11-29 02:28:14.155325] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.637 [2024-11-29 02:28:14.155334] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.637 [2024-11-29 02:28:14.155341] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2388e10) 00:23:10.637 [2024-11-29 02:28:14.155351] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.637 [2024-11-29 02:28:14.155372] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408f50, cid 3, qid 0 00:23:10.637 [2024-11-29 02:28:14.155458] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.637 [2024-11-29 02:28:14.155472] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.637 [2024-11-29 02:28:14.155478] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.637 [2024-11-29 02:28:14.155485] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408f50) on tqpair=0x2388e10 00:23:10.637 [2024-11-29 02:28:14.155502] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.637 [2024-11-29 02:28:14.155511] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.637 [2024-11-29 02:28:14.155517] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2388e10) 00:23:10.637 [2024-11-29 02:28:14.155528] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.637 [2024-11-29 02:28:14.155549] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408f50, cid 3, qid 0 00:23:10.637 [2024-11-29 02:28:14.155626] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.637 [2024-11-29 02:28:14.155638] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.637 [2024-11-29 02:28:14.155644] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.637 [2024-11-29 02:28:14.155651] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408f50) on tqpair=0x2388e10 00:23:10.637 [2024-11-29 02:28:14.155668] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.637 [2024-11-29 02:28:14.155677] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.637 [2024-11-29 02:28:14.155683] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2388e10) 00:23:10.637 [2024-11-29 02:28:14.155693] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.637 [2024-11-29 02:28:14.155714] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408f50, cid 3, qid 0 00:23:10.637 [2024-11-29 02:28:14.155795] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.637 [2024-11-29 02:28:14.155814] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.637 [2024-11-29 02:28:14.155821] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.637 [2024-11-29 02:28:14.155828] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408f50) on tqpair=0x2388e10 00:23:10.637 [2024-11-29 02:28:14.155846] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.637 [2024-11-29 02:28:14.155855] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.637 [2024-11-29 02:28:14.155861] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2388e10) 00:23:10.637 [2024-11-29 02:28:14.155872] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.638 [2024-11-29 02:28:14.155893] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408f50, cid 3, qid 0 00:23:10.638 [2024-11-29 02:28:14.155967] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.638 [2024-11-29 02:28:14.155979] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.638 [2024-11-29 02:28:14.155985] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.155992] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408f50) on tqpair=0x2388e10 00:23:10.638 [2024-11-29 02:28:14.156008] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.156018] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.156024] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2388e10) 00:23:10.638 [2024-11-29 02:28:14.156034] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.638 [2024-11-29 02:28:14.156055] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408f50, cid 3, qid 0 00:23:10.638 [2024-11-29 02:28:14.156126] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.638 [2024-11-29 02:28:14.156138] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.638 [2024-11-29 02:28:14.156145] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.156151] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408f50) on tqpair=0x2388e10 00:23:10.638 [2024-11-29 02:28:14.156168] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.156177] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.156183] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2388e10) 00:23:10.638 [2024-11-29 02:28:14.156194] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.638 [2024-11-29 02:28:14.156214] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408f50, cid 3, qid 0 00:23:10.638 [2024-11-29 02:28:14.156288] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.638 [2024-11-29 02:28:14.156300] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.638 [2024-11-29 02:28:14.156306] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.156313] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408f50) on tqpair=0x2388e10 00:23:10.638 [2024-11-29 02:28:14.156329] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.156338] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.156345] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2388e10) 00:23:10.638 [2024-11-29 02:28:14.156355] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.638 [2024-11-29 02:28:14.156375] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408f50, cid 3, qid 0 00:23:10.638 [2024-11-29 02:28:14.156463] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.638 [2024-11-29 02:28:14.156476] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.638 [2024-11-29 02:28:14.156486] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.156494] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408f50) on tqpair=0x2388e10 00:23:10.638 [2024-11-29 02:28:14.156511] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.156520] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.156526] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2388e10) 00:23:10.638 [2024-11-29 02:28:14.156537] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.638 [2024-11-29 02:28:14.156558] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408f50, cid 3, qid 0 00:23:10.638 [2024-11-29 02:28:14.156635] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.638 [2024-11-29 02:28:14.156650] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.638 [2024-11-29 02:28:14.156657] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.156663] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408f50) on tqpair=0x2388e10 00:23:10.638 [2024-11-29 02:28:14.156681] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.156690] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.156697] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2388e10) 00:23:10.638 [2024-11-29 02:28:14.156707] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.638 [2024-11-29 02:28:14.156728] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408f50, cid 3, qid 0 00:23:10.638 [2024-11-29 02:28:14.156804] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.638 [2024-11-29 02:28:14.156816] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.638 [2024-11-29 02:28:14.156823] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.156829] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408f50) on tqpair=0x2388e10 00:23:10.638 [2024-11-29 02:28:14.156846] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.156855] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.156861] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2388e10) 00:23:10.638 [2024-11-29 02:28:14.156871] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.638 [2024-11-29 02:28:14.156892] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408f50, cid 3, qid 0 00:23:10.638 [2024-11-29 02:28:14.156969] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.638 [2024-11-29 02:28:14.156981] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.638 [2024-11-29 02:28:14.156988] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.156994] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408f50) on tqpair=0x2388e10 00:23:10.638 [2024-11-29 02:28:14.157011] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.157020] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.157026] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2388e10) 00:23:10.638 [2024-11-29 02:28:14.157036] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.638 [2024-11-29 02:28:14.157057] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408f50, cid 3, qid 0 00:23:10.638 [2024-11-29 02:28:14.157134] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.638 [2024-11-29 02:28:14.157146] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.638 [2024-11-29 02:28:14.157152] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.157162] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408f50) on tqpair=0x2388e10 00:23:10.638 [2024-11-29 02:28:14.157180] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.157190] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.157196] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2388e10) 00:23:10.638 [2024-11-29 02:28:14.157206] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.638 [2024-11-29 02:28:14.157227] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408f50, cid 3, qid 0 00:23:10.638 [2024-11-29 02:28:14.157304] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.638 [2024-11-29 02:28:14.157316] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.638 [2024-11-29 02:28:14.157322] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.157328] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408f50) on tqpair=0x2388e10 00:23:10.638 [2024-11-29 02:28:14.157345] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.157354] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.157360] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2388e10) 00:23:10.638 [2024-11-29 02:28:14.157371] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.638 [2024-11-29 02:28:14.157391] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408f50, cid 3, qid 0 00:23:10.638 [2024-11-29 02:28:14.157478] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.638 [2024-11-29 02:28:14.157490] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.638 [2024-11-29 02:28:14.157497] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.157503] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408f50) on tqpair=0x2388e10 00:23:10.638 [2024-11-29 02:28:14.157519] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.157528] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.157535] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2388e10) 00:23:10.638 [2024-11-29 02:28:14.157545] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.638 [2024-11-29 02:28:14.157566] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408f50, cid 3, qid 0 00:23:10.638 [2024-11-29 02:28:14.157647] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.638 [2024-11-29 02:28:14.157662] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.638 [2024-11-29 02:28:14.157668] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.157675] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408f50) on tqpair=0x2388e10 00:23:10.638 [2024-11-29 02:28:14.157692] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.157701] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.157708] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2388e10) 00:23:10.638 [2024-11-29 02:28:14.157718] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.638 [2024-11-29 02:28:14.157740] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408f50, cid 3, qid 0 00:23:10.638 [2024-11-29 02:28:14.157820] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.638 [2024-11-29 02:28:14.157832] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.638 [2024-11-29 02:28:14.157839] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.157845] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408f50) on tqpair=0x2388e10 00:23:10.638 [2024-11-29 02:28:14.157866] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.157876] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.638 [2024-11-29 02:28:14.157882] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2388e10) 00:23:10.639 [2024-11-29 02:28:14.157893] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.639 [2024-11-29 02:28:14.157913] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408f50, cid 3, qid 0 00:23:10.639 [2024-11-29 02:28:14.157985] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.639 [2024-11-29 02:28:14.157997] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.639 [2024-11-29 02:28:14.158004] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.639 [2024-11-29 02:28:14.158010] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408f50) on tqpair=0x2388e10 00:23:10.639 [2024-11-29 02:28:14.158027] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.639 [2024-11-29 02:28:14.158036] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.639 [2024-11-29 02:28:14.158042] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2388e10) 00:23:10.639 [2024-11-29 02:28:14.158053] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.639 [2024-11-29 02:28:14.158073] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408f50, cid 3, qid 0 00:23:10.639 [2024-11-29 02:28:14.158148] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.639 [2024-11-29 02:28:14.158159] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.639 [2024-11-29 02:28:14.158166] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.639 [2024-11-29 02:28:14.158172] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408f50) on tqpair=0x2388e10 00:23:10.639 [2024-11-29 02:28:14.158189] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.639 [2024-11-29 02:28:14.158198] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.639 [2024-11-29 02:28:14.158204] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2388e10) 00:23:10.639 [2024-11-29 02:28:14.158214] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.639 [2024-11-29 02:28:14.158235] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408f50, cid 3, qid 0 00:23:10.639 [2024-11-29 02:28:14.158325] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.639 [2024-11-29 02:28:14.158340] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.639 [2024-11-29 02:28:14.158347] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.639 [2024-11-29 02:28:14.158354] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408f50) on tqpair=0x2388e10 00:23:10.639 [2024-11-29 02:28:14.158371] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.639 [2024-11-29 02:28:14.158380] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.639 [2024-11-29 02:28:14.158387] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2388e10) 00:23:10.639 [2024-11-29 02:28:14.162409] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.639 [2024-11-29 02:28:14.162437] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2408f50, cid 3, qid 0 00:23:10.639 [2024-11-29 02:28:14.162556] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.639 [2024-11-29 02:28:14.162572] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.639 [2024-11-29 02:28:14.162578] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.639 [2024-11-29 02:28:14.162585] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2408f50) on tqpair=0x2388e10 00:23:10.639 [2024-11-29 02:28:14.162604] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 7 milliseconds 00:23:10.639 0 Kelvin (-273 Celsius) 00:23:10.639 Available Spare: 0% 00:23:10.639 Available Spare Threshold: 0% 00:23:10.639 Life Percentage Used: 0% 00:23:10.639 Data Units Read: 0 00:23:10.639 Data Units Written: 0 00:23:10.639 Host Read Commands: 0 00:23:10.639 Host Write Commands: 0 00:23:10.639 Controller Busy Time: 0 minutes 00:23:10.639 Power Cycles: 0 00:23:10.639 Power On Hours: 0 hours 00:23:10.639 Unsafe Shutdowns: 0 00:23:10.639 Unrecoverable Media Errors: 0 00:23:10.639 Lifetime Error Log Entries: 0 00:23:10.639 Warning Temperature Time: 0 minutes 00:23:10.639 Critical Temperature Time: 0 minutes 00:23:10.639 00:23:10.639 Number of Queues 00:23:10.639 ================ 00:23:10.639 Number of I/O Submission Queues: 127 00:23:10.639 Number of I/O Completion Queues: 127 00:23:10.639 00:23:10.639 Active Namespaces 00:23:10.639 ================= 00:23:10.639 Namespace ID:1 00:23:10.639 Error Recovery Timeout: Unlimited 00:23:10.639 Command Set Identifier: NVM (00h) 00:23:10.639 Deallocate: Supported 00:23:10.639 Deallocated/Unwritten Error: Not Supported 00:23:10.639 Deallocated Read Value: Unknown 00:23:10.639 Deallocate in Write Zeroes: Not Supported 00:23:10.639 Deallocated Guard Field: 0xFFFF 00:23:10.639 Flush: Supported 00:23:10.639 Reservation: Supported 00:23:10.639 Namespace Sharing Capabilities: Multiple Controllers 00:23:10.639 Size (in LBAs): 131072 (0GiB) 00:23:10.639 Capacity (in LBAs): 131072 (0GiB) 00:23:10.639 Utilization (in LBAs): 131072 (0GiB) 00:23:10.639 NGUID: ABCDEF0123456789ABCDEF0123456789 00:23:10.639 EUI64: ABCDEF0123456789 00:23:10.639 UUID: 7b83d5ae-fdc9-457d-be95-ba46f379dd8d 00:23:10.639 Thin Provisioning: Not Supported 00:23:10.639 Per-NS Atomic Units: Yes 00:23:10.639 Atomic Boundary Size (Normal): 0 00:23:10.639 Atomic Boundary Size (PFail): 0 00:23:10.639 Atomic Boundary Offset: 0 00:23:10.639 Maximum Single Source Range Length: 65535 00:23:10.639 Maximum Copy Length: 65535 00:23:10.639 Maximum Source Range Count: 1 00:23:10.639 NGUID/EUI64 Never Reused: No 00:23:10.639 Namespace Write Protected: No 00:23:10.639 Number of LBA Formats: 1 00:23:10.639 Current LBA Format: LBA Format #00 00:23:10.639 LBA Format #00: Data Size: 512 Metadata Size: 0 00:23:10.639 00:23:10.639 02:28:14 -- host/identify.sh@51 -- # sync 00:23:10.639 02:28:14 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:10.639 02:28:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.639 02:28:14 -- common/autotest_common.sh@10 -- # set +x 00:23:10.639 02:28:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.639 02:28:14 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:23:10.639 02:28:14 -- host/identify.sh@56 -- # nvmftestfini 00:23:10.639 02:28:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:10.639 02:28:14 -- nvmf/common.sh@116 -- # sync 00:23:10.639 02:28:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:10.639 02:28:14 -- nvmf/common.sh@119 -- # set +e 00:23:10.639 02:28:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:10.639 02:28:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:10.639 rmmod nvme_tcp 00:23:10.639 rmmod nvme_fabrics 00:23:10.639 rmmod nvme_keyring 00:23:10.639 02:28:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:10.639 02:28:14 -- nvmf/common.sh@123 -- # set -e 00:23:10.639 02:28:14 -- nvmf/common.sh@124 -- # return 0 00:23:10.639 02:28:14 -- nvmf/common.sh@477 -- # '[' -n 193453 ']' 00:23:10.639 02:28:14 -- nvmf/common.sh@478 -- # killprocess 193453 00:23:10.639 02:28:14 -- common/autotest_common.sh@936 -- # '[' -z 193453 ']' 00:23:10.639 02:28:14 -- common/autotest_common.sh@940 -- # kill -0 193453 00:23:10.639 02:28:14 -- common/autotest_common.sh@941 -- # uname 00:23:10.639 02:28:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:10.639 02:28:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 193453 00:23:10.639 02:28:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:10.639 02:28:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:10.639 02:28:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 193453' 00:23:10.639 killing process with pid 193453 00:23:10.639 02:28:14 -- common/autotest_common.sh@955 -- # kill 193453 00:23:10.639 [2024-11-29 02:28:14.291640] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:10.639 02:28:14 -- common/autotest_common.sh@960 -- # wait 193453 00:23:11.209 02:28:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:11.209 02:28:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:11.209 02:28:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:11.209 02:28:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:11.209 02:28:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:11.209 02:28:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:11.209 02:28:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:11.209 02:28:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:13.119 02:28:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:13.119 00:23:13.119 real 0m6.453s 00:23:13.119 user 0m7.611s 00:23:13.119 sys 0m2.069s 00:23:13.119 02:28:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:13.119 02:28:16 -- common/autotest_common.sh@10 -- # set +x 00:23:13.119 ************************************ 00:23:13.119 END TEST nvmf_identify 00:23:13.119 ************************************ 00:23:13.119 02:28:16 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:13.119 02:28:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:13.119 02:28:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:13.119 02:28:16 -- common/autotest_common.sh@10 -- # set +x 00:23:13.119 ************************************ 00:23:13.119 START TEST nvmf_perf 00:23:13.119 ************************************ 00:23:13.119 02:28:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:13.119 * Looking for test storage... 00:23:13.119 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:13.119 02:28:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:13.119 02:28:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:13.119 02:28:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:13.377 02:28:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:13.377 02:28:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:13.377 02:28:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:13.377 02:28:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:13.377 02:28:16 -- scripts/common.sh@335 -- # IFS=.-: 00:23:13.377 02:28:16 -- scripts/common.sh@335 -- # read -ra ver1 00:23:13.377 02:28:16 -- scripts/common.sh@336 -- # IFS=.-: 00:23:13.377 02:28:16 -- scripts/common.sh@336 -- # read -ra ver2 00:23:13.377 02:28:16 -- scripts/common.sh@337 -- # local 'op=<' 00:23:13.377 02:28:16 -- scripts/common.sh@339 -- # ver1_l=2 00:23:13.377 02:28:16 -- scripts/common.sh@340 -- # ver2_l=1 00:23:13.377 02:28:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:13.377 02:28:16 -- scripts/common.sh@343 -- # case "$op" in 00:23:13.377 02:28:16 -- scripts/common.sh@344 -- # : 1 00:23:13.377 02:28:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:13.377 02:28:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:13.377 02:28:16 -- scripts/common.sh@364 -- # decimal 1 00:23:13.377 02:28:16 -- scripts/common.sh@352 -- # local d=1 00:23:13.377 02:28:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:13.377 02:28:16 -- scripts/common.sh@354 -- # echo 1 00:23:13.377 02:28:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:13.377 02:28:16 -- scripts/common.sh@365 -- # decimal 2 00:23:13.377 02:28:16 -- scripts/common.sh@352 -- # local d=2 00:23:13.377 02:28:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:13.377 02:28:16 -- scripts/common.sh@354 -- # echo 2 00:23:13.377 02:28:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:13.377 02:28:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:13.377 02:28:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:13.377 02:28:16 -- scripts/common.sh@367 -- # return 0 00:23:13.377 02:28:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:13.377 02:28:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:13.377 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:13.377 --rc genhtml_branch_coverage=1 00:23:13.377 --rc genhtml_function_coverage=1 00:23:13.377 --rc genhtml_legend=1 00:23:13.377 --rc geninfo_all_blocks=1 00:23:13.377 --rc geninfo_unexecuted_blocks=1 00:23:13.377 00:23:13.377 ' 00:23:13.377 02:28:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:13.377 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:13.377 --rc genhtml_branch_coverage=1 00:23:13.377 --rc genhtml_function_coverage=1 00:23:13.377 --rc genhtml_legend=1 00:23:13.377 --rc geninfo_all_blocks=1 00:23:13.377 --rc geninfo_unexecuted_blocks=1 00:23:13.377 00:23:13.377 ' 00:23:13.377 02:28:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:13.377 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:13.377 --rc genhtml_branch_coverage=1 00:23:13.377 --rc genhtml_function_coverage=1 00:23:13.377 --rc genhtml_legend=1 00:23:13.377 --rc geninfo_all_blocks=1 00:23:13.377 --rc geninfo_unexecuted_blocks=1 00:23:13.377 00:23:13.377 ' 00:23:13.377 02:28:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:13.377 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:13.377 --rc genhtml_branch_coverage=1 00:23:13.377 --rc genhtml_function_coverage=1 00:23:13.377 --rc genhtml_legend=1 00:23:13.377 --rc geninfo_all_blocks=1 00:23:13.377 --rc geninfo_unexecuted_blocks=1 00:23:13.377 00:23:13.377 ' 00:23:13.377 02:28:16 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:13.377 02:28:16 -- nvmf/common.sh@7 -- # uname -s 00:23:13.377 02:28:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:13.377 02:28:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:13.377 02:28:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:13.377 02:28:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:13.377 02:28:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:13.377 02:28:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:13.377 02:28:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:13.377 02:28:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:13.377 02:28:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:13.377 02:28:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:13.377 02:28:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:13.377 02:28:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:13.377 02:28:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:13.377 02:28:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:13.377 02:28:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:13.377 02:28:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:13.377 02:28:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:13.377 02:28:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:13.377 02:28:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:13.377 02:28:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:13.378 02:28:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:13.378 02:28:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:13.378 02:28:16 -- paths/export.sh@5 -- # export PATH 00:23:13.378 02:28:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:13.378 02:28:16 -- nvmf/common.sh@46 -- # : 0 00:23:13.378 02:28:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:13.378 02:28:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:13.378 02:28:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:13.378 02:28:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:13.378 02:28:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:13.378 02:28:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:13.378 02:28:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:13.378 02:28:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:13.378 02:28:16 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:23:13.378 02:28:16 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:23:13.378 02:28:16 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:23:13.378 02:28:16 -- host/perf.sh@17 -- # nvmftestinit 00:23:13.378 02:28:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:13.378 02:28:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:13.378 02:28:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:13.378 02:28:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:13.378 02:28:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:13.378 02:28:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:13.378 02:28:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:13.378 02:28:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:13.378 02:28:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:13.378 02:28:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:13.378 02:28:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:13.378 02:28:16 -- common/autotest_common.sh@10 -- # set +x 00:23:15.285 02:28:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:15.285 02:28:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:15.285 02:28:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:15.285 02:28:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:15.285 02:28:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:15.285 02:28:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:15.285 02:28:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:15.285 02:28:18 -- nvmf/common.sh@294 -- # net_devs=() 00:23:15.285 02:28:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:15.285 02:28:18 -- nvmf/common.sh@295 -- # e810=() 00:23:15.285 02:28:18 -- nvmf/common.sh@295 -- # local -ga e810 00:23:15.285 02:28:18 -- nvmf/common.sh@296 -- # x722=() 00:23:15.285 02:28:18 -- nvmf/common.sh@296 -- # local -ga x722 00:23:15.285 02:28:18 -- nvmf/common.sh@297 -- # mlx=() 00:23:15.285 02:28:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:15.285 02:28:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:15.285 02:28:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:15.285 02:28:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:15.285 02:28:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:15.285 02:28:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:15.285 02:28:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:15.285 02:28:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:15.285 02:28:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:15.285 02:28:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:15.285 02:28:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:15.285 02:28:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:15.285 02:28:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:15.285 02:28:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:15.285 02:28:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:15.285 02:28:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:15.285 02:28:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:15.285 02:28:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:15.285 02:28:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:15.285 02:28:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:15.285 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:15.285 02:28:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:15.285 02:28:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:15.285 02:28:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:15.285 02:28:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:15.285 02:28:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:15.285 02:28:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:15.285 02:28:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:15.285 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:15.285 02:28:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:15.285 02:28:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:15.285 02:28:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:15.286 02:28:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:15.286 02:28:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:15.286 02:28:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:15.286 02:28:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:15.286 02:28:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:15.286 02:28:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:15.286 02:28:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:15.286 02:28:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:15.286 02:28:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:15.286 02:28:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:15.286 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:15.286 02:28:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:15.286 02:28:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:15.286 02:28:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:15.286 02:28:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:15.286 02:28:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:15.286 02:28:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:15.286 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:15.286 02:28:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:15.286 02:28:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:15.286 02:28:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:15.286 02:28:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:15.286 02:28:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:15.286 02:28:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:15.286 02:28:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:15.286 02:28:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:15.286 02:28:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:15.286 02:28:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:15.286 02:28:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:15.286 02:28:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:15.286 02:28:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:15.286 02:28:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:15.286 02:28:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:15.286 02:28:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:15.286 02:28:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:15.286 02:28:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:15.286 02:28:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:15.286 02:28:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:15.286 02:28:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:15.286 02:28:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:15.286 02:28:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:15.286 02:28:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:15.286 02:28:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:15.286 02:28:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:15.286 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:15.286 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.156 ms 00:23:15.286 00:23:15.286 --- 10.0.0.2 ping statistics --- 00:23:15.286 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:15.286 rtt min/avg/max/mdev = 0.156/0.156/0.156/0.000 ms 00:23:15.286 02:28:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:15.286 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:15.286 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.080 ms 00:23:15.286 00:23:15.286 --- 10.0.0.1 ping statistics --- 00:23:15.286 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:15.286 rtt min/avg/max/mdev = 0.080/0.080/0.080/0.000 ms 00:23:15.286 02:28:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:15.286 02:28:18 -- nvmf/common.sh@410 -- # return 0 00:23:15.286 02:28:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:15.286 02:28:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:15.286 02:28:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:15.286 02:28:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:15.286 02:28:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:15.286 02:28:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:15.286 02:28:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:15.545 02:28:18 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:23:15.545 02:28:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:15.545 02:28:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:15.545 02:28:18 -- common/autotest_common.sh@10 -- # set +x 00:23:15.545 02:28:18 -- nvmf/common.sh@469 -- # nvmfpid=195569 00:23:15.545 02:28:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:15.545 02:28:18 -- nvmf/common.sh@470 -- # waitforlisten 195569 00:23:15.545 02:28:18 -- common/autotest_common.sh@829 -- # '[' -z 195569 ']' 00:23:15.545 02:28:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:15.545 02:28:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:15.545 02:28:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:15.545 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:15.545 02:28:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:15.545 02:28:18 -- common/autotest_common.sh@10 -- # set +x 00:23:15.545 [2024-11-29 02:28:19.014698] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:15.545 [2024-11-29 02:28:19.014767] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:15.545 EAL: No free 2048 kB hugepages reported on node 1 00:23:15.545 [2024-11-29 02:28:19.085161] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:15.545 [2024-11-29 02:28:19.201155] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:15.545 [2024-11-29 02:28:19.201319] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:15.545 [2024-11-29 02:28:19.201339] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:15.545 [2024-11-29 02:28:19.201353] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:15.545 [2024-11-29 02:28:19.201416] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:15.545 [2024-11-29 02:28:19.201472] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:15.545 [2024-11-29 02:28:19.201511] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:15.545 [2024-11-29 02:28:19.201515] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:16.481 02:28:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:16.481 02:28:20 -- common/autotest_common.sh@862 -- # return 0 00:23:16.481 02:28:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:16.481 02:28:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:16.481 02:28:20 -- common/autotest_common.sh@10 -- # set +x 00:23:16.481 02:28:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:16.481 02:28:20 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:23:16.481 02:28:20 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:23:19.769 02:28:23 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:23:19.769 02:28:23 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:23:19.769 02:28:23 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:23:19.769 02:28:23 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:23:20.027 02:28:23 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:23:20.027 02:28:23 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:23:20.027 02:28:23 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:23:20.027 02:28:23 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:23:20.027 02:28:23 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:23:20.285 [2024-11-29 02:28:23.914347] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:20.285 02:28:23 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:20.543 02:28:24 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:20.543 02:28:24 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:20.801 02:28:24 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:20.801 02:28:24 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:23:21.059 02:28:24 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:21.318 [2024-11-29 02:28:24.942256] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:21.318 02:28:24 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:21.575 02:28:25 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:23:21.575 02:28:25 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:21.575 02:28:25 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:23:21.575 02:28:25 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:22.948 Initializing NVMe Controllers 00:23:22.948 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:23:22.948 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:23:22.948 Initialization complete. Launching workers. 00:23:22.948 ======================================================== 00:23:22.948 Latency(us) 00:23:22.948 Device Information : IOPS MiB/s Average min max 00:23:22.948 PCIE (0000:88:00.0) NSID 1 from core 0: 87160.00 340.47 366.73 10.36 6248.78 00:23:22.948 ======================================================== 00:23:22.948 Total : 87160.00 340.47 366.73 10.36 6248.78 00:23:22.948 00:23:22.948 02:28:26 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:22.948 EAL: No free 2048 kB hugepages reported on node 1 00:23:24.329 Initializing NVMe Controllers 00:23:24.329 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:24.330 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:24.330 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:24.330 Initialization complete. Launching workers. 00:23:24.330 ======================================================== 00:23:24.330 Latency(us) 00:23:24.330 Device Information : IOPS MiB/s Average min max 00:23:24.330 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 100.00 0.39 10404.92 151.10 45463.81 00:23:24.330 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 60.00 0.23 17289.82 7937.94 47901.96 00:23:24.330 ======================================================== 00:23:24.330 Total : 160.00 0.62 12986.76 151.10 47901.96 00:23:24.330 00:23:24.330 02:28:27 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:24.330 EAL: No free 2048 kB hugepages reported on node 1 00:23:25.708 Initializing NVMe Controllers 00:23:25.708 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:25.708 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:25.708 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:25.708 Initialization complete. Launching workers. 00:23:25.708 ======================================================== 00:23:25.708 Latency(us) 00:23:25.708 Device Information : IOPS MiB/s Average min max 00:23:25.708 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8721.65 34.07 3684.62 568.03 10716.37 00:23:25.708 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3825.41 14.94 8401.81 6312.85 16375.19 00:23:25.708 ======================================================== 00:23:25.708 Total : 12547.06 49.01 5122.82 568.03 16375.19 00:23:25.708 00:23:25.708 02:28:29 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:23:25.708 02:28:29 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:23:25.708 02:28:29 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:25.708 EAL: No free 2048 kB hugepages reported on node 1 00:23:28.244 Initializing NVMe Controllers 00:23:28.244 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:28.244 Controller IO queue size 128, less than required. 00:23:28.244 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:28.244 Controller IO queue size 128, less than required. 00:23:28.244 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:28.244 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:28.244 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:28.244 Initialization complete. Launching workers. 00:23:28.244 ======================================================== 00:23:28.244 Latency(us) 00:23:28.244 Device Information : IOPS MiB/s Average min max 00:23:28.244 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1687.20 421.80 77455.51 48881.87 118305.25 00:23:28.244 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 573.55 143.39 234465.39 87136.51 334285.50 00:23:28.244 ======================================================== 00:23:28.244 Total : 2260.75 565.19 117288.66 48881.87 334285.50 00:23:28.244 00:23:28.244 02:28:31 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:23:28.504 EAL: No free 2048 kB hugepages reported on node 1 00:23:28.763 No valid NVMe controllers or AIO or URING devices found 00:23:28.763 Initializing NVMe Controllers 00:23:28.763 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:28.763 Controller IO queue size 128, less than required. 00:23:28.763 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:28.763 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:23:28.763 Controller IO queue size 128, less than required. 00:23:28.763 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:28.763 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:23:28.763 WARNING: Some requested NVMe devices were skipped 00:23:28.763 02:28:32 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:23:28.763 EAL: No free 2048 kB hugepages reported on node 1 00:23:31.298 Initializing NVMe Controllers 00:23:31.298 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:31.298 Controller IO queue size 128, less than required. 00:23:31.298 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:31.298 Controller IO queue size 128, less than required. 00:23:31.298 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:31.298 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:31.298 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:31.298 Initialization complete. Launching workers. 00:23:31.298 00:23:31.298 ==================== 00:23:31.298 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:23:31.298 TCP transport: 00:23:31.298 polls: 11518 00:23:31.298 idle_polls: 8419 00:23:31.298 sock_completions: 3099 00:23:31.298 nvme_completions: 5807 00:23:31.298 submitted_requests: 8866 00:23:31.298 queued_requests: 1 00:23:31.298 00:23:31.298 ==================== 00:23:31.298 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:23:31.298 TCP transport: 00:23:31.298 polls: 8973 00:23:31.298 idle_polls: 5568 00:23:31.298 sock_completions: 3405 00:23:31.298 nvme_completions: 6264 00:23:31.298 submitted_requests: 9595 00:23:31.298 queued_requests: 1 00:23:31.298 ======================================================== 00:23:31.298 Latency(us) 00:23:31.298 Device Information : IOPS MiB/s Average min max 00:23:31.298 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1515.49 378.87 85977.26 46346.33 141383.70 00:23:31.298 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1629.49 407.37 79834.22 40930.25 123518.79 00:23:31.298 ======================================================== 00:23:31.298 Total : 3144.97 786.24 82794.40 40930.25 141383.70 00:23:31.298 00:23:31.298 02:28:34 -- host/perf.sh@66 -- # sync 00:23:31.298 02:28:34 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:31.556 02:28:35 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:23:31.556 02:28:35 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:23:31.556 02:28:35 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:23:35.752 02:28:38 -- host/perf.sh@72 -- # ls_guid=353686d4-37e5-491b-bbb3-6cb8c5f07507 00:23:35.752 02:28:38 -- host/perf.sh@73 -- # get_lvs_free_mb 353686d4-37e5-491b-bbb3-6cb8c5f07507 00:23:35.752 02:28:38 -- common/autotest_common.sh@1353 -- # local lvs_uuid=353686d4-37e5-491b-bbb3-6cb8c5f07507 00:23:35.752 02:28:38 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:35.752 02:28:38 -- common/autotest_common.sh@1355 -- # local fc 00:23:35.752 02:28:38 -- common/autotest_common.sh@1356 -- # local cs 00:23:35.752 02:28:38 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:35.752 02:28:38 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:35.752 { 00:23:35.752 "uuid": "353686d4-37e5-491b-bbb3-6cb8c5f07507", 00:23:35.752 "name": "lvs_0", 00:23:35.752 "base_bdev": "Nvme0n1", 00:23:35.752 "total_data_clusters": 238234, 00:23:35.752 "free_clusters": 238234, 00:23:35.752 "block_size": 512, 00:23:35.752 "cluster_size": 4194304 00:23:35.752 } 00:23:35.752 ]' 00:23:35.752 02:28:38 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="353686d4-37e5-491b-bbb3-6cb8c5f07507") .free_clusters' 00:23:35.752 02:28:38 -- common/autotest_common.sh@1358 -- # fc=238234 00:23:35.752 02:28:38 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="353686d4-37e5-491b-bbb3-6cb8c5f07507") .cluster_size' 00:23:35.752 02:28:38 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:35.752 02:28:38 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:23:35.752 02:28:38 -- common/autotest_common.sh@1363 -- # echo 952936 00:23:35.752 952936 00:23:35.752 02:28:38 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:23:35.752 02:28:38 -- host/perf.sh@78 -- # free_mb=20480 00:23:35.752 02:28:38 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 353686d4-37e5-491b-bbb3-6cb8c5f07507 lbd_0 20480 00:23:35.752 02:28:39 -- host/perf.sh@80 -- # lb_guid=632b8470-0480-4c1a-ba24-252091ce18f9 00:23:35.752 02:28:39 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 632b8470-0480-4c1a-ba24-252091ce18f9 lvs_n_0 00:23:36.759 02:28:40 -- host/perf.sh@83 -- # ls_nested_guid=32742b07-4122-4bb7-96a9-cbd9398bf8b5 00:23:36.759 02:28:40 -- host/perf.sh@84 -- # get_lvs_free_mb 32742b07-4122-4bb7-96a9-cbd9398bf8b5 00:23:36.759 02:28:40 -- common/autotest_common.sh@1353 -- # local lvs_uuid=32742b07-4122-4bb7-96a9-cbd9398bf8b5 00:23:36.759 02:28:40 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:36.759 02:28:40 -- common/autotest_common.sh@1355 -- # local fc 00:23:36.759 02:28:40 -- common/autotest_common.sh@1356 -- # local cs 00:23:36.759 02:28:40 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:36.759 02:28:40 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:36.759 { 00:23:36.759 "uuid": "353686d4-37e5-491b-bbb3-6cb8c5f07507", 00:23:36.759 "name": "lvs_0", 00:23:36.759 "base_bdev": "Nvme0n1", 00:23:36.759 "total_data_clusters": 238234, 00:23:36.759 "free_clusters": 233114, 00:23:36.759 "block_size": 512, 00:23:36.759 "cluster_size": 4194304 00:23:36.759 }, 00:23:36.759 { 00:23:36.759 "uuid": "32742b07-4122-4bb7-96a9-cbd9398bf8b5", 00:23:36.759 "name": "lvs_n_0", 00:23:36.759 "base_bdev": "632b8470-0480-4c1a-ba24-252091ce18f9", 00:23:36.759 "total_data_clusters": 5114, 00:23:36.759 "free_clusters": 5114, 00:23:36.759 "block_size": 512, 00:23:36.759 "cluster_size": 4194304 00:23:36.759 } 00:23:36.759 ]' 00:23:36.759 02:28:40 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="32742b07-4122-4bb7-96a9-cbd9398bf8b5") .free_clusters' 00:23:37.049 02:28:40 -- common/autotest_common.sh@1358 -- # fc=5114 00:23:37.049 02:28:40 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="32742b07-4122-4bb7-96a9-cbd9398bf8b5") .cluster_size' 00:23:37.049 02:28:40 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:37.049 02:28:40 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:23:37.049 02:28:40 -- common/autotest_common.sh@1363 -- # echo 20456 00:23:37.049 20456 00:23:37.049 02:28:40 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:23:37.049 02:28:40 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 32742b07-4122-4bb7-96a9-cbd9398bf8b5 lbd_nest_0 20456 00:23:37.308 02:28:40 -- host/perf.sh@88 -- # lb_nested_guid=4090eb19-f5d3-408d-a00c-f3fc0aff7c12 00:23:37.308 02:28:40 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:37.308 02:28:40 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:23:37.308 02:28:40 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 4090eb19-f5d3-408d-a00c-f3fc0aff7c12 00:23:37.567 02:28:41 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:37.826 02:28:41 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:23:37.826 02:28:41 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:23:37.826 02:28:41 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:37.826 02:28:41 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:37.826 02:28:41 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:38.087 EAL: No free 2048 kB hugepages reported on node 1 00:23:50.301 Initializing NVMe Controllers 00:23:50.301 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:50.301 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:50.301 Initialization complete. Launching workers. 00:23:50.301 ======================================================== 00:23:50.301 Latency(us) 00:23:50.301 Device Information : IOPS MiB/s Average min max 00:23:50.301 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 48.30 0.02 20764.61 171.23 47894.22 00:23:50.301 ======================================================== 00:23:50.301 Total : 48.30 0.02 20764.61 171.23 47894.22 00:23:50.301 00:23:50.301 02:28:52 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:50.301 02:28:52 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:50.301 EAL: No free 2048 kB hugepages reported on node 1 00:24:00.288 Initializing NVMe Controllers 00:24:00.288 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:00.288 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:00.288 Initialization complete. Launching workers. 00:24:00.288 ======================================================== 00:24:00.288 Latency(us) 00:24:00.288 Device Information : IOPS MiB/s Average min max 00:24:00.288 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 82.80 10.35 12105.12 5017.13 47898.91 00:24:00.288 ======================================================== 00:24:00.288 Total : 82.80 10.35 12105.12 5017.13 47898.91 00:24:00.288 00:24:00.288 02:29:02 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:00.288 02:29:02 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:00.288 02:29:02 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:00.288 EAL: No free 2048 kB hugepages reported on node 1 00:24:10.265 Initializing NVMe Controllers 00:24:10.265 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:10.265 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:10.265 Initialization complete. Launching workers. 00:24:10.265 ======================================================== 00:24:10.265 Latency(us) 00:24:10.265 Device Information : IOPS MiB/s Average min max 00:24:10.265 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7935.95 3.87 4032.01 267.16 10363.46 00:24:10.265 ======================================================== 00:24:10.265 Total : 7935.95 3.87 4032.01 267.16 10363.46 00:24:10.265 00:24:10.265 02:29:12 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:10.265 02:29:12 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:10.265 EAL: No free 2048 kB hugepages reported on node 1 00:24:20.248 Initializing NVMe Controllers 00:24:20.248 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:20.248 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:20.249 Initialization complete. Launching workers. 00:24:20.249 ======================================================== 00:24:20.249 Latency(us) 00:24:20.249 Device Information : IOPS MiB/s Average min max 00:24:20.249 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 4100.20 512.52 7804.36 633.93 18925.08 00:24:20.249 ======================================================== 00:24:20.249 Total : 4100.20 512.52 7804.36 633.93 18925.08 00:24:20.249 00:24:20.249 02:29:22 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:20.249 02:29:22 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:20.249 02:29:22 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:20.249 EAL: No free 2048 kB hugepages reported on node 1 00:24:30.225 Initializing NVMe Controllers 00:24:30.225 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:30.225 Controller IO queue size 128, less than required. 00:24:30.225 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:30.225 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:30.225 Initialization complete. Launching workers. 00:24:30.225 ======================================================== 00:24:30.225 Latency(us) 00:24:30.225 Device Information : IOPS MiB/s Average min max 00:24:30.225 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12062.23 5.89 10613.35 1824.99 26009.70 00:24:30.225 ======================================================== 00:24:30.225 Total : 12062.23 5.89 10613.35 1824.99 26009.70 00:24:30.225 00:24:30.225 02:29:33 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:30.225 02:29:33 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:30.225 EAL: No free 2048 kB hugepages reported on node 1 00:24:40.211 Initializing NVMe Controllers 00:24:40.211 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:40.211 Controller IO queue size 128, less than required. 00:24:40.211 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:40.211 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:40.211 Initialization complete. Launching workers. 00:24:40.211 ======================================================== 00:24:40.211 Latency(us) 00:24:40.211 Device Information : IOPS MiB/s Average min max 00:24:40.211 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1179.20 147.40 109057.11 15791.83 234578.91 00:24:40.211 ======================================================== 00:24:40.211 Total : 1179.20 147.40 109057.11 15791.83 234578.91 00:24:40.211 00:24:40.211 02:29:43 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:40.469 02:29:44 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 4090eb19-f5d3-408d-a00c-f3fc0aff7c12 00:24:41.405 02:29:44 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:41.405 02:29:45 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 632b8470-0480-4c1a-ba24-252091ce18f9 00:24:41.666 02:29:45 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:41.924 02:29:45 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:24:41.924 02:29:45 -- host/perf.sh@114 -- # nvmftestfini 00:24:41.924 02:29:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:41.924 02:29:45 -- nvmf/common.sh@116 -- # sync 00:24:41.924 02:29:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:41.924 02:29:45 -- nvmf/common.sh@119 -- # set +e 00:24:41.924 02:29:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:41.924 02:29:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:41.924 rmmod nvme_tcp 00:24:42.182 rmmod nvme_fabrics 00:24:42.182 rmmod nvme_keyring 00:24:42.182 02:29:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:42.182 02:29:45 -- nvmf/common.sh@123 -- # set -e 00:24:42.182 02:29:45 -- nvmf/common.sh@124 -- # return 0 00:24:42.182 02:29:45 -- nvmf/common.sh@477 -- # '[' -n 195569 ']' 00:24:42.182 02:29:45 -- nvmf/common.sh@478 -- # killprocess 195569 00:24:42.182 02:29:45 -- common/autotest_common.sh@936 -- # '[' -z 195569 ']' 00:24:42.182 02:29:45 -- common/autotest_common.sh@940 -- # kill -0 195569 00:24:42.182 02:29:45 -- common/autotest_common.sh@941 -- # uname 00:24:42.182 02:29:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:42.182 02:29:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 195569 00:24:42.182 02:29:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:42.182 02:29:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:42.182 02:29:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 195569' 00:24:42.182 killing process with pid 195569 00:24:42.182 02:29:45 -- common/autotest_common.sh@955 -- # kill 195569 00:24:42.182 02:29:45 -- common/autotest_common.sh@960 -- # wait 195569 00:24:44.090 02:29:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:44.090 02:29:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:44.090 02:29:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:44.090 02:29:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:44.090 02:29:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:44.090 02:29:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:44.090 02:29:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:44.090 02:29:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:45.997 02:29:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:45.997 00:24:45.997 real 1m32.729s 00:24:45.997 user 5m43.683s 00:24:45.997 sys 0m15.740s 00:24:45.997 02:29:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:45.997 02:29:49 -- common/autotest_common.sh@10 -- # set +x 00:24:45.997 ************************************ 00:24:45.997 END TEST nvmf_perf 00:24:45.997 ************************************ 00:24:45.997 02:29:49 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:45.997 02:29:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:45.997 02:29:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:45.997 02:29:49 -- common/autotest_common.sh@10 -- # set +x 00:24:45.997 ************************************ 00:24:45.997 START TEST nvmf_fio_host 00:24:45.997 ************************************ 00:24:45.997 02:29:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:45.997 * Looking for test storage... 00:24:45.997 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:45.997 02:29:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:45.997 02:29:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:45.997 02:29:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:45.997 02:29:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:45.997 02:29:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:45.997 02:29:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:45.997 02:29:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:45.997 02:29:49 -- scripts/common.sh@335 -- # IFS=.-: 00:24:45.997 02:29:49 -- scripts/common.sh@335 -- # read -ra ver1 00:24:45.997 02:29:49 -- scripts/common.sh@336 -- # IFS=.-: 00:24:45.997 02:29:49 -- scripts/common.sh@336 -- # read -ra ver2 00:24:45.997 02:29:49 -- scripts/common.sh@337 -- # local 'op=<' 00:24:45.997 02:29:49 -- scripts/common.sh@339 -- # ver1_l=2 00:24:45.997 02:29:49 -- scripts/common.sh@340 -- # ver2_l=1 00:24:45.997 02:29:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:45.997 02:29:49 -- scripts/common.sh@343 -- # case "$op" in 00:24:45.997 02:29:49 -- scripts/common.sh@344 -- # : 1 00:24:45.997 02:29:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:45.997 02:29:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:45.997 02:29:49 -- scripts/common.sh@364 -- # decimal 1 00:24:45.997 02:29:49 -- scripts/common.sh@352 -- # local d=1 00:24:45.997 02:29:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:45.997 02:29:49 -- scripts/common.sh@354 -- # echo 1 00:24:45.997 02:29:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:45.997 02:29:49 -- scripts/common.sh@365 -- # decimal 2 00:24:45.997 02:29:49 -- scripts/common.sh@352 -- # local d=2 00:24:45.997 02:29:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:45.997 02:29:49 -- scripts/common.sh@354 -- # echo 2 00:24:45.997 02:29:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:45.997 02:29:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:45.997 02:29:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:45.997 02:29:49 -- scripts/common.sh@367 -- # return 0 00:24:45.997 02:29:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:45.997 02:29:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:45.997 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:45.997 --rc genhtml_branch_coverage=1 00:24:45.997 --rc genhtml_function_coverage=1 00:24:45.997 --rc genhtml_legend=1 00:24:45.997 --rc geninfo_all_blocks=1 00:24:45.997 --rc geninfo_unexecuted_blocks=1 00:24:45.997 00:24:45.997 ' 00:24:45.997 02:29:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:45.997 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:45.997 --rc genhtml_branch_coverage=1 00:24:45.997 --rc genhtml_function_coverage=1 00:24:45.997 --rc genhtml_legend=1 00:24:45.997 --rc geninfo_all_blocks=1 00:24:45.997 --rc geninfo_unexecuted_blocks=1 00:24:45.997 00:24:45.997 ' 00:24:45.997 02:29:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:45.997 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:45.997 --rc genhtml_branch_coverage=1 00:24:45.997 --rc genhtml_function_coverage=1 00:24:45.997 --rc genhtml_legend=1 00:24:45.997 --rc geninfo_all_blocks=1 00:24:45.997 --rc geninfo_unexecuted_blocks=1 00:24:45.997 00:24:45.997 ' 00:24:45.997 02:29:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:45.997 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:45.997 --rc genhtml_branch_coverage=1 00:24:45.997 --rc genhtml_function_coverage=1 00:24:45.997 --rc genhtml_legend=1 00:24:45.997 --rc geninfo_all_blocks=1 00:24:45.997 --rc geninfo_unexecuted_blocks=1 00:24:45.997 00:24:45.997 ' 00:24:45.997 02:29:49 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:45.997 02:29:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:45.997 02:29:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:45.997 02:29:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:45.997 02:29:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:45.997 02:29:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:45.997 02:29:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:45.997 02:29:49 -- paths/export.sh@5 -- # export PATH 00:24:45.997 02:29:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:45.997 02:29:49 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:45.997 02:29:49 -- nvmf/common.sh@7 -- # uname -s 00:24:45.997 02:29:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:45.997 02:29:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:45.997 02:29:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:45.997 02:29:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:45.997 02:29:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:45.997 02:29:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:45.997 02:29:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:45.997 02:29:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:45.997 02:29:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:45.997 02:29:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:45.997 02:29:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:45.997 02:29:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:45.997 02:29:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:45.997 02:29:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:45.997 02:29:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:45.998 02:29:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:45.998 02:29:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:45.998 02:29:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:45.998 02:29:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:45.998 02:29:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:45.998 02:29:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:45.998 02:29:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:45.998 02:29:49 -- paths/export.sh@5 -- # export PATH 00:24:45.998 02:29:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:45.998 02:29:49 -- nvmf/common.sh@46 -- # : 0 00:24:45.998 02:29:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:45.998 02:29:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:45.998 02:29:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:45.998 02:29:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:45.998 02:29:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:45.998 02:29:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:45.998 02:29:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:45.998 02:29:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:45.998 02:29:49 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:24:45.998 02:29:49 -- host/fio.sh@14 -- # nvmftestinit 00:24:45.998 02:29:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:45.998 02:29:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:45.998 02:29:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:45.998 02:29:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:45.998 02:29:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:45.998 02:29:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:45.998 02:29:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:45.998 02:29:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:45.998 02:29:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:45.998 02:29:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:45.998 02:29:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:45.998 02:29:49 -- common/autotest_common.sh@10 -- # set +x 00:24:47.903 02:29:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:47.903 02:29:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:47.903 02:29:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:47.903 02:29:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:47.903 02:29:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:47.903 02:29:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:47.903 02:29:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:47.903 02:29:51 -- nvmf/common.sh@294 -- # net_devs=() 00:24:47.903 02:29:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:47.903 02:29:51 -- nvmf/common.sh@295 -- # e810=() 00:24:47.903 02:29:51 -- nvmf/common.sh@295 -- # local -ga e810 00:24:47.903 02:29:51 -- nvmf/common.sh@296 -- # x722=() 00:24:47.903 02:29:51 -- nvmf/common.sh@296 -- # local -ga x722 00:24:47.903 02:29:51 -- nvmf/common.sh@297 -- # mlx=() 00:24:47.903 02:29:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:47.903 02:29:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:47.903 02:29:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:47.903 02:29:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:47.903 02:29:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:47.903 02:29:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:47.903 02:29:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:47.903 02:29:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:47.903 02:29:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:47.903 02:29:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:47.903 02:29:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:47.903 02:29:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:47.903 02:29:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:47.903 02:29:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:47.903 02:29:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:47.903 02:29:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:47.903 02:29:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:47.903 02:29:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:47.903 02:29:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:47.903 02:29:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:47.903 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:47.903 02:29:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:47.903 02:29:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:47.903 02:29:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:47.903 02:29:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:47.903 02:29:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:47.903 02:29:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:47.903 02:29:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:47.903 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:47.903 02:29:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:47.903 02:29:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:47.903 02:29:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:47.903 02:29:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:47.903 02:29:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:47.903 02:29:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:47.903 02:29:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:47.903 02:29:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:47.903 02:29:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:47.903 02:29:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:47.903 02:29:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:47.903 02:29:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:47.903 02:29:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:47.903 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:47.903 02:29:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:47.903 02:29:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:47.903 02:29:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:47.903 02:29:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:47.903 02:29:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:47.903 02:29:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:47.903 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:47.903 02:29:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:47.903 02:29:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:47.903 02:29:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:47.903 02:29:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:47.903 02:29:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:47.903 02:29:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:47.903 02:29:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:47.903 02:29:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:47.903 02:29:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:47.903 02:29:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:47.903 02:29:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:47.903 02:29:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:47.903 02:29:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:47.903 02:29:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:47.903 02:29:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:47.903 02:29:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:47.903 02:29:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:47.903 02:29:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:47.903 02:29:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:48.163 02:29:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:48.163 02:29:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:48.163 02:29:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:48.163 02:29:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:48.163 02:29:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:48.163 02:29:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:48.163 02:29:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:48.163 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:48.163 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.226 ms 00:24:48.163 00:24:48.163 --- 10.0.0.2 ping statistics --- 00:24:48.163 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:48.163 rtt min/avg/max/mdev = 0.226/0.226/0.226/0.000 ms 00:24:48.163 02:29:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:48.163 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:48.163 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:24:48.163 00:24:48.163 --- 10.0.0.1 ping statistics --- 00:24:48.163 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:48.163 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:24:48.163 02:29:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:48.163 02:29:51 -- nvmf/common.sh@410 -- # return 0 00:24:48.163 02:29:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:48.163 02:29:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:48.163 02:29:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:48.163 02:29:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:48.163 02:29:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:48.163 02:29:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:48.163 02:29:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:48.163 02:29:51 -- host/fio.sh@16 -- # [[ y != y ]] 00:24:48.163 02:29:51 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:24:48.163 02:29:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:48.163 02:29:51 -- common/autotest_common.sh@10 -- # set +x 00:24:48.163 02:29:51 -- host/fio.sh@24 -- # nvmfpid=208139 00:24:48.163 02:29:51 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:24:48.163 02:29:51 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:48.163 02:29:51 -- host/fio.sh@28 -- # waitforlisten 208139 00:24:48.163 02:29:51 -- common/autotest_common.sh@829 -- # '[' -z 208139 ']' 00:24:48.163 02:29:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:48.163 02:29:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:48.163 02:29:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:48.163 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:48.163 02:29:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:48.163 02:29:51 -- common/autotest_common.sh@10 -- # set +x 00:24:48.163 [2024-11-29 02:29:51.733595] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:48.163 [2024-11-29 02:29:51.733686] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:48.163 EAL: No free 2048 kB hugepages reported on node 1 00:24:48.163 [2024-11-29 02:29:51.802866] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:48.424 [2024-11-29 02:29:51.919589] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:48.424 [2024-11-29 02:29:51.919761] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:48.424 [2024-11-29 02:29:51.919794] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:48.424 [2024-11-29 02:29:51.919810] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:48.424 [2024-11-29 02:29:51.919877] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:48.424 [2024-11-29 02:29:51.919936] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:48.424 [2024-11-29 02:29:51.920065] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:48.424 [2024-11-29 02:29:51.920068] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:49.360 02:29:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:49.361 02:29:52 -- common/autotest_common.sh@862 -- # return 0 00:24:49.361 02:29:52 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:24:49.361 [2024-11-29 02:29:52.925612] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:49.361 02:29:52 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:24:49.361 02:29:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:49.361 02:29:52 -- common/autotest_common.sh@10 -- # set +x 00:24:49.361 02:29:52 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:24:49.619 Malloc1 00:24:49.619 02:29:53 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:49.877 02:29:53 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:50.135 02:29:53 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:50.394 [2024-11-29 02:29:53.975914] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:50.394 02:29:53 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:24:50.653 02:29:54 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:24:50.653 02:29:54 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:50.653 02:29:54 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:50.653 02:29:54 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:50.653 02:29:54 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:50.653 02:29:54 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:50.653 02:29:54 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:50.653 02:29:54 -- common/autotest_common.sh@1330 -- # shift 00:24:50.653 02:29:54 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:50.653 02:29:54 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:50.653 02:29:54 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:50.653 02:29:54 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:50.653 02:29:54 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:50.653 02:29:54 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:50.653 02:29:54 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:50.653 02:29:54 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:50.653 02:29:54 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:50.653 02:29:54 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:50.653 02:29:54 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:50.653 02:29:54 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:50.653 02:29:54 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:50.653 02:29:54 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:50.653 02:29:54 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:50.911 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:50.911 fio-3.35 00:24:50.911 Starting 1 thread 00:24:50.911 EAL: No free 2048 kB hugepages reported on node 1 00:24:53.517 00:24:53.517 test: (groupid=0, jobs=1): err= 0: pid=208635: Fri Nov 29 02:29:56 2024 00:24:53.517 read: IOPS=9008, BW=35.2MiB/s (36.9MB/s)(70.6MiB/2006msec) 00:24:53.517 slat (nsec): min=1838, max=134200, avg=2394.56, stdev=1635.58 00:24:53.517 clat (usec): min=2346, max=13520, avg=7837.64, stdev=592.83 00:24:53.517 lat (usec): min=2365, max=13523, avg=7840.03, stdev=592.76 00:24:53.517 clat percentiles (usec): 00:24:53.517 | 1.00th=[ 6521], 5.00th=[ 6915], 10.00th=[ 7111], 20.00th=[ 7373], 00:24:53.517 | 30.00th=[ 7570], 40.00th=[ 7701], 50.00th=[ 7832], 60.00th=[ 7963], 00:24:53.517 | 70.00th=[ 8094], 80.00th=[ 8291], 90.00th=[ 8586], 95.00th=[ 8717], 00:24:53.517 | 99.00th=[ 9241], 99.50th=[ 9372], 99.90th=[11207], 99.95th=[12649], 00:24:53.517 | 99.99th=[13435] 00:24:53.517 bw ( KiB/s): min=34744, max=36936, per=99.89%, avg=35996.00, stdev=913.04, samples=4 00:24:53.517 iops : min= 8686, max= 9234, avg=8999.00, stdev=228.26, samples=4 00:24:53.517 write: IOPS=9027, BW=35.3MiB/s (37.0MB/s)(70.7MiB/2006msec); 0 zone resets 00:24:53.517 slat (nsec): min=1928, max=103985, avg=2458.69, stdev=1218.03 00:24:53.517 clat (usec): min=1005, max=11930, avg=6326.06, stdev=521.33 00:24:53.517 lat (usec): min=1012, max=11932, avg=6328.52, stdev=521.31 00:24:53.517 clat percentiles (usec): 00:24:53.517 | 1.00th=[ 5211], 5.00th=[ 5538], 10.00th=[ 5735], 20.00th=[ 5932], 00:24:53.517 | 30.00th=[ 6063], 40.00th=[ 6194], 50.00th=[ 6325], 60.00th=[ 6456], 00:24:53.517 | 70.00th=[ 6587], 80.00th=[ 6718], 90.00th=[ 6915], 95.00th=[ 7111], 00:24:53.517 | 99.00th=[ 7504], 99.50th=[ 7635], 99.90th=[ 9896], 99.95th=[11076], 00:24:53.517 | 99.99th=[11863] 00:24:53.517 bw ( KiB/s): min=35656, max=36480, per=100.00%, avg=36112.00, stdev=397.59, samples=4 00:24:53.517 iops : min= 8914, max= 9120, avg=9028.00, stdev=99.40, samples=4 00:24:53.517 lat (msec) : 2=0.02%, 4=0.08%, 10=99.78%, 20=0.12% 00:24:53.517 cpu : usr=63.89%, sys=34.11%, ctx=71, majf=0, minf=41 00:24:53.517 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:24:53.517 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:53.517 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:53.517 issued rwts: total=18072,18109,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:53.517 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:53.517 00:24:53.517 Run status group 0 (all jobs): 00:24:53.517 READ: bw=35.2MiB/s (36.9MB/s), 35.2MiB/s-35.2MiB/s (36.9MB/s-36.9MB/s), io=70.6MiB (74.0MB), run=2006-2006msec 00:24:53.517 WRITE: bw=35.3MiB/s (37.0MB/s), 35.3MiB/s-35.3MiB/s (37.0MB/s-37.0MB/s), io=70.7MiB (74.2MB), run=2006-2006msec 00:24:53.517 02:29:56 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:53.517 02:29:56 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:53.517 02:29:56 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:53.517 02:29:56 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:53.517 02:29:56 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:53.517 02:29:56 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:53.517 02:29:56 -- common/autotest_common.sh@1330 -- # shift 00:24:53.517 02:29:56 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:53.517 02:29:56 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:53.517 02:29:56 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:53.517 02:29:56 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:53.517 02:29:56 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:53.517 02:29:56 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:53.517 02:29:56 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:53.517 02:29:56 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:53.517 02:29:56 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:53.517 02:29:56 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:53.517 02:29:56 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:53.517 02:29:56 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:53.517 02:29:56 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:53.517 02:29:56 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:53.517 02:29:56 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:53.517 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:24:53.517 fio-3.35 00:24:53.517 Starting 1 thread 00:24:53.517 EAL: No free 2048 kB hugepages reported on node 1 00:24:56.047 00:24:56.047 test: (groupid=0, jobs=1): err= 0: pid=208988: Fri Nov 29 02:29:59 2024 00:24:56.047 read: IOPS=8809, BW=138MiB/s (144MB/s)(276MiB/2006msec) 00:24:56.047 slat (usec): min=2, max=137, avg= 3.76, stdev= 2.14 00:24:56.047 clat (usec): min=2551, max=17154, avg=8436.34, stdev=2114.73 00:24:56.047 lat (usec): min=2554, max=17158, avg=8440.10, stdev=2114.81 00:24:56.047 clat percentiles (usec): 00:24:56.047 | 1.00th=[ 4424], 5.00th=[ 5211], 10.00th=[ 5800], 20.00th=[ 6587], 00:24:56.047 | 30.00th=[ 7177], 40.00th=[ 7701], 50.00th=[ 8291], 60.00th=[ 8979], 00:24:56.047 | 70.00th=[ 9503], 80.00th=[10290], 90.00th=[11076], 95.00th=[11994], 00:24:56.047 | 99.00th=[13960], 99.50th=[14615], 99.90th=[16188], 99.95th=[16319], 00:24:56.047 | 99.99th=[17171] 00:24:56.047 bw ( KiB/s): min=66976, max=80096, per=52.07%, avg=73400.00, stdev=6820.50, samples=4 00:24:56.047 iops : min= 4186, max= 5006, avg=4587.50, stdev=426.28, samples=4 00:24:56.047 write: IOPS=5364, BW=83.8MiB/s (87.9MB/s)(150MiB/1784msec); 0 zone resets 00:24:56.047 slat (usec): min=30, max=154, avg=34.36, stdev= 6.09 00:24:56.047 clat (usec): min=3809, max=19431, avg=10593.01, stdev=1764.52 00:24:56.047 lat (usec): min=3842, max=19462, avg=10627.37, stdev=1764.70 00:24:56.047 clat percentiles (usec): 00:24:56.047 | 1.00th=[ 7439], 5.00th=[ 8094], 10.00th=[ 8586], 20.00th=[ 9110], 00:24:56.047 | 30.00th=[ 9503], 40.00th=[ 9896], 50.00th=[10421], 60.00th=[10814], 00:24:56.047 | 70.00th=[11338], 80.00th=[11994], 90.00th=[13042], 95.00th=[13829], 00:24:56.047 | 99.00th=[15401], 99.50th=[16057], 99.90th=[16909], 99.95th=[19268], 00:24:56.047 | 99.99th=[19530] 00:24:56.047 bw ( KiB/s): min=70464, max=83840, per=89.20%, avg=76568.00, stdev=7046.75, samples=4 00:24:56.047 iops : min= 4404, max= 5240, avg=4785.50, stdev=440.42, samples=4 00:24:56.047 lat (msec) : 4=0.33%, 10=64.41%, 20=35.25% 00:24:56.047 cpu : usr=80.00%, sys=18.55%, ctx=34, majf=0, minf=71 00:24:56.047 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:24:56.047 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:56.047 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:56.047 issued rwts: total=17672,9571,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:56.047 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:56.047 00:24:56.047 Run status group 0 (all jobs): 00:24:56.047 READ: bw=138MiB/s (144MB/s), 138MiB/s-138MiB/s (144MB/s-144MB/s), io=276MiB (290MB), run=2006-2006msec 00:24:56.047 WRITE: bw=83.8MiB/s (87.9MB/s), 83.8MiB/s-83.8MiB/s (87.9MB/s-87.9MB/s), io=150MiB (157MB), run=1784-1784msec 00:24:56.047 02:29:59 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:56.305 02:29:59 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:24:56.305 02:29:59 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:24:56.305 02:29:59 -- host/fio.sh@51 -- # get_nvme_bdfs 00:24:56.305 02:29:59 -- common/autotest_common.sh@1508 -- # bdfs=() 00:24:56.305 02:29:59 -- common/autotest_common.sh@1508 -- # local bdfs 00:24:56.305 02:29:59 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:24:56.305 02:29:59 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:24:56.305 02:29:59 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:24:56.305 02:29:59 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:24:56.305 02:29:59 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:24:56.305 02:29:59 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:24:59.580 Nvme0n1 00:24:59.580 02:30:02 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:25:02.856 02:30:05 -- host/fio.sh@53 -- # ls_guid=b6005a75-595f-4b15-98e0-bd0f1599fd72 00:25:02.856 02:30:05 -- host/fio.sh@54 -- # get_lvs_free_mb b6005a75-595f-4b15-98e0-bd0f1599fd72 00:25:02.856 02:30:05 -- common/autotest_common.sh@1353 -- # local lvs_uuid=b6005a75-595f-4b15-98e0-bd0f1599fd72 00:25:02.856 02:30:05 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:02.856 02:30:05 -- common/autotest_common.sh@1355 -- # local fc 00:25:02.856 02:30:05 -- common/autotest_common.sh@1356 -- # local cs 00:25:02.856 02:30:05 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:02.856 02:30:06 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:02.856 { 00:25:02.856 "uuid": "b6005a75-595f-4b15-98e0-bd0f1599fd72", 00:25:02.856 "name": "lvs_0", 00:25:02.856 "base_bdev": "Nvme0n1", 00:25:02.856 "total_data_clusters": 930, 00:25:02.856 "free_clusters": 930, 00:25:02.856 "block_size": 512, 00:25:02.856 "cluster_size": 1073741824 00:25:02.856 } 00:25:02.856 ]' 00:25:02.856 02:30:06 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="b6005a75-595f-4b15-98e0-bd0f1599fd72") .free_clusters' 00:25:02.856 02:30:06 -- common/autotest_common.sh@1358 -- # fc=930 00:25:02.856 02:30:06 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="b6005a75-595f-4b15-98e0-bd0f1599fd72") .cluster_size' 00:25:02.856 02:30:06 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:25:02.856 02:30:06 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:25:02.856 02:30:06 -- common/autotest_common.sh@1363 -- # echo 952320 00:25:02.856 952320 00:25:02.856 02:30:06 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:25:03.114 b8dec38f-9819-408e-99d9-e9a0a88c6bbb 00:25:03.114 02:30:06 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:25:03.372 02:30:06 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:25:03.631 02:30:07 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:03.889 02:30:07 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:03.889 02:30:07 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:03.889 02:30:07 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:03.889 02:30:07 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:03.889 02:30:07 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:03.889 02:30:07 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:03.889 02:30:07 -- common/autotest_common.sh@1330 -- # shift 00:25:03.889 02:30:07 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:03.889 02:30:07 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:03.889 02:30:07 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:03.889 02:30:07 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:03.889 02:30:07 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:03.889 02:30:07 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:03.889 02:30:07 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:03.889 02:30:07 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:03.889 02:30:07 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:03.889 02:30:07 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:03.889 02:30:07 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:03.889 02:30:07 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:03.889 02:30:07 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:03.889 02:30:07 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:03.889 02:30:07 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:04.148 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:04.148 fio-3.35 00:25:04.148 Starting 1 thread 00:25:04.148 EAL: No free 2048 kB hugepages reported on node 1 00:25:06.675 00:25:06.675 test: (groupid=0, jobs=1): err= 0: pid=210667: Fri Nov 29 02:30:09 2024 00:25:06.675 read: IOPS=6516, BW=25.5MiB/s (26.7MB/s)(51.1MiB/2007msec) 00:25:06.675 slat (nsec): min=1915, max=143908, avg=2661.06, stdev=2005.46 00:25:06.675 clat (usec): min=889, max=170894, avg=10784.61, stdev=11243.27 00:25:06.675 lat (usec): min=893, max=170926, avg=10787.28, stdev=11243.55 00:25:06.675 clat percentiles (msec): 00:25:06.675 | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 10], 00:25:06.675 | 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11], 00:25:06.675 | 70.00th=[ 11], 80.00th=[ 11], 90.00th=[ 12], 95.00th=[ 12], 00:25:06.675 | 99.00th=[ 12], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:25:06.675 | 99.99th=[ 171] 00:25:06.675 bw ( KiB/s): min=18432, max=28696, per=99.83%, avg=26020.00, stdev=5061.17, samples=4 00:25:06.675 iops : min= 4608, max= 7174, avg=6505.00, stdev=1265.29, samples=4 00:25:06.675 write: IOPS=6525, BW=25.5MiB/s (26.7MB/s)(51.2MiB/2007msec); 0 zone resets 00:25:06.675 slat (usec): min=2, max=114, avg= 2.70, stdev= 1.55 00:25:06.675 clat (usec): min=306, max=169007, avg=8749.08, stdev=10516.50 00:25:06.675 lat (usec): min=309, max=169013, avg=8751.77, stdev=10516.81 00:25:06.675 clat percentiles (msec): 00:25:06.675 | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 8], 00:25:06.675 | 30.00th=[ 8], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 9], 00:25:06.675 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 9], 95.00th=[ 10], 00:25:06.675 | 99.00th=[ 10], 99.50th=[ 15], 99.90th=[ 169], 99.95th=[ 169], 00:25:06.675 | 99.99th=[ 169] 00:25:06.675 bw ( KiB/s): min=19464, max=28560, per=99.90%, avg=26076.00, stdev=4412.65, samples=4 00:25:06.675 iops : min= 4866, max= 7140, avg=6519.00, stdev=1103.16, samples=4 00:25:06.675 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:25:06.675 lat (msec) : 2=0.03%, 4=0.16%, 10=74.79%, 20=24.51%, 250=0.49% 00:25:06.675 cpu : usr=61.02%, sys=37.09%, ctx=107, majf=0, minf=41 00:25:06.675 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:25:06.675 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:06.675 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:06.675 issued rwts: total=13078,13097,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:06.675 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:06.675 00:25:06.675 Run status group 0 (all jobs): 00:25:06.675 READ: bw=25.5MiB/s (26.7MB/s), 25.5MiB/s-25.5MiB/s (26.7MB/s-26.7MB/s), io=51.1MiB (53.6MB), run=2007-2007msec 00:25:06.675 WRITE: bw=25.5MiB/s (26.7MB/s), 25.5MiB/s-25.5MiB/s (26.7MB/s-26.7MB/s), io=51.2MiB (53.6MB), run=2007-2007msec 00:25:06.675 02:30:09 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:06.675 02:30:10 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:25:08.047 02:30:11 -- host/fio.sh@64 -- # ls_nested_guid=b976a532-e8d4-4632-a0ed-9d88e6085006 00:25:08.047 02:30:11 -- host/fio.sh@65 -- # get_lvs_free_mb b976a532-e8d4-4632-a0ed-9d88e6085006 00:25:08.047 02:30:11 -- common/autotest_common.sh@1353 -- # local lvs_uuid=b976a532-e8d4-4632-a0ed-9d88e6085006 00:25:08.047 02:30:11 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:08.047 02:30:11 -- common/autotest_common.sh@1355 -- # local fc 00:25:08.047 02:30:11 -- common/autotest_common.sh@1356 -- # local cs 00:25:08.047 02:30:11 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:08.047 02:30:11 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:08.047 { 00:25:08.047 "uuid": "b6005a75-595f-4b15-98e0-bd0f1599fd72", 00:25:08.047 "name": "lvs_0", 00:25:08.047 "base_bdev": "Nvme0n1", 00:25:08.047 "total_data_clusters": 930, 00:25:08.047 "free_clusters": 0, 00:25:08.047 "block_size": 512, 00:25:08.047 "cluster_size": 1073741824 00:25:08.047 }, 00:25:08.047 { 00:25:08.047 "uuid": "b976a532-e8d4-4632-a0ed-9d88e6085006", 00:25:08.047 "name": "lvs_n_0", 00:25:08.047 "base_bdev": "b8dec38f-9819-408e-99d9-e9a0a88c6bbb", 00:25:08.047 "total_data_clusters": 237847, 00:25:08.047 "free_clusters": 237847, 00:25:08.047 "block_size": 512, 00:25:08.047 "cluster_size": 4194304 00:25:08.047 } 00:25:08.047 ]' 00:25:08.047 02:30:11 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="b976a532-e8d4-4632-a0ed-9d88e6085006") .free_clusters' 00:25:08.047 02:30:11 -- common/autotest_common.sh@1358 -- # fc=237847 00:25:08.047 02:30:11 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="b976a532-e8d4-4632-a0ed-9d88e6085006") .cluster_size' 00:25:08.047 02:30:11 -- common/autotest_common.sh@1359 -- # cs=4194304 00:25:08.047 02:30:11 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:25:08.047 02:30:11 -- common/autotest_common.sh@1363 -- # echo 951388 00:25:08.047 951388 00:25:08.047 02:30:11 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:25:08.980 b056d092-a51d-4045-9394-ccec98fc899b 00:25:08.980 02:30:12 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:25:08.981 02:30:12 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:25:09.237 02:30:12 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:25:09.494 02:30:13 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:09.494 02:30:13 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:09.494 02:30:13 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:09.494 02:30:13 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:09.494 02:30:13 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:09.494 02:30:13 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:09.494 02:30:13 -- common/autotest_common.sh@1330 -- # shift 00:25:09.494 02:30:13 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:09.495 02:30:13 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:09.495 02:30:13 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:09.495 02:30:13 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:09.495 02:30:13 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:09.495 02:30:13 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:09.495 02:30:13 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:09.495 02:30:13 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:09.495 02:30:13 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:09.495 02:30:13 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:09.495 02:30:13 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:09.495 02:30:13 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:09.495 02:30:13 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:09.495 02:30:13 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:09.495 02:30:13 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:09.751 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:09.751 fio-3.35 00:25:09.751 Starting 1 thread 00:25:09.751 EAL: No free 2048 kB hugepages reported on node 1 00:25:12.279 00:25:12.279 test: (groupid=0, jobs=1): err= 0: pid=211687: Fri Nov 29 02:30:15 2024 00:25:12.279 read: IOPS=6225, BW=24.3MiB/s (25.5MB/s)(48.9MiB/2009msec) 00:25:12.279 slat (usec): min=2, max=132, avg= 2.66, stdev= 2.00 00:25:12.279 clat (usec): min=4022, max=18909, avg=11316.85, stdev=985.24 00:25:12.279 lat (usec): min=4027, max=18912, avg=11319.51, stdev=985.14 00:25:12.279 clat percentiles (usec): 00:25:12.279 | 1.00th=[ 8979], 5.00th=[ 9765], 10.00th=[10159], 20.00th=[10552], 00:25:12.279 | 30.00th=[10814], 40.00th=[11076], 50.00th=[11338], 60.00th=[11600], 00:25:12.279 | 70.00th=[11863], 80.00th=[12125], 90.00th=[12518], 95.00th=[12780], 00:25:12.279 | 99.00th=[13435], 99.50th=[13960], 99.90th=[16188], 99.95th=[17433], 00:25:12.279 | 99.99th=[18744] 00:25:12.279 bw ( KiB/s): min=23584, max=25336, per=99.87%, avg=24870.00, stdev=857.76, samples=4 00:25:12.279 iops : min= 5896, max= 6334, avg=6217.50, stdev=214.44, samples=4 00:25:12.279 write: IOPS=6216, BW=24.3MiB/s (25.5MB/s)(48.8MiB/2009msec); 0 zone resets 00:25:12.279 slat (usec): min=2, max=100, avg= 2.76, stdev= 1.69 00:25:12.279 clat (usec): min=1885, max=17000, avg=9156.55, stdev=859.33 00:25:12.279 lat (usec): min=1894, max=17003, avg=9159.31, stdev=859.31 00:25:12.279 clat percentiles (usec): 00:25:12.279 | 1.00th=[ 7242], 5.00th=[ 7898], 10.00th=[ 8160], 20.00th=[ 8455], 00:25:12.279 | 30.00th=[ 8717], 40.00th=[ 8979], 50.00th=[ 9110], 60.00th=[ 9372], 00:25:12.279 | 70.00th=[ 9503], 80.00th=[ 9765], 90.00th=[10159], 95.00th=[10421], 00:25:12.279 | 99.00th=[10945], 99.50th=[11338], 99.90th=[14877], 99.95th=[15926], 00:25:12.279 | 99.99th=[16909] 00:25:12.279 bw ( KiB/s): min=24712, max=25080, per=100.00%, avg=24866.00, stdev=154.21, samples=4 00:25:12.279 iops : min= 6178, max= 6270, avg=6216.50, stdev=38.55, samples=4 00:25:12.279 lat (msec) : 2=0.01%, 4=0.03%, 10=47.41%, 20=52.55% 00:25:12.279 cpu : usr=59.51%, sys=38.84%, ctx=108, majf=0, minf=41 00:25:12.279 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:25:12.279 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:12.279 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:12.279 issued rwts: total=12507,12489,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:12.279 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:12.279 00:25:12.279 Run status group 0 (all jobs): 00:25:12.279 READ: bw=24.3MiB/s (25.5MB/s), 24.3MiB/s-24.3MiB/s (25.5MB/s-25.5MB/s), io=48.9MiB (51.2MB), run=2009-2009msec 00:25:12.279 WRITE: bw=24.3MiB/s (25.5MB/s), 24.3MiB/s-24.3MiB/s (25.5MB/s-25.5MB/s), io=48.8MiB (51.2MB), run=2009-2009msec 00:25:12.279 02:30:15 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:25:12.537 02:30:15 -- host/fio.sh@74 -- # sync 00:25:12.537 02:30:15 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:25:16.714 02:30:19 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:25:16.714 02:30:20 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:25:19.989 02:30:22 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:25:19.989 02:30:23 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:25:21.887 02:30:25 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:25:21.887 02:30:25 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:25:21.887 02:30:25 -- host/fio.sh@86 -- # nvmftestfini 00:25:21.887 02:30:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:21.887 02:30:25 -- nvmf/common.sh@116 -- # sync 00:25:21.887 02:30:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:21.887 02:30:25 -- nvmf/common.sh@119 -- # set +e 00:25:21.887 02:30:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:21.887 02:30:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:21.887 rmmod nvme_tcp 00:25:21.887 rmmod nvme_fabrics 00:25:21.887 rmmod nvme_keyring 00:25:21.887 02:30:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:21.887 02:30:25 -- nvmf/common.sh@123 -- # set -e 00:25:21.887 02:30:25 -- nvmf/common.sh@124 -- # return 0 00:25:21.887 02:30:25 -- nvmf/common.sh@477 -- # '[' -n 208139 ']' 00:25:21.887 02:30:25 -- nvmf/common.sh@478 -- # killprocess 208139 00:25:21.887 02:30:25 -- common/autotest_common.sh@936 -- # '[' -z 208139 ']' 00:25:21.887 02:30:25 -- common/autotest_common.sh@940 -- # kill -0 208139 00:25:21.887 02:30:25 -- common/autotest_common.sh@941 -- # uname 00:25:21.887 02:30:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:21.887 02:30:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 208139 00:25:21.887 02:30:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:21.887 02:30:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:21.887 02:30:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 208139' 00:25:21.887 killing process with pid 208139 00:25:21.887 02:30:25 -- common/autotest_common.sh@955 -- # kill 208139 00:25:21.887 02:30:25 -- common/autotest_common.sh@960 -- # wait 208139 00:25:21.887 02:30:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:21.887 02:30:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:21.887 02:30:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:21.887 02:30:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:21.887 02:30:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:21.887 02:30:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:21.887 02:30:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:21.887 02:30:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:24.420 02:30:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:24.420 00:25:24.420 real 0m38.121s 00:25:24.420 user 2m26.835s 00:25:24.420 sys 0m6.796s 00:25:24.420 02:30:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:24.420 02:30:27 -- common/autotest_common.sh@10 -- # set +x 00:25:24.420 ************************************ 00:25:24.420 END TEST nvmf_fio_host 00:25:24.420 ************************************ 00:25:24.420 02:30:27 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:24.420 02:30:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:24.420 02:30:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:24.420 02:30:27 -- common/autotest_common.sh@10 -- # set +x 00:25:24.420 ************************************ 00:25:24.420 START TEST nvmf_failover 00:25:24.420 ************************************ 00:25:24.420 02:30:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:24.420 * Looking for test storage... 00:25:24.420 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:24.420 02:30:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:24.420 02:30:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:24.420 02:30:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:24.420 02:30:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:24.420 02:30:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:24.420 02:30:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:24.420 02:30:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:24.420 02:30:27 -- scripts/common.sh@335 -- # IFS=.-: 00:25:24.420 02:30:27 -- scripts/common.sh@335 -- # read -ra ver1 00:25:24.420 02:30:27 -- scripts/common.sh@336 -- # IFS=.-: 00:25:24.420 02:30:27 -- scripts/common.sh@336 -- # read -ra ver2 00:25:24.420 02:30:27 -- scripts/common.sh@337 -- # local 'op=<' 00:25:24.420 02:30:27 -- scripts/common.sh@339 -- # ver1_l=2 00:25:24.420 02:30:27 -- scripts/common.sh@340 -- # ver2_l=1 00:25:24.420 02:30:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:24.420 02:30:27 -- scripts/common.sh@343 -- # case "$op" in 00:25:24.420 02:30:27 -- scripts/common.sh@344 -- # : 1 00:25:24.420 02:30:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:24.420 02:30:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:24.420 02:30:27 -- scripts/common.sh@364 -- # decimal 1 00:25:24.420 02:30:27 -- scripts/common.sh@352 -- # local d=1 00:25:24.420 02:30:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:24.420 02:30:27 -- scripts/common.sh@354 -- # echo 1 00:25:24.420 02:30:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:24.420 02:30:27 -- scripts/common.sh@365 -- # decimal 2 00:25:24.420 02:30:27 -- scripts/common.sh@352 -- # local d=2 00:25:24.420 02:30:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:24.420 02:30:27 -- scripts/common.sh@354 -- # echo 2 00:25:24.420 02:30:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:24.420 02:30:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:24.420 02:30:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:24.420 02:30:27 -- scripts/common.sh@367 -- # return 0 00:25:24.420 02:30:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:24.420 02:30:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:24.421 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:24.421 --rc genhtml_branch_coverage=1 00:25:24.421 --rc genhtml_function_coverage=1 00:25:24.421 --rc genhtml_legend=1 00:25:24.421 --rc geninfo_all_blocks=1 00:25:24.421 --rc geninfo_unexecuted_blocks=1 00:25:24.421 00:25:24.421 ' 00:25:24.421 02:30:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:24.421 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:24.421 --rc genhtml_branch_coverage=1 00:25:24.421 --rc genhtml_function_coverage=1 00:25:24.421 --rc genhtml_legend=1 00:25:24.421 --rc geninfo_all_blocks=1 00:25:24.421 --rc geninfo_unexecuted_blocks=1 00:25:24.421 00:25:24.421 ' 00:25:24.421 02:30:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:24.421 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:24.421 --rc genhtml_branch_coverage=1 00:25:24.421 --rc genhtml_function_coverage=1 00:25:24.421 --rc genhtml_legend=1 00:25:24.421 --rc geninfo_all_blocks=1 00:25:24.421 --rc geninfo_unexecuted_blocks=1 00:25:24.421 00:25:24.421 ' 00:25:24.421 02:30:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:24.421 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:24.421 --rc genhtml_branch_coverage=1 00:25:24.421 --rc genhtml_function_coverage=1 00:25:24.421 --rc genhtml_legend=1 00:25:24.421 --rc geninfo_all_blocks=1 00:25:24.421 --rc geninfo_unexecuted_blocks=1 00:25:24.421 00:25:24.421 ' 00:25:24.421 02:30:27 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:24.421 02:30:27 -- nvmf/common.sh@7 -- # uname -s 00:25:24.421 02:30:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:24.421 02:30:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:24.421 02:30:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:24.421 02:30:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:24.421 02:30:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:24.421 02:30:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:24.421 02:30:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:24.421 02:30:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:24.421 02:30:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:24.421 02:30:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:24.421 02:30:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:24.421 02:30:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:24.421 02:30:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:24.421 02:30:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:24.421 02:30:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:24.421 02:30:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:24.421 02:30:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:24.421 02:30:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:24.421 02:30:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:24.421 02:30:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:24.421 02:30:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:24.421 02:30:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:24.421 02:30:27 -- paths/export.sh@5 -- # export PATH 00:25:24.421 02:30:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:24.421 02:30:27 -- nvmf/common.sh@46 -- # : 0 00:25:24.421 02:30:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:24.421 02:30:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:24.421 02:30:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:24.421 02:30:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:24.421 02:30:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:24.421 02:30:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:24.421 02:30:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:24.421 02:30:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:24.421 02:30:27 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:24.421 02:30:27 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:24.421 02:30:27 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:24.421 02:30:27 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:24.421 02:30:27 -- host/failover.sh@18 -- # nvmftestinit 00:25:24.421 02:30:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:24.421 02:30:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:24.421 02:30:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:24.421 02:30:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:24.421 02:30:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:24.421 02:30:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:24.421 02:30:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:24.421 02:30:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:24.421 02:30:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:24.421 02:30:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:24.421 02:30:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:24.421 02:30:27 -- common/autotest_common.sh@10 -- # set +x 00:25:26.324 02:30:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:26.325 02:30:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:26.325 02:30:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:26.325 02:30:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:26.325 02:30:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:26.325 02:30:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:26.325 02:30:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:26.325 02:30:29 -- nvmf/common.sh@294 -- # net_devs=() 00:25:26.325 02:30:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:26.325 02:30:29 -- nvmf/common.sh@295 -- # e810=() 00:25:26.325 02:30:29 -- nvmf/common.sh@295 -- # local -ga e810 00:25:26.325 02:30:29 -- nvmf/common.sh@296 -- # x722=() 00:25:26.325 02:30:29 -- nvmf/common.sh@296 -- # local -ga x722 00:25:26.325 02:30:29 -- nvmf/common.sh@297 -- # mlx=() 00:25:26.325 02:30:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:26.325 02:30:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:26.325 02:30:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:26.325 02:30:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:26.325 02:30:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:26.325 02:30:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:26.325 02:30:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:26.325 02:30:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:26.325 02:30:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:26.325 02:30:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:26.325 02:30:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:26.325 02:30:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:26.325 02:30:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:26.325 02:30:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:26.325 02:30:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:26.325 02:30:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:26.325 02:30:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:26.325 02:30:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:26.325 02:30:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:26.325 02:30:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:26.325 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:26.325 02:30:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:26.325 02:30:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:26.325 02:30:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:26.325 02:30:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:26.325 02:30:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:26.325 02:30:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:26.325 02:30:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:26.325 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:26.325 02:30:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:26.325 02:30:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:26.325 02:30:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:26.325 02:30:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:26.325 02:30:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:26.325 02:30:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:26.325 02:30:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:26.325 02:30:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:26.325 02:30:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:26.325 02:30:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:26.325 02:30:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:26.325 02:30:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:26.325 02:30:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:26.325 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:26.325 02:30:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:26.325 02:30:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:26.325 02:30:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:26.325 02:30:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:26.325 02:30:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:26.325 02:30:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:26.325 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:26.325 02:30:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:26.325 02:30:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:26.325 02:30:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:26.325 02:30:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:26.325 02:30:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:26.325 02:30:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:26.325 02:30:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:26.325 02:30:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:26.325 02:30:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:26.325 02:30:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:26.325 02:30:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:26.325 02:30:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:26.325 02:30:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:26.325 02:30:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:26.325 02:30:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:26.325 02:30:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:26.325 02:30:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:26.325 02:30:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:26.325 02:30:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:26.325 02:30:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:26.325 02:30:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:26.325 02:30:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:26.325 02:30:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:26.325 02:30:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:26.325 02:30:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:26.325 02:30:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:26.325 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:26.325 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.254 ms 00:25:26.325 00:25:26.325 --- 10.0.0.2 ping statistics --- 00:25:26.325 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:26.325 rtt min/avg/max/mdev = 0.254/0.254/0.254/0.000 ms 00:25:26.325 02:30:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:26.325 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:26.325 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.094 ms 00:25:26.325 00:25:26.325 --- 10.0.0.1 ping statistics --- 00:25:26.325 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:26.325 rtt min/avg/max/mdev = 0.094/0.094/0.094/0.000 ms 00:25:26.325 02:30:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:26.325 02:30:29 -- nvmf/common.sh@410 -- # return 0 00:25:26.325 02:30:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:26.325 02:30:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:26.325 02:30:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:26.325 02:30:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:26.325 02:30:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:26.325 02:30:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:26.325 02:30:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:26.325 02:30:29 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:25:26.325 02:30:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:26.325 02:30:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:26.325 02:30:29 -- common/autotest_common.sh@10 -- # set +x 00:25:26.325 02:30:29 -- nvmf/common.sh@469 -- # nvmfpid=215127 00:25:26.325 02:30:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:26.325 02:30:29 -- nvmf/common.sh@470 -- # waitforlisten 215127 00:25:26.325 02:30:29 -- common/autotest_common.sh@829 -- # '[' -z 215127 ']' 00:25:26.325 02:30:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:26.325 02:30:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:26.325 02:30:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:26.325 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:26.325 02:30:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:26.325 02:30:29 -- common/autotest_common.sh@10 -- # set +x 00:25:26.325 [2024-11-29 02:30:29.918470] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:26.325 [2024-11-29 02:30:29.918541] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:26.325 EAL: No free 2048 kB hugepages reported on node 1 00:25:26.325 [2024-11-29 02:30:29.990498] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:26.584 [2024-11-29 02:30:30.110053] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:26.584 [2024-11-29 02:30:30.110213] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:26.584 [2024-11-29 02:30:30.110232] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:26.584 [2024-11-29 02:30:30.110245] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:26.584 [2024-11-29 02:30:30.110295] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:26.584 [2024-11-29 02:30:30.110354] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:26.584 [2024-11-29 02:30:30.110359] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:27.518 02:30:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:27.518 02:30:30 -- common/autotest_common.sh@862 -- # return 0 00:25:27.518 02:30:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:27.518 02:30:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:27.518 02:30:30 -- common/autotest_common.sh@10 -- # set +x 00:25:27.518 02:30:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:27.518 02:30:31 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:25:27.776 [2024-11-29 02:30:31.276514] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:27.776 02:30:31 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:25:28.034 Malloc0 00:25:28.034 02:30:31 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:28.290 02:30:31 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:28.548 02:30:32 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:28.806 [2024-11-29 02:30:32.321876] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:28.806 02:30:32 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:29.065 [2024-11-29 02:30:32.570605] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:29.065 02:30:32 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:29.323 [2024-11-29 02:30:32.823475] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:29.323 02:30:32 -- host/failover.sh@31 -- # bdevperf_pid=215437 00:25:29.323 02:30:32 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:25:29.323 02:30:32 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:29.323 02:30:32 -- host/failover.sh@34 -- # waitforlisten 215437 /var/tmp/bdevperf.sock 00:25:29.323 02:30:32 -- common/autotest_common.sh@829 -- # '[' -z 215437 ']' 00:25:29.323 02:30:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:29.323 02:30:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:29.323 02:30:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:29.323 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:29.323 02:30:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:29.323 02:30:32 -- common/autotest_common.sh@10 -- # set +x 00:25:30.256 02:30:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:30.256 02:30:33 -- common/autotest_common.sh@862 -- # return 0 00:25:30.256 02:30:33 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:30.821 NVMe0n1 00:25:30.821 02:30:34 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:31.079 00:25:31.337 02:30:34 -- host/failover.sh@39 -- # run_test_pid=215711 00:25:31.337 02:30:34 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:31.337 02:30:34 -- host/failover.sh@41 -- # sleep 1 00:25:32.270 02:30:35 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:32.558 [2024-11-29 02:30:36.005098] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005167] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005192] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005205] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005230] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005241] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005277] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005289] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005300] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005312] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005325] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005346] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005370] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005420] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005432] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005444] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005456] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005469] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005504] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005528] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005541] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005553] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005564] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005576] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005587] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005612] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005624] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005635] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005647] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005674] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005697] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005740] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005752] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005763] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005774] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005808] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 [2024-11-29 02:30:36.005819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cefcb0 is same with the state(5) to be set 00:25:32.558 02:30:36 -- host/failover.sh@45 -- # sleep 3 00:25:35.868 02:30:39 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:35.868 00:25:35.868 02:30:39 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:36.126 [2024-11-29 02:30:39.672438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.126 [2024-11-29 02:30:39.672507] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.126 [2024-11-29 02:30:39.672524] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.126 [2024-11-29 02:30:39.672538] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.126 [2024-11-29 02:30:39.672550] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.126 [2024-11-29 02:30:39.672563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.126 [2024-11-29 02:30:39.672575] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.126 [2024-11-29 02:30:39.672587] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.126 [2024-11-29 02:30:39.672600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.126 [2024-11-29 02:30:39.672613] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.126 [2024-11-29 02:30:39.672625] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.126 [2024-11-29 02:30:39.672638] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.126 [2024-11-29 02:30:39.672651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.126 [2024-11-29 02:30:39.672663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.672676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.672726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.672739] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.672752] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.672778] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.672790] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.672801] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.672812] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.672823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.672835] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.672846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.672857] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.672868] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.672878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.672890] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.672901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.672917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.672928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.672939] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.672950] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.672962] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.672973] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.672984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.672995] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.673008] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.673020] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.673031] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.673042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 [2024-11-29 02:30:39.673057] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf13a0 is same with the state(5) to be set 00:25:36.127 02:30:39 -- host/failover.sh@50 -- # sleep 3 00:25:39.412 02:30:42 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:39.412 [2024-11-29 02:30:42.980007] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:39.412 02:30:43 -- host/failover.sh@55 -- # sleep 1 00:25:40.346 02:30:44 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:40.604 [2024-11-29 02:30:44.263095] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.604 [2024-11-29 02:30:44.263150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.604 [2024-11-29 02:30:44.263174] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.604 [2024-11-29 02:30:44.263186] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.604 [2024-11-29 02:30:44.263198] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.604 [2024-11-29 02:30:44.263209] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.604 [2024-11-29 02:30:44.263221] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.604 [2024-11-29 02:30:44.263233] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.604 [2024-11-29 02:30:44.263244] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.604 [2024-11-29 02:30:44.263256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.604 [2024-11-29 02:30:44.263268] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.604 [2024-11-29 02:30:44.263280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.604 [2024-11-29 02:30:44.263292] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.604 [2024-11-29 02:30:44.263304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263315] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263327] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263364] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263388] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263430] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263444] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263465] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263488] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263499] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263535] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263557] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263569] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263580] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263592] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263603] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263615] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263638] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263675] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263687] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263714] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263737] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263761] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 [2024-11-29 02:30:44.263785] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf1a80 is same with the state(5) to be set 00:25:40.605 02:30:44 -- host/failover.sh@59 -- # wait 215711 00:25:47.176 0 00:25:47.176 02:30:49 -- host/failover.sh@61 -- # killprocess 215437 00:25:47.176 02:30:49 -- common/autotest_common.sh@936 -- # '[' -z 215437 ']' 00:25:47.176 02:30:49 -- common/autotest_common.sh@940 -- # kill -0 215437 00:25:47.176 02:30:49 -- common/autotest_common.sh@941 -- # uname 00:25:47.176 02:30:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:47.176 02:30:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 215437 00:25:47.176 02:30:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:47.176 02:30:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:47.176 02:30:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 215437' 00:25:47.176 killing process with pid 215437 00:25:47.176 02:30:49 -- common/autotest_common.sh@955 -- # kill 215437 00:25:47.176 02:30:49 -- common/autotest_common.sh@960 -- # wait 215437 00:25:47.176 02:30:50 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:47.176 [2024-11-29 02:30:32.882880] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:47.176 [2024-11-29 02:30:32.882973] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid215437 ] 00:25:47.176 EAL: No free 2048 kB hugepages reported on node 1 00:25:47.176 [2024-11-29 02:30:32.946101] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:47.176 [2024-11-29 02:30:33.054277] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:47.176 Running I/O for 15 seconds... 00:25:47.176 [2024-11-29 02:30:36.006133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:117088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.006175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.006204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:117104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.006221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.006239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:117120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.006253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.006269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:116608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.006282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.006298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:116624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.006312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.006327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:116640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.006341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.006356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:116648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.006370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.006386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:116656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.006409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.006425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:116664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.006439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.006455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:116672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.006468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.006484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:116680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.006498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.006521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:117136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.006536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.006551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:117152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.006565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.006580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:117160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.006594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.006618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:117168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.006646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.006662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:117184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.006675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.006690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:117192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.006704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.006734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:117200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.006748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.006762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:117208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.006775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.006789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:117240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.006802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.006816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:117248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.006829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.006843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:117256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.006856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.006870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:117288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.006883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.006897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:117296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.006913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.006928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:117304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.006952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.006967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:116688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.006980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.006994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:116696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.007008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.007023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:116704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.007037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.176 [2024-11-29 02:30:36.007051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:116728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.176 [2024-11-29 02:30:36.007064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:116736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.007091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:116744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.007118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:116752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.007144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:116760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.007172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:117312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.007199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:116784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.007226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:116792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.007254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:116800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.007285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:116816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.007313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:116856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.007340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:116864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.007367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:116888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.007419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:116936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.007449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:117328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.007477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:117344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.007505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:116968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.007533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:116976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.007560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:116992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.007588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:117000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.007616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:117016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.007649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:117024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.007692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:117040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.007724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:117072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.007753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:117360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.177 [2024-11-29 02:30:36.007781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:117368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.177 [2024-11-29 02:30:36.007809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:117376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.177 [2024-11-29 02:30:36.007838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:117384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.177 [2024-11-29 02:30:36.007866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:117392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.177 [2024-11-29 02:30:36.007894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:117400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.007921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:117408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.007949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:117416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.007977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.007991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:117424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.008004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.008027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:117432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.008041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.008057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:117440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.177 [2024-11-29 02:30:36.008071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.008087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:117448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.177 [2024-11-29 02:30:36.008100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.008114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:117456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.177 [2024-11-29 02:30:36.008128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.008143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:117464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.177 [2024-11-29 02:30:36.008157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.008172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:117472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.177 [2024-11-29 02:30:36.008185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.177 [2024-11-29 02:30:36.008199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:117480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.178 [2024-11-29 02:30:36.008214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.008229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:117488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.178 [2024-11-29 02:30:36.008243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.008257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:117496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.178 [2024-11-29 02:30:36.008272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.008287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:117504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.178 [2024-11-29 02:30:36.008306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.008321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:117512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.178 [2024-11-29 02:30:36.008334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.008348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:117520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.178 [2024-11-29 02:30:36.008362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.008398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:117528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.178 [2024-11-29 02:30:36.008418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.008434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:117536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.178 [2024-11-29 02:30:36.008448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.008463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:117544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.178 [2024-11-29 02:30:36.008477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.008492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:117552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.178 [2024-11-29 02:30:36.008505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.008520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:117560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.178 [2024-11-29 02:30:36.008534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.008549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:117568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.178 [2024-11-29 02:30:36.008563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.008578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:117576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.178 [2024-11-29 02:30:36.008591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.008607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:117584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.178 [2024-11-29 02:30:36.008622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.008638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:117592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.178 [2024-11-29 02:30:36.008652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.008668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:117600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.178 [2024-11-29 02:30:36.008682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.008712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:117080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.178 [2024-11-29 02:30:36.008726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.008741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:117096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.178 [2024-11-29 02:30:36.008754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.008768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:117112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.178 [2024-11-29 02:30:36.008782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.008797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:117128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.178 [2024-11-29 02:30:36.008818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.008834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:117144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.178 [2024-11-29 02:30:36.008848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.008862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:117176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.178 [2024-11-29 02:30:36.008876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.008890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:117216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.178 [2024-11-29 02:30:36.008903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.008918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:117224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.178 [2024-11-29 02:30:36.008931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.008946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:117608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.178 [2024-11-29 02:30:36.008959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.008973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:117616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.178 [2024-11-29 02:30:36.008987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.009002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:117624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.178 [2024-11-29 02:30:36.009015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.009030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:117632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.178 [2024-11-29 02:30:36.009043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.009057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:117640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.178 [2024-11-29 02:30:36.009071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.009086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:117648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.178 [2024-11-29 02:30:36.009100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.009114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:117656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.178 [2024-11-29 02:30:36.009127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.009141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:117664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.178 [2024-11-29 02:30:36.009155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.009172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:117672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.178 [2024-11-29 02:30:36.009186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.009200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:117680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.178 [2024-11-29 02:30:36.009213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.009228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:117688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.178 [2024-11-29 02:30:36.009241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.009255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:117696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.178 [2024-11-29 02:30:36.009273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.009288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:117704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.178 [2024-11-29 02:30:36.009302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.009316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:117712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.178 [2024-11-29 02:30:36.009329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.009343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:117720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.178 [2024-11-29 02:30:36.009356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.178 [2024-11-29 02:30:36.009371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:117728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.179 [2024-11-29 02:30:36.009383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:36.009421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:117736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.179 [2024-11-29 02:30:36.009437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:36.009452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:117744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.179 [2024-11-29 02:30:36.009465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:36.009480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:117752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.179 [2024-11-29 02:30:36.009493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:36.009508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:117760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.179 [2024-11-29 02:30:36.009522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:36.009536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:117768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.179 [2024-11-29 02:30:36.009554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:36.009570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:117776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.179 [2024-11-29 02:30:36.009584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:36.009599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:117784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.179 [2024-11-29 02:30:36.009613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:36.009627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:117792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.179 [2024-11-29 02:30:36.009641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:36.009656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:117800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.179 [2024-11-29 02:30:36.009668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:36.009684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:117808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.179 [2024-11-29 02:30:36.009711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:36.009727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:117816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.179 [2024-11-29 02:30:36.009740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:36.009754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:117824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.179 [2024-11-29 02:30:36.009773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:36.009787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:117832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.179 [2024-11-29 02:30:36.009800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:36.009814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:117840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.179 [2024-11-29 02:30:36.009828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:36.009841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:117232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.179 [2024-11-29 02:30:36.009854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:36.009868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:117264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.179 [2024-11-29 02:30:36.009881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:36.009895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:117272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.179 [2024-11-29 02:30:36.009908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:36.009926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:117280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.179 [2024-11-29 02:30:36.009939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:36.009954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:117320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.179 [2024-11-29 02:30:36.009967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:36.009981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:117336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.179 [2024-11-29 02:30:36.010008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:36.010023] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x251b6a0 is same with the state(5) to be set 00:25:47.179 [2024-11-29 02:30:36.010041] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:47.179 [2024-11-29 02:30:36.010052] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:47.179 [2024-11-29 02:30:36.010063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:117352 len:8 PRP1 0x0 PRP2 0x0 00:25:47.179 [2024-11-29 02:30:36.010076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:36.010139] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x251b6a0 was disconnected and freed. reset controller. 00:25:47.179 [2024-11-29 02:30:36.010165] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:47.179 [2024-11-29 02:30:36.010217] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.179 [2024-11-29 02:30:36.010238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:36.010253] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.179 [2024-11-29 02:30:36.010266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:36.010279] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.179 [2024-11-29 02:30:36.010292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:36.010306] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.179 [2024-11-29 02:30:36.010319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:36.010339] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:47.179 [2024-11-29 02:30:36.012818] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:47.179 [2024-11-29 02:30:36.012857] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x24fc870 (9): Bad file descriptor 00:25:47.179 [2024-11-29 02:30:36.043278] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:47.179 [2024-11-29 02:30:39.673204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:116040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.179 [2024-11-29 02:30:39.673247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:39.673284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:116056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.179 [2024-11-29 02:30:39.673302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:39.673319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:116072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.179 [2024-11-29 02:30:39.673333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:39.673348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:116080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.179 [2024-11-29 02:30:39.673362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:39.673378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:116096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.179 [2024-11-29 02:30:39.673403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:39.673420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:115488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.179 [2024-11-29 02:30:39.673449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:39.673465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:115496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.179 [2024-11-29 02:30:39.673479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:39.673494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:115528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.179 [2024-11-29 02:30:39.673507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:39.673522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:115536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.179 [2024-11-29 02:30:39.673535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:39.673550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:115544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.179 [2024-11-29 02:30:39.673563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.179 [2024-11-29 02:30:39.673578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:115552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.180 [2024-11-29 02:30:39.673591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.673607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:115560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.180 [2024-11-29 02:30:39.673620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.673635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:115592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.180 [2024-11-29 02:30:39.673648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.673662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:116136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.180 [2024-11-29 02:30:39.673690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.673721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:116152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.180 [2024-11-29 02:30:39.673734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.673748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:116160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.180 [2024-11-29 02:30:39.673761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.673775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:116192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.180 [2024-11-29 02:30:39.673789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.673803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:116216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.180 [2024-11-29 02:30:39.673816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.673831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:116224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.180 [2024-11-29 02:30:39.673843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.673857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:116232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.180 [2024-11-29 02:30:39.673870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.673885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:116240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.180 [2024-11-29 02:30:39.673897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.673911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:116248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.180 [2024-11-29 02:30:39.673924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.673938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:115624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.180 [2024-11-29 02:30:39.673951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.673965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:115640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.180 [2024-11-29 02:30:39.673978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.673991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:115656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.180 [2024-11-29 02:30:39.674004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.674018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:115672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.180 [2024-11-29 02:30:39.674031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.674049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:115680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.180 [2024-11-29 02:30:39.674062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.674076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:115712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.180 [2024-11-29 02:30:39.674090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.674104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:115720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.180 [2024-11-29 02:30:39.674116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.674130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:115728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.180 [2024-11-29 02:30:39.674143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.674157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:116256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.180 [2024-11-29 02:30:39.674170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.674184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:116264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.180 [2024-11-29 02:30:39.674197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.674211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:116272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.180 [2024-11-29 02:30:39.674224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.674238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:116280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.180 [2024-11-29 02:30:39.674251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.674266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:116288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.180 [2024-11-29 02:30:39.674278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.674293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:116296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.180 [2024-11-29 02:30:39.674306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.674320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:116304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.180 [2024-11-29 02:30:39.674333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.674347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:116312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.180 [2024-11-29 02:30:39.674360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.674389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:116320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.180 [2024-11-29 02:30:39.674414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.674431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:116328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.180 [2024-11-29 02:30:39.674446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.674461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:116336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.180 [2024-11-29 02:30:39.674475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.674491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:116344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.180 [2024-11-29 02:30:39.674505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.674523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:116352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.180 [2024-11-29 02:30:39.674539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.180 [2024-11-29 02:30:39.674555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:116360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.181 [2024-11-29 02:30:39.674569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.674584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:116368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.674599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.674613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:116376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.674627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.674642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:116384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.674656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.674671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:115736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.674684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.674699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:115752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.674714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.674744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:115760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.674757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.674772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:115768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.674785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.674800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:115776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.674817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.674832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:115800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.674846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.674860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:115808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.674873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.674888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:115856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.674901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.674916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:116392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.181 [2024-11-29 02:30:39.674929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.674943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:116400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.674957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.674971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:116408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.674984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.674999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:116416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.181 [2024-11-29 02:30:39.675012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.675027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:116424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.675041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.675055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:116432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.181 [2024-11-29 02:30:39.675069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.675083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:116440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.675096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.675110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:116448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.675123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.675138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:116456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.675151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.675168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:116464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.675183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.675198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:116472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.181 [2024-11-29 02:30:39.675212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.675226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:116480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.675239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.675253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:116488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.181 [2024-11-29 02:30:39.675267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.675282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:116496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.675295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.675310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:115872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.675323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.675337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:115880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.675350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.675365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:115936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.675399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.675423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:115960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.675437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.675452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:115968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.675465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.675480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:115984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.675494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.675509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:116000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.675522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.675536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:116008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.675553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.675569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:116504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.181 [2024-11-29 02:30:39.675582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.675597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:116512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.181 [2024-11-29 02:30:39.675610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.675625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:116520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.181 [2024-11-29 02:30:39.675638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.675653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:116528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.181 [2024-11-29 02:30:39.675667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.675682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:116536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.181 [2024-11-29 02:30:39.675695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.675725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:116544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.181 [2024-11-29 02:30:39.675738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.181 [2024-11-29 02:30:39.675752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:116552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.182 [2024-11-29 02:30:39.675765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.675779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:116560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.182 [2024-11-29 02:30:39.675792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.675806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:116568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.182 [2024-11-29 02:30:39.675819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.675833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:116576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.182 [2024-11-29 02:30:39.675846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.675860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:116584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.182 [2024-11-29 02:30:39.675874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.675889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:116592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.182 [2024-11-29 02:30:39.675902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.675919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:116600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.182 [2024-11-29 02:30:39.675933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.675947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:116608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.182 [2024-11-29 02:30:39.675961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.675975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:116616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.182 [2024-11-29 02:30:39.675988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:116624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.182 [2024-11-29 02:30:39.676014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:116632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.182 [2024-11-29 02:30:39.676041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:116016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.182 [2024-11-29 02:30:39.676068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:116024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.182 [2024-11-29 02:30:39.676095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:116032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.182 [2024-11-29 02:30:39.676127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:116048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.182 [2024-11-29 02:30:39.676154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:116064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.182 [2024-11-29 02:30:39.676182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:116088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.182 [2024-11-29 02:30:39.676210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:116104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.182 [2024-11-29 02:30:39.676236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:116112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.182 [2024-11-29 02:30:39.676267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:116640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.182 [2024-11-29 02:30:39.676295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:116648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.182 [2024-11-29 02:30:39.676322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:116656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.182 [2024-11-29 02:30:39.676351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:116664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.182 [2024-11-29 02:30:39.676399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:116672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.182 [2024-11-29 02:30:39.676431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:116680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.182 [2024-11-29 02:30:39.676459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:116688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.182 [2024-11-29 02:30:39.676488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:116696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.182 [2024-11-29 02:30:39.676517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:116704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.182 [2024-11-29 02:30:39.676547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:116712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.182 [2024-11-29 02:30:39.676576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:116720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.182 [2024-11-29 02:30:39.676611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:116728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.182 [2024-11-29 02:30:39.676642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:116736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.182 [2024-11-29 02:30:39.676675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:116744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.182 [2024-11-29 02:30:39.676719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:116752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.182 [2024-11-29 02:30:39.676747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:116760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.182 [2024-11-29 02:30:39.676790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:116768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.182 [2024-11-29 02:30:39.676817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:116776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.182 [2024-11-29 02:30:39.676844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:116120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.182 [2024-11-29 02:30:39.676871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:116128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.182 [2024-11-29 02:30:39.676899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:116144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.182 [2024-11-29 02:30:39.676925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.182 [2024-11-29 02:30:39.676939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:116168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:39.676952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:39.676966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:116176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:39.676979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:39.676993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:116184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:39.677006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:39.677020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:116200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:39.677036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:39.677051] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2528c90 is same with the state(5) to be set 00:25:47.183 [2024-11-29 02:30:39.677067] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:47.183 [2024-11-29 02:30:39.677078] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:47.183 [2024-11-29 02:30:39.677094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:116208 len:8 PRP1 0x0 PRP2 0x0 00:25:47.183 [2024-11-29 02:30:39.677106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:39.677181] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2528c90 was disconnected and freed. reset controller. 00:25:47.183 [2024-11-29 02:30:39.677199] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:25:47.183 [2024-11-29 02:30:39.677247] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.183 [2024-11-29 02:30:39.677267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:39.677282] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.183 [2024-11-29 02:30:39.677296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:39.677310] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.183 [2024-11-29 02:30:39.677323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:39.677336] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.183 [2024-11-29 02:30:39.677349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:39.677363] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:47.183 [2024-11-29 02:30:39.677424] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x24fc870 (9): Bad file descriptor 00:25:47.183 [2024-11-29 02:30:39.679788] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:47.183 [2024-11-29 02:30:39.788189] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:47.183 [2024-11-29 02:30:44.263984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:112976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:44.264026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:44.264055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:112296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:44.264071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:44.264089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:112304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:44.264103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:44.264118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:112312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:44.264132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:44.264154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:112320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:44.264168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:44.264183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:112328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:44.264197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:44.264228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:112336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:44.264241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:44.264256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:112344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:44.264284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:44.264299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:112352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:44.264312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:44.264326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:113000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:44.264339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:44.264353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:113032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:44.264366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:44.264405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:113040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:44.264420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:44.264435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:112376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:44.264449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:44.264463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:112384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:44.264476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:44.264491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:112392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:44.264504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:44.264519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:112416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:44.264531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:44.264546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:112424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:44.264563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:44.264579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:112432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:44.264593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:44.264609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:112440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:44.264622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:44.264637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:112472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:44.264650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:44.264664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:112496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:44.264677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:44.264707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:112512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:44.264720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:44.264734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:112520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:44.264747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:44.264762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:112528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:44.264774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:44.264788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:112536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:44.264802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:44.264816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:112544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.183 [2024-11-29 02:30:44.264830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.183 [2024-11-29 02:30:44.264844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:112552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.264856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.264870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:112576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.264883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.264899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:113064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.264912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.264934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:113080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.264949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.264965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:113096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.264979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.264994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:113112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:113120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:113144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:113152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:112592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:112600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:112664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:112672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:112688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:112696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:112704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:112728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:112736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:112744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:112752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:112760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:112768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:112784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:112800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:112808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:113168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.184 [2024-11-29 02:30:44.265598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:113176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:113184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:113192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.184 [2024-11-29 02:30:44.265687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:113200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:113208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:113216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.184 [2024-11-29 02:30:44.265785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:113224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:113232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:113240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:113248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.184 [2024-11-29 02:30:44.265894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:113256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.184 [2024-11-29 02:30:44.265921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:113264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.265948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:113272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.184 [2024-11-29 02:30:44.265981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.265996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:113280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.184 [2024-11-29 02:30:44.266008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.184 [2024-11-29 02:30:44.266023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:113288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.185 [2024-11-29 02:30:44.266039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:113296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.185 [2024-11-29 02:30:44.266068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:113304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.185 [2024-11-29 02:30:44.266096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:113312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.185 [2024-11-29 02:30:44.266123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:113320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.185 [2024-11-29 02:30:44.266150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:113328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.185 [2024-11-29 02:30:44.266177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:113336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.185 [2024-11-29 02:30:44.266204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:113344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.185 [2024-11-29 02:30:44.266230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:113352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.185 [2024-11-29 02:30:44.266258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:113360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.185 [2024-11-29 02:30:44.266285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:113368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.185 [2024-11-29 02:30:44.266313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:113376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.185 [2024-11-29 02:30:44.266341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:113384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.185 [2024-11-29 02:30:44.266368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:113392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.185 [2024-11-29 02:30:44.266423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:112824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.185 [2024-11-29 02:30:44.266473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:112848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.185 [2024-11-29 02:30:44.266502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:112856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.185 [2024-11-29 02:30:44.266531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:112872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.185 [2024-11-29 02:30:44.266560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:112880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.185 [2024-11-29 02:30:44.266589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:112888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.185 [2024-11-29 02:30:44.266618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:112896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.185 [2024-11-29 02:30:44.266646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:112920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.185 [2024-11-29 02:30:44.266674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:113400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.185 [2024-11-29 02:30:44.266717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:113408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.185 [2024-11-29 02:30:44.266758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:113416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.185 [2024-11-29 02:30:44.266786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:113424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.185 [2024-11-29 02:30:44.266816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:113432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.185 [2024-11-29 02:30:44.266850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:113440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.185 [2024-11-29 02:30:44.266877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:113448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.185 [2024-11-29 02:30:44.266920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:113456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.185 [2024-11-29 02:30:44.266949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:113464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.185 [2024-11-29 02:30:44.266978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.266993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:113472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.185 [2024-11-29 02:30:44.267007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.267022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:113480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.185 [2024-11-29 02:30:44.267035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.267049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:113488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.185 [2024-11-29 02:30:44.267063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.185 [2024-11-29 02:30:44.267078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:113496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.185 [2024-11-29 02:30:44.267091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:113504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.186 [2024-11-29 02:30:44.267120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:113512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.186 [2024-11-29 02:30:44.267148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:113520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.186 [2024-11-29 02:30:44.267176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:113528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.186 [2024-11-29 02:30:44.267208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:113536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.186 [2024-11-29 02:30:44.267237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:113544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.186 [2024-11-29 02:30:44.267266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:113552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.186 [2024-11-29 02:30:44.267294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:113560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.186 [2024-11-29 02:30:44.267324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:113568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.186 [2024-11-29 02:30:44.267352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:113576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.186 [2024-11-29 02:30:44.267380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:113584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.186 [2024-11-29 02:30:44.267435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:112952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.186 [2024-11-29 02:30:44.267465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:112960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.186 [2024-11-29 02:30:44.267495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:112968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.186 [2024-11-29 02:30:44.267524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:112984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.186 [2024-11-29 02:30:44.267553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:112992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.186 [2024-11-29 02:30:44.267581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:113008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.186 [2024-11-29 02:30:44.267615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:113016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.186 [2024-11-29 02:30:44.267644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:113024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.186 [2024-11-29 02:30:44.267672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:113048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.186 [2024-11-29 02:30:44.267716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:113056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.186 [2024-11-29 02:30:44.267745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:113072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.186 [2024-11-29 02:30:44.267772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:113088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.186 [2024-11-29 02:30:44.267800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:113104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.186 [2024-11-29 02:30:44.267828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:113128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.186 [2024-11-29 02:30:44.267856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:113136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.186 [2024-11-29 02:30:44.267884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.267898] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2508d10 is same with the state(5) to be set 00:25:47.186 [2024-11-29 02:30:44.267915] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:47.186 [2024-11-29 02:30:44.267926] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:47.186 [2024-11-29 02:30:44.267937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:113160 len:8 PRP1 0x0 PRP2 0x0 00:25:47.186 [2024-11-29 02:30:44.267950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.268007] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2508d10 was disconnected and freed. reset controller. 00:25:47.186 [2024-11-29 02:30:44.268029] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:25:47.186 [2024-11-29 02:30:44.268079] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.186 [2024-11-29 02:30:44.268098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.268113] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.186 [2024-11-29 02:30:44.268127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.268140] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.186 [2024-11-29 02:30:44.268154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.268168] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.186 [2024-11-29 02:30:44.268181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.186 [2024-11-29 02:30:44.268194] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:47.186 [2024-11-29 02:30:44.268230] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x24fc870 (9): Bad file descriptor 00:25:47.186 [2024-11-29 02:30:44.270490] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:47.186 [2024-11-29 02:30:44.345928] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:47.186 00:25:47.186 Latency(us) 00:25:47.186 [2024-11-29T01:30:50.867Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:47.186 [2024-11-29T01:30:50.867Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:47.186 Verification LBA range: start 0x0 length 0x4000 00:25:47.186 NVMe0n1 : 15.01 12802.42 50.01 835.05 0.00 9368.96 646.26 15922.82 00:25:47.186 [2024-11-29T01:30:50.867Z] =================================================================================================================== 00:25:47.186 [2024-11-29T01:30:50.867Z] Total : 12802.42 50.01 835.05 0.00 9368.96 646.26 15922.82 00:25:47.186 Received shutdown signal, test time was about 15.000000 seconds 00:25:47.186 00:25:47.186 Latency(us) 00:25:47.186 [2024-11-29T01:30:50.867Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:47.186 [2024-11-29T01:30:50.867Z] =================================================================================================================== 00:25:47.186 [2024-11-29T01:30:50.867Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:47.186 02:30:50 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:25:47.187 02:30:50 -- host/failover.sh@65 -- # count=3 00:25:47.187 02:30:50 -- host/failover.sh@67 -- # (( count != 3 )) 00:25:47.187 02:30:50 -- host/failover.sh@73 -- # bdevperf_pid=217610 00:25:47.187 02:30:50 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:25:47.187 02:30:50 -- host/failover.sh@75 -- # waitforlisten 217610 /var/tmp/bdevperf.sock 00:25:47.187 02:30:50 -- common/autotest_common.sh@829 -- # '[' -z 217610 ']' 00:25:47.187 02:30:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:47.187 02:30:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:47.187 02:30:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:47.187 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:47.187 02:30:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:47.187 02:30:50 -- common/autotest_common.sh@10 -- # set +x 00:25:47.752 02:30:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:47.752 02:30:51 -- common/autotest_common.sh@862 -- # return 0 00:25:47.752 02:30:51 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:48.010 [2024-11-29 02:30:51.494940] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:48.010 02:30:51 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:48.269 [2024-11-29 02:30:51.743652] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:48.269 02:30:51 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:48.528 NVMe0n1 00:25:48.528 02:30:52 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:49.094 00:25:49.094 02:30:52 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:49.352 00:25:49.352 02:30:52 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:49.352 02:30:52 -- host/failover.sh@82 -- # grep -q NVMe0 00:25:49.610 02:30:53 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:49.868 02:30:53 -- host/failover.sh@87 -- # sleep 3 00:25:53.144 02:30:56 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:53.144 02:30:56 -- host/failover.sh@88 -- # grep -q NVMe0 00:25:53.144 02:30:56 -- host/failover.sh@90 -- # run_test_pid=218432 00:25:53.144 02:30:56 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:53.144 02:30:56 -- host/failover.sh@92 -- # wait 218432 00:25:54.518 0 00:25:54.518 02:30:57 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:54.518 [2024-11-29 02:30:50.283941] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:54.518 [2024-11-29 02:30:50.284037] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid217610 ] 00:25:54.518 EAL: No free 2048 kB hugepages reported on node 1 00:25:54.518 [2024-11-29 02:30:50.346226] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:54.518 [2024-11-29 02:30:50.450523] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:54.518 [2024-11-29 02:30:53.474733] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:54.518 [2024-11-29 02:30:53.474831] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.518 [2024-11-29 02:30:53.474855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.518 [2024-11-29 02:30:53.474873] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.518 [2024-11-29 02:30:53.474888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.518 [2024-11-29 02:30:53.474902] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.518 [2024-11-29 02:30:53.474917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.518 [2024-11-29 02:30:53.474931] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.518 [2024-11-29 02:30:53.474946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.518 [2024-11-29 02:30:53.474963] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:54.518 [2024-11-29 02:30:53.475003] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:54.518 [2024-11-29 02:30:53.475035] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17d4870 (9): Bad file descriptor 00:25:54.518 [2024-11-29 02:30:53.576747] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:54.518 Running I/O for 1 seconds... 00:25:54.518 00:25:54.518 Latency(us) 00:25:54.518 [2024-11-29T01:30:58.199Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:54.518 [2024-11-29T01:30:58.199Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:54.518 Verification LBA range: start 0x0 length 0x4000 00:25:54.518 NVMe0n1 : 1.01 12926.55 50.49 0.00 0.00 9860.33 1231.83 11311.03 00:25:54.518 [2024-11-29T01:30:58.199Z] =================================================================================================================== 00:25:54.518 [2024-11-29T01:30:58.199Z] Total : 12926.55 50.49 0.00 0.00 9860.33 1231.83 11311.03 00:25:54.518 02:30:57 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:54.518 02:30:57 -- host/failover.sh@95 -- # grep -q NVMe0 00:25:54.518 02:30:58 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:54.776 02:30:58 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:54.776 02:30:58 -- host/failover.sh@99 -- # grep -q NVMe0 00:25:55.034 02:30:58 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:55.293 02:30:58 -- host/failover.sh@101 -- # sleep 3 00:25:58.574 02:31:01 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:58.574 02:31:01 -- host/failover.sh@103 -- # grep -q NVMe0 00:25:58.574 02:31:02 -- host/failover.sh@108 -- # killprocess 217610 00:25:58.574 02:31:02 -- common/autotest_common.sh@936 -- # '[' -z 217610 ']' 00:25:58.574 02:31:02 -- common/autotest_common.sh@940 -- # kill -0 217610 00:25:58.574 02:31:02 -- common/autotest_common.sh@941 -- # uname 00:25:58.574 02:31:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:58.574 02:31:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 217610 00:25:58.574 02:31:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:58.574 02:31:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:58.574 02:31:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 217610' 00:25:58.574 killing process with pid 217610 00:25:58.574 02:31:02 -- common/autotest_common.sh@955 -- # kill 217610 00:25:58.574 02:31:02 -- common/autotest_common.sh@960 -- # wait 217610 00:25:58.832 02:31:02 -- host/failover.sh@110 -- # sync 00:25:58.832 02:31:02 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:59.090 02:31:02 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:25:59.090 02:31:02 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:59.090 02:31:02 -- host/failover.sh@116 -- # nvmftestfini 00:25:59.090 02:31:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:59.090 02:31:02 -- nvmf/common.sh@116 -- # sync 00:25:59.090 02:31:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:59.090 02:31:02 -- nvmf/common.sh@119 -- # set +e 00:25:59.090 02:31:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:59.090 02:31:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:59.090 rmmod nvme_tcp 00:25:59.090 rmmod nvme_fabrics 00:25:59.090 rmmod nvme_keyring 00:25:59.349 02:31:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:59.349 02:31:02 -- nvmf/common.sh@123 -- # set -e 00:25:59.349 02:31:02 -- nvmf/common.sh@124 -- # return 0 00:25:59.349 02:31:02 -- nvmf/common.sh@477 -- # '[' -n 215127 ']' 00:25:59.349 02:31:02 -- nvmf/common.sh@478 -- # killprocess 215127 00:25:59.349 02:31:02 -- common/autotest_common.sh@936 -- # '[' -z 215127 ']' 00:25:59.349 02:31:02 -- common/autotest_common.sh@940 -- # kill -0 215127 00:25:59.349 02:31:02 -- common/autotest_common.sh@941 -- # uname 00:25:59.349 02:31:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:59.349 02:31:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 215127 00:25:59.349 02:31:02 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:59.349 02:31:02 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:59.349 02:31:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 215127' 00:25:59.349 killing process with pid 215127 00:25:59.349 02:31:02 -- common/autotest_common.sh@955 -- # kill 215127 00:25:59.349 02:31:02 -- common/autotest_common.sh@960 -- # wait 215127 00:25:59.608 02:31:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:59.608 02:31:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:59.608 02:31:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:59.608 02:31:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:59.608 02:31:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:59.608 02:31:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:59.608 02:31:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:59.608 02:31:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:01.511 02:31:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:01.511 00:26:01.511 real 0m37.586s 00:26:01.511 user 2m12.359s 00:26:01.511 sys 0m6.384s 00:26:01.511 02:31:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:01.511 02:31:05 -- common/autotest_common.sh@10 -- # set +x 00:26:01.511 ************************************ 00:26:01.511 END TEST nvmf_failover 00:26:01.511 ************************************ 00:26:01.769 02:31:05 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:01.769 02:31:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:01.769 02:31:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:01.769 02:31:05 -- common/autotest_common.sh@10 -- # set +x 00:26:01.769 ************************************ 00:26:01.769 START TEST nvmf_discovery 00:26:01.769 ************************************ 00:26:01.769 02:31:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:01.769 * Looking for test storage... 00:26:01.769 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:01.769 02:31:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:01.769 02:31:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:01.769 02:31:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:01.769 02:31:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:01.769 02:31:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:01.769 02:31:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:01.769 02:31:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:01.769 02:31:05 -- scripts/common.sh@335 -- # IFS=.-: 00:26:01.769 02:31:05 -- scripts/common.sh@335 -- # read -ra ver1 00:26:01.769 02:31:05 -- scripts/common.sh@336 -- # IFS=.-: 00:26:01.769 02:31:05 -- scripts/common.sh@336 -- # read -ra ver2 00:26:01.769 02:31:05 -- scripts/common.sh@337 -- # local 'op=<' 00:26:01.769 02:31:05 -- scripts/common.sh@339 -- # ver1_l=2 00:26:01.769 02:31:05 -- scripts/common.sh@340 -- # ver2_l=1 00:26:01.769 02:31:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:01.769 02:31:05 -- scripts/common.sh@343 -- # case "$op" in 00:26:01.769 02:31:05 -- scripts/common.sh@344 -- # : 1 00:26:01.769 02:31:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:01.769 02:31:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:01.769 02:31:05 -- scripts/common.sh@364 -- # decimal 1 00:26:01.769 02:31:05 -- scripts/common.sh@352 -- # local d=1 00:26:01.769 02:31:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:01.769 02:31:05 -- scripts/common.sh@354 -- # echo 1 00:26:01.769 02:31:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:01.769 02:31:05 -- scripts/common.sh@365 -- # decimal 2 00:26:01.769 02:31:05 -- scripts/common.sh@352 -- # local d=2 00:26:01.769 02:31:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:01.769 02:31:05 -- scripts/common.sh@354 -- # echo 2 00:26:01.769 02:31:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:01.769 02:31:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:01.769 02:31:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:01.769 02:31:05 -- scripts/common.sh@367 -- # return 0 00:26:01.769 02:31:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:01.769 02:31:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:01.769 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:01.769 --rc genhtml_branch_coverage=1 00:26:01.769 --rc genhtml_function_coverage=1 00:26:01.769 --rc genhtml_legend=1 00:26:01.769 --rc geninfo_all_blocks=1 00:26:01.769 --rc geninfo_unexecuted_blocks=1 00:26:01.769 00:26:01.769 ' 00:26:01.769 02:31:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:01.769 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:01.769 --rc genhtml_branch_coverage=1 00:26:01.769 --rc genhtml_function_coverage=1 00:26:01.769 --rc genhtml_legend=1 00:26:01.769 --rc geninfo_all_blocks=1 00:26:01.769 --rc geninfo_unexecuted_blocks=1 00:26:01.769 00:26:01.769 ' 00:26:01.769 02:31:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:01.769 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:01.769 --rc genhtml_branch_coverage=1 00:26:01.769 --rc genhtml_function_coverage=1 00:26:01.769 --rc genhtml_legend=1 00:26:01.769 --rc geninfo_all_blocks=1 00:26:01.769 --rc geninfo_unexecuted_blocks=1 00:26:01.769 00:26:01.769 ' 00:26:01.769 02:31:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:01.769 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:01.769 --rc genhtml_branch_coverage=1 00:26:01.769 --rc genhtml_function_coverage=1 00:26:01.769 --rc genhtml_legend=1 00:26:01.769 --rc geninfo_all_blocks=1 00:26:01.769 --rc geninfo_unexecuted_blocks=1 00:26:01.769 00:26:01.769 ' 00:26:01.769 02:31:05 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:01.769 02:31:05 -- nvmf/common.sh@7 -- # uname -s 00:26:01.769 02:31:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:01.769 02:31:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:01.769 02:31:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:01.769 02:31:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:01.769 02:31:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:01.769 02:31:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:01.769 02:31:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:01.769 02:31:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:01.769 02:31:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:01.769 02:31:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:01.769 02:31:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:01.769 02:31:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:01.769 02:31:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:01.769 02:31:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:01.769 02:31:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:01.769 02:31:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:01.769 02:31:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:01.769 02:31:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:01.769 02:31:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:01.769 02:31:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:01.769 02:31:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:01.769 02:31:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:01.769 02:31:05 -- paths/export.sh@5 -- # export PATH 00:26:01.769 02:31:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:01.769 02:31:05 -- nvmf/common.sh@46 -- # : 0 00:26:01.769 02:31:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:01.769 02:31:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:01.769 02:31:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:01.769 02:31:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:01.769 02:31:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:01.769 02:31:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:01.769 02:31:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:01.769 02:31:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:01.769 02:31:05 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:26:01.769 02:31:05 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:26:01.769 02:31:05 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:26:01.769 02:31:05 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:26:01.769 02:31:05 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:26:01.769 02:31:05 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:26:01.769 02:31:05 -- host/discovery.sh@25 -- # nvmftestinit 00:26:01.769 02:31:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:01.769 02:31:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:01.769 02:31:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:01.769 02:31:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:01.769 02:31:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:01.769 02:31:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:01.770 02:31:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:01.770 02:31:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:01.770 02:31:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:01.770 02:31:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:01.770 02:31:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:01.770 02:31:05 -- common/autotest_common.sh@10 -- # set +x 00:26:03.672 02:31:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:03.672 02:31:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:03.672 02:31:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:03.672 02:31:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:03.672 02:31:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:03.672 02:31:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:03.672 02:31:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:03.672 02:31:07 -- nvmf/common.sh@294 -- # net_devs=() 00:26:03.672 02:31:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:03.672 02:31:07 -- nvmf/common.sh@295 -- # e810=() 00:26:03.672 02:31:07 -- nvmf/common.sh@295 -- # local -ga e810 00:26:03.672 02:31:07 -- nvmf/common.sh@296 -- # x722=() 00:26:03.672 02:31:07 -- nvmf/common.sh@296 -- # local -ga x722 00:26:03.672 02:31:07 -- nvmf/common.sh@297 -- # mlx=() 00:26:03.672 02:31:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:03.672 02:31:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:03.672 02:31:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:03.672 02:31:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:03.672 02:31:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:03.672 02:31:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:03.672 02:31:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:03.672 02:31:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:03.672 02:31:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:03.672 02:31:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:03.672 02:31:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:03.672 02:31:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:03.672 02:31:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:03.672 02:31:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:03.672 02:31:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:03.672 02:31:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:03.672 02:31:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:03.672 02:31:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:03.672 02:31:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:03.672 02:31:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:03.672 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:03.672 02:31:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:03.672 02:31:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:03.672 02:31:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:03.672 02:31:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:03.672 02:31:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:03.672 02:31:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:03.672 02:31:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:03.672 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:03.672 02:31:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:03.672 02:31:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:03.672 02:31:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:03.672 02:31:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:03.672 02:31:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:03.672 02:31:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:03.672 02:31:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:03.672 02:31:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:03.672 02:31:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:03.672 02:31:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:03.672 02:31:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:03.672 02:31:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:03.672 02:31:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:03.672 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:03.672 02:31:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:03.672 02:31:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:03.672 02:31:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:03.672 02:31:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:03.672 02:31:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:03.672 02:31:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:03.672 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:03.672 02:31:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:03.672 02:31:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:03.672 02:31:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:03.672 02:31:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:03.672 02:31:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:03.672 02:31:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:03.672 02:31:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:03.672 02:31:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:03.672 02:31:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:03.672 02:31:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:03.672 02:31:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:03.672 02:31:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:03.672 02:31:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:03.672 02:31:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:03.672 02:31:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:03.672 02:31:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:03.672 02:31:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:03.672 02:31:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:03.672 02:31:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:03.931 02:31:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:03.931 02:31:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:03.931 02:31:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:03.931 02:31:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:03.931 02:31:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:03.931 02:31:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:03.931 02:31:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:03.931 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:03.931 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.259 ms 00:26:03.931 00:26:03.931 --- 10.0.0.2 ping statistics --- 00:26:03.931 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:03.931 rtt min/avg/max/mdev = 0.259/0.259/0.259/0.000 ms 00:26:03.931 02:31:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:03.931 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:03.931 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.140 ms 00:26:03.931 00:26:03.931 --- 10.0.0.1 ping statistics --- 00:26:03.931 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:03.931 rtt min/avg/max/mdev = 0.140/0.140/0.140/0.000 ms 00:26:03.931 02:31:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:03.931 02:31:07 -- nvmf/common.sh@410 -- # return 0 00:26:03.931 02:31:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:03.931 02:31:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:03.931 02:31:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:03.931 02:31:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:03.931 02:31:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:03.931 02:31:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:03.931 02:31:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:03.931 02:31:07 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:26:03.931 02:31:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:03.931 02:31:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:03.931 02:31:07 -- common/autotest_common.sh@10 -- # set +x 00:26:03.931 02:31:07 -- nvmf/common.sh@469 -- # nvmfpid=221074 00:26:03.931 02:31:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:03.931 02:31:07 -- nvmf/common.sh@470 -- # waitforlisten 221074 00:26:03.931 02:31:07 -- common/autotest_common.sh@829 -- # '[' -z 221074 ']' 00:26:03.931 02:31:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:03.931 02:31:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:03.931 02:31:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:03.931 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:03.931 02:31:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:03.931 02:31:07 -- common/autotest_common.sh@10 -- # set +x 00:26:03.931 [2024-11-29 02:31:07.542435] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:03.931 [2024-11-29 02:31:07.542518] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:03.931 EAL: No free 2048 kB hugepages reported on node 1 00:26:04.190 [2024-11-29 02:31:07.611571] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:04.190 [2024-11-29 02:31:07.725084] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:04.190 [2024-11-29 02:31:07.725267] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:04.190 [2024-11-29 02:31:07.725287] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:04.190 [2024-11-29 02:31:07.725302] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:04.190 [2024-11-29 02:31:07.725334] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:05.123 02:31:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:05.123 02:31:08 -- common/autotest_common.sh@862 -- # return 0 00:26:05.123 02:31:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:05.123 02:31:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:05.123 02:31:08 -- common/autotest_common.sh@10 -- # set +x 00:26:05.123 02:31:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:05.123 02:31:08 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:05.123 02:31:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.123 02:31:08 -- common/autotest_common.sh@10 -- # set +x 00:26:05.123 [2024-11-29 02:31:08.537844] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:05.123 02:31:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.123 02:31:08 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:26:05.123 02:31:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.123 02:31:08 -- common/autotest_common.sh@10 -- # set +x 00:26:05.123 [2024-11-29 02:31:08.546023] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:05.123 02:31:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.123 02:31:08 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:26:05.123 02:31:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.123 02:31:08 -- common/autotest_common.sh@10 -- # set +x 00:26:05.123 null0 00:26:05.123 02:31:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.123 02:31:08 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:26:05.123 02:31:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.123 02:31:08 -- common/autotest_common.sh@10 -- # set +x 00:26:05.123 null1 00:26:05.123 02:31:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.123 02:31:08 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:26:05.123 02:31:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.123 02:31:08 -- common/autotest_common.sh@10 -- # set +x 00:26:05.123 02:31:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.123 02:31:08 -- host/discovery.sh@45 -- # hostpid=221227 00:26:05.123 02:31:08 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:26:05.123 02:31:08 -- host/discovery.sh@46 -- # waitforlisten 221227 /tmp/host.sock 00:26:05.123 02:31:08 -- common/autotest_common.sh@829 -- # '[' -z 221227 ']' 00:26:05.123 02:31:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:05.123 02:31:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:05.123 02:31:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:05.123 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:05.123 02:31:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:05.123 02:31:08 -- common/autotest_common.sh@10 -- # set +x 00:26:05.123 [2024-11-29 02:31:08.614519] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:05.123 [2024-11-29 02:31:08.614587] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid221227 ] 00:26:05.123 EAL: No free 2048 kB hugepages reported on node 1 00:26:05.123 [2024-11-29 02:31:08.675548] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:05.123 [2024-11-29 02:31:08.788938] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:05.123 [2024-11-29 02:31:08.789136] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:06.058 02:31:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:06.058 02:31:09 -- common/autotest_common.sh@862 -- # return 0 00:26:06.058 02:31:09 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:06.058 02:31:09 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:26:06.058 02:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.058 02:31:09 -- common/autotest_common.sh@10 -- # set +x 00:26:06.058 02:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.058 02:31:09 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:26:06.058 02:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.058 02:31:09 -- common/autotest_common.sh@10 -- # set +x 00:26:06.058 02:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.058 02:31:09 -- host/discovery.sh@72 -- # notify_id=0 00:26:06.058 02:31:09 -- host/discovery.sh@78 -- # get_subsystem_names 00:26:06.058 02:31:09 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:06.058 02:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.058 02:31:09 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:06.058 02:31:09 -- common/autotest_common.sh@10 -- # set +x 00:26:06.058 02:31:09 -- host/discovery.sh@59 -- # sort 00:26:06.058 02:31:09 -- host/discovery.sh@59 -- # xargs 00:26:06.058 02:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.058 02:31:09 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:26:06.058 02:31:09 -- host/discovery.sh@79 -- # get_bdev_list 00:26:06.058 02:31:09 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:06.058 02:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.058 02:31:09 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:06.058 02:31:09 -- common/autotest_common.sh@10 -- # set +x 00:26:06.058 02:31:09 -- host/discovery.sh@55 -- # sort 00:26:06.058 02:31:09 -- host/discovery.sh@55 -- # xargs 00:26:06.058 02:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.058 02:31:09 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:26:06.058 02:31:09 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:26:06.058 02:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.058 02:31:09 -- common/autotest_common.sh@10 -- # set +x 00:26:06.058 02:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.058 02:31:09 -- host/discovery.sh@82 -- # get_subsystem_names 00:26:06.058 02:31:09 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:06.058 02:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.058 02:31:09 -- common/autotest_common.sh@10 -- # set +x 00:26:06.058 02:31:09 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:06.058 02:31:09 -- host/discovery.sh@59 -- # sort 00:26:06.058 02:31:09 -- host/discovery.sh@59 -- # xargs 00:26:06.058 02:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.058 02:31:09 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:26:06.058 02:31:09 -- host/discovery.sh@83 -- # get_bdev_list 00:26:06.058 02:31:09 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:06.058 02:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.058 02:31:09 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:06.058 02:31:09 -- common/autotest_common.sh@10 -- # set +x 00:26:06.058 02:31:09 -- host/discovery.sh@55 -- # sort 00:26:06.058 02:31:09 -- host/discovery.sh@55 -- # xargs 00:26:06.058 02:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.315 02:31:09 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:26:06.315 02:31:09 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:26:06.315 02:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.315 02:31:09 -- common/autotest_common.sh@10 -- # set +x 00:26:06.315 02:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.315 02:31:09 -- host/discovery.sh@86 -- # get_subsystem_names 00:26:06.315 02:31:09 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:06.315 02:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.315 02:31:09 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:06.315 02:31:09 -- common/autotest_common.sh@10 -- # set +x 00:26:06.315 02:31:09 -- host/discovery.sh@59 -- # sort 00:26:06.315 02:31:09 -- host/discovery.sh@59 -- # xargs 00:26:06.315 02:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.315 02:31:09 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:26:06.315 02:31:09 -- host/discovery.sh@87 -- # get_bdev_list 00:26:06.315 02:31:09 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:06.315 02:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.315 02:31:09 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:06.315 02:31:09 -- common/autotest_common.sh@10 -- # set +x 00:26:06.315 02:31:09 -- host/discovery.sh@55 -- # sort 00:26:06.315 02:31:09 -- host/discovery.sh@55 -- # xargs 00:26:06.315 02:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.315 02:31:09 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:26:06.315 02:31:09 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:06.315 02:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.315 02:31:09 -- common/autotest_common.sh@10 -- # set +x 00:26:06.315 [2024-11-29 02:31:09.841594] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:06.315 02:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.315 02:31:09 -- host/discovery.sh@92 -- # get_subsystem_names 00:26:06.315 02:31:09 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:06.315 02:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.315 02:31:09 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:06.315 02:31:09 -- common/autotest_common.sh@10 -- # set +x 00:26:06.315 02:31:09 -- host/discovery.sh@59 -- # sort 00:26:06.315 02:31:09 -- host/discovery.sh@59 -- # xargs 00:26:06.315 02:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.315 02:31:09 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:26:06.315 02:31:09 -- host/discovery.sh@93 -- # get_bdev_list 00:26:06.315 02:31:09 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:06.315 02:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.315 02:31:09 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:06.315 02:31:09 -- host/discovery.sh@55 -- # sort 00:26:06.315 02:31:09 -- common/autotest_common.sh@10 -- # set +x 00:26:06.315 02:31:09 -- host/discovery.sh@55 -- # xargs 00:26:06.315 02:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.315 02:31:09 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:26:06.315 02:31:09 -- host/discovery.sh@94 -- # get_notification_count 00:26:06.315 02:31:09 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:06.315 02:31:09 -- host/discovery.sh@74 -- # jq '. | length' 00:26:06.315 02:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.315 02:31:09 -- common/autotest_common.sh@10 -- # set +x 00:26:06.315 02:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.315 02:31:09 -- host/discovery.sh@74 -- # notification_count=0 00:26:06.315 02:31:09 -- host/discovery.sh@75 -- # notify_id=0 00:26:06.315 02:31:09 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:26:06.315 02:31:09 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:26:06.315 02:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.315 02:31:09 -- common/autotest_common.sh@10 -- # set +x 00:26:06.315 02:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.315 02:31:09 -- host/discovery.sh@100 -- # sleep 1 00:26:07.249 [2024-11-29 02:31:10.627539] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:07.249 [2024-11-29 02:31:10.627584] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:07.249 [2024-11-29 02:31:10.627612] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:07.249 [2024-11-29 02:31:10.713894] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:07.249 [2024-11-29 02:31:10.899124] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:07.249 [2024-11-29 02:31:10.899152] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:07.506 02:31:10 -- host/discovery.sh@101 -- # get_subsystem_names 00:26:07.506 02:31:10 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:07.506 02:31:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.506 02:31:10 -- common/autotest_common.sh@10 -- # set +x 00:26:07.506 02:31:10 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:07.506 02:31:10 -- host/discovery.sh@59 -- # sort 00:26:07.506 02:31:10 -- host/discovery.sh@59 -- # xargs 00:26:07.506 02:31:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.506 02:31:11 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:07.506 02:31:11 -- host/discovery.sh@102 -- # get_bdev_list 00:26:07.506 02:31:11 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:07.506 02:31:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.506 02:31:11 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:07.506 02:31:11 -- common/autotest_common.sh@10 -- # set +x 00:26:07.506 02:31:11 -- host/discovery.sh@55 -- # sort 00:26:07.506 02:31:11 -- host/discovery.sh@55 -- # xargs 00:26:07.507 02:31:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.507 02:31:11 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:26:07.507 02:31:11 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:26:07.507 02:31:11 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:07.507 02:31:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.507 02:31:11 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:07.507 02:31:11 -- common/autotest_common.sh@10 -- # set +x 00:26:07.507 02:31:11 -- host/discovery.sh@63 -- # sort -n 00:26:07.507 02:31:11 -- host/discovery.sh@63 -- # xargs 00:26:07.507 02:31:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.507 02:31:11 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:26:07.507 02:31:11 -- host/discovery.sh@104 -- # get_notification_count 00:26:07.507 02:31:11 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:07.507 02:31:11 -- host/discovery.sh@74 -- # jq '. | length' 00:26:07.507 02:31:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.507 02:31:11 -- common/autotest_common.sh@10 -- # set +x 00:26:07.507 02:31:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.507 02:31:11 -- host/discovery.sh@74 -- # notification_count=1 00:26:07.507 02:31:11 -- host/discovery.sh@75 -- # notify_id=1 00:26:07.507 02:31:11 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:26:07.507 02:31:11 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:26:07.507 02:31:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.507 02:31:11 -- common/autotest_common.sh@10 -- # set +x 00:26:07.507 02:31:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.507 02:31:11 -- host/discovery.sh@109 -- # sleep 1 00:26:08.881 02:31:12 -- host/discovery.sh@110 -- # get_bdev_list 00:26:08.881 02:31:12 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:08.881 02:31:12 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:08.881 02:31:12 -- host/discovery.sh@55 -- # sort 00:26:08.881 02:31:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.881 02:31:12 -- common/autotest_common.sh@10 -- # set +x 00:26:08.881 02:31:12 -- host/discovery.sh@55 -- # xargs 00:26:08.881 02:31:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.881 02:31:12 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:08.881 02:31:12 -- host/discovery.sh@111 -- # get_notification_count 00:26:08.881 02:31:12 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:26:08.881 02:31:12 -- host/discovery.sh@74 -- # jq '. | length' 00:26:08.881 02:31:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.881 02:31:12 -- common/autotest_common.sh@10 -- # set +x 00:26:08.881 02:31:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.881 02:31:12 -- host/discovery.sh@74 -- # notification_count=1 00:26:08.881 02:31:12 -- host/discovery.sh@75 -- # notify_id=2 00:26:08.881 02:31:12 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:26:08.881 02:31:12 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:26:08.881 02:31:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.881 02:31:12 -- common/autotest_common.sh@10 -- # set +x 00:26:08.881 [2024-11-29 02:31:12.228878] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:08.881 [2024-11-29 02:31:12.229658] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:08.881 [2024-11-29 02:31:12.229692] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:08.881 02:31:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.881 02:31:12 -- host/discovery.sh@117 -- # sleep 1 00:26:08.881 [2024-11-29 02:31:12.356094] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:26:08.881 [2024-11-29 02:31:12.453770] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:08.881 [2024-11-29 02:31:12.453809] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:08.881 [2024-11-29 02:31:12.453820] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:09.816 02:31:13 -- host/discovery.sh@118 -- # get_subsystem_names 00:26:09.816 02:31:13 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:09.816 02:31:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.816 02:31:13 -- common/autotest_common.sh@10 -- # set +x 00:26:09.816 02:31:13 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:09.816 02:31:13 -- host/discovery.sh@59 -- # sort 00:26:09.816 02:31:13 -- host/discovery.sh@59 -- # xargs 00:26:09.816 02:31:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.816 02:31:13 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:09.816 02:31:13 -- host/discovery.sh@119 -- # get_bdev_list 00:26:09.816 02:31:13 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:09.816 02:31:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.816 02:31:13 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:09.816 02:31:13 -- common/autotest_common.sh@10 -- # set +x 00:26:09.816 02:31:13 -- host/discovery.sh@55 -- # sort 00:26:09.816 02:31:13 -- host/discovery.sh@55 -- # xargs 00:26:09.816 02:31:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.816 02:31:13 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:09.816 02:31:13 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:26:09.816 02:31:13 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:09.816 02:31:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.816 02:31:13 -- common/autotest_common.sh@10 -- # set +x 00:26:09.816 02:31:13 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:09.816 02:31:13 -- host/discovery.sh@63 -- # sort -n 00:26:09.816 02:31:13 -- host/discovery.sh@63 -- # xargs 00:26:09.816 02:31:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.817 02:31:13 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:26:09.817 02:31:13 -- host/discovery.sh@121 -- # get_notification_count 00:26:09.817 02:31:13 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:09.817 02:31:13 -- host/discovery.sh@74 -- # jq '. | length' 00:26:09.817 02:31:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.817 02:31:13 -- common/autotest_common.sh@10 -- # set +x 00:26:09.817 02:31:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.817 02:31:13 -- host/discovery.sh@74 -- # notification_count=0 00:26:09.817 02:31:13 -- host/discovery.sh@75 -- # notify_id=2 00:26:09.817 02:31:13 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:26:09.817 02:31:13 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:09.817 02:31:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.817 02:31:13 -- common/autotest_common.sh@10 -- # set +x 00:26:09.817 [2024-11-29 02:31:13.389167] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:09.817 [2024-11-29 02:31:13.389203] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:09.817 02:31:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.817 02:31:13 -- host/discovery.sh@127 -- # sleep 1 00:26:09.817 [2024-11-29 02:31:13.393068] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.817 [2024-11-29 02:31:13.393102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.817 [2024-11-29 02:31:13.393140] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.817 [2024-11-29 02:31:13.393153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.817 [2024-11-29 02:31:13.393166] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.817 [2024-11-29 02:31:13.393194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.817 [2024-11-29 02:31:13.393208] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.817 [2024-11-29 02:31:13.393221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.817 [2024-11-29 02:31:13.393234] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5c4810 is same with the state(5) to be set 00:26:09.817 [2024-11-29 02:31:13.403082] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5c4810 (9): Bad file descriptor 00:26:09.817 [2024-11-29 02:31:13.413119] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:09.817 [2024-11-29 02:31:13.413403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.817 [2024-11-29 02:31:13.413576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.817 [2024-11-29 02:31:13.413603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5c4810 with addr=10.0.0.2, port=4420 00:26:09.817 [2024-11-29 02:31:13.413619] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5c4810 is same with the state(5) to be set 00:26:09.817 [2024-11-29 02:31:13.413642] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5c4810 (9): Bad file descriptor 00:26:09.817 [2024-11-29 02:31:13.413688] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:09.817 [2024-11-29 02:31:13.413722] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:09.817 [2024-11-29 02:31:13.413740] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:09.817 [2024-11-29 02:31:13.413763] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:09.817 [2024-11-29 02:31:13.423213] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:09.817 [2024-11-29 02:31:13.423464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.817 [2024-11-29 02:31:13.423568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.817 [2024-11-29 02:31:13.423596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5c4810 with addr=10.0.0.2, port=4420 00:26:09.817 [2024-11-29 02:31:13.423612] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5c4810 is same with the state(5) to be set 00:26:09.817 [2024-11-29 02:31:13.423635] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5c4810 (9): Bad file descriptor 00:26:09.817 [2024-11-29 02:31:13.423671] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:09.817 [2024-11-29 02:31:13.423686] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:09.817 [2024-11-29 02:31:13.423704] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:09.817 [2024-11-29 02:31:13.423751] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:09.817 [2024-11-29 02:31:13.433302] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:09.817 [2024-11-29 02:31:13.433559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.817 [2024-11-29 02:31:13.433663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.817 [2024-11-29 02:31:13.433690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5c4810 with addr=10.0.0.2, port=4420 00:26:09.817 [2024-11-29 02:31:13.433706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5c4810 is same with the state(5) to be set 00:26:09.817 [2024-11-29 02:31:13.433728] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5c4810 (9): Bad file descriptor 00:26:09.817 [2024-11-29 02:31:13.433749] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:09.817 [2024-11-29 02:31:13.433763] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:09.817 [2024-11-29 02:31:13.433776] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:09.817 [2024-11-29 02:31:13.433822] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:09.817 [2024-11-29 02:31:13.443383] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:09.817 [2024-11-29 02:31:13.443583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.817 [2024-11-29 02:31:13.443705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.817 [2024-11-29 02:31:13.443730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5c4810 with addr=10.0.0.2, port=4420 00:26:09.817 [2024-11-29 02:31:13.443746] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5c4810 is same with the state(5) to be set 00:26:09.817 [2024-11-29 02:31:13.443767] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5c4810 (9): Bad file descriptor 00:26:09.817 [2024-11-29 02:31:13.443788] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:09.817 [2024-11-29 02:31:13.443802] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:09.817 [2024-11-29 02:31:13.443816] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:09.817 [2024-11-29 02:31:13.443848] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:09.817 [2024-11-29 02:31:13.453464] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:09.817 [2024-11-29 02:31:13.453618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.817 [2024-11-29 02:31:13.453773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.817 [2024-11-29 02:31:13.453800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5c4810 with addr=10.0.0.2, port=4420 00:26:09.817 [2024-11-29 02:31:13.453816] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5c4810 is same with the state(5) to be set 00:26:09.817 [2024-11-29 02:31:13.453839] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5c4810 (9): Bad file descriptor 00:26:09.817 [2024-11-29 02:31:13.453891] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:09.817 [2024-11-29 02:31:13.453911] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:09.817 [2024-11-29 02:31:13.453927] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:09.817 [2024-11-29 02:31:13.453954] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:09.817 [2024-11-29 02:31:13.463532] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:09.817 [2024-11-29 02:31:13.463719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.817 [2024-11-29 02:31:13.463842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.817 [2024-11-29 02:31:13.463872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5c4810 with addr=10.0.0.2, port=4420 00:26:09.817 [2024-11-29 02:31:13.463890] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5c4810 is same with the state(5) to be set 00:26:09.817 [2024-11-29 02:31:13.463915] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5c4810 (9): Bad file descriptor 00:26:09.817 [2024-11-29 02:31:13.463951] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:09.817 [2024-11-29 02:31:13.463971] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:09.817 [2024-11-29 02:31:13.463987] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:09.817 [2024-11-29 02:31:13.464007] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:09.817 [2024-11-29 02:31:13.473599] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:09.817 [2024-11-29 02:31:13.473800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.817 [2024-11-29 02:31:13.473905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.817 [2024-11-29 02:31:13.473934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5c4810 with addr=10.0.0.2, port=4420 00:26:09.817 [2024-11-29 02:31:13.473951] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5c4810 is same with the state(5) to be set 00:26:09.817 [2024-11-29 02:31:13.473976] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5c4810 (9): Bad file descriptor 00:26:09.817 [2024-11-29 02:31:13.474014] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:09.817 [2024-11-29 02:31:13.474034] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:09.817 [2024-11-29 02:31:13.474049] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:09.817 [2024-11-29 02:31:13.474070] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:09.818 [2024-11-29 02:31:13.475007] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:26:09.818 [2024-11-29 02:31:13.475037] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:10.752 02:31:14 -- host/discovery.sh@128 -- # get_subsystem_names 00:26:10.752 02:31:14 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:10.752 02:31:14 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:10.752 02:31:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.752 02:31:14 -- host/discovery.sh@59 -- # sort 00:26:10.752 02:31:14 -- common/autotest_common.sh@10 -- # set +x 00:26:10.752 02:31:14 -- host/discovery.sh@59 -- # xargs 00:26:10.752 02:31:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.011 02:31:14 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:11.011 02:31:14 -- host/discovery.sh@129 -- # get_bdev_list 00:26:11.011 02:31:14 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:11.011 02:31:14 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:11.011 02:31:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.011 02:31:14 -- host/discovery.sh@55 -- # sort 00:26:11.011 02:31:14 -- common/autotest_common.sh@10 -- # set +x 00:26:11.011 02:31:14 -- host/discovery.sh@55 -- # xargs 00:26:11.011 02:31:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.011 02:31:14 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:11.011 02:31:14 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:26:11.011 02:31:14 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:11.011 02:31:14 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:11.011 02:31:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.011 02:31:14 -- common/autotest_common.sh@10 -- # set +x 00:26:11.011 02:31:14 -- host/discovery.sh@63 -- # sort -n 00:26:11.011 02:31:14 -- host/discovery.sh@63 -- # xargs 00:26:11.011 02:31:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.011 02:31:14 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:26:11.011 02:31:14 -- host/discovery.sh@131 -- # get_notification_count 00:26:11.011 02:31:14 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:11.011 02:31:14 -- host/discovery.sh@74 -- # jq '. | length' 00:26:11.011 02:31:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.011 02:31:14 -- common/autotest_common.sh@10 -- # set +x 00:26:11.011 02:31:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.011 02:31:14 -- host/discovery.sh@74 -- # notification_count=0 00:26:11.011 02:31:14 -- host/discovery.sh@75 -- # notify_id=2 00:26:11.011 02:31:14 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:26:11.011 02:31:14 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:26:11.011 02:31:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.011 02:31:14 -- common/autotest_common.sh@10 -- # set +x 00:26:11.011 02:31:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.011 02:31:14 -- host/discovery.sh@135 -- # sleep 1 00:26:11.949 02:31:15 -- host/discovery.sh@136 -- # get_subsystem_names 00:26:11.949 02:31:15 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:11.949 02:31:15 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:11.949 02:31:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.949 02:31:15 -- common/autotest_common.sh@10 -- # set +x 00:26:11.949 02:31:15 -- host/discovery.sh@59 -- # sort 00:26:11.949 02:31:15 -- host/discovery.sh@59 -- # xargs 00:26:11.949 02:31:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:12.207 02:31:15 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:26:12.207 02:31:15 -- host/discovery.sh@137 -- # get_bdev_list 00:26:12.207 02:31:15 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:12.207 02:31:15 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:12.207 02:31:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:12.207 02:31:15 -- common/autotest_common.sh@10 -- # set +x 00:26:12.207 02:31:15 -- host/discovery.sh@55 -- # sort 00:26:12.207 02:31:15 -- host/discovery.sh@55 -- # xargs 00:26:12.207 02:31:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:12.207 02:31:15 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:26:12.207 02:31:15 -- host/discovery.sh@138 -- # get_notification_count 00:26:12.207 02:31:15 -- host/discovery.sh@74 -- # jq '. | length' 00:26:12.207 02:31:15 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:12.207 02:31:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:12.207 02:31:15 -- common/autotest_common.sh@10 -- # set +x 00:26:12.207 02:31:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:12.207 02:31:15 -- host/discovery.sh@74 -- # notification_count=2 00:26:12.207 02:31:15 -- host/discovery.sh@75 -- # notify_id=4 00:26:12.207 02:31:15 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:26:12.207 02:31:15 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:12.207 02:31:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:12.207 02:31:15 -- common/autotest_common.sh@10 -- # set +x 00:26:13.147 [2024-11-29 02:31:16.773143] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:13.147 [2024-11-29 02:31:16.773172] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:13.147 [2024-11-29 02:31:16.773198] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:13.448 [2024-11-29 02:31:16.860471] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:26:13.448 [2024-11-29 02:31:17.088107] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:13.448 [2024-11-29 02:31:17.088153] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:13.448 02:31:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.448 02:31:17 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:13.448 02:31:17 -- common/autotest_common.sh@650 -- # local es=0 00:26:13.448 02:31:17 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:13.448 02:31:17 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:13.448 02:31:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:13.449 02:31:17 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:13.449 02:31:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:13.449 02:31:17 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:13.449 02:31:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.449 02:31:17 -- common/autotest_common.sh@10 -- # set +x 00:26:13.449 request: 00:26:13.449 { 00:26:13.449 "name": "nvme", 00:26:13.449 "trtype": "tcp", 00:26:13.449 "traddr": "10.0.0.2", 00:26:13.449 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:13.449 "adrfam": "ipv4", 00:26:13.449 "trsvcid": "8009", 00:26:13.449 "wait_for_attach": true, 00:26:13.449 "method": "bdev_nvme_start_discovery", 00:26:13.449 "req_id": 1 00:26:13.449 } 00:26:13.449 Got JSON-RPC error response 00:26:13.449 response: 00:26:13.449 { 00:26:13.449 "code": -17, 00:26:13.449 "message": "File exists" 00:26:13.449 } 00:26:13.449 02:31:17 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:13.449 02:31:17 -- common/autotest_common.sh@653 -- # es=1 00:26:13.449 02:31:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:13.449 02:31:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:13.449 02:31:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:13.449 02:31:17 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:26:13.449 02:31:17 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:13.449 02:31:17 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:13.449 02:31:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.449 02:31:17 -- common/autotest_common.sh@10 -- # set +x 00:26:13.449 02:31:17 -- host/discovery.sh@67 -- # sort 00:26:13.449 02:31:17 -- host/discovery.sh@67 -- # xargs 00:26:13.731 02:31:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.731 02:31:17 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:26:13.731 02:31:17 -- host/discovery.sh@147 -- # get_bdev_list 00:26:13.731 02:31:17 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:13.731 02:31:17 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:13.731 02:31:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.731 02:31:17 -- common/autotest_common.sh@10 -- # set +x 00:26:13.731 02:31:17 -- host/discovery.sh@55 -- # sort 00:26:13.731 02:31:17 -- host/discovery.sh@55 -- # xargs 00:26:13.731 02:31:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.731 02:31:17 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:13.731 02:31:17 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:13.731 02:31:17 -- common/autotest_common.sh@650 -- # local es=0 00:26:13.731 02:31:17 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:13.731 02:31:17 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:13.731 02:31:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:13.731 02:31:17 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:13.731 02:31:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:13.731 02:31:17 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:13.731 02:31:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.731 02:31:17 -- common/autotest_common.sh@10 -- # set +x 00:26:13.731 request: 00:26:13.731 { 00:26:13.731 "name": "nvme_second", 00:26:13.731 "trtype": "tcp", 00:26:13.731 "traddr": "10.0.0.2", 00:26:13.731 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:13.731 "adrfam": "ipv4", 00:26:13.731 "trsvcid": "8009", 00:26:13.731 "wait_for_attach": true, 00:26:13.731 "method": "bdev_nvme_start_discovery", 00:26:13.731 "req_id": 1 00:26:13.731 } 00:26:13.731 Got JSON-RPC error response 00:26:13.731 response: 00:26:13.731 { 00:26:13.731 "code": -17, 00:26:13.731 "message": "File exists" 00:26:13.731 } 00:26:13.731 02:31:17 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:13.732 02:31:17 -- common/autotest_common.sh@653 -- # es=1 00:26:13.732 02:31:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:13.732 02:31:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:13.732 02:31:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:13.732 02:31:17 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:26:13.732 02:31:17 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:13.732 02:31:17 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:13.732 02:31:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.732 02:31:17 -- common/autotest_common.sh@10 -- # set +x 00:26:13.732 02:31:17 -- host/discovery.sh@67 -- # sort 00:26:13.732 02:31:17 -- host/discovery.sh@67 -- # xargs 00:26:13.732 02:31:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.732 02:31:17 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:26:13.732 02:31:17 -- host/discovery.sh@153 -- # get_bdev_list 00:26:13.732 02:31:17 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:13.732 02:31:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.732 02:31:17 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:13.732 02:31:17 -- common/autotest_common.sh@10 -- # set +x 00:26:13.732 02:31:17 -- host/discovery.sh@55 -- # sort 00:26:13.732 02:31:17 -- host/discovery.sh@55 -- # xargs 00:26:13.732 02:31:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.732 02:31:17 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:13.732 02:31:17 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:13.732 02:31:17 -- common/autotest_common.sh@650 -- # local es=0 00:26:13.732 02:31:17 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:13.732 02:31:17 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:13.732 02:31:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:13.732 02:31:17 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:13.732 02:31:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:13.732 02:31:17 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:13.732 02:31:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.732 02:31:17 -- common/autotest_common.sh@10 -- # set +x 00:26:14.669 [2024-11-29 02:31:18.284368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:14.669 [2024-11-29 02:31:18.284573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:14.669 [2024-11-29 02:31:18.284601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5e83d0 with addr=10.0.0.2, port=8010 00:26:14.669 [2024-11-29 02:31:18.284627] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:14.669 [2024-11-29 02:31:18.284642] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:14.669 [2024-11-29 02:31:18.284655] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:15.607 [2024-11-29 02:31:19.286704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.607 [2024-11-29 02:31:19.286954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.607 [2024-11-29 02:31:19.286981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5b4d30 with addr=10.0.0.2, port=8010 00:26:15.607 [2024-11-29 02:31:19.287004] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:15.607 [2024-11-29 02:31:19.287018] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:15.607 [2024-11-29 02:31:19.287046] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:16.986 [2024-11-29 02:31:20.289028] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:26:16.987 request: 00:26:16.987 { 00:26:16.987 "name": "nvme_second", 00:26:16.987 "trtype": "tcp", 00:26:16.987 "traddr": "10.0.0.2", 00:26:16.987 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:16.987 "adrfam": "ipv4", 00:26:16.987 "trsvcid": "8010", 00:26:16.987 "attach_timeout_ms": 3000, 00:26:16.987 "method": "bdev_nvme_start_discovery", 00:26:16.987 "req_id": 1 00:26:16.987 } 00:26:16.987 Got JSON-RPC error response 00:26:16.987 response: 00:26:16.987 { 00:26:16.987 "code": -110, 00:26:16.987 "message": "Connection timed out" 00:26:16.987 } 00:26:16.987 02:31:20 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:16.987 02:31:20 -- common/autotest_common.sh@653 -- # es=1 00:26:16.987 02:31:20 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:16.987 02:31:20 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:16.987 02:31:20 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:16.987 02:31:20 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:26:16.987 02:31:20 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:16.987 02:31:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.987 02:31:20 -- common/autotest_common.sh@10 -- # set +x 00:26:16.987 02:31:20 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:16.987 02:31:20 -- host/discovery.sh@67 -- # sort 00:26:16.987 02:31:20 -- host/discovery.sh@67 -- # xargs 00:26:16.987 02:31:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.987 02:31:20 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:26:16.987 02:31:20 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:26:16.987 02:31:20 -- host/discovery.sh@162 -- # kill 221227 00:26:16.987 02:31:20 -- host/discovery.sh@163 -- # nvmftestfini 00:26:16.987 02:31:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:16.987 02:31:20 -- nvmf/common.sh@116 -- # sync 00:26:16.987 02:31:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:16.987 02:31:20 -- nvmf/common.sh@119 -- # set +e 00:26:16.987 02:31:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:16.987 02:31:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:16.987 rmmod nvme_tcp 00:26:16.987 rmmod nvme_fabrics 00:26:16.987 rmmod nvme_keyring 00:26:16.987 02:31:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:16.987 02:31:20 -- nvmf/common.sh@123 -- # set -e 00:26:16.987 02:31:20 -- nvmf/common.sh@124 -- # return 0 00:26:16.987 02:31:20 -- nvmf/common.sh@477 -- # '[' -n 221074 ']' 00:26:16.987 02:31:20 -- nvmf/common.sh@478 -- # killprocess 221074 00:26:16.987 02:31:20 -- common/autotest_common.sh@936 -- # '[' -z 221074 ']' 00:26:16.987 02:31:20 -- common/autotest_common.sh@940 -- # kill -0 221074 00:26:16.987 02:31:20 -- common/autotest_common.sh@941 -- # uname 00:26:16.987 02:31:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:16.987 02:31:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 221074 00:26:16.987 02:31:20 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:16.987 02:31:20 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:16.987 02:31:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 221074' 00:26:16.987 killing process with pid 221074 00:26:16.987 02:31:20 -- common/autotest_common.sh@955 -- # kill 221074 00:26:16.987 02:31:20 -- common/autotest_common.sh@960 -- # wait 221074 00:26:17.247 02:31:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:17.247 02:31:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:17.247 02:31:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:17.247 02:31:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:17.247 02:31:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:17.247 02:31:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:17.247 02:31:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:17.247 02:31:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:19.154 02:31:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:19.154 00:26:19.154 real 0m17.530s 00:26:19.154 user 0m27.173s 00:26:19.154 sys 0m2.865s 00:26:19.154 02:31:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:19.154 02:31:22 -- common/autotest_common.sh@10 -- # set +x 00:26:19.154 ************************************ 00:26:19.154 END TEST nvmf_discovery 00:26:19.154 ************************************ 00:26:19.154 02:31:22 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:19.154 02:31:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:19.154 02:31:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:19.154 02:31:22 -- common/autotest_common.sh@10 -- # set +x 00:26:19.154 ************************************ 00:26:19.154 START TEST nvmf_discovery_remove_ifc 00:26:19.154 ************************************ 00:26:19.154 02:31:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:19.154 * Looking for test storage... 00:26:19.154 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:19.154 02:31:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:19.154 02:31:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:19.154 02:31:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:19.415 02:31:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:19.415 02:31:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:19.415 02:31:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:19.415 02:31:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:19.415 02:31:22 -- scripts/common.sh@335 -- # IFS=.-: 00:26:19.415 02:31:22 -- scripts/common.sh@335 -- # read -ra ver1 00:26:19.415 02:31:22 -- scripts/common.sh@336 -- # IFS=.-: 00:26:19.415 02:31:22 -- scripts/common.sh@336 -- # read -ra ver2 00:26:19.415 02:31:22 -- scripts/common.sh@337 -- # local 'op=<' 00:26:19.415 02:31:22 -- scripts/common.sh@339 -- # ver1_l=2 00:26:19.415 02:31:22 -- scripts/common.sh@340 -- # ver2_l=1 00:26:19.415 02:31:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:19.415 02:31:22 -- scripts/common.sh@343 -- # case "$op" in 00:26:19.415 02:31:22 -- scripts/common.sh@344 -- # : 1 00:26:19.415 02:31:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:19.415 02:31:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:19.415 02:31:22 -- scripts/common.sh@364 -- # decimal 1 00:26:19.415 02:31:22 -- scripts/common.sh@352 -- # local d=1 00:26:19.415 02:31:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:19.415 02:31:22 -- scripts/common.sh@354 -- # echo 1 00:26:19.415 02:31:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:19.415 02:31:22 -- scripts/common.sh@365 -- # decimal 2 00:26:19.415 02:31:22 -- scripts/common.sh@352 -- # local d=2 00:26:19.415 02:31:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:19.415 02:31:22 -- scripts/common.sh@354 -- # echo 2 00:26:19.415 02:31:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:19.415 02:31:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:19.415 02:31:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:19.415 02:31:22 -- scripts/common.sh@367 -- # return 0 00:26:19.415 02:31:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:19.415 02:31:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:19.415 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:19.415 --rc genhtml_branch_coverage=1 00:26:19.415 --rc genhtml_function_coverage=1 00:26:19.415 --rc genhtml_legend=1 00:26:19.415 --rc geninfo_all_blocks=1 00:26:19.415 --rc geninfo_unexecuted_blocks=1 00:26:19.415 00:26:19.415 ' 00:26:19.415 02:31:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:19.415 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:19.415 --rc genhtml_branch_coverage=1 00:26:19.415 --rc genhtml_function_coverage=1 00:26:19.415 --rc genhtml_legend=1 00:26:19.415 --rc geninfo_all_blocks=1 00:26:19.415 --rc geninfo_unexecuted_blocks=1 00:26:19.415 00:26:19.415 ' 00:26:19.415 02:31:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:19.415 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:19.415 --rc genhtml_branch_coverage=1 00:26:19.415 --rc genhtml_function_coverage=1 00:26:19.415 --rc genhtml_legend=1 00:26:19.415 --rc geninfo_all_blocks=1 00:26:19.415 --rc geninfo_unexecuted_blocks=1 00:26:19.415 00:26:19.415 ' 00:26:19.415 02:31:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:19.415 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:19.415 --rc genhtml_branch_coverage=1 00:26:19.415 --rc genhtml_function_coverage=1 00:26:19.415 --rc genhtml_legend=1 00:26:19.415 --rc geninfo_all_blocks=1 00:26:19.415 --rc geninfo_unexecuted_blocks=1 00:26:19.415 00:26:19.415 ' 00:26:19.415 02:31:22 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:19.415 02:31:22 -- nvmf/common.sh@7 -- # uname -s 00:26:19.415 02:31:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:19.415 02:31:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:19.415 02:31:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:19.415 02:31:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:19.415 02:31:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:19.415 02:31:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:19.415 02:31:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:19.415 02:31:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:19.415 02:31:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:19.415 02:31:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:19.415 02:31:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:19.415 02:31:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:19.415 02:31:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:19.415 02:31:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:19.415 02:31:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:19.415 02:31:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:19.415 02:31:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:19.415 02:31:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:19.415 02:31:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:19.415 02:31:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:19.415 02:31:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:19.415 02:31:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:19.415 02:31:22 -- paths/export.sh@5 -- # export PATH 00:26:19.415 02:31:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:19.415 02:31:22 -- nvmf/common.sh@46 -- # : 0 00:26:19.415 02:31:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:19.415 02:31:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:19.415 02:31:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:19.415 02:31:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:19.415 02:31:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:19.415 02:31:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:19.415 02:31:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:19.415 02:31:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:19.415 02:31:22 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:26:19.415 02:31:22 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:26:19.415 02:31:22 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:26:19.415 02:31:22 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:26:19.415 02:31:22 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:26:19.415 02:31:22 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:26:19.415 02:31:22 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:26:19.415 02:31:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:19.415 02:31:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:19.415 02:31:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:19.415 02:31:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:19.415 02:31:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:19.415 02:31:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:19.415 02:31:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:19.415 02:31:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:19.415 02:31:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:19.415 02:31:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:19.415 02:31:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:19.415 02:31:22 -- common/autotest_common.sh@10 -- # set +x 00:26:21.319 02:31:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:21.319 02:31:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:21.319 02:31:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:21.319 02:31:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:21.319 02:31:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:21.319 02:31:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:21.319 02:31:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:21.319 02:31:24 -- nvmf/common.sh@294 -- # net_devs=() 00:26:21.320 02:31:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:21.320 02:31:24 -- nvmf/common.sh@295 -- # e810=() 00:26:21.320 02:31:24 -- nvmf/common.sh@295 -- # local -ga e810 00:26:21.320 02:31:24 -- nvmf/common.sh@296 -- # x722=() 00:26:21.320 02:31:24 -- nvmf/common.sh@296 -- # local -ga x722 00:26:21.320 02:31:24 -- nvmf/common.sh@297 -- # mlx=() 00:26:21.320 02:31:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:21.320 02:31:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:21.320 02:31:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:21.320 02:31:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:21.320 02:31:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:21.320 02:31:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:21.320 02:31:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:21.320 02:31:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:21.320 02:31:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:21.320 02:31:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:21.320 02:31:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:21.320 02:31:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:21.320 02:31:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:21.320 02:31:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:21.320 02:31:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:21.320 02:31:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:21.320 02:31:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:21.320 02:31:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:21.320 02:31:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:21.320 02:31:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:21.320 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:21.320 02:31:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:21.320 02:31:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:21.320 02:31:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:21.320 02:31:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:21.320 02:31:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:21.320 02:31:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:21.320 02:31:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:21.320 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:21.320 02:31:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:21.320 02:31:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:21.320 02:31:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:21.320 02:31:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:21.320 02:31:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:21.320 02:31:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:21.320 02:31:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:21.320 02:31:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:21.320 02:31:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:21.320 02:31:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:21.320 02:31:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:21.320 02:31:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:21.320 02:31:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:21.320 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:21.320 02:31:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:21.320 02:31:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:21.320 02:31:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:21.320 02:31:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:21.320 02:31:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:21.320 02:31:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:21.320 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:21.320 02:31:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:21.320 02:31:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:21.320 02:31:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:21.320 02:31:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:21.320 02:31:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:21.320 02:31:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:21.320 02:31:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:21.320 02:31:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:21.320 02:31:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:21.320 02:31:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:21.320 02:31:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:21.320 02:31:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:21.320 02:31:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:21.320 02:31:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:21.320 02:31:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:21.320 02:31:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:21.320 02:31:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:21.320 02:31:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:21.320 02:31:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:21.320 02:31:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:21.320 02:31:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:21.320 02:31:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:21.320 02:31:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:21.580 02:31:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:21.580 02:31:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:21.580 02:31:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:21.580 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:21.580 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.238 ms 00:26:21.580 00:26:21.580 --- 10.0.0.2 ping statistics --- 00:26:21.580 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:21.580 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:26:21.580 02:31:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:21.580 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:21.580 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.058 ms 00:26:21.580 00:26:21.580 --- 10.0.0.1 ping statistics --- 00:26:21.580 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:21.580 rtt min/avg/max/mdev = 0.058/0.058/0.058/0.000 ms 00:26:21.580 02:31:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:21.580 02:31:25 -- nvmf/common.sh@410 -- # return 0 00:26:21.580 02:31:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:21.580 02:31:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:21.580 02:31:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:21.580 02:31:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:21.580 02:31:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:21.580 02:31:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:21.580 02:31:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:21.580 02:31:25 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:26:21.580 02:31:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:21.580 02:31:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:21.580 02:31:25 -- common/autotest_common.sh@10 -- # set +x 00:26:21.580 02:31:25 -- nvmf/common.sh@469 -- # nvmfpid=224732 00:26:21.580 02:31:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:21.580 02:31:25 -- nvmf/common.sh@470 -- # waitforlisten 224732 00:26:21.580 02:31:25 -- common/autotest_common.sh@829 -- # '[' -z 224732 ']' 00:26:21.580 02:31:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:21.580 02:31:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:21.580 02:31:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:21.580 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:21.580 02:31:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:21.580 02:31:25 -- common/autotest_common.sh@10 -- # set +x 00:26:21.580 [2024-11-29 02:31:25.091828] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:21.580 [2024-11-29 02:31:25.091900] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:21.580 EAL: No free 2048 kB hugepages reported on node 1 00:26:21.580 [2024-11-29 02:31:25.166325] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:21.839 [2024-11-29 02:31:25.280688] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:21.839 [2024-11-29 02:31:25.280853] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:21.839 [2024-11-29 02:31:25.280872] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:21.839 [2024-11-29 02:31:25.280887] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:21.839 [2024-11-29 02:31:25.280928] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:22.776 02:31:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:22.776 02:31:26 -- common/autotest_common.sh@862 -- # return 0 00:26:22.776 02:31:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:22.776 02:31:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:22.776 02:31:26 -- common/autotest_common.sh@10 -- # set +x 00:26:22.776 02:31:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:22.776 02:31:26 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:26:22.776 02:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.776 02:31:26 -- common/autotest_common.sh@10 -- # set +x 00:26:22.776 [2024-11-29 02:31:26.126633] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:22.776 [2024-11-29 02:31:26.134821] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:22.776 null0 00:26:22.776 [2024-11-29 02:31:26.166791] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:22.776 02:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.776 02:31:26 -- host/discovery_remove_ifc.sh@59 -- # hostpid=224906 00:26:22.776 02:31:26 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:26:22.776 02:31:26 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 224906 /tmp/host.sock 00:26:22.776 02:31:26 -- common/autotest_common.sh@829 -- # '[' -z 224906 ']' 00:26:22.776 02:31:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:22.776 02:31:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:22.776 02:31:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:22.776 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:22.776 02:31:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:22.776 02:31:26 -- common/autotest_common.sh@10 -- # set +x 00:26:22.776 [2024-11-29 02:31:26.228224] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:22.776 [2024-11-29 02:31:26.228300] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid224906 ] 00:26:22.776 EAL: No free 2048 kB hugepages reported on node 1 00:26:22.776 [2024-11-29 02:31:26.292597] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:22.776 [2024-11-29 02:31:26.407011] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:22.776 [2024-11-29 02:31:26.407207] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:22.776 02:31:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:22.776 02:31:26 -- common/autotest_common.sh@862 -- # return 0 00:26:22.776 02:31:26 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:22.776 02:31:26 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:26:22.776 02:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.776 02:31:26 -- common/autotest_common.sh@10 -- # set +x 00:26:22.776 02:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.776 02:31:26 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:26:22.776 02:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.776 02:31:26 -- common/autotest_common.sh@10 -- # set +x 00:26:23.036 02:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.036 02:31:26 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:26:23.036 02:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.036 02:31:26 -- common/autotest_common.sh@10 -- # set +x 00:26:23.975 [2024-11-29 02:31:27.614587] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:23.975 [2024-11-29 02:31:27.614617] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:23.975 [2024-11-29 02:31:27.614641] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:24.233 [2024-11-29 02:31:27.700936] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:24.233 [2024-11-29 02:31:27.805536] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:24.233 [2024-11-29 02:31:27.805582] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:24.233 [2024-11-29 02:31:27.805618] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:24.233 [2024-11-29 02:31:27.805639] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:24.233 [2024-11-29 02:31:27.805665] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:24.233 02:31:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.233 02:31:27 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:26:24.233 02:31:27 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:24.233 02:31:27 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:24.233 02:31:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.233 02:31:27 -- common/autotest_common.sh@10 -- # set +x 00:26:24.233 02:31:27 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:24.233 02:31:27 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:24.233 02:31:27 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:24.233 [2024-11-29 02:31:27.812725] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xa93d40 was disconnected and freed. delete nvme_qpair. 00:26:24.233 02:31:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.233 02:31:27 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:26:24.233 02:31:27 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:26:24.233 02:31:27 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:26:24.233 02:31:27 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:26:24.233 02:31:27 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:24.233 02:31:27 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:24.233 02:31:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.233 02:31:27 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:24.233 02:31:27 -- common/autotest_common.sh@10 -- # set +x 00:26:24.233 02:31:27 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:24.233 02:31:27 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:24.233 02:31:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.490 02:31:27 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:24.490 02:31:27 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:25.426 02:31:28 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:25.426 02:31:28 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:25.426 02:31:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:25.426 02:31:28 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:25.426 02:31:28 -- common/autotest_common.sh@10 -- # set +x 00:26:25.426 02:31:28 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:25.426 02:31:28 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:25.427 02:31:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:25.427 02:31:28 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:25.427 02:31:28 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:26.361 02:31:29 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:26.361 02:31:29 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:26.361 02:31:29 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:26.361 02:31:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.361 02:31:29 -- common/autotest_common.sh@10 -- # set +x 00:26:26.361 02:31:29 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:26.361 02:31:29 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:26.361 02:31:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.361 02:31:30 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:26.361 02:31:30 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:27.742 02:31:31 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:27.742 02:31:31 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:27.742 02:31:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.742 02:31:31 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:27.742 02:31:31 -- common/autotest_common.sh@10 -- # set +x 00:26:27.742 02:31:31 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:27.742 02:31:31 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:27.742 02:31:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.742 02:31:31 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:27.742 02:31:31 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:28.678 02:31:32 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:28.678 02:31:32 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:28.678 02:31:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.678 02:31:32 -- common/autotest_common.sh@10 -- # set +x 00:26:28.678 02:31:32 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:28.678 02:31:32 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:28.678 02:31:32 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:28.678 02:31:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.678 02:31:32 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:28.678 02:31:32 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:29.619 02:31:33 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:29.619 02:31:33 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:29.619 02:31:33 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:29.619 02:31:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:29.619 02:31:33 -- common/autotest_common.sh@10 -- # set +x 00:26:29.619 02:31:33 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:29.619 02:31:33 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:29.619 02:31:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:29.619 02:31:33 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:29.619 02:31:33 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:29.619 [2024-11-29 02:31:33.246806] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:26:29.619 [2024-11-29 02:31:33.246878] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:29.619 [2024-11-29 02:31:33.246914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:29.619 [2024-11-29 02:31:33.246950] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:29.619 [2024-11-29 02:31:33.246976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:29.619 [2024-11-29 02:31:33.247002] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:29.619 [2024-11-29 02:31:33.247025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:29.619 [2024-11-29 02:31:33.247051] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:29.619 [2024-11-29 02:31:33.247076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:29.619 [2024-11-29 02:31:33.247102] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:29.619 [2024-11-29 02:31:33.247126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:29.619 [2024-11-29 02:31:33.247151] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa5a430 is same with the state(5) to be set 00:26:29.619 [2024-11-29 02:31:33.256825] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa5a430 (9): Bad file descriptor 00:26:29.619 [2024-11-29 02:31:33.266872] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:30.553 02:31:34 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:30.553 02:31:34 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:30.553 02:31:34 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:30.553 02:31:34 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:30.553 02:31:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:30.553 02:31:34 -- common/autotest_common.sh@10 -- # set +x 00:26:30.553 02:31:34 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:30.812 [2024-11-29 02:31:34.314423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:31.749 [2024-11-29 02:31:35.338433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:31.749 [2024-11-29 02:31:35.338497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa5a430 with addr=10.0.0.2, port=4420 00:26:31.749 [2024-11-29 02:31:35.338528] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa5a430 is same with the state(5) to be set 00:26:31.749 [2024-11-29 02:31:35.338569] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:31.749 [2024-11-29 02:31:35.338596] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:31.749 [2024-11-29 02:31:35.338618] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:31.749 [2024-11-29 02:31:35.338642] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:26:31.749 [2024-11-29 02:31:35.339136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa5a430 (9): Bad file descriptor 00:26:31.749 [2024-11-29 02:31:35.339189] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:31.749 [2024-11-29 02:31:35.339243] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:26:31.749 [2024-11-29 02:31:35.339294] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:31.749 [2024-11-29 02:31:35.339326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:31.749 [2024-11-29 02:31:35.339358] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:31.749 [2024-11-29 02:31:35.339391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:31.749 [2024-11-29 02:31:35.339439] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:31.749 [2024-11-29 02:31:35.339478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:31.749 [2024-11-29 02:31:35.339503] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:31.749 [2024-11-29 02:31:35.339526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:31.749 [2024-11-29 02:31:35.339552] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:31.749 [2024-11-29 02:31:35.339573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:31.749 [2024-11-29 02:31:35.339596] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:26:31.749 [2024-11-29 02:31:35.339655] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa5a840 (9): Bad file descriptor 00:26:31.749 [2024-11-29 02:31:35.340653] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:26:31.749 [2024-11-29 02:31:35.340693] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:26:31.749 02:31:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:31.749 02:31:35 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:31.749 02:31:35 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:32.685 02:31:36 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:32.685 02:31:36 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:32.686 02:31:36 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:32.686 02:31:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:32.686 02:31:36 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:32.686 02:31:36 -- common/autotest_common.sh@10 -- # set +x 00:26:32.686 02:31:36 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:32.946 02:31:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:32.946 02:31:36 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:26:32.946 02:31:36 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:32.946 02:31:36 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:32.946 02:31:36 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:26:32.946 02:31:36 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:32.946 02:31:36 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:32.946 02:31:36 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:32.946 02:31:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:32.946 02:31:36 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:32.946 02:31:36 -- common/autotest_common.sh@10 -- # set +x 00:26:32.946 02:31:36 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:32.946 02:31:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:32.946 02:31:36 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:32.946 02:31:36 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:33.881 [2024-11-29 02:31:37.390122] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:33.881 [2024-11-29 02:31:37.390146] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:33.881 [2024-11-29 02:31:37.390171] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:33.881 02:31:37 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:33.881 02:31:37 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:33.881 02:31:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:33.881 02:31:37 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:33.881 02:31:37 -- common/autotest_common.sh@10 -- # set +x 00:26:33.881 02:31:37 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:33.881 02:31:37 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:33.881 02:31:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:33.881 [2024-11-29 02:31:37.517605] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:26:33.881 02:31:37 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:33.881 02:31:37 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:34.141 [2024-11-29 02:31:37.620495] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:34.141 [2024-11-29 02:31:37.620541] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:34.141 [2024-11-29 02:31:37.620573] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:34.141 [2024-11-29 02:31:37.620593] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:26:34.141 [2024-11-29 02:31:37.620605] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:34.141 [2024-11-29 02:31:37.628716] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xa68ef0 was disconnected and freed. delete nvme_qpair. 00:26:35.081 02:31:38 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:35.081 02:31:38 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:35.081 02:31:38 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:35.081 02:31:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:35.081 02:31:38 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:35.081 02:31:38 -- common/autotest_common.sh@10 -- # set +x 00:26:35.081 02:31:38 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:35.081 02:31:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:35.081 02:31:38 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:26:35.081 02:31:38 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:26:35.081 02:31:38 -- host/discovery_remove_ifc.sh@90 -- # killprocess 224906 00:26:35.081 02:31:38 -- common/autotest_common.sh@936 -- # '[' -z 224906 ']' 00:26:35.081 02:31:38 -- common/autotest_common.sh@940 -- # kill -0 224906 00:26:35.081 02:31:38 -- common/autotest_common.sh@941 -- # uname 00:26:35.081 02:31:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:35.081 02:31:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 224906 00:26:35.081 02:31:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:35.081 02:31:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:35.081 02:31:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 224906' 00:26:35.081 killing process with pid 224906 00:26:35.081 02:31:38 -- common/autotest_common.sh@955 -- # kill 224906 00:26:35.081 02:31:38 -- common/autotest_common.sh@960 -- # wait 224906 00:26:35.340 02:31:38 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:26:35.340 02:31:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:35.340 02:31:38 -- nvmf/common.sh@116 -- # sync 00:26:35.340 02:31:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:35.340 02:31:38 -- nvmf/common.sh@119 -- # set +e 00:26:35.340 02:31:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:35.340 02:31:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:35.340 rmmod nvme_tcp 00:26:35.340 rmmod nvme_fabrics 00:26:35.340 rmmod nvme_keyring 00:26:35.340 02:31:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:35.340 02:31:38 -- nvmf/common.sh@123 -- # set -e 00:26:35.340 02:31:38 -- nvmf/common.sh@124 -- # return 0 00:26:35.340 02:31:38 -- nvmf/common.sh@477 -- # '[' -n 224732 ']' 00:26:35.340 02:31:38 -- nvmf/common.sh@478 -- # killprocess 224732 00:26:35.340 02:31:38 -- common/autotest_common.sh@936 -- # '[' -z 224732 ']' 00:26:35.340 02:31:38 -- common/autotest_common.sh@940 -- # kill -0 224732 00:26:35.340 02:31:38 -- common/autotest_common.sh@941 -- # uname 00:26:35.340 02:31:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:35.340 02:31:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 224732 00:26:35.340 02:31:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:35.340 02:31:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:35.340 02:31:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 224732' 00:26:35.340 killing process with pid 224732 00:26:35.340 02:31:38 -- common/autotest_common.sh@955 -- # kill 224732 00:26:35.340 02:31:38 -- common/autotest_common.sh@960 -- # wait 224732 00:26:35.599 02:31:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:35.599 02:31:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:35.599 02:31:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:35.599 02:31:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:35.599 02:31:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:35.599 02:31:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:35.599 02:31:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:35.599 02:31:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:38.135 02:31:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:38.135 00:26:38.135 real 0m18.499s 00:26:38.135 user 0m25.763s 00:26:38.135 sys 0m2.885s 00:26:38.135 02:31:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:38.135 02:31:41 -- common/autotest_common.sh@10 -- # set +x 00:26:38.135 ************************************ 00:26:38.135 END TEST nvmf_discovery_remove_ifc 00:26:38.135 ************************************ 00:26:38.135 02:31:41 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:26:38.135 02:31:41 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:38.135 02:31:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:38.135 02:31:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:38.135 02:31:41 -- common/autotest_common.sh@10 -- # set +x 00:26:38.135 ************************************ 00:26:38.135 START TEST nvmf_digest 00:26:38.135 ************************************ 00:26:38.135 02:31:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:38.135 * Looking for test storage... 00:26:38.135 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:38.135 02:31:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:38.135 02:31:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:38.135 02:31:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:38.135 02:31:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:38.135 02:31:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:38.135 02:31:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:38.135 02:31:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:38.135 02:31:41 -- scripts/common.sh@335 -- # IFS=.-: 00:26:38.135 02:31:41 -- scripts/common.sh@335 -- # read -ra ver1 00:26:38.135 02:31:41 -- scripts/common.sh@336 -- # IFS=.-: 00:26:38.135 02:31:41 -- scripts/common.sh@336 -- # read -ra ver2 00:26:38.135 02:31:41 -- scripts/common.sh@337 -- # local 'op=<' 00:26:38.135 02:31:41 -- scripts/common.sh@339 -- # ver1_l=2 00:26:38.135 02:31:41 -- scripts/common.sh@340 -- # ver2_l=1 00:26:38.135 02:31:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:38.135 02:31:41 -- scripts/common.sh@343 -- # case "$op" in 00:26:38.135 02:31:41 -- scripts/common.sh@344 -- # : 1 00:26:38.135 02:31:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:38.135 02:31:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:38.135 02:31:41 -- scripts/common.sh@364 -- # decimal 1 00:26:38.135 02:31:41 -- scripts/common.sh@352 -- # local d=1 00:26:38.135 02:31:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:38.135 02:31:41 -- scripts/common.sh@354 -- # echo 1 00:26:38.135 02:31:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:38.135 02:31:41 -- scripts/common.sh@365 -- # decimal 2 00:26:38.135 02:31:41 -- scripts/common.sh@352 -- # local d=2 00:26:38.135 02:31:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:38.135 02:31:41 -- scripts/common.sh@354 -- # echo 2 00:26:38.135 02:31:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:38.135 02:31:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:38.135 02:31:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:38.135 02:31:41 -- scripts/common.sh@367 -- # return 0 00:26:38.135 02:31:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:38.135 02:31:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:38.135 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:38.135 --rc genhtml_branch_coverage=1 00:26:38.135 --rc genhtml_function_coverage=1 00:26:38.135 --rc genhtml_legend=1 00:26:38.135 --rc geninfo_all_blocks=1 00:26:38.135 --rc geninfo_unexecuted_blocks=1 00:26:38.135 00:26:38.135 ' 00:26:38.135 02:31:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:38.135 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:38.135 --rc genhtml_branch_coverage=1 00:26:38.135 --rc genhtml_function_coverage=1 00:26:38.135 --rc genhtml_legend=1 00:26:38.135 --rc geninfo_all_blocks=1 00:26:38.135 --rc geninfo_unexecuted_blocks=1 00:26:38.135 00:26:38.135 ' 00:26:38.135 02:31:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:38.135 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:38.135 --rc genhtml_branch_coverage=1 00:26:38.135 --rc genhtml_function_coverage=1 00:26:38.135 --rc genhtml_legend=1 00:26:38.135 --rc geninfo_all_blocks=1 00:26:38.135 --rc geninfo_unexecuted_blocks=1 00:26:38.135 00:26:38.135 ' 00:26:38.135 02:31:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:38.135 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:38.135 --rc genhtml_branch_coverage=1 00:26:38.135 --rc genhtml_function_coverage=1 00:26:38.135 --rc genhtml_legend=1 00:26:38.135 --rc geninfo_all_blocks=1 00:26:38.135 --rc geninfo_unexecuted_blocks=1 00:26:38.135 00:26:38.135 ' 00:26:38.135 02:31:41 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:38.135 02:31:41 -- nvmf/common.sh@7 -- # uname -s 00:26:38.135 02:31:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:38.135 02:31:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:38.135 02:31:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:38.135 02:31:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:38.135 02:31:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:38.135 02:31:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:38.135 02:31:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:38.135 02:31:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:38.135 02:31:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:38.135 02:31:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:38.135 02:31:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:38.135 02:31:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:38.135 02:31:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:38.135 02:31:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:38.135 02:31:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:38.135 02:31:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:38.135 02:31:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:38.135 02:31:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:38.135 02:31:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:38.136 02:31:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:38.136 02:31:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:38.136 02:31:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:38.136 02:31:41 -- paths/export.sh@5 -- # export PATH 00:26:38.136 02:31:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:38.136 02:31:41 -- nvmf/common.sh@46 -- # : 0 00:26:38.136 02:31:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:38.136 02:31:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:38.136 02:31:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:38.136 02:31:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:38.136 02:31:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:38.136 02:31:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:38.136 02:31:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:38.136 02:31:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:38.136 02:31:41 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:26:38.136 02:31:41 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:26:38.136 02:31:41 -- host/digest.sh@16 -- # runtime=2 00:26:38.136 02:31:41 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:26:38.136 02:31:41 -- host/digest.sh@132 -- # nvmftestinit 00:26:38.136 02:31:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:38.136 02:31:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:38.136 02:31:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:38.136 02:31:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:38.136 02:31:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:38.136 02:31:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:38.136 02:31:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:38.136 02:31:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:38.136 02:31:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:38.136 02:31:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:38.136 02:31:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:38.136 02:31:41 -- common/autotest_common.sh@10 -- # set +x 00:26:40.039 02:31:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:40.039 02:31:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:40.039 02:31:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:40.039 02:31:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:40.039 02:31:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:40.039 02:31:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:40.039 02:31:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:40.039 02:31:43 -- nvmf/common.sh@294 -- # net_devs=() 00:26:40.039 02:31:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:40.039 02:31:43 -- nvmf/common.sh@295 -- # e810=() 00:26:40.039 02:31:43 -- nvmf/common.sh@295 -- # local -ga e810 00:26:40.039 02:31:43 -- nvmf/common.sh@296 -- # x722=() 00:26:40.039 02:31:43 -- nvmf/common.sh@296 -- # local -ga x722 00:26:40.039 02:31:43 -- nvmf/common.sh@297 -- # mlx=() 00:26:40.039 02:31:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:40.039 02:31:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:40.039 02:31:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:40.039 02:31:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:40.039 02:31:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:40.040 02:31:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:40.040 02:31:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:40.040 02:31:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:40.040 02:31:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:40.040 02:31:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:40.040 02:31:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:40.040 02:31:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:40.040 02:31:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:40.040 02:31:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:40.040 02:31:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:40.040 02:31:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:40.040 02:31:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:40.040 02:31:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:40.040 02:31:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:40.040 02:31:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:40.040 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:40.040 02:31:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:40.040 02:31:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:40.040 02:31:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:40.040 02:31:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:40.040 02:31:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:40.040 02:31:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:40.040 02:31:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:40.040 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:40.040 02:31:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:40.040 02:31:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:40.040 02:31:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:40.040 02:31:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:40.040 02:31:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:40.040 02:31:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:40.040 02:31:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:40.040 02:31:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:40.040 02:31:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:40.040 02:31:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:40.040 02:31:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:40.040 02:31:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:40.040 02:31:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:40.040 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:40.040 02:31:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:40.040 02:31:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:40.040 02:31:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:40.040 02:31:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:40.040 02:31:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:40.040 02:31:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:40.040 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:40.040 02:31:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:40.040 02:31:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:40.040 02:31:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:40.040 02:31:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:40.040 02:31:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:40.040 02:31:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:40.040 02:31:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:40.040 02:31:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:40.040 02:31:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:40.040 02:31:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:40.040 02:31:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:40.040 02:31:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:40.040 02:31:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:40.040 02:31:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:40.040 02:31:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:40.040 02:31:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:40.040 02:31:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:40.040 02:31:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:40.040 02:31:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:40.040 02:31:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:40.040 02:31:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:40.040 02:31:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:40.040 02:31:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:40.040 02:31:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:40.040 02:31:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:40.040 02:31:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:40.040 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:40.040 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.274 ms 00:26:40.040 00:26:40.040 --- 10.0.0.2 ping statistics --- 00:26:40.040 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:40.040 rtt min/avg/max/mdev = 0.274/0.274/0.274/0.000 ms 00:26:40.040 02:31:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:40.040 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:40.040 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:26:40.040 00:26:40.040 --- 10.0.0.1 ping statistics --- 00:26:40.040 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:40.040 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:26:40.040 02:31:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:40.040 02:31:43 -- nvmf/common.sh@410 -- # return 0 00:26:40.040 02:31:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:40.040 02:31:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:40.040 02:31:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:40.040 02:31:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:40.040 02:31:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:40.040 02:31:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:40.040 02:31:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:40.040 02:31:43 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:26:40.040 02:31:43 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:26:40.040 02:31:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:40.040 02:31:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:40.040 02:31:43 -- common/autotest_common.sh@10 -- # set +x 00:26:40.040 ************************************ 00:26:40.040 START TEST nvmf_digest_clean 00:26:40.040 ************************************ 00:26:40.040 02:31:43 -- common/autotest_common.sh@1114 -- # run_digest 00:26:40.040 02:31:43 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:26:40.040 02:31:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:40.040 02:31:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:40.040 02:31:43 -- common/autotest_common.sh@10 -- # set +x 00:26:40.040 02:31:43 -- nvmf/common.sh@469 -- # nvmfpid=228510 00:26:40.040 02:31:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:40.040 02:31:43 -- nvmf/common.sh@470 -- # waitforlisten 228510 00:26:40.040 02:31:43 -- common/autotest_common.sh@829 -- # '[' -z 228510 ']' 00:26:40.040 02:31:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:40.040 02:31:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:40.040 02:31:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:40.040 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:40.040 02:31:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:40.040 02:31:43 -- common/autotest_common.sh@10 -- # set +x 00:26:40.040 [2024-11-29 02:31:43.631280] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:40.040 [2024-11-29 02:31:43.631360] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:40.040 EAL: No free 2048 kB hugepages reported on node 1 00:26:40.040 [2024-11-29 02:31:43.699255] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:40.300 [2024-11-29 02:31:43.813794] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:40.300 [2024-11-29 02:31:43.813951] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:40.300 [2024-11-29 02:31:43.813984] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:40.300 [2024-11-29 02:31:43.813996] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:40.300 [2024-11-29 02:31:43.814025] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:40.300 02:31:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:40.300 02:31:43 -- common/autotest_common.sh@862 -- # return 0 00:26:40.300 02:31:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:40.300 02:31:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:40.300 02:31:43 -- common/autotest_common.sh@10 -- # set +x 00:26:40.300 02:31:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:40.300 02:31:43 -- host/digest.sh@120 -- # common_target_config 00:26:40.300 02:31:43 -- host/digest.sh@43 -- # rpc_cmd 00:26:40.300 02:31:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:40.300 02:31:43 -- common/autotest_common.sh@10 -- # set +x 00:26:40.559 null0 00:26:40.559 [2024-11-29 02:31:43.984862] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:40.559 [2024-11-29 02:31:44.009098] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:40.559 02:31:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:40.559 02:31:44 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:26:40.559 02:31:44 -- host/digest.sh@77 -- # local rw bs qd 00:26:40.559 02:31:44 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:40.559 02:31:44 -- host/digest.sh@80 -- # rw=randread 00:26:40.559 02:31:44 -- host/digest.sh@80 -- # bs=4096 00:26:40.559 02:31:44 -- host/digest.sh@80 -- # qd=128 00:26:40.559 02:31:44 -- host/digest.sh@82 -- # bperfpid=228535 00:26:40.559 02:31:44 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:40.559 02:31:44 -- host/digest.sh@83 -- # waitforlisten 228535 /var/tmp/bperf.sock 00:26:40.559 02:31:44 -- common/autotest_common.sh@829 -- # '[' -z 228535 ']' 00:26:40.559 02:31:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:40.559 02:31:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:40.559 02:31:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:40.559 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:40.559 02:31:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:40.559 02:31:44 -- common/autotest_common.sh@10 -- # set +x 00:26:40.559 [2024-11-29 02:31:44.052546] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:40.559 [2024-11-29 02:31:44.052623] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid228535 ] 00:26:40.559 EAL: No free 2048 kB hugepages reported on node 1 00:26:40.559 [2024-11-29 02:31:44.113404] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:40.559 [2024-11-29 02:31:44.231381] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:40.817 02:31:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:40.817 02:31:44 -- common/autotest_common.sh@862 -- # return 0 00:26:40.817 02:31:44 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:40.817 02:31:44 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:40.817 02:31:44 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:41.076 02:31:44 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:41.076 02:31:44 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:41.645 nvme0n1 00:26:41.645 02:31:45 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:41.645 02:31:45 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:41.645 Running I/O for 2 seconds... 00:26:43.550 00:26:43.550 Latency(us) 00:26:43.550 [2024-11-29T01:31:47.231Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:43.550 [2024-11-29T01:31:47.231Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:43.550 nvme0n1 : 2.01 15724.73 61.42 0.00 0.00 8131.93 3713.71 17282.09 00:26:43.550 [2024-11-29T01:31:47.231Z] =================================================================================================================== 00:26:43.550 [2024-11-29T01:31:47.231Z] Total : 15724.73 61.42 0.00 0.00 8131.93 3713.71 17282.09 00:26:43.550 0 00:26:43.550 02:31:47 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:43.550 02:31:47 -- host/digest.sh@92 -- # get_accel_stats 00:26:43.550 02:31:47 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:43.550 02:31:47 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:43.550 | select(.opcode=="crc32c") 00:26:43.550 | "\(.module_name) \(.executed)"' 00:26:43.550 02:31:47 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:43.809 02:31:47 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:43.809 02:31:47 -- host/digest.sh@93 -- # exp_module=software 00:26:43.809 02:31:47 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:43.809 02:31:47 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:43.809 02:31:47 -- host/digest.sh@97 -- # killprocess 228535 00:26:43.809 02:31:47 -- common/autotest_common.sh@936 -- # '[' -z 228535 ']' 00:26:43.809 02:31:47 -- common/autotest_common.sh@940 -- # kill -0 228535 00:26:43.809 02:31:47 -- common/autotest_common.sh@941 -- # uname 00:26:43.809 02:31:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:43.809 02:31:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 228535 00:26:44.069 02:31:47 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:44.069 02:31:47 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:44.069 02:31:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 228535' 00:26:44.069 killing process with pid 228535 00:26:44.069 02:31:47 -- common/autotest_common.sh@955 -- # kill 228535 00:26:44.069 Received shutdown signal, test time was about 2.000000 seconds 00:26:44.069 00:26:44.069 Latency(us) 00:26:44.069 [2024-11-29T01:31:47.750Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:44.069 [2024-11-29T01:31:47.750Z] =================================================================================================================== 00:26:44.069 [2024-11-29T01:31:47.750Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:44.069 02:31:47 -- common/autotest_common.sh@960 -- # wait 228535 00:26:44.328 02:31:47 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:26:44.328 02:31:47 -- host/digest.sh@77 -- # local rw bs qd 00:26:44.328 02:31:47 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:44.328 02:31:47 -- host/digest.sh@80 -- # rw=randread 00:26:44.328 02:31:47 -- host/digest.sh@80 -- # bs=131072 00:26:44.328 02:31:47 -- host/digest.sh@80 -- # qd=16 00:26:44.328 02:31:47 -- host/digest.sh@82 -- # bperfpid=228957 00:26:44.328 02:31:47 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:44.328 02:31:47 -- host/digest.sh@83 -- # waitforlisten 228957 /var/tmp/bperf.sock 00:26:44.328 02:31:47 -- common/autotest_common.sh@829 -- # '[' -z 228957 ']' 00:26:44.328 02:31:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:44.328 02:31:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:44.328 02:31:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:44.328 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:44.328 02:31:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:44.328 02:31:47 -- common/autotest_common.sh@10 -- # set +x 00:26:44.328 [2024-11-29 02:31:47.810901] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:44.328 [2024-11-29 02:31:47.810985] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid228957 ] 00:26:44.328 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:44.328 Zero copy mechanism will not be used. 00:26:44.328 EAL: No free 2048 kB hugepages reported on node 1 00:26:44.328 [2024-11-29 02:31:47.875855] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:44.328 [2024-11-29 02:31:47.990025] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:44.587 02:31:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:44.587 02:31:48 -- common/autotest_common.sh@862 -- # return 0 00:26:44.587 02:31:48 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:44.587 02:31:48 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:44.587 02:31:48 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:44.846 02:31:48 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:44.846 02:31:48 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:45.416 nvme0n1 00:26:45.416 02:31:48 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:45.416 02:31:48 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:45.416 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:45.416 Zero copy mechanism will not be used. 00:26:45.416 Running I/O for 2 seconds... 00:26:47.324 00:26:47.324 Latency(us) 00:26:47.324 [2024-11-29T01:31:51.005Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:47.324 [2024-11-29T01:31:51.005Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:26:47.324 nvme0n1 : 2.00 6210.83 776.35 0.00 0.00 2572.00 1001.24 5873.97 00:26:47.324 [2024-11-29T01:31:51.005Z] =================================================================================================================== 00:26:47.324 [2024-11-29T01:31:51.005Z] Total : 6210.83 776.35 0.00 0.00 2572.00 1001.24 5873.97 00:26:47.324 0 00:26:47.324 02:31:50 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:47.324 02:31:50 -- host/digest.sh@92 -- # get_accel_stats 00:26:47.324 02:31:50 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:47.324 02:31:50 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:47.324 | select(.opcode=="crc32c") 00:26:47.324 | "\(.module_name) \(.executed)"' 00:26:47.324 02:31:50 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:47.585 02:31:51 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:47.585 02:31:51 -- host/digest.sh@93 -- # exp_module=software 00:26:47.585 02:31:51 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:47.585 02:31:51 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:47.585 02:31:51 -- host/digest.sh@97 -- # killprocess 228957 00:26:47.585 02:31:51 -- common/autotest_common.sh@936 -- # '[' -z 228957 ']' 00:26:47.585 02:31:51 -- common/autotest_common.sh@940 -- # kill -0 228957 00:26:47.585 02:31:51 -- common/autotest_common.sh@941 -- # uname 00:26:47.585 02:31:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:47.585 02:31:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 228957 00:26:47.857 02:31:51 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:47.857 02:31:51 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:47.857 02:31:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 228957' 00:26:47.857 killing process with pid 228957 00:26:47.857 02:31:51 -- common/autotest_common.sh@955 -- # kill 228957 00:26:47.857 Received shutdown signal, test time was about 2.000000 seconds 00:26:47.857 00:26:47.857 Latency(us) 00:26:47.857 [2024-11-29T01:31:51.538Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:47.857 [2024-11-29T01:31:51.538Z] =================================================================================================================== 00:26:47.857 [2024-11-29T01:31:51.538Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:47.857 02:31:51 -- common/autotest_common.sh@960 -- # wait 228957 00:26:48.158 02:31:51 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:26:48.158 02:31:51 -- host/digest.sh@77 -- # local rw bs qd 00:26:48.158 02:31:51 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:48.158 02:31:51 -- host/digest.sh@80 -- # rw=randwrite 00:26:48.158 02:31:51 -- host/digest.sh@80 -- # bs=4096 00:26:48.158 02:31:51 -- host/digest.sh@80 -- # qd=128 00:26:48.158 02:31:51 -- host/digest.sh@82 -- # bperfpid=229500 00:26:48.158 02:31:51 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:48.158 02:31:51 -- host/digest.sh@83 -- # waitforlisten 229500 /var/tmp/bperf.sock 00:26:48.158 02:31:51 -- common/autotest_common.sh@829 -- # '[' -z 229500 ']' 00:26:48.158 02:31:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:48.158 02:31:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:48.158 02:31:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:48.158 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:48.158 02:31:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:48.158 02:31:51 -- common/autotest_common.sh@10 -- # set +x 00:26:48.158 [2024-11-29 02:31:51.598116] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:48.158 [2024-11-29 02:31:51.598186] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid229500 ] 00:26:48.159 EAL: No free 2048 kB hugepages reported on node 1 00:26:48.159 [2024-11-29 02:31:51.658495] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:48.159 [2024-11-29 02:31:51.773726] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:48.419 02:31:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:48.419 02:31:51 -- common/autotest_common.sh@862 -- # return 0 00:26:48.419 02:31:51 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:48.419 02:31:51 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:48.419 02:31:51 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:48.681 02:31:52 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:48.681 02:31:52 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:49.248 nvme0n1 00:26:49.248 02:31:52 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:49.248 02:31:52 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:49.248 Running I/O for 2 seconds... 00:26:51.786 00:26:51.786 Latency(us) 00:26:51.786 [2024-11-29T01:31:55.467Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:51.786 [2024-11-29T01:31:55.467Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:26:51.786 nvme0n1 : 2.01 19521.24 76.25 0.00 0.00 6542.82 3021.94 18835.53 00:26:51.786 [2024-11-29T01:31:55.467Z] =================================================================================================================== 00:26:51.786 [2024-11-29T01:31:55.467Z] Total : 19521.24 76.25 0.00 0.00 6542.82 3021.94 18835.53 00:26:51.786 0 00:26:51.786 02:31:54 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:51.786 02:31:54 -- host/digest.sh@92 -- # get_accel_stats 00:26:51.786 02:31:54 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:51.786 02:31:54 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:51.786 | select(.opcode=="crc32c") 00:26:51.786 | "\(.module_name) \(.executed)"' 00:26:51.786 02:31:54 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:51.786 02:31:55 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:51.786 02:31:55 -- host/digest.sh@93 -- # exp_module=software 00:26:51.786 02:31:55 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:51.786 02:31:55 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:51.786 02:31:55 -- host/digest.sh@97 -- # killprocess 229500 00:26:51.786 02:31:55 -- common/autotest_common.sh@936 -- # '[' -z 229500 ']' 00:26:51.786 02:31:55 -- common/autotest_common.sh@940 -- # kill -0 229500 00:26:51.786 02:31:55 -- common/autotest_common.sh@941 -- # uname 00:26:51.786 02:31:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:51.786 02:31:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 229500 00:26:51.786 02:31:55 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:51.786 02:31:55 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:51.786 02:31:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 229500' 00:26:51.786 killing process with pid 229500 00:26:51.786 02:31:55 -- common/autotest_common.sh@955 -- # kill 229500 00:26:51.786 Received shutdown signal, test time was about 2.000000 seconds 00:26:51.786 00:26:51.786 Latency(us) 00:26:51.786 [2024-11-29T01:31:55.467Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:51.786 [2024-11-29T01:31:55.467Z] =================================================================================================================== 00:26:51.786 [2024-11-29T01:31:55.467Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:51.786 02:31:55 -- common/autotest_common.sh@960 -- # wait 229500 00:26:51.786 02:31:55 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:26:51.786 02:31:55 -- host/digest.sh@77 -- # local rw bs qd 00:26:51.786 02:31:55 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:51.786 02:31:55 -- host/digest.sh@80 -- # rw=randwrite 00:26:51.786 02:31:55 -- host/digest.sh@80 -- # bs=131072 00:26:51.786 02:31:55 -- host/digest.sh@80 -- # qd=16 00:26:51.786 02:31:55 -- host/digest.sh@82 -- # bperfpid=229926 00:26:51.786 02:31:55 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:51.786 02:31:55 -- host/digest.sh@83 -- # waitforlisten 229926 /var/tmp/bperf.sock 00:26:51.786 02:31:55 -- common/autotest_common.sh@829 -- # '[' -z 229926 ']' 00:26:51.786 02:31:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:51.786 02:31:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:51.786 02:31:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:51.786 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:51.786 02:31:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:51.786 02:31:55 -- common/autotest_common.sh@10 -- # set +x 00:26:52.044 [2024-11-29 02:31:55.474580] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:52.044 [2024-11-29 02:31:55.474657] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid229926 ] 00:26:52.044 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:52.044 Zero copy mechanism will not be used. 00:26:52.044 EAL: No free 2048 kB hugepages reported on node 1 00:26:52.044 [2024-11-29 02:31:55.537423] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:52.044 [2024-11-29 02:31:55.649387] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:52.044 02:31:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:52.044 02:31:55 -- common/autotest_common.sh@862 -- # return 0 00:26:52.045 02:31:55 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:52.045 02:31:55 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:52.045 02:31:55 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:52.610 02:31:56 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:52.610 02:31:56 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:52.868 nvme0n1 00:26:52.868 02:31:56 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:52.868 02:31:56 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:53.128 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:53.128 Zero copy mechanism will not be used. 00:26:53.128 Running I/O for 2 seconds... 00:26:55.034 00:26:55.034 Latency(us) 00:26:55.034 [2024-11-29T01:31:58.715Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:55.034 [2024-11-29T01:31:58.715Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:26:55.034 nvme0n1 : 2.00 6759.51 844.94 0.00 0.00 2360.23 1808.31 12621.75 00:26:55.034 [2024-11-29T01:31:58.715Z] =================================================================================================================== 00:26:55.034 [2024-11-29T01:31:58.715Z] Total : 6759.51 844.94 0.00 0.00 2360.23 1808.31 12621.75 00:26:55.034 0 00:26:55.034 02:31:58 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:55.034 02:31:58 -- host/digest.sh@92 -- # get_accel_stats 00:26:55.034 02:31:58 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:55.034 02:31:58 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:55.034 | select(.opcode=="crc32c") 00:26:55.034 | "\(.module_name) \(.executed)"' 00:26:55.034 02:31:58 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:55.293 02:31:58 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:55.293 02:31:58 -- host/digest.sh@93 -- # exp_module=software 00:26:55.293 02:31:58 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:55.293 02:31:58 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:55.293 02:31:58 -- host/digest.sh@97 -- # killprocess 229926 00:26:55.293 02:31:58 -- common/autotest_common.sh@936 -- # '[' -z 229926 ']' 00:26:55.293 02:31:58 -- common/autotest_common.sh@940 -- # kill -0 229926 00:26:55.293 02:31:58 -- common/autotest_common.sh@941 -- # uname 00:26:55.293 02:31:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:55.293 02:31:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 229926 00:26:55.293 02:31:58 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:55.293 02:31:58 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:55.293 02:31:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 229926' 00:26:55.293 killing process with pid 229926 00:26:55.293 02:31:58 -- common/autotest_common.sh@955 -- # kill 229926 00:26:55.293 Received shutdown signal, test time was about 2.000000 seconds 00:26:55.293 00:26:55.293 Latency(us) 00:26:55.293 [2024-11-29T01:31:58.974Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:55.293 [2024-11-29T01:31:58.974Z] =================================================================================================================== 00:26:55.293 [2024-11-29T01:31:58.974Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:55.293 02:31:58 -- common/autotest_common.sh@960 -- # wait 229926 00:26:55.551 02:31:59 -- host/digest.sh@126 -- # killprocess 228510 00:26:55.551 02:31:59 -- common/autotest_common.sh@936 -- # '[' -z 228510 ']' 00:26:55.551 02:31:59 -- common/autotest_common.sh@940 -- # kill -0 228510 00:26:55.551 02:31:59 -- common/autotest_common.sh@941 -- # uname 00:26:55.551 02:31:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:55.551 02:31:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 228510 00:26:55.810 02:31:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:55.810 02:31:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:55.810 02:31:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 228510' 00:26:55.810 killing process with pid 228510 00:26:55.810 02:31:59 -- common/autotest_common.sh@955 -- # kill 228510 00:26:55.810 02:31:59 -- common/autotest_common.sh@960 -- # wait 228510 00:26:56.068 00:26:56.068 real 0m15.929s 00:26:56.068 user 0m31.596s 00:26:56.068 sys 0m4.393s 00:26:56.068 02:31:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:56.068 02:31:59 -- common/autotest_common.sh@10 -- # set +x 00:26:56.068 ************************************ 00:26:56.068 END TEST nvmf_digest_clean 00:26:56.068 ************************************ 00:26:56.068 02:31:59 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:26:56.068 02:31:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:56.068 02:31:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:56.068 02:31:59 -- common/autotest_common.sh@10 -- # set +x 00:26:56.068 ************************************ 00:26:56.068 START TEST nvmf_digest_error 00:26:56.068 ************************************ 00:26:56.068 02:31:59 -- common/autotest_common.sh@1114 -- # run_digest_error 00:26:56.068 02:31:59 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:26:56.068 02:31:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:56.068 02:31:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:56.068 02:31:59 -- common/autotest_common.sh@10 -- # set +x 00:26:56.068 02:31:59 -- nvmf/common.sh@469 -- # nvmfpid=230500 00:26:56.068 02:31:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:56.068 02:31:59 -- nvmf/common.sh@470 -- # waitforlisten 230500 00:26:56.068 02:31:59 -- common/autotest_common.sh@829 -- # '[' -z 230500 ']' 00:26:56.068 02:31:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:56.068 02:31:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:56.068 02:31:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:56.068 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:56.068 02:31:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:56.068 02:31:59 -- common/autotest_common.sh@10 -- # set +x 00:26:56.068 [2024-11-29 02:31:59.584307] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:56.068 [2024-11-29 02:31:59.584404] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:56.068 EAL: No free 2048 kB hugepages reported on node 1 00:26:56.068 [2024-11-29 02:31:59.648355] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:56.327 [2024-11-29 02:31:59.753322] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:56.327 [2024-11-29 02:31:59.753513] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:56.327 [2024-11-29 02:31:59.753539] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:56.327 [2024-11-29 02:31:59.753558] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:56.327 [2024-11-29 02:31:59.753602] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:56.327 02:31:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:56.327 02:31:59 -- common/autotest_common.sh@862 -- # return 0 00:26:56.327 02:31:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:56.327 02:31:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:56.327 02:31:59 -- common/autotest_common.sh@10 -- # set +x 00:26:56.327 02:31:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:56.327 02:31:59 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:26:56.327 02:31:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:56.327 02:31:59 -- common/autotest_common.sh@10 -- # set +x 00:26:56.327 [2024-11-29 02:31:59.822217] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:26:56.327 02:31:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:56.327 02:31:59 -- host/digest.sh@104 -- # common_target_config 00:26:56.327 02:31:59 -- host/digest.sh@43 -- # rpc_cmd 00:26:56.327 02:31:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:56.327 02:31:59 -- common/autotest_common.sh@10 -- # set +x 00:26:56.327 null0 00:26:56.327 [2024-11-29 02:31:59.937138] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:56.327 [2024-11-29 02:31:59.961363] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:56.327 02:31:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:56.327 02:31:59 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:26:56.327 02:31:59 -- host/digest.sh@54 -- # local rw bs qd 00:26:56.327 02:31:59 -- host/digest.sh@56 -- # rw=randread 00:26:56.327 02:31:59 -- host/digest.sh@56 -- # bs=4096 00:26:56.327 02:31:59 -- host/digest.sh@56 -- # qd=128 00:26:56.327 02:31:59 -- host/digest.sh@58 -- # bperfpid=230524 00:26:56.327 02:31:59 -- host/digest.sh@60 -- # waitforlisten 230524 /var/tmp/bperf.sock 00:26:56.327 02:31:59 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:26:56.327 02:31:59 -- common/autotest_common.sh@829 -- # '[' -z 230524 ']' 00:26:56.327 02:31:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:56.327 02:31:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:56.327 02:31:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:56.327 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:56.327 02:31:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:56.327 02:31:59 -- common/autotest_common.sh@10 -- # set +x 00:26:56.587 [2024-11-29 02:32:00.007355] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:56.587 [2024-11-29 02:32:00.007462] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid230524 ] 00:26:56.587 EAL: No free 2048 kB hugepages reported on node 1 00:26:56.587 [2024-11-29 02:32:00.077092] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:56.587 [2024-11-29 02:32:00.191639] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:57.526 02:32:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:57.526 02:32:00 -- common/autotest_common.sh@862 -- # return 0 00:26:57.526 02:32:00 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:57.526 02:32:00 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:57.785 02:32:01 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:57.785 02:32:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:57.785 02:32:01 -- common/autotest_common.sh@10 -- # set +x 00:26:57.785 02:32:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:57.785 02:32:01 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:57.785 02:32:01 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:58.045 nvme0n1 00:26:58.045 02:32:01 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:26:58.045 02:32:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:58.045 02:32:01 -- common/autotest_common.sh@10 -- # set +x 00:26:58.045 02:32:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:58.045 02:32:01 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:58.045 02:32:01 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:58.045 Running I/O for 2 seconds... 00:26:58.304 [2024-11-29 02:32:01.741192] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.304 [2024-11-29 02:32:01.741250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:7897 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.304 [2024-11-29 02:32:01.741289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.304 [2024-11-29 02:32:01.757465] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.304 [2024-11-29 02:32:01.757496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:3020 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.304 [2024-11-29 02:32:01.757513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.304 [2024-11-29 02:32:01.774948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.304 [2024-11-29 02:32:01.774985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:20145 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.304 [2024-11-29 02:32:01.775005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.304 [2024-11-29 02:32:01.789388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.304 [2024-11-29 02:32:01.789432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:22102 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.304 [2024-11-29 02:32:01.789467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.304 [2024-11-29 02:32:01.807381] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.304 [2024-11-29 02:32:01.807425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:1821 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.304 [2024-11-29 02:32:01.807445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.304 [2024-11-29 02:32:01.824491] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.304 [2024-11-29 02:32:01.824521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1913 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.304 [2024-11-29 02:32:01.824538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.304 [2024-11-29 02:32:01.841804] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.304 [2024-11-29 02:32:01.841834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:21025 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.304 [2024-11-29 02:32:01.841851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.304 [2024-11-29 02:32:01.852506] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.304 [2024-11-29 02:32:01.852535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9962 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.304 [2024-11-29 02:32:01.852552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.304 [2024-11-29 02:32:01.870059] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.304 [2024-11-29 02:32:01.870094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:5648 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.304 [2024-11-29 02:32:01.870113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.304 [2024-11-29 02:32:01.881875] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.304 [2024-11-29 02:32:01.881909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:10471 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.304 [2024-11-29 02:32:01.881928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.305 [2024-11-29 02:32:01.893088] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.305 [2024-11-29 02:32:01.893121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:1469 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.305 [2024-11-29 02:32:01.893141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.305 [2024-11-29 02:32:01.909586] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.305 [2024-11-29 02:32:01.909614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:21477 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.305 [2024-11-29 02:32:01.909630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.305 [2024-11-29 02:32:01.926088] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.305 [2024-11-29 02:32:01.926117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:2987 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.305 [2024-11-29 02:32:01.926140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.305 [2024-11-29 02:32:01.942793] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.305 [2024-11-29 02:32:01.942827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:7486 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.305 [2024-11-29 02:32:01.942848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.305 [2024-11-29 02:32:01.959522] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.305 [2024-11-29 02:32:01.959550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:14393 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.305 [2024-11-29 02:32:01.959568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.305 [2024-11-29 02:32:01.976356] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.305 [2024-11-29 02:32:01.976577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:14564 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.305 [2024-11-29 02:32:01.976599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.565 [2024-11-29 02:32:01.993982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.565 [2024-11-29 02:32:01.994017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:6872 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.565 [2024-11-29 02:32:01.994037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.565 [2024-11-29 02:32:02.011452] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.565 [2024-11-29 02:32:02.011484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:9233 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.565 [2024-11-29 02:32:02.011502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.565 [2024-11-29 02:32:02.022191] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.565 [2024-11-29 02:32:02.022219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:18997 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.565 [2024-11-29 02:32:02.022252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.565 [2024-11-29 02:32:02.037146] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.565 [2024-11-29 02:32:02.037175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19190 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.565 [2024-11-29 02:32:02.037191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.565 [2024-11-29 02:32:02.054210] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.565 [2024-11-29 02:32:02.054244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:23408 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.565 [2024-11-29 02:32:02.054264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.565 [2024-11-29 02:32:02.071027] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.565 [2024-11-29 02:32:02.071068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:24936 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.565 [2024-11-29 02:32:02.071089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.565 [2024-11-29 02:32:02.088517] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.565 [2024-11-29 02:32:02.088555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20547 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.565 [2024-11-29 02:32:02.088572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.565 [2024-11-29 02:32:02.105495] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.565 [2024-11-29 02:32:02.105525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:12951 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.565 [2024-11-29 02:32:02.105542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.565 [2024-11-29 02:32:02.122354] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.565 [2024-11-29 02:32:02.122388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24636 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.565 [2024-11-29 02:32:02.122417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.565 [2024-11-29 02:32:02.137588] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.565 [2024-11-29 02:32:02.137617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:4023 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.566 [2024-11-29 02:32:02.137633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.566 [2024-11-29 02:32:02.148511] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.566 [2024-11-29 02:32:02.148541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:15589 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.566 [2024-11-29 02:32:02.148556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.566 [2024-11-29 02:32:02.164726] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.566 [2024-11-29 02:32:02.164760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:17845 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.566 [2024-11-29 02:32:02.164779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.566 [2024-11-29 02:32:02.180898] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.566 [2024-11-29 02:32:02.180925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:18678 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.566 [2024-11-29 02:32:02.180940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.566 [2024-11-29 02:32:02.196957] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.566 [2024-11-29 02:32:02.196983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:21989 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.566 [2024-11-29 02:32:02.196999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.566 [2024-11-29 02:32:02.214000] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.566 [2024-11-29 02:32:02.214034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:18058 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.566 [2024-11-29 02:32:02.214053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.566 [2024-11-29 02:32:02.229850] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.566 [2024-11-29 02:32:02.229878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:21936 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.566 [2024-11-29 02:32:02.229894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.827 [2024-11-29 02:32:02.246503] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.827 [2024-11-29 02:32:02.246532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:11337 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.827 [2024-11-29 02:32:02.246548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.827 [2024-11-29 02:32:02.263095] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.827 [2024-11-29 02:32:02.263124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:19782 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.827 [2024-11-29 02:32:02.263141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.827 [2024-11-29 02:32:02.279387] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.827 [2024-11-29 02:32:02.279421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:11671 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.827 [2024-11-29 02:32:02.279437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.827 [2024-11-29 02:32:02.296015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.827 [2024-11-29 02:32:02.296044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:2384 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.827 [2024-11-29 02:32:02.296061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.827 [2024-11-29 02:32:02.313047] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.827 [2024-11-29 02:32:02.313075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:11724 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.827 [2024-11-29 02:32:02.313090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.827 [2024-11-29 02:32:02.329498] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.827 [2024-11-29 02:32:02.329525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:10144 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.827 [2024-11-29 02:32:02.329541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.827 [2024-11-29 02:32:02.346142] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.827 [2024-11-29 02:32:02.346176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:5724 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.827 [2024-11-29 02:32:02.346202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.827 [2024-11-29 02:32:02.362955] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.827 [2024-11-29 02:32:02.362983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:16089 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.827 [2024-11-29 02:32:02.362999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.827 [2024-11-29 02:32:02.378286] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.827 [2024-11-29 02:32:02.378315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:11273 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.827 [2024-11-29 02:32:02.378331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.827 [2024-11-29 02:32:02.389581] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.827 [2024-11-29 02:32:02.389608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:5416 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.827 [2024-11-29 02:32:02.389623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.827 [2024-11-29 02:32:02.405730] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.827 [2024-11-29 02:32:02.405758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:19225 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.827 [2024-11-29 02:32:02.405773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.827 [2024-11-29 02:32:02.423182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.827 [2024-11-29 02:32:02.423210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:499 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.827 [2024-11-29 02:32:02.423226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.827 [2024-11-29 02:32:02.438643] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.827 [2024-11-29 02:32:02.438671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:25211 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.827 [2024-11-29 02:32:02.438702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.827 [2024-11-29 02:32:02.455075] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.827 [2024-11-29 02:32:02.455102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:25220 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.827 [2024-11-29 02:32:02.455117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.827 [2024-11-29 02:32:02.471544] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.827 [2024-11-29 02:32:02.471573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:18945 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.827 [2024-11-29 02:32:02.471589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.827 [2024-11-29 02:32:02.487960] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.827 [2024-11-29 02:32:02.487988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:5567 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.827 [2024-11-29 02:32:02.488004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.827 [2024-11-29 02:32:02.504273] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:58.827 [2024-11-29 02:32:02.504300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:12171 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.827 [2024-11-29 02:32:02.504316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.087 [2024-11-29 02:32:02.520891] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.087 [2024-11-29 02:32:02.520919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:3785 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.087 [2024-11-29 02:32:02.520936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.087 [2024-11-29 02:32:02.537298] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.087 [2024-11-29 02:32:02.537332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:2870 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.087 [2024-11-29 02:32:02.537351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.087 [2024-11-29 02:32:02.554222] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.087 [2024-11-29 02:32:02.554255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:15048 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.087 [2024-11-29 02:32:02.554274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.088 [2024-11-29 02:32:02.566567] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.088 [2024-11-29 02:32:02.566596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24210 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.088 [2024-11-29 02:32:02.566612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.088 [2024-11-29 02:32:02.583510] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.088 [2024-11-29 02:32:02.583542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11647 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.088 [2024-11-29 02:32:02.583559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.088 [2024-11-29 02:32:02.594966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.088 [2024-11-29 02:32:02.594995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:22217 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.088 [2024-11-29 02:32:02.595011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.088 [2024-11-29 02:32:02.618077] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.088 [2024-11-29 02:32:02.618105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:15629 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.088 [2024-11-29 02:32:02.618126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.088 [2024-11-29 02:32:02.634506] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.088 [2024-11-29 02:32:02.634535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4569 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.088 [2024-11-29 02:32:02.634550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.088 [2024-11-29 02:32:02.651059] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.088 [2024-11-29 02:32:02.651088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13464 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.088 [2024-11-29 02:32:02.651104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.088 [2024-11-29 02:32:02.667800] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.088 [2024-11-29 02:32:02.667834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:9916 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.088 [2024-11-29 02:32:02.667853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.088 [2024-11-29 02:32:02.682915] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.088 [2024-11-29 02:32:02.682946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:12795 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.088 [2024-11-29 02:32:02.682962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.088 [2024-11-29 02:32:02.693840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.088 [2024-11-29 02:32:02.693873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:23706 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.088 [2024-11-29 02:32:02.693891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.088 [2024-11-29 02:32:02.711567] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.088 [2024-11-29 02:32:02.711596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:3707 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.088 [2024-11-29 02:32:02.711613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.088 [2024-11-29 02:32:02.728300] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.088 [2024-11-29 02:32:02.728333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11518 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.088 [2024-11-29 02:32:02.728351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.088 [2024-11-29 02:32:02.745503] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.088 [2024-11-29 02:32:02.745532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:625 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.088 [2024-11-29 02:32:02.745549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.088 [2024-11-29 02:32:02.762694] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.088 [2024-11-29 02:32:02.762733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:9471 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.088 [2024-11-29 02:32:02.762760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.345 [2024-11-29 02:32:02.778223] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.345 [2024-11-29 02:32:02.778269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:2046 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.345 [2024-11-29 02:32:02.778287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.345 [2024-11-29 02:32:02.789755] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.345 [2024-11-29 02:32:02.789790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:14707 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.345 [2024-11-29 02:32:02.789809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.345 [2024-11-29 02:32:02.806340] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.345 [2024-11-29 02:32:02.806376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:19643 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.345 [2024-11-29 02:32:02.806404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.345 [2024-11-29 02:32:02.819170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.345 [2024-11-29 02:32:02.819199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:6689 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.345 [2024-11-29 02:32:02.819216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.345 [2024-11-29 02:32:02.830233] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.345 [2024-11-29 02:32:02.830267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:6757 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.345 [2024-11-29 02:32:02.830285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.345 [2024-11-29 02:32:02.844408] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.346 [2024-11-29 02:32:02.844452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:6125 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.346 [2024-11-29 02:32:02.844469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.346 [2024-11-29 02:32:02.860634] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.346 [2024-11-29 02:32:02.860664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:2710 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.346 [2024-11-29 02:32:02.860680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.346 [2024-11-29 02:32:02.871415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.346 [2024-11-29 02:32:02.871449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:14858 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.346 [2024-11-29 02:32:02.871481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.346 [2024-11-29 02:32:02.887200] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.346 [2024-11-29 02:32:02.887234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:5480 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.346 [2024-11-29 02:32:02.887253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.346 [2024-11-29 02:32:02.897704] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.346 [2024-11-29 02:32:02.897737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:21035 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.346 [2024-11-29 02:32:02.897755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.346 [2024-11-29 02:32:02.913643] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.346 [2024-11-29 02:32:02.913686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10032 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.346 [2024-11-29 02:32:02.913706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.346 [2024-11-29 02:32:02.930609] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.346 [2024-11-29 02:32:02.930638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:20403 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.346 [2024-11-29 02:32:02.930654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.346 [2024-11-29 02:32:02.945834] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.346 [2024-11-29 02:32:02.945863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:2346 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.346 [2024-11-29 02:32:02.945880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.346 [2024-11-29 02:32:02.957753] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.346 [2024-11-29 02:32:02.957786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16865 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.346 [2024-11-29 02:32:02.957805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.346 [2024-11-29 02:32:02.969089] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.346 [2024-11-29 02:32:02.969116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:19752 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.346 [2024-11-29 02:32:02.969132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.346 [2024-11-29 02:32:02.981359] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.346 [2024-11-29 02:32:02.981400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:15621 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.346 [2024-11-29 02:32:02.981421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.346 [2024-11-29 02:32:02.994861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.346 [2024-11-29 02:32:02.994891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:21570 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.346 [2024-11-29 02:32:02.994914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.346 [2024-11-29 02:32:03.011789] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.346 [2024-11-29 02:32:03.011817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:19119 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.346 [2024-11-29 02:32:03.011833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.605 [2024-11-29 02:32:03.029355] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.605 [2024-11-29 02:32:03.029384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:19593 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.605 [2024-11-29 02:32:03.029427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.605 [2024-11-29 02:32:03.046672] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.605 [2024-11-29 02:32:03.046709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:10458 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.605 [2024-11-29 02:32:03.046730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.605 [2024-11-29 02:32:03.063501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.605 [2024-11-29 02:32:03.063530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4533 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.605 [2024-11-29 02:32:03.063547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.605 [2024-11-29 02:32:03.080317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.605 [2024-11-29 02:32:03.080345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:8230 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.605 [2024-11-29 02:32:03.080361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.605 [2024-11-29 02:32:03.095573] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.605 [2024-11-29 02:32:03.095603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:19666 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.605 [2024-11-29 02:32:03.095620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.605 [2024-11-29 02:32:03.107626] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.605 [2024-11-29 02:32:03.107654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:7421 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.605 [2024-11-29 02:32:03.107670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.605 [2024-11-29 02:32:03.125138] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.605 [2024-11-29 02:32:03.125165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:8951 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.605 [2024-11-29 02:32:03.125181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.605 [2024-11-29 02:32:03.140691] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.605 [2024-11-29 02:32:03.140726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:1993 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.605 [2024-11-29 02:32:03.140761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.605 [2024-11-29 02:32:03.152326] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.605 [2024-11-29 02:32:03.152360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:12017 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.605 [2024-11-29 02:32:03.152378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.605 [2024-11-29 02:32:03.167898] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.605 [2024-11-29 02:32:03.167925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:10277 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.605 [2024-11-29 02:32:03.167940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.606 [2024-11-29 02:32:03.183093] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.606 [2024-11-29 02:32:03.183122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:13808 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.606 [2024-11-29 02:32:03.183138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.606 [2024-11-29 02:32:03.194489] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.606 [2024-11-29 02:32:03.194518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:777 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.606 [2024-11-29 02:32:03.194535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.606 [2024-11-29 02:32:03.209386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.606 [2024-11-29 02:32:03.209421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:834 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.606 [2024-11-29 02:32:03.209453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.606 [2024-11-29 02:32:03.227353] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.606 [2024-11-29 02:32:03.227386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6141 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.606 [2024-11-29 02:32:03.227416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.606 [2024-11-29 02:32:03.241900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.606 [2024-11-29 02:32:03.241929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:15094 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.606 [2024-11-29 02:32:03.241946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.606 [2024-11-29 02:32:03.253053] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.606 [2024-11-29 02:32:03.253087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:11591 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.606 [2024-11-29 02:32:03.253106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.606 [2024-11-29 02:32:03.264943] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.606 [2024-11-29 02:32:03.264971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:14228 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.606 [2024-11-29 02:32:03.264987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.606 [2024-11-29 02:32:03.278250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.606 [2024-11-29 02:32:03.278291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:1822 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.606 [2024-11-29 02:32:03.278311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.864 [2024-11-29 02:32:03.290264] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.864 [2024-11-29 02:32:03.290309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:15051 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.864 [2024-11-29 02:32:03.290325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.864 [2024-11-29 02:32:03.302107] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.864 [2024-11-29 02:32:03.302143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:9685 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.864 [2024-11-29 02:32:03.302163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.864 [2024-11-29 02:32:03.314269] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.864 [2024-11-29 02:32:03.314303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:13602 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.864 [2024-11-29 02:32:03.314322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.864 [2024-11-29 02:32:03.326255] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.864 [2024-11-29 02:32:03.326289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:14097 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.864 [2024-11-29 02:32:03.326308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.864 [2024-11-29 02:32:03.339352] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.864 [2024-11-29 02:32:03.339404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:13479 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.864 [2024-11-29 02:32:03.339423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.864 [2024-11-29 02:32:03.351695] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.864 [2024-11-29 02:32:03.351723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:13812 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.865 [2024-11-29 02:32:03.351755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.865 [2024-11-29 02:32:03.362614] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.865 [2024-11-29 02:32:03.362648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13981 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.865 [2024-11-29 02:32:03.362665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.865 [2024-11-29 02:32:03.379264] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.865 [2024-11-29 02:32:03.379298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4689 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.865 [2024-11-29 02:32:03.379318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.865 [2024-11-29 02:32:03.396087] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.865 [2024-11-29 02:32:03.396121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:47 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.865 [2024-11-29 02:32:03.396139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.865 [2024-11-29 02:32:03.412721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.865 [2024-11-29 02:32:03.412748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:7895 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.865 [2024-11-29 02:32:03.412764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.865 [2024-11-29 02:32:03.428861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.865 [2024-11-29 02:32:03.428889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:24096 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.865 [2024-11-29 02:32:03.428905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.865 [2024-11-29 02:32:03.445534] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.865 [2024-11-29 02:32:03.445562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:23110 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.865 [2024-11-29 02:32:03.445578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.865 [2024-11-29 02:32:03.462180] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.865 [2024-11-29 02:32:03.462214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:21369 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.865 [2024-11-29 02:32:03.462233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.865 [2024-11-29 02:32:03.478800] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.865 [2024-11-29 02:32:03.478828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:13213 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.865 [2024-11-29 02:32:03.478844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.865 [2024-11-29 02:32:03.495658] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.865 [2024-11-29 02:32:03.495685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:14137 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.865 [2024-11-29 02:32:03.495701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.865 [2024-11-29 02:32:03.512050] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.865 [2024-11-29 02:32:03.512078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:5450 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.865 [2024-11-29 02:32:03.512093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.865 [2024-11-29 02:32:03.528853] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:26:59.865 [2024-11-29 02:32:03.528886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21769 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.865 [2024-11-29 02:32:03.528905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.124 [2024-11-29 02:32:03.545232] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:27:00.124 [2024-11-29 02:32:03.545261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:19290 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.124 [2024-11-29 02:32:03.545277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.124 [2024-11-29 02:32:03.561949] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:27:00.124 [2024-11-29 02:32:03.561985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:12518 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.124 [2024-11-29 02:32:03.562005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.124 [2024-11-29 02:32:03.578757] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:27:00.124 [2024-11-29 02:32:03.578786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:15527 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.124 [2024-11-29 02:32:03.578802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.124 [2024-11-29 02:32:03.595643] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:27:00.124 [2024-11-29 02:32:03.595691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:22997 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.124 [2024-11-29 02:32:03.595711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.125 [2024-11-29 02:32:03.612278] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:27:00.125 [2024-11-29 02:32:03.612306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:23310 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.125 [2024-11-29 02:32:03.612322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.125 [2024-11-29 02:32:03.628879] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:27:00.125 [2024-11-29 02:32:03.628912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:11157 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.125 [2024-11-29 02:32:03.628931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.125 [2024-11-29 02:32:03.645487] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:27:00.125 [2024-11-29 02:32:03.645516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:10902 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.125 [2024-11-29 02:32:03.645538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.125 [2024-11-29 02:32:03.662001] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:27:00.125 [2024-11-29 02:32:03.662028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:3909 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.125 [2024-11-29 02:32:03.662044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.125 [2024-11-29 02:32:03.678219] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:27:00.125 [2024-11-29 02:32:03.678246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:25514 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.125 [2024-11-29 02:32:03.678261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.125 [2024-11-29 02:32:03.694630] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:27:00.125 [2024-11-29 02:32:03.694657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21281 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.125 [2024-11-29 02:32:03.694673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.125 [2024-11-29 02:32:03.711048] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:27:00.125 [2024-11-29 02:32:03.711082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:3137 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.125 [2024-11-29 02:32:03.711101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.125 [2024-11-29 02:32:03.727996] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x204cbb0) 00:27:00.125 [2024-11-29 02:32:03.728025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:2348 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.125 [2024-11-29 02:32:03.728041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.125 00:27:00.125 Latency(us) 00:27:00.125 [2024-11-29T01:32:03.806Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:00.125 [2024-11-29T01:32:03.806Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:27:00.125 nvme0n1 : 2.00 16577.24 64.75 0.00 0.00 7714.72 3301.07 32039.82 00:27:00.125 [2024-11-29T01:32:03.806Z] =================================================================================================================== 00:27:00.125 [2024-11-29T01:32:03.806Z] Total : 16577.24 64.75 0.00 0.00 7714.72 3301.07 32039.82 00:27:00.125 0 00:27:00.125 02:32:03 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:00.125 02:32:03 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:00.125 02:32:03 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:00.125 | .driver_specific 00:27:00.125 | .nvme_error 00:27:00.125 | .status_code 00:27:00.125 | .command_transient_transport_error' 00:27:00.125 02:32:03 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:00.385 02:32:04 -- host/digest.sh@71 -- # (( 130 > 0 )) 00:27:00.385 02:32:04 -- host/digest.sh@73 -- # killprocess 230524 00:27:00.385 02:32:04 -- common/autotest_common.sh@936 -- # '[' -z 230524 ']' 00:27:00.385 02:32:04 -- common/autotest_common.sh@940 -- # kill -0 230524 00:27:00.385 02:32:04 -- common/autotest_common.sh@941 -- # uname 00:27:00.385 02:32:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:00.385 02:32:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 230524 00:27:00.385 02:32:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:00.385 02:32:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:00.385 02:32:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 230524' 00:27:00.385 killing process with pid 230524 00:27:00.385 02:32:04 -- common/autotest_common.sh@955 -- # kill 230524 00:27:00.385 Received shutdown signal, test time was about 2.000000 seconds 00:27:00.385 00:27:00.385 Latency(us) 00:27:00.385 [2024-11-29T01:32:04.066Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:00.385 [2024-11-29T01:32:04.066Z] =================================================================================================================== 00:27:00.385 [2024-11-29T01:32:04.066Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:00.385 02:32:04 -- common/autotest_common.sh@960 -- # wait 230524 00:27:00.644 02:32:04 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:27:00.644 02:32:04 -- host/digest.sh@54 -- # local rw bs qd 00:27:00.644 02:32:04 -- host/digest.sh@56 -- # rw=randread 00:27:00.644 02:32:04 -- host/digest.sh@56 -- # bs=131072 00:27:00.644 02:32:04 -- host/digest.sh@56 -- # qd=16 00:27:00.644 02:32:04 -- host/digest.sh@58 -- # bperfpid=231073 00:27:00.644 02:32:04 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:27:00.644 02:32:04 -- host/digest.sh@60 -- # waitforlisten 231073 /var/tmp/bperf.sock 00:27:00.644 02:32:04 -- common/autotest_common.sh@829 -- # '[' -z 231073 ']' 00:27:00.644 02:32:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:00.644 02:32:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:00.644 02:32:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:00.644 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:00.644 02:32:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:00.644 02:32:04 -- common/autotest_common.sh@10 -- # set +x 00:27:00.905 [2024-11-29 02:32:04.362167] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:00.905 [2024-11-29 02:32:04.362256] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid231073 ] 00:27:00.905 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:00.905 Zero copy mechanism will not be used. 00:27:00.905 EAL: No free 2048 kB hugepages reported on node 1 00:27:00.905 [2024-11-29 02:32:04.422790] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:00.905 [2024-11-29 02:32:04.533294] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:01.839 02:32:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:01.839 02:32:05 -- common/autotest_common.sh@862 -- # return 0 00:27:01.839 02:32:05 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:01.839 02:32:05 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:02.097 02:32:05 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:02.097 02:32:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:02.097 02:32:05 -- common/autotest_common.sh@10 -- # set +x 00:27:02.097 02:32:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:02.097 02:32:05 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:02.097 02:32:05 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:02.668 nvme0n1 00:27:02.668 02:32:06 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:02.668 02:32:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:02.668 02:32:06 -- common/autotest_common.sh@10 -- # set +x 00:27:02.668 02:32:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:02.668 02:32:06 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:02.668 02:32:06 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:02.668 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:02.668 Zero copy mechanism will not be used. 00:27:02.668 Running I/O for 2 seconds... 00:27:02.668 [2024-11-29 02:32:06.188418] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.668 [2024-11-29 02:32:06.188499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-29 02:32:06.188521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.668 [2024-11-29 02:32:06.194998] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.668 [2024-11-29 02:32:06.195036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-29 02:32:06.195056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.668 [2024-11-29 02:32:06.201212] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.668 [2024-11-29 02:32:06.201246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-29 02:32:06.201265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.668 [2024-11-29 02:32:06.207235] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.668 [2024-11-29 02:32:06.207265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-29 02:32:06.207283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.668 [2024-11-29 02:32:06.212534] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.668 [2024-11-29 02:32:06.212564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-29 02:32:06.212581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.669 [2024-11-29 02:32:06.218086] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.669 [2024-11-29 02:32:06.218116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.669 [2024-11-29 02:32:06.218133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.669 [2024-11-29 02:32:06.223074] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.669 [2024-11-29 02:32:06.223105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.669 [2024-11-29 02:32:06.223121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.669 [2024-11-29 02:32:06.229031] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.669 [2024-11-29 02:32:06.229061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.669 [2024-11-29 02:32:06.229077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.669 [2024-11-29 02:32:06.235433] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.669 [2024-11-29 02:32:06.235464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.669 [2024-11-29 02:32:06.235483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.669 [2024-11-29 02:32:06.241827] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.669 [2024-11-29 02:32:06.241857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.669 [2024-11-29 02:32:06.241890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.669 [2024-11-29 02:32:06.247498] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.669 [2024-11-29 02:32:06.247530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.669 [2024-11-29 02:32:06.247547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.669 [2024-11-29 02:32:06.253030] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.669 [2024-11-29 02:32:06.253062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.669 [2024-11-29 02:32:06.253079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.669 [2024-11-29 02:32:06.258505] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.669 [2024-11-29 02:32:06.258537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.669 [2024-11-29 02:32:06.258555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.669 [2024-11-29 02:32:06.264037] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.669 [2024-11-29 02:32:06.264068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.669 [2024-11-29 02:32:06.264085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.669 [2024-11-29 02:32:06.269873] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.669 [2024-11-29 02:32:06.269904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.669 [2024-11-29 02:32:06.269921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.669 [2024-11-29 02:32:06.275501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.669 [2024-11-29 02:32:06.275532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.669 [2024-11-29 02:32:06.275549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.669 [2024-11-29 02:32:06.280958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.669 [2024-11-29 02:32:06.280989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.669 [2024-11-29 02:32:06.281012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.669 [2024-11-29 02:32:06.286639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.669 [2024-11-29 02:32:06.286671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.669 [2024-11-29 02:32:06.286703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.669 [2024-11-29 02:32:06.292084] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.669 [2024-11-29 02:32:06.292116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.669 [2024-11-29 02:32:06.292133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.669 [2024-11-29 02:32:06.297556] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.669 [2024-11-29 02:32:06.297586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.669 [2024-11-29 02:32:06.297602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.669 [2024-11-29 02:32:06.301982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.669 [2024-11-29 02:32:06.302013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.669 [2024-11-29 02:32:06.302030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.669 [2024-11-29 02:32:06.306160] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.669 [2024-11-29 02:32:06.306190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.669 [2024-11-29 02:32:06.306209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.669 [2024-11-29 02:32:06.310375] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.669 [2024-11-29 02:32:06.310412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.669 [2024-11-29 02:32:06.310429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.669 [2024-11-29 02:32:06.315708] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.669 [2024-11-29 02:32:06.315739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.669 [2024-11-29 02:32:06.315756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.669 [2024-11-29 02:32:06.321258] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.669 [2024-11-29 02:32:06.321289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.669 [2024-11-29 02:32:06.321306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.669 [2024-11-29 02:32:06.326839] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.669 [2024-11-29 02:32:06.326870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.669 [2024-11-29 02:32:06.326886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.669 [2024-11-29 02:32:06.332061] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.669 [2024-11-29 02:32:06.332092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.669 [2024-11-29 02:32:06.332109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.669 [2024-11-29 02:32:06.337224] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.669 [2024-11-29 02:32:06.337254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.669 [2024-11-29 02:32:06.337271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.669 [2024-11-29 02:32:06.342350] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.669 [2024-11-29 02:32:06.342381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.669 [2024-11-29 02:32:06.342408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.347915] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.347947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.347965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.352994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.353025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.353043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.357759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.357789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.357807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.362703] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.362733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.362750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.367651] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.367681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.367703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.372592] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.372622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.372639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.377520] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.377549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.377565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.382501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.382530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.382547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.386997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.387026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.387043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.391545] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.391575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.391591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.396742] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.396772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.396788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.402169] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.402217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.402236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.407720] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.407751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.407768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.414302] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.414339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.414357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.420545] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.420577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.420594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.426338] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.426372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.426415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.431623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.431653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.431669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.436785] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.436830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.436847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.442681] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.442712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.442729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.448307] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.448339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.448356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.454943] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.454973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.454990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.460997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.461027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.461044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.465126] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.465157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.465174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.470980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.471010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.471026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.476984] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.477012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.477028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.482865] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.482914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.482931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.487369] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.487406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.487425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.491528] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.491559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.491575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.495467] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.495498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.495515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.500370] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.500425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.500444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.506566] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.506611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.506634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.511485] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.511515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.511532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.516586] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.516615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.516631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.521648] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.521693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.521710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.526488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.526518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.526549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.531497] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.531527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.531558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.931 [2024-11-29 02:32:06.536492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.931 [2024-11-29 02:32:06.536539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-29 02:32:06.536557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.932 [2024-11-29 02:32:06.541420] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.932 [2024-11-29 02:32:06.541453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.932 [2024-11-29 02:32:06.541485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.932 [2024-11-29 02:32:06.546514] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.932 [2024-11-29 02:32:06.546544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.932 [2024-11-29 02:32:06.546561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.932 [2024-11-29 02:32:06.551477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.932 [2024-11-29 02:32:06.551518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.932 [2024-11-29 02:32:06.551536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.932 [2024-11-29 02:32:06.556425] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.932 [2024-11-29 02:32:06.556473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.932 [2024-11-29 02:32:06.556491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.932 [2024-11-29 02:32:06.562114] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.932 [2024-11-29 02:32:06.562147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.932 [2024-11-29 02:32:06.562166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.932 [2024-11-29 02:32:06.567647] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.932 [2024-11-29 02:32:06.567678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.932 [2024-11-29 02:32:06.567695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.932 [2024-11-29 02:32:06.573593] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.932 [2024-11-29 02:32:06.573639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.932 [2024-11-29 02:32:06.573656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.932 [2024-11-29 02:32:06.579305] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.932 [2024-11-29 02:32:06.579336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.932 [2024-11-29 02:32:06.579367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.932 [2024-11-29 02:32:06.584952] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.932 [2024-11-29 02:32:06.584998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.932 [2024-11-29 02:32:06.585015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.932 [2024-11-29 02:32:06.590891] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.932 [2024-11-29 02:32:06.590926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.932 [2024-11-29 02:32:06.590946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.932 [2024-11-29 02:32:06.596735] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.932 [2024-11-29 02:32:06.596767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.932 [2024-11-29 02:32:06.596784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.932 [2024-11-29 02:32:06.602352] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.932 [2024-11-29 02:32:06.602383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.932 [2024-11-29 02:32:06.602411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.932 [2024-11-29 02:32:06.607872] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:02.932 [2024-11-29 02:32:06.607903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.932 [2024-11-29 02:32:06.607921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.194 [2024-11-29 02:32:06.613401] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.194 [2024-11-29 02:32:06.613459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.194 [2024-11-29 02:32:06.613476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.194 [2024-11-29 02:32:06.620081] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.194 [2024-11-29 02:32:06.620115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.194 [2024-11-29 02:32:06.620142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.194 [2024-11-29 02:32:06.626534] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.194 [2024-11-29 02:32:06.626565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.194 [2024-11-29 02:32:06.626582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.194 [2024-11-29 02:32:06.632200] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.194 [2024-11-29 02:32:06.632232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.194 [2024-11-29 02:32:06.632249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.194 [2024-11-29 02:32:06.636370] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.194 [2024-11-29 02:32:06.636409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.194 [2024-11-29 02:32:06.636428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.194 [2024-11-29 02:32:06.641304] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.194 [2024-11-29 02:32:06.641339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.194 [2024-11-29 02:32:06.641357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.194 [2024-11-29 02:32:06.646345] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.194 [2024-11-29 02:32:06.646376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.194 [2024-11-29 02:32:06.646408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.194 [2024-11-29 02:32:06.651422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.194 [2024-11-29 02:32:06.651452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.194 [2024-11-29 02:32:06.651469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.194 [2024-11-29 02:32:06.656279] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.194 [2024-11-29 02:32:06.656309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.194 [2024-11-29 02:32:06.656325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.194 [2024-11-29 02:32:06.661218] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.194 [2024-11-29 02:32:06.661249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.194 [2024-11-29 02:32:06.661280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.194 [2024-11-29 02:32:06.666014] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.194 [2024-11-29 02:32:06.666044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.194 [2024-11-29 02:32:06.666060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.194 [2024-11-29 02:32:06.670987] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.194 [2024-11-29 02:32:06.671032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.194 [2024-11-29 02:32:06.671048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.194 [2024-11-29 02:32:06.675767] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.194 [2024-11-29 02:32:06.675796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.194 [2024-11-29 02:32:06.675813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.194 [2024-11-29 02:32:06.680635] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.194 [2024-11-29 02:32:06.680664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.194 [2024-11-29 02:32:06.680681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.194 [2024-11-29 02:32:06.685416] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.194 [2024-11-29 02:32:06.685446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.194 [2024-11-29 02:32:06.685463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.194 [2024-11-29 02:32:06.690202] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.194 [2024-11-29 02:32:06.690230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.690246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.694999] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.195 [2024-11-29 02:32:06.695028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.695044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.699815] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.195 [2024-11-29 02:32:06.699845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.699862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.704685] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.195 [2024-11-29 02:32:06.704715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.704731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.709668] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.195 [2024-11-29 02:32:06.709697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.709713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.714492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.195 [2024-11-29 02:32:06.714530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.714561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.720194] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.195 [2024-11-29 02:32:06.720224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.720241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.725316] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.195 [2024-11-29 02:32:06.725346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.725363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.730386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.195 [2024-11-29 02:32:06.730424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.730453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.736000] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.195 [2024-11-29 02:32:06.736030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.736046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.741087] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.195 [2024-11-29 02:32:06.741118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.741135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.745545] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.195 [2024-11-29 02:32:06.745576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.745593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.749916] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.195 [2024-11-29 02:32:06.749962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.749979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.754953] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.195 [2024-11-29 02:32:06.754983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.754999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.760543] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.195 [2024-11-29 02:32:06.760574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.760591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.767461] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.195 [2024-11-29 02:32:06.767492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.767509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.775164] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.195 [2024-11-29 02:32:06.775195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.775212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.783564] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.195 [2024-11-29 02:32:06.783617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.783636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.790579] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.195 [2024-11-29 02:32:06.790610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.790626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.796160] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.195 [2024-11-29 02:32:06.796192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.796209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.802070] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.195 [2024-11-29 02:32:06.802100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.802117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.806550] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.195 [2024-11-29 02:32:06.806581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.806598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.810849] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.195 [2024-11-29 02:32:06.810879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.810896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.815197] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.195 [2024-11-29 02:32:06.815227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.815243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.819139] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.195 [2024-11-29 02:32:06.819169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.819186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.824228] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.195 [2024-11-29 02:32:06.824258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.824275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.829851] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.195 [2024-11-29 02:32:06.829882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-29 02:32:06.829900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.195 [2024-11-29 02:32:06.835562] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.196 [2024-11-29 02:32:06.835607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.196 [2024-11-29 02:32:06.835624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.196 [2024-11-29 02:32:06.841219] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.196 [2024-11-29 02:32:06.841251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.196 [2024-11-29 02:32:06.841267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.196 [2024-11-29 02:32:06.847079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.196 [2024-11-29 02:32:06.847111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.196 [2024-11-29 02:32:06.847143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.196 [2024-11-29 02:32:06.853291] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.196 [2024-11-29 02:32:06.853337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.196 [2024-11-29 02:32:06.853355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.196 [2024-11-29 02:32:06.859134] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.196 [2024-11-29 02:32:06.859165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.196 [2024-11-29 02:32:06.859182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.196 [2024-11-29 02:32:06.864544] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.196 [2024-11-29 02:32:06.864590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.196 [2024-11-29 02:32:06.864608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.196 [2024-11-29 02:32:06.867887] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.196 [2024-11-29 02:32:06.867916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.196 [2024-11-29 02:32:06.867932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.196 [2024-11-29 02:32:06.872086] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.196 [2024-11-29 02:32:06.872115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.196 [2024-11-29 02:32:06.872141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.456 [2024-11-29 02:32:06.876480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.456 [2024-11-29 02:32:06.876511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.456 [2024-11-29 02:32:06.876528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.456 [2024-11-29 02:32:06.880572] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.456 [2024-11-29 02:32:06.880602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.456 [2024-11-29 02:32:06.880618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.456 [2024-11-29 02:32:06.885509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.456 [2024-11-29 02:32:06.885551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.456 [2024-11-29 02:32:06.885567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.456 [2024-11-29 02:32:06.889570] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.456 [2024-11-29 02:32:06.889599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.456 [2024-11-29 02:32:06.889615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.456 [2024-11-29 02:32:06.893652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.456 [2024-11-29 02:32:06.893681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.456 [2024-11-29 02:32:06.893697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.456 [2024-11-29 02:32:06.897805] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.456 [2024-11-29 02:32:06.897833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.456 [2024-11-29 02:32:06.897849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.456 [2024-11-29 02:32:06.901761] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.456 [2024-11-29 02:32:06.901790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.456 [2024-11-29 02:32:06.901807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.456 [2024-11-29 02:32:06.906726] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.456 [2024-11-29 02:32:06.906772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.456 [2024-11-29 02:32:06.906791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.456 [2024-11-29 02:32:06.911669] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.456 [2024-11-29 02:32:06.911719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.456 [2024-11-29 02:32:06.911736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.456 [2024-11-29 02:32:06.916515] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.456 [2024-11-29 02:32:06.916544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.456 [2024-11-29 02:32:06.916560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.456 [2024-11-29 02:32:06.921371] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.456 [2024-11-29 02:32:06.921413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.456 [2024-11-29 02:32:06.921433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.456 [2024-11-29 02:32:06.926359] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.456 [2024-11-29 02:32:06.926389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.456 [2024-11-29 02:32:06.926429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.456 [2024-11-29 02:32:06.931428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.456 [2024-11-29 02:32:06.931471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.456 [2024-11-29 02:32:06.931486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.456 [2024-11-29 02:32:06.936605] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.456 [2024-11-29 02:32:06.936635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.456 [2024-11-29 02:32:06.936651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.456 [2024-11-29 02:32:06.941507] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.456 [2024-11-29 02:32:06.941535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.456 [2024-11-29 02:32:06.941551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.456 [2024-11-29 02:32:06.946601] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.456 [2024-11-29 02:32:06.946630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.456 [2024-11-29 02:32:06.946647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.456 [2024-11-29 02:32:06.951567] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.456 [2024-11-29 02:32:06.951596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.456 [2024-11-29 02:32:06.951613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.456 [2024-11-29 02:32:06.956467] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.456 [2024-11-29 02:32:06.956496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.456 [2024-11-29 02:32:06.956526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.456 [2024-11-29 02:32:06.961512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.456 [2024-11-29 02:32:06.961542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.456 [2024-11-29 02:32:06.961572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.456 [2024-11-29 02:32:06.966293] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.456 [2024-11-29 02:32:06.966322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-29 02:32:06.966338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.457 [2024-11-29 02:32:06.971385] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.457 [2024-11-29 02:32:06.971443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-29 02:32:06.971460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.457 [2024-11-29 02:32:06.976150] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.457 [2024-11-29 02:32:06.976195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-29 02:32:06.976212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.457 [2024-11-29 02:32:06.981137] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.457 [2024-11-29 02:32:06.981166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-29 02:32:06.981182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.457 [2024-11-29 02:32:06.986610] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.457 [2024-11-29 02:32:06.986640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-29 02:32:06.986657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.457 [2024-11-29 02:32:06.992460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.457 [2024-11-29 02:32:06.992491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-29 02:32:06.992521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.457 [2024-11-29 02:32:06.997700] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.457 [2024-11-29 02:32:06.997729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-29 02:32:06.997767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.457 [2024-11-29 02:32:07.002569] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.457 [2024-11-29 02:32:07.002611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-29 02:32:07.002626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.457 [2024-11-29 02:32:07.007344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.457 [2024-11-29 02:32:07.007373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-29 02:32:07.007417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.457 [2024-11-29 02:32:07.012320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.457 [2024-11-29 02:32:07.012349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-29 02:32:07.012380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.457 [2024-11-29 02:32:07.017201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.457 [2024-11-29 02:32:07.017245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-29 02:32:07.017261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.457 [2024-11-29 02:32:07.021899] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.457 [2024-11-29 02:32:07.021944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-29 02:32:07.021960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.457 [2024-11-29 02:32:07.026861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.457 [2024-11-29 02:32:07.026890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-29 02:32:07.026922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.457 [2024-11-29 02:32:07.032000] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.457 [2024-11-29 02:32:07.032034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-29 02:32:07.032053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.457 [2024-11-29 02:32:07.037129] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.457 [2024-11-29 02:32:07.037162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-29 02:32:07.037180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.457 [2024-11-29 02:32:07.041810] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.457 [2024-11-29 02:32:07.041856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-29 02:32:07.041873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.457 [2024-11-29 02:32:07.047440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.457 [2024-11-29 02:32:07.047471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-29 02:32:07.047488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.457 [2024-11-29 02:32:07.052946] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.457 [2024-11-29 02:32:07.052977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-29 02:32:07.052995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.457 [2024-11-29 02:32:07.057855] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.457 [2024-11-29 02:32:07.057884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-29 02:32:07.057900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.457 [2024-11-29 02:32:07.062493] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.457 [2024-11-29 02:32:07.062531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-29 02:32:07.062548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.457 [2024-11-29 02:32:07.066683] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.457 [2024-11-29 02:32:07.066712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-29 02:32:07.066729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.457 [2024-11-29 02:32:07.070907] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.457 [2024-11-29 02:32:07.070935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-29 02:32:07.070951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.457 [2024-11-29 02:32:07.075017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.457 [2024-11-29 02:32:07.075045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-29 02:32:07.075062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.457 [2024-11-29 02:32:07.079575] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.457 [2024-11-29 02:32:07.079605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-29 02:32:07.079628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.458 [2024-11-29 02:32:07.085117] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.458 [2024-11-29 02:32:07.085151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.458 [2024-11-29 02:32:07.085170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.458 [2024-11-29 02:32:07.089103] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.458 [2024-11-29 02:32:07.089133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.458 [2024-11-29 02:32:07.089150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.458 [2024-11-29 02:32:07.093630] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.458 [2024-11-29 02:32:07.093661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.458 [2024-11-29 02:32:07.093678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.458 [2024-11-29 02:32:07.097850] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.458 [2024-11-29 02:32:07.097881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.458 [2024-11-29 02:32:07.097898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.458 [2024-11-29 02:32:07.101817] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.458 [2024-11-29 02:32:07.101846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.458 [2024-11-29 02:32:07.101862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.458 [2024-11-29 02:32:07.106448] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.458 [2024-11-29 02:32:07.106477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.458 [2024-11-29 02:32:07.106494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.458 [2024-11-29 02:32:07.111502] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.458 [2024-11-29 02:32:07.111533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.458 [2024-11-29 02:32:07.111549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.458 [2024-11-29 02:32:07.116770] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.458 [2024-11-29 02:32:07.116802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.458 [2024-11-29 02:32:07.116819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.458 [2024-11-29 02:32:07.122179] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.458 [2024-11-29 02:32:07.122217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.458 [2024-11-29 02:32:07.122235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.458 [2024-11-29 02:32:07.128265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.458 [2024-11-29 02:32:07.128300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.458 [2024-11-29 02:32:07.128319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.720 [2024-11-29 02:32:07.135134] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.720 [2024-11-29 02:32:07.135167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.720 [2024-11-29 02:32:07.135184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.720 [2024-11-29 02:32:07.140036] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.720 [2024-11-29 02:32:07.140066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.720 [2024-11-29 02:32:07.140083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.720 [2024-11-29 02:32:07.145148] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.721 [2024-11-29 02:32:07.145178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.721 [2024-11-29 02:32:07.145195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.721 [2024-11-29 02:32:07.150119] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.721 [2024-11-29 02:32:07.150160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.721 [2024-11-29 02:32:07.150177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.721 [2024-11-29 02:32:07.153447] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.721 [2024-11-29 02:32:07.153492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.721 [2024-11-29 02:32:07.153508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.721 [2024-11-29 02:32:07.158877] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.721 [2024-11-29 02:32:07.158908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.721 [2024-11-29 02:32:07.158924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.721 [2024-11-29 02:32:07.163559] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.721 [2024-11-29 02:32:07.163590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.721 [2024-11-29 02:32:07.163607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.721 [2024-11-29 02:32:07.168167] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.721 [2024-11-29 02:32:07.168196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.721 [2024-11-29 02:32:07.168228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.721 [2024-11-29 02:32:07.173277] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.721 [2024-11-29 02:32:07.173310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.721 [2024-11-29 02:32:07.173329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.721 [2024-11-29 02:32:07.177945] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.721 [2024-11-29 02:32:07.177974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.721 [2024-11-29 02:32:07.178006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.721 [2024-11-29 02:32:07.182410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.721 [2024-11-29 02:32:07.182443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.721 [2024-11-29 02:32:07.182461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.721 [2024-11-29 02:32:07.187143] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.721 [2024-11-29 02:32:07.187173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.721 [2024-11-29 02:32:07.187189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.721 [2024-11-29 02:32:07.192202] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.721 [2024-11-29 02:32:07.192236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.721 [2024-11-29 02:32:07.192254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.721 [2024-11-29 02:32:07.197188] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.721 [2024-11-29 02:32:07.197221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.721 [2024-11-29 02:32:07.197239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.721 [2024-11-29 02:32:07.201930] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.721 [2024-11-29 02:32:07.201960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.721 [2024-11-29 02:32:07.201977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.721 [2024-11-29 02:32:07.207322] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.721 [2024-11-29 02:32:07.207353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.721 [2024-11-29 02:32:07.207401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.721 [2024-11-29 02:32:07.212801] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.721 [2024-11-29 02:32:07.212835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.721 [2024-11-29 02:32:07.212854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.721 [2024-11-29 02:32:07.217784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.721 [2024-11-29 02:32:07.217814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.721 [2024-11-29 02:32:07.217831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.721 [2024-11-29 02:32:07.222683] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.721 [2024-11-29 02:32:07.222713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.721 [2024-11-29 02:32:07.222745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.721 [2024-11-29 02:32:07.227808] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.721 [2024-11-29 02:32:07.227838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.721 [2024-11-29 02:32:07.227855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.721 [2024-11-29 02:32:07.232793] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.721 [2024-11-29 02:32:07.232823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.721 [2024-11-29 02:32:07.232853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.721 [2024-11-29 02:32:07.238183] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.722 [2024-11-29 02:32:07.238231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.722 [2024-11-29 02:32:07.238251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.722 [2024-11-29 02:32:07.243636] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.722 [2024-11-29 02:32:07.243667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.722 [2024-11-29 02:32:07.243700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.722 [2024-11-29 02:32:07.248825] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.722 [2024-11-29 02:32:07.248856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.722 [2024-11-29 02:32:07.248873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.722 [2024-11-29 02:32:07.253491] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.722 [2024-11-29 02:32:07.253529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.722 [2024-11-29 02:32:07.253547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.722 [2024-11-29 02:32:07.259318] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.722 [2024-11-29 02:32:07.259365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.722 [2024-11-29 02:32:07.259385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.722 [2024-11-29 02:32:07.265317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.722 [2024-11-29 02:32:07.265364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.722 [2024-11-29 02:32:07.265382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.722 [2024-11-29 02:32:07.270657] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.722 [2024-11-29 02:32:07.270688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.722 [2024-11-29 02:32:07.270705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.722 [2024-11-29 02:32:07.275705] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.722 [2024-11-29 02:32:07.275736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.722 [2024-11-29 02:32:07.275754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.722 [2024-11-29 02:32:07.280493] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.722 [2024-11-29 02:32:07.280541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.722 [2024-11-29 02:32:07.280558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.722 [2024-11-29 02:32:07.285114] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.722 [2024-11-29 02:32:07.285144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.722 [2024-11-29 02:32:07.285160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.722 [2024-11-29 02:32:07.290100] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.722 [2024-11-29 02:32:07.290145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.722 [2024-11-29 02:32:07.290160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.722 [2024-11-29 02:32:07.295059] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.722 [2024-11-29 02:32:07.295087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.722 [2024-11-29 02:32:07.295103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.722 [2024-11-29 02:32:07.300051] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.722 [2024-11-29 02:32:07.300082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.722 [2024-11-29 02:32:07.300098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.722 [2024-11-29 02:32:07.305855] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.722 [2024-11-29 02:32:07.305885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.722 [2024-11-29 02:32:07.305902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.722 [2024-11-29 02:32:07.309832] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.722 [2024-11-29 02:32:07.309861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.722 [2024-11-29 02:32:07.309877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.722 [2024-11-29 02:32:07.313890] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.722 [2024-11-29 02:32:07.313920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.722 [2024-11-29 02:32:07.313936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.722 [2024-11-29 02:32:07.317970] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.722 [2024-11-29 02:32:07.318000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.722 [2024-11-29 02:32:07.318016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.722 [2024-11-29 02:32:07.321967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.722 [2024-11-29 02:32:07.321996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.722 [2024-11-29 02:32:07.322012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.722 [2024-11-29 02:32:07.326890] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.722 [2024-11-29 02:32:07.326920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.722 [2024-11-29 02:32:07.326938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.722 [2024-11-29 02:32:07.333805] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.722 [2024-11-29 02:32:07.333836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.723 [2024-11-29 02:32:07.333853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.723 [2024-11-29 02:32:07.340738] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.723 [2024-11-29 02:32:07.340768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.723 [2024-11-29 02:32:07.340790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.723 [2024-11-29 02:32:07.346961] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.723 [2024-11-29 02:32:07.346991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.723 [2024-11-29 02:32:07.347008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.723 [2024-11-29 02:32:07.352703] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.723 [2024-11-29 02:32:07.352733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.723 [2024-11-29 02:32:07.352749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.723 [2024-11-29 02:32:07.357901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.723 [2024-11-29 02:32:07.357930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.723 [2024-11-29 02:32:07.357965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.723 [2024-11-29 02:32:07.363761] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.723 [2024-11-29 02:32:07.363791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.723 [2024-11-29 02:32:07.363807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.723 [2024-11-29 02:32:07.369289] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.723 [2024-11-29 02:32:07.369319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.723 [2024-11-29 02:32:07.369336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.723 [2024-11-29 02:32:07.375425] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.723 [2024-11-29 02:32:07.375455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.723 [2024-11-29 02:32:07.375472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.723 [2024-11-29 02:32:07.380855] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.723 [2024-11-29 02:32:07.380886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.723 [2024-11-29 02:32:07.380904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.723 [2024-11-29 02:32:07.386506] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.723 [2024-11-29 02:32:07.386537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.723 [2024-11-29 02:32:07.386554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.723 [2024-11-29 02:32:07.391818] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.723 [2024-11-29 02:32:07.391850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.723 [2024-11-29 02:32:07.391867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.723 [2024-11-29 02:32:07.397460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.723 [2024-11-29 02:32:07.397490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.723 [2024-11-29 02:32:07.397507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.985 [2024-11-29 02:32:07.402056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.985 [2024-11-29 02:32:07.402087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.985 [2024-11-29 02:32:07.402104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.985 [2024-11-29 02:32:07.407282] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.985 [2024-11-29 02:32:07.407312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.985 [2024-11-29 02:32:07.407329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.985 [2024-11-29 02:32:07.412512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.985 [2024-11-29 02:32:07.412542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.985 [2024-11-29 02:32:07.412559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.985 [2024-11-29 02:32:07.417335] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.985 [2024-11-29 02:32:07.417364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.985 [2024-11-29 02:32:07.417380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.985 [2024-11-29 02:32:07.422488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.985 [2024-11-29 02:32:07.422518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.985 [2024-11-29 02:32:07.422535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.985 [2024-11-29 02:32:07.427298] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.985 [2024-11-29 02:32:07.427328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.985 [2024-11-29 02:32:07.427344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.985 [2024-11-29 02:32:07.432110] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.985 [2024-11-29 02:32:07.432140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.985 [2024-11-29 02:32:07.432164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.985 [2024-11-29 02:32:07.437420] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.985 [2024-11-29 02:32:07.437450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.985 [2024-11-29 02:32:07.437467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.985 [2024-11-29 02:32:07.443105] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.985 [2024-11-29 02:32:07.443135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.985 [2024-11-29 02:32:07.443153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.985 [2024-11-29 02:32:07.448154] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.985 [2024-11-29 02:32:07.448184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.985 [2024-11-29 02:32:07.448201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.985 [2024-11-29 02:32:07.452929] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.985 [2024-11-29 02:32:07.452959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.985 [2024-11-29 02:32:07.452975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.986 [2024-11-29 02:32:07.457663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.986 [2024-11-29 02:32:07.457693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.986 [2024-11-29 02:32:07.457710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.986 [2024-11-29 02:32:07.462544] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.986 [2024-11-29 02:32:07.462574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.986 [2024-11-29 02:32:07.462590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.986 [2024-11-29 02:32:07.467372] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.986 [2024-11-29 02:32:07.467410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.986 [2024-11-29 02:32:07.467428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.986 [2024-11-29 02:32:07.471987] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.986 [2024-11-29 02:32:07.472014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.986 [2024-11-29 02:32:07.472046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.986 [2024-11-29 02:32:07.476797] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.986 [2024-11-29 02:32:07.476832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.986 [2024-11-29 02:32:07.476849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.986 [2024-11-29 02:32:07.481998] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.986 [2024-11-29 02:32:07.482028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.986 [2024-11-29 02:32:07.482046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.986 [2024-11-29 02:32:07.487477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.986 [2024-11-29 02:32:07.487508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.986 [2024-11-29 02:32:07.487525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.986 [2024-11-29 02:32:07.493101] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.986 [2024-11-29 02:32:07.493146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.986 [2024-11-29 02:32:07.493164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.986 [2024-11-29 02:32:07.498122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.986 [2024-11-29 02:32:07.498168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.986 [2024-11-29 02:32:07.498186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.986 [2024-11-29 02:32:07.501313] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.986 [2024-11-29 02:32:07.501357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.986 [2024-11-29 02:32:07.501377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.986 [2024-11-29 02:32:07.506829] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.986 [2024-11-29 02:32:07.506863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.986 [2024-11-29 02:32:07.506883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.986 [2024-11-29 02:32:07.512615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.986 [2024-11-29 02:32:07.512646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.986 [2024-11-29 02:32:07.512663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.986 [2024-11-29 02:32:07.517452] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.986 [2024-11-29 02:32:07.517498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.986 [2024-11-29 02:32:07.517518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.986 [2024-11-29 02:32:07.521731] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.986 [2024-11-29 02:32:07.521760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.986 [2024-11-29 02:32:07.521777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.986 [2024-11-29 02:32:07.525679] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.986 [2024-11-29 02:32:07.525708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.986 [2024-11-29 02:32:07.525724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.986 [2024-11-29 02:32:07.529570] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.986 [2024-11-29 02:32:07.529598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.986 [2024-11-29 02:32:07.529614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.986 [2024-11-29 02:32:07.533891] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.986 [2024-11-29 02:32:07.533921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.986 [2024-11-29 02:32:07.533938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.986 [2024-11-29 02:32:07.536617] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.986 [2024-11-29 02:32:07.536645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.986 [2024-11-29 02:32:07.536676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.986 [2024-11-29 02:32:07.540203] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.986 [2024-11-29 02:32:07.540230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.986 [2024-11-29 02:32:07.540246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.986 [2024-11-29 02:32:07.544587] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.986 [2024-11-29 02:32:07.544616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.987 [2024-11-29 02:32:07.544633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.987 [2024-11-29 02:32:07.549016] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.987 [2024-11-29 02:32:07.549045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.987 [2024-11-29 02:32:07.549060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.987 [2024-11-29 02:32:07.554510] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.987 [2024-11-29 02:32:07.554554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.987 [2024-11-29 02:32:07.554577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.987 [2024-11-29 02:32:07.559941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.987 [2024-11-29 02:32:07.559985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.987 [2024-11-29 02:32:07.560004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.987 [2024-11-29 02:32:07.565005] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.987 [2024-11-29 02:32:07.565034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.987 [2024-11-29 02:32:07.565064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.987 [2024-11-29 02:32:07.570684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.987 [2024-11-29 02:32:07.570714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.987 [2024-11-29 02:32:07.570730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.987 [2024-11-29 02:32:07.576378] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.987 [2024-11-29 02:32:07.576417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.987 [2024-11-29 02:32:07.576435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.987 [2024-11-29 02:32:07.582347] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.987 [2024-11-29 02:32:07.582398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.987 [2024-11-29 02:32:07.582416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.987 [2024-11-29 02:32:07.588077] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.987 [2024-11-29 02:32:07.588121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.987 [2024-11-29 02:32:07.588137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.987 [2024-11-29 02:32:07.594186] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.987 [2024-11-29 02:32:07.594222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.987 [2024-11-29 02:32:07.594241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.987 [2024-11-29 02:32:07.599996] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.987 [2024-11-29 02:32:07.600030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.987 [2024-11-29 02:32:07.600049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.987 [2024-11-29 02:32:07.605558] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.987 [2024-11-29 02:32:07.605595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.987 [2024-11-29 02:32:07.605626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.987 [2024-11-29 02:32:07.610578] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.987 [2024-11-29 02:32:07.610622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.987 [2024-11-29 02:32:07.610638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.987 [2024-11-29 02:32:07.616369] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.987 [2024-11-29 02:32:07.616408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.987 [2024-11-29 02:32:07.616427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.987 [2024-11-29 02:32:07.621600] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.987 [2024-11-29 02:32:07.621630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.987 [2024-11-29 02:32:07.621664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.987 [2024-11-29 02:32:07.626541] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.987 [2024-11-29 02:32:07.626571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.987 [2024-11-29 02:32:07.626588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.987 [2024-11-29 02:32:07.631437] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.987 [2024-11-29 02:32:07.631466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.987 [2024-11-29 02:32:07.631483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.987 [2024-11-29 02:32:07.636414] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.987 [2024-11-29 02:32:07.636468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.987 [2024-11-29 02:32:07.636485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.987 [2024-11-29 02:32:07.641389] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.987 [2024-11-29 02:32:07.641442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.987 [2024-11-29 02:32:07.641458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.987 [2024-11-29 02:32:07.646379] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.987 [2024-11-29 02:32:07.646431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.987 [2024-11-29 02:32:07.646465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.988 [2024-11-29 02:32:07.651362] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.988 [2024-11-29 02:32:07.651390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.988 [2024-11-29 02:32:07.651433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.988 [2024-11-29 02:32:07.656302] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.988 [2024-11-29 02:32:07.656330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.988 [2024-11-29 02:32:07.656346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.988 [2024-11-29 02:32:07.661285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:03.988 [2024-11-29 02:32:07.661315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.988 [2024-11-29 02:32:07.661332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.249 [2024-11-29 02:32:07.666463] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.249 [2024-11-29 02:32:07.666493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.249 [2024-11-29 02:32:07.666509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.249 [2024-11-29 02:32:07.671194] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.249 [2024-11-29 02:32:07.671224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.249 [2024-11-29 02:32:07.671241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.249 [2024-11-29 02:32:07.676619] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.249 [2024-11-29 02:32:07.676649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.249 [2024-11-29 02:32:07.676665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.249 [2024-11-29 02:32:07.681830] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.249 [2024-11-29 02:32:07.681859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.249 [2024-11-29 02:32:07.681875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.249 [2024-11-29 02:32:07.687236] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.249 [2024-11-29 02:32:07.687266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.249 [2024-11-29 02:32:07.687282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.249 [2024-11-29 02:32:07.693310] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.249 [2024-11-29 02:32:07.693364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.249 [2024-11-29 02:32:07.693384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.249 [2024-11-29 02:32:07.700206] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.249 [2024-11-29 02:32:07.700236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.249 [2024-11-29 02:32:07.700253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.249 [2024-11-29 02:32:07.707527] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.249 [2024-11-29 02:32:07.707558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.249 [2024-11-29 02:32:07.707576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.249 [2024-11-29 02:32:07.714980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.249 [2024-11-29 02:32:07.715011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.715028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.722382] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.722420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.722452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.729758] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.729789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.729806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.737379] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.737417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.737435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.744086] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.744116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.744133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.750378] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.750415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.750434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.755494] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.755525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.755542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.761047] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.761092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.761109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.766527] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.766557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.766574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.771586] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.771616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.771633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.776729] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.776759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.776776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.781661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.781691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.781722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.787057] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.787088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.787105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.792131] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.792175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.792192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.796986] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.797016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.797054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.801978] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.802022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.802038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.806903] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.806948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.806964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.811609] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.811640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.811657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.817580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.817610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.817627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.821350] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.821400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.821420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.825071] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.825100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.825117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.828925] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.828970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.828987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.832558] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.832586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.832603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.836306] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.836340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.836376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.840072] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.840116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.840133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.843666] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.843694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.843711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.847241] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.847270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.250 [2024-11-29 02:32:07.847287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.250 [2024-11-29 02:32:07.850757] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.250 [2024-11-29 02:32:07.850785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.251 [2024-11-29 02:32:07.850801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.251 [2024-11-29 02:32:07.854210] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.251 [2024-11-29 02:32:07.854237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.251 [2024-11-29 02:32:07.854253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.251 [2024-11-29 02:32:07.857697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.251 [2024-11-29 02:32:07.857725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.251 [2024-11-29 02:32:07.857741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.251 [2024-11-29 02:32:07.862169] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.251 [2024-11-29 02:32:07.862198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.251 [2024-11-29 02:32:07.862214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.251 [2024-11-29 02:32:07.865844] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.251 [2024-11-29 02:32:07.865873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.251 [2024-11-29 02:32:07.865889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.251 [2024-11-29 02:32:07.869852] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.251 [2024-11-29 02:32:07.869880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.251 [2024-11-29 02:32:07.869896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.251 [2024-11-29 02:32:07.873856] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.251 [2024-11-29 02:32:07.873884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.251 [2024-11-29 02:32:07.873899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.251 [2024-11-29 02:32:07.878621] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.251 [2024-11-29 02:32:07.878650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.251 [2024-11-29 02:32:07.878666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.251 [2024-11-29 02:32:07.882653] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.251 [2024-11-29 02:32:07.882682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.251 [2024-11-29 02:32:07.882699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.251 [2024-11-29 02:32:07.886560] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.251 [2024-11-29 02:32:07.886588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.251 [2024-11-29 02:32:07.886605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.251 [2024-11-29 02:32:07.890619] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.251 [2024-11-29 02:32:07.890649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.251 [2024-11-29 02:32:07.890666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.251 [2024-11-29 02:32:07.893899] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.251 [2024-11-29 02:32:07.893942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.251 [2024-11-29 02:32:07.893959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.251 [2024-11-29 02:32:07.898490] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.251 [2024-11-29 02:32:07.898520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.251 [2024-11-29 02:32:07.898537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.251 [2024-11-29 02:32:07.903915] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.251 [2024-11-29 02:32:07.903959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.251 [2024-11-29 02:32:07.903981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.251 [2024-11-29 02:32:07.908712] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.251 [2024-11-29 02:32:07.908758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.251 [2024-11-29 02:32:07.908777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.251 [2024-11-29 02:32:07.914538] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.251 [2024-11-29 02:32:07.914568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.251 [2024-11-29 02:32:07.914585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.251 [2024-11-29 02:32:07.921406] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.251 [2024-11-29 02:32:07.921434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.251 [2024-11-29 02:32:07.921450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.513 [2024-11-29 02:32:07.928538] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.513 [2024-11-29 02:32:07.928584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.513 [2024-11-29 02:32:07.928602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.513 [2024-11-29 02:32:07.935655] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.513 [2024-11-29 02:32:07.935702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.513 [2024-11-29 02:32:07.935719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.513 [2024-11-29 02:32:07.943906] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.513 [2024-11-29 02:32:07.943941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.513 [2024-11-29 02:32:07.943960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.513 [2024-11-29 02:32:07.950197] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.513 [2024-11-29 02:32:07.950231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.513 [2024-11-29 02:32:07.950250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.513 [2024-11-29 02:32:07.955449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.513 [2024-11-29 02:32:07.955479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.513 [2024-11-29 02:32:07.955496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.513 [2024-11-29 02:32:07.959760] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.513 [2024-11-29 02:32:07.959805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.513 [2024-11-29 02:32:07.959822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.513 [2024-11-29 02:32:07.963520] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.513 [2024-11-29 02:32:07.963550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.513 [2024-11-29 02:32:07.963566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.513 [2024-11-29 02:32:07.967584] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.513 [2024-11-29 02:32:07.967613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.513 [2024-11-29 02:32:07.967630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.513 [2024-11-29 02:32:07.971450] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.513 [2024-11-29 02:32:07.971478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.513 [2024-11-29 02:32:07.971495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.513 [2024-11-29 02:32:07.975346] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.513 [2024-11-29 02:32:07.975374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.513 [2024-11-29 02:32:07.975391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.513 [2024-11-29 02:32:07.979034] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.513 [2024-11-29 02:32:07.979063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.513 [2024-11-29 02:32:07.979079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.513 [2024-11-29 02:32:07.983029] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.513 [2024-11-29 02:32:07.983057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.513 [2024-11-29 02:32:07.983088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.513 [2024-11-29 02:32:07.987192] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.513 [2024-11-29 02:32:07.987221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.513 [2024-11-29 02:32:07.987238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.513 [2024-11-29 02:32:07.991045] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.513 [2024-11-29 02:32:07.991073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.513 [2024-11-29 02:32:07.991095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.513 [2024-11-29 02:32:07.994995] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.513 [2024-11-29 02:32:07.995023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.513 [2024-11-29 02:32:07.995040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.513 [2024-11-29 02:32:07.999030] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.513 [2024-11-29 02:32:07.999057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.513 [2024-11-29 02:32:07.999073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.513 [2024-11-29 02:32:08.002929] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.513 [2024-11-29 02:32:08.002957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.513 [2024-11-29 02:32:08.002973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.513 [2024-11-29 02:32:08.007031] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.513 [2024-11-29 02:32:08.007059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.513 [2024-11-29 02:32:08.007075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.513 [2024-11-29 02:32:08.010993] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.513 [2024-11-29 02:32:08.011022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.513 [2024-11-29 02:32:08.011039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.513 [2024-11-29 02:32:08.014902] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.513 [2024-11-29 02:32:08.014930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.513 [2024-11-29 02:32:08.014946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.513 [2024-11-29 02:32:08.019018] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.513 [2024-11-29 02:32:08.019046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.513 [2024-11-29 02:32:08.019062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.513 [2024-11-29 02:32:08.022953] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.513 [2024-11-29 02:32:08.022980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.513 [2024-11-29 02:32:08.022996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.026754] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.026787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.026803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.030506] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.030535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.030551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.034562] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.034590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.034606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.038460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.038489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.038506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.042222] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.042254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.042272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.046077] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.046106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.046122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.049855] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.049883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.049900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.053848] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.053876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.053892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.057625] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.057653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.057670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.062160] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.062188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.062204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.065975] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.066002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.066018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.069960] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.069987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.070003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.074067] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.074096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.074112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.078424] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.078454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.078471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.082742] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.082776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.082795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.088460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.088505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.088522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.094130] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.094160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.094176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.099909] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.099954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.099976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.105408] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.105454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.105474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.111129] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.111173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.111188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.116812] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.116847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.116881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.120948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.120992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.121009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.124772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.124802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.124818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.128712] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.128741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.128758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.132718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.132747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.132763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.136620] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.136650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.136666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.514 [2024-11-29 02:32:08.140503] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.514 [2024-11-29 02:32:08.140539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.514 [2024-11-29 02:32:08.140556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.515 [2024-11-29 02:32:08.144792] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.515 [2024-11-29 02:32:08.144821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.515 [2024-11-29 02:32:08.144837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.515 [2024-11-29 02:32:08.149576] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.515 [2024-11-29 02:32:08.149618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.515 [2024-11-29 02:32:08.149634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.515 [2024-11-29 02:32:08.154777] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.515 [2024-11-29 02:32:08.154806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.515 [2024-11-29 02:32:08.154822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.515 [2024-11-29 02:32:08.159532] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.515 [2024-11-29 02:32:08.159576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.515 [2024-11-29 02:32:08.159594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.515 [2024-11-29 02:32:08.165358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.515 [2024-11-29 02:32:08.165388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.515 [2024-11-29 02:32:08.165414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.515 [2024-11-29 02:32:08.172384] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.515 [2024-11-29 02:32:08.172441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.515 [2024-11-29 02:32:08.172459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.515 [2024-11-29 02:32:08.179904] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2478bb0) 00:27:04.515 [2024-11-29 02:32:08.179935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.515 [2024-11-29 02:32:08.179952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.515 00:27:04.515 Latency(us) 00:27:04.515 [2024-11-29T01:32:08.196Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:04.515 [2024-11-29T01:32:08.196Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:27:04.515 nvme0n1 : 2.00 6123.81 765.48 0.00 0.00 2608.32 564.34 10582.85 00:27:04.515 [2024-11-29T01:32:08.196Z] =================================================================================================================== 00:27:04.515 [2024-11-29T01:32:08.196Z] Total : 6123.81 765.48 0.00 0.00 2608.32 564.34 10582.85 00:27:04.515 0 00:27:04.775 02:32:08 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:04.775 02:32:08 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:04.775 02:32:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:04.775 02:32:08 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:04.775 | .driver_specific 00:27:04.775 | .nvme_error 00:27:04.775 | .status_code 00:27:04.775 | .command_transient_transport_error' 00:27:05.036 02:32:08 -- host/digest.sh@71 -- # (( 395 > 0 )) 00:27:05.036 02:32:08 -- host/digest.sh@73 -- # killprocess 231073 00:27:05.036 02:32:08 -- common/autotest_common.sh@936 -- # '[' -z 231073 ']' 00:27:05.036 02:32:08 -- common/autotest_common.sh@940 -- # kill -0 231073 00:27:05.036 02:32:08 -- common/autotest_common.sh@941 -- # uname 00:27:05.036 02:32:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:05.036 02:32:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 231073 00:27:05.036 02:32:08 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:05.036 02:32:08 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:05.036 02:32:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 231073' 00:27:05.036 killing process with pid 231073 00:27:05.036 02:32:08 -- common/autotest_common.sh@955 -- # kill 231073 00:27:05.036 Received shutdown signal, test time was about 2.000000 seconds 00:27:05.036 00:27:05.036 Latency(us) 00:27:05.036 [2024-11-29T01:32:08.717Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:05.036 [2024-11-29T01:32:08.717Z] =================================================================================================================== 00:27:05.036 [2024-11-29T01:32:08.717Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:05.036 02:32:08 -- common/autotest_common.sh@960 -- # wait 231073 00:27:05.295 02:32:08 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:27:05.295 02:32:08 -- host/digest.sh@54 -- # local rw bs qd 00:27:05.295 02:32:08 -- host/digest.sh@56 -- # rw=randwrite 00:27:05.295 02:32:08 -- host/digest.sh@56 -- # bs=4096 00:27:05.295 02:32:08 -- host/digest.sh@56 -- # qd=128 00:27:05.295 02:32:08 -- host/digest.sh@58 -- # bperfpid=231625 00:27:05.295 02:32:08 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:27:05.295 02:32:08 -- host/digest.sh@60 -- # waitforlisten 231625 /var/tmp/bperf.sock 00:27:05.295 02:32:08 -- common/autotest_common.sh@829 -- # '[' -z 231625 ']' 00:27:05.295 02:32:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:05.295 02:32:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:05.295 02:32:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:05.295 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:05.295 02:32:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:05.295 02:32:08 -- common/autotest_common.sh@10 -- # set +x 00:27:05.295 [2024-11-29 02:32:08.825016] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:05.295 [2024-11-29 02:32:08.825091] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid231625 ] 00:27:05.295 EAL: No free 2048 kB hugepages reported on node 1 00:27:05.295 [2024-11-29 02:32:08.883943] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:05.556 [2024-11-29 02:32:08.997942] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:06.492 02:32:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:06.492 02:32:09 -- common/autotest_common.sh@862 -- # return 0 00:27:06.492 02:32:09 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:06.492 02:32:09 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:06.492 02:32:10 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:06.492 02:32:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:06.492 02:32:10 -- common/autotest_common.sh@10 -- # set +x 00:27:06.492 02:32:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:06.492 02:32:10 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:06.492 02:32:10 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:07.063 nvme0n1 00:27:07.063 02:32:10 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:27:07.063 02:32:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:07.063 02:32:10 -- common/autotest_common.sh@10 -- # set +x 00:27:07.063 02:32:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:07.063 02:32:10 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:07.063 02:32:10 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:07.063 Running I/O for 2 seconds... 00:27:07.063 [2024-11-29 02:32:10.657963] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190eea00 00:27:07.063 [2024-11-29 02:32:10.659724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:22871 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.063 [2024-11-29 02:32:10.659786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.063 [2024-11-29 02:32:10.669418] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e73e0 00:27:07.063 [2024-11-29 02:32:10.670472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23633 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.063 [2024-11-29 02:32:10.670520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:27:07.063 [2024-11-29 02:32:10.681886] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e1710 00:27:07.063 [2024-11-29 02:32:10.682952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:6637 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.063 [2024-11-29 02:32:10.682986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:27:07.063 [2024-11-29 02:32:10.694239] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190ea248 00:27:07.063 [2024-11-29 02:32:10.695307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:20819 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.063 [2024-11-29 02:32:10.695341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:27:07.063 [2024-11-29 02:32:10.706685] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190de8a8 00:27:07.063 [2024-11-29 02:32:10.708046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:20331 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.063 [2024-11-29 02:32:10.708076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:07.063 [2024-11-29 02:32:10.719146] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190ed0b0 00:27:07.063 [2024-11-29 02:32:10.720281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:24215 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.063 [2024-11-29 02:32:10.720310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:27:07.063 [2024-11-29 02:32:10.731455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e84c0 00:27:07.063 [2024-11-29 02:32:10.732536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:4641 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.063 [2024-11-29 02:32:10.732565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:003f p:0 m:0 dnr:0 00:27:07.322 [2024-11-29 02:32:10.743427] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190df988 00:27:07.322 [2024-11-29 02:32:10.744549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:604 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.322 [2024-11-29 02:32:10.744578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:003e p:0 m:0 dnr:0 00:27:07.322 [2024-11-29 02:32:10.755555] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190ecc78 00:27:07.322 [2024-11-29 02:32:10.756685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:1321 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.322 [2024-11-29 02:32:10.756718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:003d p:0 m:0 dnr:0 00:27:07.322 [2024-11-29 02:32:10.768252] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e27f0 00:27:07.322 [2024-11-29 02:32:10.769347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:2536 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.322 [2024-11-29 02:32:10.769390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:003c p:0 m:0 dnr:0 00:27:07.322 [2024-11-29 02:32:10.780739] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f3a28 00:27:07.323 [2024-11-29 02:32:10.781541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:9885 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.323 [2024-11-29 02:32:10.781571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:27:07.323 [2024-11-29 02:32:10.793523] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190df550 00:27:07.323 [2024-11-29 02:32:10.794569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:2871 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.323 [2024-11-29 02:32:10.794599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:27:07.323 [2024-11-29 02:32:10.805935] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190df550 00:27:07.323 [2024-11-29 02:32:10.807002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:10953 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.323 [2024-11-29 02:32:10.807032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:27:07.323 [2024-11-29 02:32:10.818402] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190df550 00:27:07.323 [2024-11-29 02:32:10.819495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:21932 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.323 [2024-11-29 02:32:10.819524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:07.323 [2024-11-29 02:32:10.830817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190df550 00:27:07.323 [2024-11-29 02:32:10.831893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:3667 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.323 [2024-11-29 02:32:10.831931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:07.323 [2024-11-29 02:32:10.843312] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190df550 00:27:07.323 [2024-11-29 02:32:10.844406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:19905 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.323 [2024-11-29 02:32:10.844453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:07.323 [2024-11-29 02:32:10.855810] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190df550 00:27:07.323 [2024-11-29 02:32:10.856930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:17268 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.323 [2024-11-29 02:32:10.856962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:07.323 [2024-11-29 02:32:10.868288] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190df550 00:27:07.323 [2024-11-29 02:32:10.869473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:10167 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.323 [2024-11-29 02:32:10.869516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:07.323 [2024-11-29 02:32:10.880653] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190ed4e8 00:27:07.323 [2024-11-29 02:32:10.881765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:22050 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.323 [2024-11-29 02:32:10.881798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:07.323 [2024-11-29 02:32:10.893151] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190df550 00:27:07.323 [2024-11-29 02:32:10.894260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:4422 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.323 [2024-11-29 02:32:10.894291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:07.323 [2024-11-29 02:32:10.905574] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190df550 00:27:07.323 [2024-11-29 02:32:10.906720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:12100 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.323 [2024-11-29 02:32:10.906748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:07.323 [2024-11-29 02:32:10.918052] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190df550 00:27:07.323 [2024-11-29 02:32:10.919209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:4686 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.323 [2024-11-29 02:32:10.919237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:07.323 [2024-11-29 02:32:10.930405] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190df550 00:27:07.323 [2024-11-29 02:32:10.931588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:8926 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.323 [2024-11-29 02:32:10.931630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:07.323 [2024-11-29 02:32:10.942762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190df550 00:27:07.323 [2024-11-29 02:32:10.943965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:2181 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.323 [2024-11-29 02:32:10.943997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:07.323 [2024-11-29 02:32:10.955267] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190df550 00:27:07.323 [2024-11-29 02:32:10.956552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:20803 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.323 [2024-11-29 02:32:10.956596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:07.323 [2024-11-29 02:32:10.967707] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190df550 00:27:07.323 [2024-11-29 02:32:10.968959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:5673 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.323 [2024-11-29 02:32:10.968991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:07.323 [2024-11-29 02:32:10.980236] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190df550 00:27:07.323 [2024-11-29 02:32:10.981564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:21318 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.323 [2024-11-29 02:32:10.981591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:07.323 [2024-11-29 02:32:10.992792] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190df550 00:27:07.323 [2024-11-29 02:32:10.994071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:23468 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.323 [2024-11-29 02:32:10.994102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:27:07.582 [2024-11-29 02:32:11.005259] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190df550 00:27:07.582 [2024-11-29 02:32:11.006536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:362 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.582 [2024-11-29 02:32:11.006565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:07.582 [2024-11-29 02:32:11.017777] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190df550 00:27:07.582 [2024-11-29 02:32:11.019033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:18539 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.582 [2024-11-29 02:32:11.019065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:07.582 [2024-11-29 02:32:11.029584] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e23b8 00:27:07.582 [2024-11-29 02:32:11.029867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:25102 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.582 [2024-11-29 02:32:11.029897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0039 p:0 m:0 dnr:0 00:27:07.582 [2024-11-29 02:32:11.042379] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e3060 00:27:07.582 [2024-11-29 02:32:11.043352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:600 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.582 [2024-11-29 02:32:11.043384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:27:07.582 [2024-11-29 02:32:11.054564] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f35f0 00:27:07.582 [2024-11-29 02:32:11.055598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:7843 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.582 [2024-11-29 02:32:11.055642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:27:07.582 [2024-11-29 02:32:11.066917] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f4b08 00:27:07.582 [2024-11-29 02:32:11.068244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:3243 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.582 [2024-11-29 02:32:11.068277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:27:07.582 [2024-11-29 02:32:11.079192] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e88f8 00:27:07.582 [2024-11-29 02:32:11.080523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:10198 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.582 [2024-11-29 02:32:11.080549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:27:07.583 [2024-11-29 02:32:11.091905] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190eff18 00:27:07.583 [2024-11-29 02:32:11.093169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:13717 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.583 [2024-11-29 02:32:11.093201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:27:07.583 [2024-11-29 02:32:11.104115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f0bc0 00:27:07.583 [2024-11-29 02:32:11.105433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:9414 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.583 [2024-11-29 02:32:11.105460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:27:07.583 [2024-11-29 02:32:11.116504] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190df550 00:27:07.583 [2024-11-29 02:32:11.117793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:15086 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.583 [2024-11-29 02:32:11.117827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:27:07.583 [2024-11-29 02:32:11.128788] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190eee38 00:27:07.583 [2024-11-29 02:32:11.130096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:1328 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.583 [2024-11-29 02:32:11.130129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:27:07.583 [2024-11-29 02:32:11.141012] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e6300 00:27:07.583 [2024-11-29 02:32:11.142308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:10723 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.583 [2024-11-29 02:32:11.142341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:27:07.583 [2024-11-29 02:32:11.153597] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190eee38 00:27:07.583 [2024-11-29 02:32:11.154057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:11935 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.583 [2024-11-29 02:32:11.154088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:27:07.583 [2024-11-29 02:32:11.166020] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f2510 00:27:07.583 [2024-11-29 02:32:11.166653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:2474 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.583 [2024-11-29 02:32:11.166700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:07.583 [2024-11-29 02:32:11.178177] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190ed920 00:27:07.583 [2024-11-29 02:32:11.178809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:23710 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.583 [2024-11-29 02:32:11.178842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:07.583 [2024-11-29 02:32:11.190155] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e1b48 00:27:07.583 [2024-11-29 02:32:11.190749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:20781 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.583 [2024-11-29 02:32:11.190782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:07.583 [2024-11-29 02:32:11.202478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e9e10 00:27:07.583 [2024-11-29 02:32:11.203019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:20453 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.583 [2024-11-29 02:32:11.203051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:07.583 [2024-11-29 02:32:11.214854] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e1b48 00:27:07.583 [2024-11-29 02:32:11.215326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:24515 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.583 [2024-11-29 02:32:11.215357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:27:07.583 [2024-11-29 02:32:11.227080] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190ed920 00:27:07.583 [2024-11-29 02:32:11.227570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:11407 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.583 [2024-11-29 02:32:11.227598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:27:07.583 [2024-11-29 02:32:11.239306] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e0a68 00:27:07.583 [2024-11-29 02:32:11.239721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:24787 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.583 [2024-11-29 02:32:11.239753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:27:07.583 [2024-11-29 02:32:11.251511] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e6b70 00:27:07.583 [2024-11-29 02:32:11.251876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:9027 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.583 [2024-11-29 02:32:11.251907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:27:07.841 [2024-11-29 02:32:11.263848] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e1f80 00:27:07.841 [2024-11-29 02:32:11.264208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:3727 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.842 [2024-11-29 02:32:11.264245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:27:07.842 [2024-11-29 02:32:11.276196] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f1ca0 00:27:07.842 [2024-11-29 02:32:11.276604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:12647 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.842 [2024-11-29 02:32:11.276633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:27:07.842 [2024-11-29 02:32:11.288482] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e1b48 00:27:07.842 [2024-11-29 02:32:11.288924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:929 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.842 [2024-11-29 02:32:11.288956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:27:07.842 [2024-11-29 02:32:11.300831] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e1f80 00:27:07.842 [2024-11-29 02:32:11.301324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:5202 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.842 [2024-11-29 02:32:11.301356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:27:07.842 [2024-11-29 02:32:11.313221] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f1ca0 00:27:07.842 [2024-11-29 02:32:11.313777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:2006 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.842 [2024-11-29 02:32:11.313809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:27:07.842 [2024-11-29 02:32:11.325478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e27f0 00:27:07.842 [2024-11-29 02:32:11.326848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:12152 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.842 [2024-11-29 02:32:11.326881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:27:07.842 [2024-11-29 02:32:11.337830] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e27f0 00:27:07.842 [2024-11-29 02:32:11.338944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:11220 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.842 [2024-11-29 02:32:11.338976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:27:07.842 [2024-11-29 02:32:11.350310] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e27f0 00:27:07.842 [2024-11-29 02:32:11.351484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:17821 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.842 [2024-11-29 02:32:11.351526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:27:07.842 [2024-11-29 02:32:11.362694] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e27f0 00:27:07.842 [2024-11-29 02:32:11.363833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:1993 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.842 [2024-11-29 02:32:11.363866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:27:07.842 [2024-11-29 02:32:11.375066] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e27f0 00:27:07.842 [2024-11-29 02:32:11.376221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:19714 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.842 [2024-11-29 02:32:11.376252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:27:07.842 [2024-11-29 02:32:11.387484] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e27f0 00:27:07.842 [2024-11-29 02:32:11.388672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:21786 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.842 [2024-11-29 02:32:11.388698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:27:07.842 [2024-11-29 02:32:11.399832] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e27f0 00:27:07.842 [2024-11-29 02:32:11.401008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:20123 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.842 [2024-11-29 02:32:11.401039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:27:07.842 [2024-11-29 02:32:11.413088] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f5378 00:27:07.842 [2024-11-29 02:32:11.414413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17170 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.842 [2024-11-29 02:32:11.414459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:27:07.842 [2024-11-29 02:32:11.425001] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e0ea0 00:27:07.842 [2024-11-29 02:32:11.425885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:54 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.842 [2024-11-29 02:32:11.425916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:27:07.842 [2024-11-29 02:32:11.437358] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e12d8 00:27:07.842 [2024-11-29 02:32:11.438552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:13970 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.842 [2024-11-29 02:32:11.438580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:27:07.842 [2024-11-29 02:32:11.449498] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e9e10 00:27:07.842 [2024-11-29 02:32:11.450671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:23990 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.842 [2024-11-29 02:32:11.450699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:27:07.842 [2024-11-29 02:32:11.462091] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e01f8 00:27:07.842 [2024-11-29 02:32:11.463119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:22724 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.842 [2024-11-29 02:32:11.463150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:27:07.842 [2024-11-29 02:32:11.474605] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e01f8 00:27:07.842 [2024-11-29 02:32:11.475774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:3383 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.842 [2024-11-29 02:32:11.475806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:07.842 [2024-11-29 02:32:11.487061] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e01f8 00:27:07.842 [2024-11-29 02:32:11.488282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:1224 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.842 [2024-11-29 02:32:11.488314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:07.842 [2024-11-29 02:32:11.499519] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e01f8 00:27:07.842 [2024-11-29 02:32:11.500737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:23112 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.842 [2024-11-29 02:32:11.500769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:07.842 [2024-11-29 02:32:11.511973] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e01f8 00:27:07.842 [2024-11-29 02:32:11.513161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:5220 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.843 [2024-11-29 02:32:11.513193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:08.102 [2024-11-29 02:32:11.524411] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190eea00 00:27:08.102 [2024-11-29 02:32:11.525618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:24598 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.102 [2024-11-29 02:32:11.525646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:08.102 [2024-11-29 02:32:11.536786] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190eea00 00:27:08.102 [2024-11-29 02:32:11.538026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:19385 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.102 [2024-11-29 02:32:11.538057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:08.102 [2024-11-29 02:32:11.549294] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190eea00 00:27:08.102 [2024-11-29 02:32:11.550523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:13979 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.102 [2024-11-29 02:32:11.550566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:08.102 [2024-11-29 02:32:11.561863] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190eea00 00:27:08.102 [2024-11-29 02:32:11.563108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:13290 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.102 [2024-11-29 02:32:11.563140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:08.102 [2024-11-29 02:32:11.574419] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190eea00 00:27:08.102 [2024-11-29 02:32:11.575667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:4821 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.102 [2024-11-29 02:32:11.575694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:08.102 [2024-11-29 02:32:11.586768] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190eea00 00:27:08.102 [2024-11-29 02:32:11.588051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:5332 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.102 [2024-11-29 02:32:11.588088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:27:08.102 [2024-11-29 02:32:11.599263] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190eea00 00:27:08.102 [2024-11-29 02:32:11.600572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:21993 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.102 [2024-11-29 02:32:11.600614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:08.102 [2024-11-29 02:32:11.611772] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190eea00 00:27:08.102 [2024-11-29 02:32:11.613089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:17849 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.102 [2024-11-29 02:32:11.613120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:08.102 [2024-11-29 02:32:11.624249] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190eea00 00:27:08.102 [2024-11-29 02:32:11.625573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:1891 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.102 [2024-11-29 02:32:11.625600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:27:08.102 [2024-11-29 02:32:11.636857] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190eea00 00:27:08.102 [2024-11-29 02:32:11.638481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:10485 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.102 [2024-11-29 02:32:11.638510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:27:08.102 [2024-11-29 02:32:11.650148] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190eea00 00:27:08.102 [2024-11-29 02:32:11.651875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:3674 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.102 [2024-11-29 02:32:11.651907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:27:08.102 [2024-11-29 02:32:11.662723] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190df988 00:27:08.102 [2024-11-29 02:32:11.664025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:11944 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.102 [2024-11-29 02:32:11.664068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.102 [2024-11-29 02:32:11.674965] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190de8a8 00:27:08.102 [2024-11-29 02:32:11.675957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:13732 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.102 [2024-11-29 02:32:11.675990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:08.102 [2024-11-29 02:32:11.687290] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e5ec8 00:27:08.102 [2024-11-29 02:32:11.688199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:13930 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.102 [2024-11-29 02:32:11.688228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:27:08.102 [2024-11-29 02:32:11.699455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f7da8 00:27:08.102 [2024-11-29 02:32:11.700346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:2824 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.102 [2024-11-29 02:32:11.700377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:08.102 [2024-11-29 02:32:11.711700] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f96f8 00:27:08.102 [2024-11-29 02:32:11.712570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14331 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.102 [2024-11-29 02:32:11.712598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:08.102 [2024-11-29 02:32:11.723922] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f1868 00:27:08.102 [2024-11-29 02:32:11.724748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:8554 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.102 [2024-11-29 02:32:11.724780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:08.102 [2024-11-29 02:32:11.736207] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f6cc8 00:27:08.103 [2024-11-29 02:32:11.737034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:6897 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.103 [2024-11-29 02:32:11.737071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:08.103 [2024-11-29 02:32:11.748458] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f8e88 00:27:08.103 [2024-11-29 02:32:11.749232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:14845 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.103 [2024-11-29 02:32:11.749264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:27:08.103 [2024-11-29 02:32:11.760714] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e5658 00:27:08.103 [2024-11-29 02:32:11.761523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:9578 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.103 [2024-11-29 02:32:11.761553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:27:08.103 [2024-11-29 02:32:11.773021] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f7100 00:27:08.103 [2024-11-29 02:32:11.773724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:6260 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.103 [2024-11-29 02:32:11.773782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:27:08.363 [2024-11-29 02:32:11.785476] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e1b48 00:27:08.363 [2024-11-29 02:32:11.786256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:1464 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.363 [2024-11-29 02:32:11.786289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:27:08.363 [2024-11-29 02:32:11.797641] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f96f8 00:27:08.363 [2024-11-29 02:32:11.798445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:14897 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.363 [2024-11-29 02:32:11.798473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:27:08.363 [2024-11-29 02:32:11.809748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e6b70 00:27:08.363 [2024-11-29 02:32:11.811535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:16152 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.363 [2024-11-29 02:32:11.811564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:27:08.363 [2024-11-29 02:32:11.821955] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f7970 00:27:08.363 [2024-11-29 02:32:11.823671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:21622 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.363 [2024-11-29 02:32:11.823700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:27:08.363 [2024-11-29 02:32:11.834778] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e1b48 00:27:08.363 [2024-11-29 02:32:11.836407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:348 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.363 [2024-11-29 02:32:11.836457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:27:08.363 [2024-11-29 02:32:11.847237] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f35f0 00:27:08.363 [2024-11-29 02:32:11.849058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:18832 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.363 [2024-11-29 02:32:11.849089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:27:08.363 [2024-11-29 02:32:11.859620] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f2510 00:27:08.363 [2024-11-29 02:32:11.861235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:19356 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.363 [2024-11-29 02:32:11.861267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:27:08.363 [2024-11-29 02:32:11.871906] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e12d8 00:27:08.363 [2024-11-29 02:32:11.873551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:3344 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.363 [2024-11-29 02:32:11.873594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:27:08.363 [2024-11-29 02:32:11.884264] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f81e0 00:27:08.363 [2024-11-29 02:32:11.885897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:4585 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.363 [2024-11-29 02:32:11.885930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:27:08.363 [2024-11-29 02:32:11.896507] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e1710 00:27:08.363 [2024-11-29 02:32:11.898199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:6898 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.363 [2024-11-29 02:32:11.898230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:27:08.363 [2024-11-29 02:32:11.909119] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e5a90 00:27:08.363 [2024-11-29 02:32:11.910342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:17914 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.364 [2024-11-29 02:32:11.910378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:27:08.364 [2024-11-29 02:32:11.921312] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190edd58 00:27:08.364 [2024-11-29 02:32:11.922247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:9683 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.364 [2024-11-29 02:32:11.922279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:08.364 [2024-11-29 02:32:11.933594] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e9168 00:27:08.364 [2024-11-29 02:32:11.934530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:4830 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.364 [2024-11-29 02:32:11.934558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:08.364 [2024-11-29 02:32:11.946015] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190eaef0 00:27:08.364 [2024-11-29 02:32:11.946874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:4127 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.364 [2024-11-29 02:32:11.946903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:08.364 [2024-11-29 02:32:11.958108] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f4b08 00:27:08.364 [2024-11-29 02:32:11.958904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:24489 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.364 [2024-11-29 02:32:11.958936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:08.364 [2024-11-29 02:32:11.970606] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e95a0 00:27:08.364 [2024-11-29 02:32:11.971447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:6210 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.364 [2024-11-29 02:32:11.971475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:27:08.364 [2024-11-29 02:32:11.982746] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e6b70 00:27:08.364 [2024-11-29 02:32:11.983484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:3368 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.364 [2024-11-29 02:32:11.983512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:27:08.364 [2024-11-29 02:32:11.995004] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e5220 00:27:08.364 [2024-11-29 02:32:11.995689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:23508 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.364 [2024-11-29 02:32:11.995735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:27:08.364 [2024-11-29 02:32:12.007161] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f35f0 00:27:08.364 [2024-11-29 02:32:12.007820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:18062 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.364 [2024-11-29 02:32:12.007853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:27:08.364 [2024-11-29 02:32:12.019489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190ea248 00:27:08.364 [2024-11-29 02:32:12.020224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:18894 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.364 [2024-11-29 02:32:12.020256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:27:08.364 [2024-11-29 02:32:12.031628] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e5658 00:27:08.364 [2024-11-29 02:32:12.032350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:11558 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.364 [2024-11-29 02:32:12.032381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:27:08.625 [2024-11-29 02:32:12.043950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f92c0 00:27:08.625 [2024-11-29 02:32:12.044738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:16312 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.625 [2024-11-29 02:32:12.044769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:27:08.625 [2024-11-29 02:32:12.056005] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e5220 00:27:08.625 [2024-11-29 02:32:12.057727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:12031 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.625 [2024-11-29 02:32:12.057759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:27:08.625 [2024-11-29 02:32:12.068463] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f6458 00:27:08.625 [2024-11-29 02:32:12.069858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:1496 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.625 [2024-11-29 02:32:12.069890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:27:08.625 [2024-11-29 02:32:12.080961] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190ea680 00:27:08.625 [2024-11-29 02:32:12.082390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:24739 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.625 [2024-11-29 02:32:12.082443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:27:08.625 [2024-11-29 02:32:12.093424] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f7100 00:27:08.625 [2024-11-29 02:32:12.094867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:23140 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.625 [2024-11-29 02:32:12.094898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:27:08.625 [2024-11-29 02:32:12.105679] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f6458 00:27:08.625 [2024-11-29 02:32:12.107180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:6593 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.625 [2024-11-29 02:32:12.107212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:27:08.625 [2024-11-29 02:32:12.118075] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f46d0 00:27:08.625 [2024-11-29 02:32:12.119568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:10162 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.625 [2024-11-29 02:32:12.119594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:27:08.625 [2024-11-29 02:32:12.129846] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190eb760 00:27:08.625 [2024-11-29 02:32:12.130386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:4318 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.625 [2024-11-29 02:32:12.130440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0047 p:0 m:0 dnr:0 00:27:08.625 [2024-11-29 02:32:12.142596] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190ecc78 00:27:08.625 [2024-11-29 02:32:12.143907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:2404 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.625 [2024-11-29 02:32:12.143939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:08.625 [2024-11-29 02:32:12.155828] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190eb328 00:27:08.625 [2024-11-29 02:32:12.156614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:6665 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.625 [2024-11-29 02:32:12.156641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:08.625 [2024-11-29 02:32:12.166785] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e4de8 00:27:08.625 [2024-11-29 02:32:12.167803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:9373 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.625 [2024-11-29 02:32:12.167834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:08.625 [2024-11-29 02:32:12.179187] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e2c28 00:27:08.625 [2024-11-29 02:32:12.179577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:22660 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.625 [2024-11-29 02:32:12.179619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:003f p:0 m:0 dnr:0 00:27:08.625 [2024-11-29 02:32:12.191938] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e8d30 00:27:08.625 [2024-11-29 02:32:12.193029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:11055 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.625 [2024-11-29 02:32:12.193060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:08.625 [2024-11-29 02:32:12.204347] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e8d30 00:27:08.625 [2024-11-29 02:32:12.205488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:25469 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.625 [2024-11-29 02:32:12.205517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:08.625 [2024-11-29 02:32:12.216572] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e8d30 00:27:08.625 [2024-11-29 02:32:12.217694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:10700 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.625 [2024-11-29 02:32:12.217723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:08.625 [2024-11-29 02:32:12.229074] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e8d30 00:27:08.625 [2024-11-29 02:32:12.230181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1460 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.625 [2024-11-29 02:32:12.230213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:08.625 [2024-11-29 02:32:12.241521] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e8d30 00:27:08.625 [2024-11-29 02:32:12.242654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:21809 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.625 [2024-11-29 02:32:12.242683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:08.625 [2024-11-29 02:32:12.253785] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e8d30 00:27:08.626 [2024-11-29 02:32:12.254972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:22578 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.626 [2024-11-29 02:32:12.255003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:08.626 [2024-11-29 02:32:12.266331] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e8d30 00:27:08.626 [2024-11-29 02:32:12.267505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:10846 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.626 [2024-11-29 02:32:12.267533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:08.626 [2024-11-29 02:32:12.278811] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e8d30 00:27:08.626 [2024-11-29 02:32:12.280029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:20473 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.626 [2024-11-29 02:32:12.280061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:08.626 [2024-11-29 02:32:12.291300] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e8d30 00:27:08.626 [2024-11-29 02:32:12.292546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:10690 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.626 [2024-11-29 02:32:12.292574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:08.626 [2024-11-29 02:32:12.303728] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e8d30 00:27:08.889 [2024-11-29 02:32:12.304973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:687 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.889 [2024-11-29 02:32:12.305005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:08.889 [2024-11-29 02:32:12.316256] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e8d30 00:27:08.889 [2024-11-29 02:32:12.317547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:11623 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.889 [2024-11-29 02:32:12.317594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:08.889 [2024-11-29 02:32:12.328753] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e8d30 00:27:08.889 [2024-11-29 02:32:12.330006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:10834 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.889 [2024-11-29 02:32:12.330037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:08.889 [2024-11-29 02:32:12.341301] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e8d30 00:27:08.889 [2024-11-29 02:32:12.342575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:2603 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.889 [2024-11-29 02:32:12.342609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:27:08.889 [2024-11-29 02:32:12.353675] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e8d30 00:27:08.889 [2024-11-29 02:32:12.355166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:19432 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.889 [2024-11-29 02:32:12.355197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:08.889 [2024-11-29 02:32:12.366192] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e8d30 00:27:08.889 [2024-11-29 02:32:12.367508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:18407 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.889 [2024-11-29 02:32:12.367535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:08.889 [2024-11-29 02:32:12.378677] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e8d30 00:27:08.889 [2024-11-29 02:32:12.380027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:301 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.889 [2024-11-29 02:32:12.380058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:27:08.889 [2024-11-29 02:32:12.391148] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e8d30 00:27:08.889 [2024-11-29 02:32:12.392471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:1190 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.889 [2024-11-29 02:32:12.392511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:27:08.889 [2024-11-29 02:32:12.403587] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e8d30 00:27:08.889 [2024-11-29 02:32:12.404931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:4419 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.889 [2024-11-29 02:32:12.404962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:27:08.889 [2024-11-29 02:32:12.415988] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190eb328 00:27:08.889 [2024-11-29 02:32:12.417307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:16079 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.889 [2024-11-29 02:32:12.417339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:27:08.889 [2024-11-29 02:32:12.428521] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f7da8 00:27:08.889 [2024-11-29 02:32:12.429871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:21606 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.889 [2024-11-29 02:32:12.429903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:27:08.889 [2024-11-29 02:32:12.440985] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e0a68 00:27:08.889 [2024-11-29 02:32:12.442347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:10845 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.889 [2024-11-29 02:32:12.442378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:27:08.889 [2024-11-29 02:32:12.453401] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190ebb98 00:27:08.889 [2024-11-29 02:32:12.454772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:10901 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.889 [2024-11-29 02:32:12.454804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:27:08.889 [2024-11-29 02:32:12.464914] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190f1ca0 00:27:08.889 [2024-11-29 02:32:12.466060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:24835 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.889 [2024-11-29 02:32:12.466091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:003e p:0 m:0 dnr:0 00:27:08.889 [2024-11-29 02:32:12.477588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e0ea0 00:27:08.889 [2024-11-29 02:32:12.478439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:19787 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.889 [2024-11-29 02:32:12.478484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:27:08.889 [2024-11-29 02:32:12.490174] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e0ea0 00:27:08.889 [2024-11-29 02:32:12.491250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:18792 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.889 [2024-11-29 02:32:12.491282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:08.889 [2024-11-29 02:32:12.502586] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e0ea0 00:27:08.889 [2024-11-29 02:32:12.503664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:13349 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.889 [2024-11-29 02:32:12.503692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:08.889 [2024-11-29 02:32:12.514997] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e0ea0 00:27:08.889 [2024-11-29 02:32:12.516105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:6482 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.889 [2024-11-29 02:32:12.516136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:08.889 [2024-11-29 02:32:12.527483] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e0ea0 00:27:08.889 [2024-11-29 02:32:12.528593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:153 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.890 [2024-11-29 02:32:12.528621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:08.890 [2024-11-29 02:32:12.539957] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e0ea0 00:27:08.890 [2024-11-29 02:32:12.541108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:13010 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.890 [2024-11-29 02:32:12.541139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:08.890 [2024-11-29 02:32:12.552523] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e0ea0 00:27:08.890 [2024-11-29 02:32:12.553650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:8359 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.890 [2024-11-29 02:32:12.553679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:08.890 [2024-11-29 02:32:12.564950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e0ea0 00:27:08.890 [2024-11-29 02:32:12.566126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:8317 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.890 [2024-11-29 02:32:12.566157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:09.149 [2024-11-29 02:32:12.577406] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e0ea0 00:27:09.149 [2024-11-29 02:32:12.578586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:15488 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.149 [2024-11-29 02:32:12.578614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:09.149 [2024-11-29 02:32:12.589852] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e0ea0 00:27:09.149 [2024-11-29 02:32:12.591049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24725 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.149 [2024-11-29 02:32:12.591079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:09.149 [2024-11-29 02:32:12.602415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e0ea0 00:27:09.149 [2024-11-29 02:32:12.603599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:3905 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.149 [2024-11-29 02:32:12.603627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:09.149 [2024-11-29 02:32:12.614888] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e0ea0 00:27:09.149 [2024-11-29 02:32:12.616118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:21305 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.149 [2024-11-29 02:32:12.616149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:09.149 [2024-11-29 02:32:12.627379] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e0ea0 00:27:09.149 [2024-11-29 02:32:12.628602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19098 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.149 [2024-11-29 02:32:12.628630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:09.149 [2024-11-29 02:32:12.639873] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716ad0) with pdu=0x2000190e0ea0 00:27:09.149 [2024-11-29 02:32:12.641124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:11161 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.149 [2024-11-29 02:32:12.641155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:09.149 00:27:09.149 Latency(us) 00:27:09.149 [2024-11-29T01:32:12.830Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:09.149 [2024-11-29T01:32:12.830Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:27:09.149 nvme0n1 : 2.00 20580.14 80.39 0.00 0.00 6211.68 3106.89 13689.74 00:27:09.149 [2024-11-29T01:32:12.830Z] =================================================================================================================== 00:27:09.149 [2024-11-29T01:32:12.830Z] Total : 20580.14 80.39 0.00 0.00 6211.68 3106.89 13689.74 00:27:09.149 0 00:27:09.149 02:32:12 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:09.149 02:32:12 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:09.149 02:32:12 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:09.149 02:32:12 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:09.149 | .driver_specific 00:27:09.149 | .nvme_error 00:27:09.149 | .status_code 00:27:09.149 | .command_transient_transport_error' 00:27:09.407 02:32:12 -- host/digest.sh@71 -- # (( 161 > 0 )) 00:27:09.407 02:32:12 -- host/digest.sh@73 -- # killprocess 231625 00:27:09.407 02:32:12 -- common/autotest_common.sh@936 -- # '[' -z 231625 ']' 00:27:09.407 02:32:12 -- common/autotest_common.sh@940 -- # kill -0 231625 00:27:09.407 02:32:12 -- common/autotest_common.sh@941 -- # uname 00:27:09.407 02:32:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:09.407 02:32:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 231625 00:27:09.407 02:32:12 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:09.407 02:32:12 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:09.407 02:32:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 231625' 00:27:09.407 killing process with pid 231625 00:27:09.407 02:32:12 -- common/autotest_common.sh@955 -- # kill 231625 00:27:09.407 Received shutdown signal, test time was about 2.000000 seconds 00:27:09.407 00:27:09.407 Latency(us) 00:27:09.407 [2024-11-29T01:32:13.088Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:09.407 [2024-11-29T01:32:13.088Z] =================================================================================================================== 00:27:09.407 [2024-11-29T01:32:13.088Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:09.407 02:32:12 -- common/autotest_common.sh@960 -- # wait 231625 00:27:09.666 02:32:13 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:27:09.666 02:32:13 -- host/digest.sh@54 -- # local rw bs qd 00:27:09.666 02:32:13 -- host/digest.sh@56 -- # rw=randwrite 00:27:09.666 02:32:13 -- host/digest.sh@56 -- # bs=131072 00:27:09.666 02:32:13 -- host/digest.sh@56 -- # qd=16 00:27:09.666 02:32:13 -- host/digest.sh@58 -- # bperfpid=232181 00:27:09.666 02:32:13 -- host/digest.sh@60 -- # waitforlisten 232181 /var/tmp/bperf.sock 00:27:09.666 02:32:13 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:27:09.666 02:32:13 -- common/autotest_common.sh@829 -- # '[' -z 232181 ']' 00:27:09.666 02:32:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:09.666 02:32:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:09.666 02:32:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:09.666 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:09.666 02:32:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:09.666 02:32:13 -- common/autotest_common.sh@10 -- # set +x 00:27:09.666 [2024-11-29 02:32:13.256868] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:09.666 [2024-11-29 02:32:13.256955] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid232181 ] 00:27:09.666 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:09.666 Zero copy mechanism will not be used. 00:27:09.666 EAL: No free 2048 kB hugepages reported on node 1 00:27:09.666 [2024-11-29 02:32:13.329526] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:09.925 [2024-11-29 02:32:13.460336] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:10.185 02:32:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:10.185 02:32:13 -- common/autotest_common.sh@862 -- # return 0 00:27:10.185 02:32:13 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:10.185 02:32:13 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:10.185 02:32:13 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:10.185 02:32:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.185 02:32:13 -- common/autotest_common.sh@10 -- # set +x 00:27:10.445 02:32:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.445 02:32:13 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:10.445 02:32:13 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:10.703 nvme0n1 00:27:10.703 02:32:14 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:10.703 02:32:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.703 02:32:14 -- common/autotest_common.sh@10 -- # set +x 00:27:10.703 02:32:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.703 02:32:14 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:10.703 02:32:14 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:10.962 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:10.962 Zero copy mechanism will not be used. 00:27:10.962 Running I/O for 2 seconds... 00:27:10.962 [2024-11-29 02:32:14.456298] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.962 [2024-11-29 02:32:14.456603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.962 [2024-11-29 02:32:14.456643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.962 [2024-11-29 02:32:14.461266] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.962 [2024-11-29 02:32:14.461430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.962 [2024-11-29 02:32:14.461462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.962 [2024-11-29 02:32:14.465640] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.962 [2024-11-29 02:32:14.465800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.962 [2024-11-29 02:32:14.465829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.962 [2024-11-29 02:32:14.470047] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.962 [2024-11-29 02:32:14.470165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.962 [2024-11-29 02:32:14.470194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.962 [2024-11-29 02:32:14.474623] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.962 [2024-11-29 02:32:14.474707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.962 [2024-11-29 02:32:14.474735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.962 [2024-11-29 02:32:14.480049] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.480170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.480198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.484636] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.484825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.484854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.489714] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.489928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.489956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.495075] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.495316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.495345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.500831] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.501038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.501066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.506616] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.506746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.506775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.511026] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.511141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.511170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.515550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.515647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.515675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.520361] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.520520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.520548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.524925] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.525070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.525099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.529637] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.529858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.529886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.534127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.534322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.534351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.538623] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.538768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.538797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.542930] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.543028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.543056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.547807] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.548000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.548027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.552919] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.553062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.553090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.558563] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.558716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.558744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.564319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.564496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.564525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.568769] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.568900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.568934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.573440] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.573623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.573652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.577974] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.578150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.578179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.582290] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.582463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.582493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.587612] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.587778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.587806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.592856] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.593017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.593046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.599078] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.599204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.599232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.603815] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.603931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.603975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.608351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.963 [2024-11-29 02:32:14.608490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.963 [2024-11-29 02:32:14.608518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.963 [2024-11-29 02:32:14.613138] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.964 [2024-11-29 02:32:14.613308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.964 [2024-11-29 02:32:14.613337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.964 [2024-11-29 02:32:14.617668] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.964 [2024-11-29 02:32:14.617826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.964 [2024-11-29 02:32:14.617868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.964 [2024-11-29 02:32:14.622347] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.964 [2024-11-29 02:32:14.622523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.964 [2024-11-29 02:32:14.622552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.964 [2024-11-29 02:32:14.627089] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.964 [2024-11-29 02:32:14.627244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.964 [2024-11-29 02:32:14.627272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.964 [2024-11-29 02:32:14.631530] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.964 [2024-11-29 02:32:14.631635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.964 [2024-11-29 02:32:14.631664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.964 [2024-11-29 02:32:14.636099] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.964 [2024-11-29 02:32:14.636262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.964 [2024-11-29 02:32:14.636290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.964 [2024-11-29 02:32:14.640220] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:10.964 [2024-11-29 02:32:14.640346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.964 [2024-11-29 02:32:14.640374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.224 [2024-11-29 02:32:14.644416] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.224 [2024-11-29 02:32:14.644635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.224 [2024-11-29 02:32:14.644663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.224 [2024-11-29 02:32:14.648680] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.224 [2024-11-29 02:32:14.648835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.224 [2024-11-29 02:32:14.648863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.224 [2024-11-29 02:32:14.653599] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.224 [2024-11-29 02:32:14.653749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.224 [2024-11-29 02:32:14.653778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.224 [2024-11-29 02:32:14.657779] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.224 [2024-11-29 02:32:14.657895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.224 [2024-11-29 02:32:14.657925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.224 [2024-11-29 02:32:14.661926] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.224 [2024-11-29 02:32:14.662042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.224 [2024-11-29 02:32:14.662070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.224 [2024-11-29 02:32:14.666067] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.224 [2024-11-29 02:32:14.666200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.224 [2024-11-29 02:32:14.666229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.224 [2024-11-29 02:32:14.670483] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.224 [2024-11-29 02:32:14.670647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.224 [2024-11-29 02:32:14.670676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.224 [2024-11-29 02:32:14.674567] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.224 [2024-11-29 02:32:14.674709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.224 [2024-11-29 02:32:14.674737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.224 [2024-11-29 02:32:14.678767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.224 [2024-11-29 02:32:14.678991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.224 [2024-11-29 02:32:14.679034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.224 [2024-11-29 02:32:14.682864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.224 [2024-11-29 02:32:14.683033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.224 [2024-11-29 02:32:14.683061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.224 [2024-11-29 02:32:14.687111] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.224 [2024-11-29 02:32:14.687269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.224 [2024-11-29 02:32:14.687303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.224 [2024-11-29 02:32:14.691244] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.224 [2024-11-29 02:32:14.691357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.224 [2024-11-29 02:32:14.691386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.224 [2024-11-29 02:32:14.695416] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.224 [2024-11-29 02:32:14.695519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.224 [2024-11-29 02:32:14.695548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.224 [2024-11-29 02:32:14.699510] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.224 [2024-11-29 02:32:14.699604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.224 [2024-11-29 02:32:14.699631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.224 [2024-11-29 02:32:14.703619] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.224 [2024-11-29 02:32:14.703777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.703805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.707679] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.707813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.707841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.711835] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.712068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.712100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.715864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.716139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.716194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.720020] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.720134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.720165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.724350] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.724511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.724540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.728565] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.728673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.728707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.732902] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.733032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.733061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.737227] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.737399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.737428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.741471] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.741598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.741626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.745784] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.745994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.746022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.749942] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.750128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.750156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.754145] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.754311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.754340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.758368] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.758524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.758558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.762568] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.762688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.762716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.766734] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.766847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.766875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.771055] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.771223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.771251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.775268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.775420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.775448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.779573] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.779801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.779831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.783894] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.784103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.784131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.788262] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.788466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.788495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.792427] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.792561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.792589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.796550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.796674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.796702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.800664] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.800773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.800801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.804878] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.805048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.805077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.809027] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.809162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.809189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.813297] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.813537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.225 [2024-11-29 02:32:14.813566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.225 [2024-11-29 02:32:14.817512] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.225 [2024-11-29 02:32:14.817719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.226 [2024-11-29 02:32:14.817747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.226 [2024-11-29 02:32:14.821965] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.226 [2024-11-29 02:32:14.822149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.226 [2024-11-29 02:32:14.822177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.226 [2024-11-29 02:32:14.826189] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.226 [2024-11-29 02:32:14.826300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.226 [2024-11-29 02:32:14.826328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.226 [2024-11-29 02:32:14.830321] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.226 [2024-11-29 02:32:14.830433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.226 [2024-11-29 02:32:14.830461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.226 [2024-11-29 02:32:14.834552] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.226 [2024-11-29 02:32:14.834654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.226 [2024-11-29 02:32:14.834682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.226 [2024-11-29 02:32:14.838822] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.226 [2024-11-29 02:32:14.838984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.226 [2024-11-29 02:32:14.839012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.226 [2024-11-29 02:32:14.843054] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.226 [2024-11-29 02:32:14.843159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.226 [2024-11-29 02:32:14.843189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.226 [2024-11-29 02:32:14.847422] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.226 [2024-11-29 02:32:14.847648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.226 [2024-11-29 02:32:14.847676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.226 [2024-11-29 02:32:14.851649] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.226 [2024-11-29 02:32:14.851888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.226 [2024-11-29 02:32:14.851918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.226 [2024-11-29 02:32:14.855948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.226 [2024-11-29 02:32:14.856142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.226 [2024-11-29 02:32:14.856171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.226 [2024-11-29 02:32:14.860179] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.226 [2024-11-29 02:32:14.860302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.226 [2024-11-29 02:32:14.860330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.226 [2024-11-29 02:32:14.864489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.226 [2024-11-29 02:32:14.864599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.226 [2024-11-29 02:32:14.864627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.226 [2024-11-29 02:32:14.869339] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.226 [2024-11-29 02:32:14.869443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.226 [2024-11-29 02:32:14.869476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.226 [2024-11-29 02:32:14.873838] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.226 [2024-11-29 02:32:14.874045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.226 [2024-11-29 02:32:14.874073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.226 [2024-11-29 02:32:14.878118] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.226 [2024-11-29 02:32:14.878271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.226 [2024-11-29 02:32:14.878315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.226 [2024-11-29 02:32:14.882529] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.226 [2024-11-29 02:32:14.882754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.226 [2024-11-29 02:32:14.882782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.226 [2024-11-29 02:32:14.886847] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.226 [2024-11-29 02:32:14.887073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.226 [2024-11-29 02:32:14.887102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.226 [2024-11-29 02:32:14.891160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.226 [2024-11-29 02:32:14.891347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.226 [2024-11-29 02:32:14.891375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.226 [2024-11-29 02:32:14.895379] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.226 [2024-11-29 02:32:14.895520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.226 [2024-11-29 02:32:14.895548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.226 [2024-11-29 02:32:14.899589] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.226 [2024-11-29 02:32:14.899702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.226 [2024-11-29 02:32:14.899731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.486 [2024-11-29 02:32:14.903820] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.486 [2024-11-29 02:32:14.903926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.486 [2024-11-29 02:32:14.903955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.486 [2024-11-29 02:32:14.908229] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.486 [2024-11-29 02:32:14.908413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.486 [2024-11-29 02:32:14.908440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.486 [2024-11-29 02:32:14.912533] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.486 [2024-11-29 02:32:14.912662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.486 [2024-11-29 02:32:14.912690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.486 [2024-11-29 02:32:14.916997] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.486 [2024-11-29 02:32:14.917234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.486 [2024-11-29 02:32:14.917262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.486 [2024-11-29 02:32:14.921197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.486 [2024-11-29 02:32:14.921455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.486 [2024-11-29 02:32:14.921484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.486 [2024-11-29 02:32:14.925480] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.486 [2024-11-29 02:32:14.925674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.486 [2024-11-29 02:32:14.925702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.486 [2024-11-29 02:32:14.929840] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.486 [2024-11-29 02:32:14.929949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.486 [2024-11-29 02:32:14.929977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:14.933980] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:14.934080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:14.934108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:14.938263] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:14.938366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:14.938402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:14.942427] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:14.942594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:14.942622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:14.946914] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:14.947006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:14.947033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:14.952122] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:14.952400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:14.952429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:14.957382] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:14.957641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:14.957670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:14.963485] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:14.963706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:14.963740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:14.968735] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:14.968859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:14.968890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:14.972916] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:14.973088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:14.973126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:14.977206] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:14.977322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:14.977353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:14.982495] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:14.982668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:14.982697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:14.987164] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:14.987276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:14.987311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:14.991537] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:14.991765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:14.991794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:14.995782] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:14.995975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:14.996002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:15.000160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:15.000324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:15.000353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:15.004464] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:15.004591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:15.004620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:15.008738] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:15.008872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:15.008900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:15.013050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:15.013168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:15.013196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:15.017441] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:15.017589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:15.017617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:15.022489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:15.022666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:15.022695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:15.026975] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:15.027221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:15.027266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:15.031227] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:15.031445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:15.031475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:15.035597] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:15.035772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:15.035801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:15.039851] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:15.039971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:15.039999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:15.044093] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:15.044204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:15.044232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:15.048362] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:15.048521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:15.048550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.487 [2024-11-29 02:32:15.052726] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.487 [2024-11-29 02:32:15.052896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.487 [2024-11-29 02:32:15.052924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.488 [2024-11-29 02:32:15.056924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.488 [2024-11-29 02:32:15.057059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.488 [2024-11-29 02:32:15.057087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.488 [2024-11-29 02:32:15.061255] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.488 [2024-11-29 02:32:15.061491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.488 [2024-11-29 02:32:15.061520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.488 [2024-11-29 02:32:15.065519] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.488 [2024-11-29 02:32:15.065695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.488 [2024-11-29 02:32:15.065723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.488 [2024-11-29 02:32:15.069762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.488 [2024-11-29 02:32:15.069926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.488 [2024-11-29 02:32:15.069954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.488 [2024-11-29 02:32:15.073883] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.488 [2024-11-29 02:32:15.074004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.488 [2024-11-29 02:32:15.074032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.488 [2024-11-29 02:32:15.078103] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.488 [2024-11-29 02:32:15.078214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.488 [2024-11-29 02:32:15.078242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.488 [2024-11-29 02:32:15.082388] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.488 [2024-11-29 02:32:15.082512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.488 [2024-11-29 02:32:15.082539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.488 [2024-11-29 02:32:15.086693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.488 [2024-11-29 02:32:15.086860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.488 [2024-11-29 02:32:15.086889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.488 [2024-11-29 02:32:15.090959] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.488 [2024-11-29 02:32:15.091097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.488 [2024-11-29 02:32:15.091124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.488 [2024-11-29 02:32:15.095313] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.488 [2024-11-29 02:32:15.095550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.488 [2024-11-29 02:32:15.095594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.488 [2024-11-29 02:32:15.099693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.488 [2024-11-29 02:32:15.099926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.488 [2024-11-29 02:32:15.099960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.488 [2024-11-29 02:32:15.104075] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.488 [2024-11-29 02:32:15.104267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.488 [2024-11-29 02:32:15.104296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.488 [2024-11-29 02:32:15.108205] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.488 [2024-11-29 02:32:15.108323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.488 [2024-11-29 02:32:15.108352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.488 [2024-11-29 02:32:15.112509] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.488 [2024-11-29 02:32:15.112620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.488 [2024-11-29 02:32:15.112648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.488 [2024-11-29 02:32:15.116850] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.488 [2024-11-29 02:32:15.116956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.488 [2024-11-29 02:32:15.116999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.488 [2024-11-29 02:32:15.121110] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.488 [2024-11-29 02:32:15.121305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.488 [2024-11-29 02:32:15.121334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.488 [2024-11-29 02:32:15.125480] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.488 [2024-11-29 02:32:15.125613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.488 [2024-11-29 02:32:15.125641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.488 [2024-11-29 02:32:15.129914] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.488 [2024-11-29 02:32:15.130157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.488 [2024-11-29 02:32:15.130186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.488 [2024-11-29 02:32:15.134218] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.488 [2024-11-29 02:32:15.134403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.488 [2024-11-29 02:32:15.134431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.488 [2024-11-29 02:32:15.138501] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.488 [2024-11-29 02:32:15.138696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.488 [2024-11-29 02:32:15.138724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.488 [2024-11-29 02:32:15.142791] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.488 [2024-11-29 02:32:15.142919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.488 [2024-11-29 02:32:15.142947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.488 [2024-11-29 02:32:15.146975] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.488 [2024-11-29 02:32:15.147098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.488 [2024-11-29 02:32:15.147126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.488 [2024-11-29 02:32:15.151225] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.488 [2024-11-29 02:32:15.151327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.488 [2024-11-29 02:32:15.151354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.488 [2024-11-29 02:32:15.155555] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.488 [2024-11-29 02:32:15.155718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.488 [2024-11-29 02:32:15.155748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.488 [2024-11-29 02:32:15.159950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.488 [2024-11-29 02:32:15.160093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.488 [2024-11-29 02:32:15.160122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.488 [2024-11-29 02:32:15.164378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.488 [2024-11-29 02:32:15.164648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.488 [2024-11-29 02:32:15.164678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.168574] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.750 [2024-11-29 02:32:15.168783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.750 [2024-11-29 02:32:15.168811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.172866] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.750 [2024-11-29 02:32:15.173045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.750 [2024-11-29 02:32:15.173087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.177204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.750 [2024-11-29 02:32:15.177327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.750 [2024-11-29 02:32:15.177355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.181444] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.750 [2024-11-29 02:32:15.181553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.750 [2024-11-29 02:32:15.181581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.185691] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.750 [2024-11-29 02:32:15.185807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.750 [2024-11-29 02:32:15.185836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.189977] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.750 [2024-11-29 02:32:15.190141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.750 [2024-11-29 02:32:15.190169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.194288] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.750 [2024-11-29 02:32:15.194426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.750 [2024-11-29 02:32:15.194455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.198742] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.750 [2024-11-29 02:32:15.198970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.750 [2024-11-29 02:32:15.198997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.203032] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.750 [2024-11-29 02:32:15.203251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.750 [2024-11-29 02:32:15.203279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.207315] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.750 [2024-11-29 02:32:15.207477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.750 [2024-11-29 02:32:15.207505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.211547] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.750 [2024-11-29 02:32:15.211655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.750 [2024-11-29 02:32:15.211695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.215828] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.750 [2024-11-29 02:32:15.215941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.750 [2024-11-29 02:32:15.215973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.220119] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.750 [2024-11-29 02:32:15.220233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.750 [2024-11-29 02:32:15.220271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.224288] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.750 [2024-11-29 02:32:15.224492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.750 [2024-11-29 02:32:15.224530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.228432] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.750 [2024-11-29 02:32:15.228558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.750 [2024-11-29 02:32:15.228589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.232812] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.750 [2024-11-29 02:32:15.233065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.750 [2024-11-29 02:32:15.233095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.237198] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.750 [2024-11-29 02:32:15.237327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.750 [2024-11-29 02:32:15.237357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.241369] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.750 [2024-11-29 02:32:15.241493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.750 [2024-11-29 02:32:15.241522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.245694] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.750 [2024-11-29 02:32:15.245820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.750 [2024-11-29 02:32:15.245863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.249943] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.750 [2024-11-29 02:32:15.250102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.750 [2024-11-29 02:32:15.250131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.254173] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.750 [2024-11-29 02:32:15.254296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.750 [2024-11-29 02:32:15.254325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.258434] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.750 [2024-11-29 02:32:15.258600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.750 [2024-11-29 02:32:15.258629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.262642] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.750 [2024-11-29 02:32:15.262783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.750 [2024-11-29 02:32:15.262811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.267014] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.750 [2024-11-29 02:32:15.267238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.750 [2024-11-29 02:32:15.267266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.271276] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.750 [2024-11-29 02:32:15.271517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.750 [2024-11-29 02:32:15.271546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.275628] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.750 [2024-11-29 02:32:15.275805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.750 [2024-11-29 02:32:15.275833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.750 [2024-11-29 02:32:15.279908] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.280022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.280051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.284130] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.284255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.284299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.288420] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.288547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.288575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.292741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.292934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.292962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.297078] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.297195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.297224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.301361] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.301638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.301668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.305573] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.305770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.305798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.309861] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.310039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.310081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.314202] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.314302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.314330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.318321] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.318435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.318463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.322550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.322659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.322693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.326888] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.327053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.327080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.331125] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.331264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.331292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.335517] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.335745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.335774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.339675] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.339876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.339904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.343971] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.344130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.344158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.348299] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.348430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.348458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.352527] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.352642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.352670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.356693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.356791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.356819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.360951] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.361128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.361156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.365229] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.365356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.365384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.369584] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.369851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.369879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.373872] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.374075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.374103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.378285] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.378457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.378486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.382650] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.382746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.382779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.386907] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.387031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.387060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.391181] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.751 [2024-11-29 02:32:15.391316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.751 [2024-11-29 02:32:15.391345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.751 [2024-11-29 02:32:15.395540] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.752 [2024-11-29 02:32:15.395703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.752 [2024-11-29 02:32:15.395731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.752 [2024-11-29 02:32:15.399756] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.752 [2024-11-29 02:32:15.399882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.752 [2024-11-29 02:32:15.399910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.752 [2024-11-29 02:32:15.404078] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.752 [2024-11-29 02:32:15.404305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.752 [2024-11-29 02:32:15.404333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.752 [2024-11-29 02:32:15.408228] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.752 [2024-11-29 02:32:15.408450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.752 [2024-11-29 02:32:15.408479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.752 [2024-11-29 02:32:15.412564] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.752 [2024-11-29 02:32:15.412737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.752 [2024-11-29 02:32:15.412765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.752 [2024-11-29 02:32:15.416790] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.752 [2024-11-29 02:32:15.416908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.752 [2024-11-29 02:32:15.416937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.752 [2024-11-29 02:32:15.420958] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.752 [2024-11-29 02:32:15.421068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.752 [2024-11-29 02:32:15.421095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.752 [2024-11-29 02:32:15.425134] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:11.752 [2024-11-29 02:32:15.425252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.752 [2024-11-29 02:32:15.425280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.014 [2024-11-29 02:32:15.429488] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.014 [2024-11-29 02:32:15.429649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.014 [2024-11-29 02:32:15.429678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.014 [2024-11-29 02:32:15.434557] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.014 [2024-11-29 02:32:15.434781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.014 [2024-11-29 02:32:15.434815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.014 [2024-11-29 02:32:15.439967] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.014 [2024-11-29 02:32:15.440189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.014 [2024-11-29 02:32:15.440217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.014 [2024-11-29 02:32:15.446158] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.014 [2024-11-29 02:32:15.446403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.014 [2024-11-29 02:32:15.446432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.014 [2024-11-29 02:32:15.452157] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.014 [2024-11-29 02:32:15.452383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.014 [2024-11-29 02:32:15.452435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.014 [2024-11-29 02:32:15.457411] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.014 [2024-11-29 02:32:15.457653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.014 [2024-11-29 02:32:15.457680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.014 [2024-11-29 02:32:15.462802] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.014 [2024-11-29 02:32:15.462985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.014 [2024-11-29 02:32:15.463013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.014 [2024-11-29 02:32:15.468123] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.014 [2024-11-29 02:32:15.468308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.014 [2024-11-29 02:32:15.468359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.014 [2024-11-29 02:32:15.473713] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.014 [2024-11-29 02:32:15.473864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.014 [2024-11-29 02:32:15.473901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.014 [2024-11-29 02:32:15.479165] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.014 [2024-11-29 02:32:15.479417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.014 [2024-11-29 02:32:15.479447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.014 [2024-11-29 02:32:15.484645] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.014 [2024-11-29 02:32:15.484836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.014 [2024-11-29 02:32:15.484864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.014 [2024-11-29 02:32:15.490124] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.014 [2024-11-29 02:32:15.490305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.014 [2024-11-29 02:32:15.490335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.014 [2024-11-29 02:32:15.495499] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.014 [2024-11-29 02:32:15.495738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.014 [2024-11-29 02:32:15.495766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.014 [2024-11-29 02:32:15.501144] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.014 [2024-11-29 02:32:15.501389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.014 [2024-11-29 02:32:15.501426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.014 [2024-11-29 02:32:15.506435] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.014 [2024-11-29 02:32:15.506735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.014 [2024-11-29 02:32:15.506767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.014 [2024-11-29 02:32:15.511765] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.014 [2024-11-29 02:32:15.511981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.014 [2024-11-29 02:32:15.512009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.014 [2024-11-29 02:32:15.516996] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.014 [2024-11-29 02:32:15.517235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.014 [2024-11-29 02:32:15.517263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.014 [2024-11-29 02:32:15.522408] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.014 [2024-11-29 02:32:15.522564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.014 [2024-11-29 02:32:15.522593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.014 [2024-11-29 02:32:15.527126] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.014 [2024-11-29 02:32:15.527302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.014 [2024-11-29 02:32:15.527335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.014 [2024-11-29 02:32:15.532515] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.014 [2024-11-29 02:32:15.532676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.014 [2024-11-29 02:32:15.532704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.014 [2024-11-29 02:32:15.537857] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.014 [2024-11-29 02:32:15.538015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.014 [2024-11-29 02:32:15.538043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.014 [2024-11-29 02:32:15.544253] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.544426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.544454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.015 [2024-11-29 02:32:15.549171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.549369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.549405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.015 [2024-11-29 02:32:15.554838] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.555004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.555031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.015 [2024-11-29 02:32:15.560184] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.560377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.560413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.015 [2024-11-29 02:32:15.564964] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.565088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.565130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.015 [2024-11-29 02:32:15.570185] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.570448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.570476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.015 [2024-11-29 02:32:15.575310] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.575580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.575630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.015 [2024-11-29 02:32:15.580348] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.580513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.580542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.015 [2024-11-29 02:32:15.585130] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.585296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.585324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.015 [2024-11-29 02:32:15.590034] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.590212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.590240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.015 [2024-11-29 02:32:15.595389] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.595530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.595571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.015 [2024-11-29 02:32:15.601527] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.601707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.601736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.015 [2024-11-29 02:32:15.606812] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.606937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.606965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.015 [2024-11-29 02:32:15.611107] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.611228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.611256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.015 [2024-11-29 02:32:15.615945] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.616143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.616171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.015 [2024-11-29 02:32:15.620248] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.620434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.620463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.015 [2024-11-29 02:32:15.625818] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.626054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.626097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.015 [2024-11-29 02:32:15.631661] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.631886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.631914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.015 [2024-11-29 02:32:15.637057] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.637216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.637244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.015 [2024-11-29 02:32:15.642364] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.642499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.642528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.015 [2024-11-29 02:32:15.646878] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.646993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.647021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.015 [2024-11-29 02:32:15.651135] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.651263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.651291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.015 [2024-11-29 02:32:15.656132] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.656210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.656236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.015 [2024-11-29 02:32:15.661098] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.661213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.661246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.015 [2024-11-29 02:32:15.665615] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.665728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.665756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.015 [2024-11-29 02:32:15.670105] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.670251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.670278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.015 [2024-11-29 02:32:15.674438] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.015 [2024-11-29 02:32:15.674552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.015 [2024-11-29 02:32:15.674579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.016 [2024-11-29 02:32:15.678714] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.016 [2024-11-29 02:32:15.678863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.016 [2024-11-29 02:32:15.678892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.016 [2024-11-29 02:32:15.682904] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.016 [2024-11-29 02:32:15.683006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.016 [2024-11-29 02:32:15.683033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.016 [2024-11-29 02:32:15.687113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.016 [2024-11-29 02:32:15.687277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.016 [2024-11-29 02:32:15.687305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.016 [2024-11-29 02:32:15.691543] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.016 [2024-11-29 02:32:15.691727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.016 [2024-11-29 02:32:15.691754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.278 [2024-11-29 02:32:15.695767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.278 [2024-11-29 02:32:15.695954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.278 [2024-11-29 02:32:15.695982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.278 [2024-11-29 02:32:15.699904] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.278 [2024-11-29 02:32:15.700062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.278 [2024-11-29 02:32:15.700090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.278 [2024-11-29 02:32:15.704142] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.278 [2024-11-29 02:32:15.704323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.278 [2024-11-29 02:32:15.704351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.278 [2024-11-29 02:32:15.708423] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.278 [2024-11-29 02:32:15.708534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.278 [2024-11-29 02:32:15.708562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.278 [2024-11-29 02:32:15.712665] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.278 [2024-11-29 02:32:15.712805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.278 [2024-11-29 02:32:15.712832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.278 [2024-11-29 02:32:15.716891] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.278 [2024-11-29 02:32:15.717007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.278 [2024-11-29 02:32:15.717034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.278 [2024-11-29 02:32:15.721162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.278 [2024-11-29 02:32:15.721335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.278 [2024-11-29 02:32:15.721372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.278 [2024-11-29 02:32:15.725413] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.278 [2024-11-29 02:32:15.725607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.278 [2024-11-29 02:32:15.725637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.278 [2024-11-29 02:32:15.729657] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.278 [2024-11-29 02:32:15.729842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.278 [2024-11-29 02:32:15.729871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.278 [2024-11-29 02:32:15.733941] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.278 [2024-11-29 02:32:15.734051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.278 [2024-11-29 02:32:15.734079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.278 [2024-11-29 02:32:15.738208] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.278 [2024-11-29 02:32:15.738361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.278 [2024-11-29 02:32:15.738390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.278 [2024-11-29 02:32:15.742353] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.278 [2024-11-29 02:32:15.742534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.278 [2024-11-29 02:32:15.742562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.278 [2024-11-29 02:32:15.746606] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.278 [2024-11-29 02:32:15.746749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.278 [2024-11-29 02:32:15.746791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.278 [2024-11-29 02:32:15.750826] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.278 [2024-11-29 02:32:15.750938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.278 [2024-11-29 02:32:15.750967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.279 [2024-11-29 02:32:15.755100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.279 [2024-11-29 02:32:15.755265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.279 [2024-11-29 02:32:15.755293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.279 [2024-11-29 02:32:15.759439] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.279 [2024-11-29 02:32:15.759628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.279 [2024-11-29 02:32:15.759655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.279 [2024-11-29 02:32:15.763765] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.279 [2024-11-29 02:32:15.763949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.279 [2024-11-29 02:32:15.763977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.279 [2024-11-29 02:32:15.767972] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.279 [2024-11-29 02:32:15.768083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.279 [2024-11-29 02:32:15.768111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.279 [2024-11-29 02:32:15.772158] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.279 [2024-11-29 02:32:15.772301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.279 [2024-11-29 02:32:15.772335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.279 [2024-11-29 02:32:15.776353] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.279 [2024-11-29 02:32:15.776480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.279 [2024-11-29 02:32:15.776508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.279 [2024-11-29 02:32:15.780538] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.279 [2024-11-29 02:32:15.780681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.279 [2024-11-29 02:32:15.780708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.279 [2024-11-29 02:32:15.784867] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.279 [2024-11-29 02:32:15.784973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.279 [2024-11-29 02:32:15.785001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.279 [2024-11-29 02:32:15.789101] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.279 [2024-11-29 02:32:15.789262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.279 [2024-11-29 02:32:15.789289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.279 [2024-11-29 02:32:15.793352] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.279 [2024-11-29 02:32:15.793532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.279 [2024-11-29 02:32:15.793560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.279 [2024-11-29 02:32:15.797622] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.279 [2024-11-29 02:32:15.797802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.279 [2024-11-29 02:32:15.797830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.279 [2024-11-29 02:32:15.801864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.279 [2024-11-29 02:32:15.802016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.279 [2024-11-29 02:32:15.802044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.279 [2024-11-29 02:32:15.806048] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.279 [2024-11-29 02:32:15.806203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.279 [2024-11-29 02:32:15.806231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.279 [2024-11-29 02:32:15.810201] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.279 [2024-11-29 02:32:15.810319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.279 [2024-11-29 02:32:15.810348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.279 [2024-11-29 02:32:15.814410] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.279 [2024-11-29 02:32:15.814546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.279 [2024-11-29 02:32:15.814573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.279 [2024-11-29 02:32:15.818652] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.279 [2024-11-29 02:32:15.818780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.279 [2024-11-29 02:32:15.818808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.279 [2024-11-29 02:32:15.822947] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.279 [2024-11-29 02:32:15.823109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.279 [2024-11-29 02:32:15.823138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.279 [2024-11-29 02:32:15.827210] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.279 [2024-11-29 02:32:15.827403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.279 [2024-11-29 02:32:15.827431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.279 [2024-11-29 02:32:15.831497] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.279 [2024-11-29 02:32:15.831689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.279 [2024-11-29 02:32:15.831716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.279 [2024-11-29 02:32:15.835729] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.279 [2024-11-29 02:32:15.835861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.279 [2024-11-29 02:32:15.835889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.279 [2024-11-29 02:32:15.840846] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.279 [2024-11-29 02:32:15.841043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.279 [2024-11-29 02:32:15.841087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.279 [2024-11-29 02:32:15.846104] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.279 [2024-11-29 02:32:15.846259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.279 [2024-11-29 02:32:15.846287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.279 [2024-11-29 02:32:15.851716] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.280 [2024-11-29 02:32:15.851866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.280 [2024-11-29 02:32:15.851894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.280 [2024-11-29 02:32:15.857549] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.280 [2024-11-29 02:32:15.857723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.280 [2024-11-29 02:32:15.857751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.280 [2024-11-29 02:32:15.861814] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.280 [2024-11-29 02:32:15.861933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.280 [2024-11-29 02:32:15.861961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.280 [2024-11-29 02:32:15.866490] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.280 [2024-11-29 02:32:15.866655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.280 [2024-11-29 02:32:15.866682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.280 [2024-11-29 02:32:15.870783] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.280 [2024-11-29 02:32:15.870905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.280 [2024-11-29 02:32:15.870933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.280 [2024-11-29 02:32:15.875357] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.280 [2024-11-29 02:32:15.875492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.280 [2024-11-29 02:32:15.875520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.280 [2024-11-29 02:32:15.880245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.280 [2024-11-29 02:32:15.880403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.280 [2024-11-29 02:32:15.880431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.280 [2024-11-29 02:32:15.885473] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.280 [2024-11-29 02:32:15.885635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.280 [2024-11-29 02:32:15.885663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.280 [2024-11-29 02:32:15.891593] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.280 [2024-11-29 02:32:15.891724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.280 [2024-11-29 02:32:15.891756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.280 [2024-11-29 02:32:15.896389] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.280 [2024-11-29 02:32:15.896506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.280 [2024-11-29 02:32:15.896533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.280 [2024-11-29 02:32:15.901007] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.280 [2024-11-29 02:32:15.901179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.280 [2024-11-29 02:32:15.901207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.280 [2024-11-29 02:32:15.905749] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.280 [2024-11-29 02:32:15.905947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.280 [2024-11-29 02:32:15.905976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.280 [2024-11-29 02:32:15.910433] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.280 [2024-11-29 02:32:15.910639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.280 [2024-11-29 02:32:15.910669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.280 [2024-11-29 02:32:15.915137] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.280 [2024-11-29 02:32:15.915250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.280 [2024-11-29 02:32:15.915293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.280 [2024-11-29 02:32:15.919761] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.280 [2024-11-29 02:32:15.919882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.280 [2024-11-29 02:32:15.919911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.280 [2024-11-29 02:32:15.924255] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.280 [2024-11-29 02:32:15.924386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.280 [2024-11-29 02:32:15.924421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.280 [2024-11-29 02:32:15.929361] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.280 [2024-11-29 02:32:15.929554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.280 [2024-11-29 02:32:15.929583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.280 [2024-11-29 02:32:15.934449] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.280 [2024-11-29 02:32:15.934611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.280 [2024-11-29 02:32:15.934640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.280 [2024-11-29 02:32:15.940348] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.280 [2024-11-29 02:32:15.940544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.280 [2024-11-29 02:32:15.940572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.280 [2024-11-29 02:32:15.945780] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.280 [2024-11-29 02:32:15.945969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.280 [2024-11-29 02:32:15.945997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.280 [2024-11-29 02:32:15.950055] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.280 [2024-11-29 02:32:15.950179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.280 [2024-11-29 02:32:15.950207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.280 [2024-11-29 02:32:15.954709] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.280 [2024-11-29 02:32:15.954873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.280 [2024-11-29 02:32:15.954901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.541 [2024-11-29 02:32:15.958982] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.541 [2024-11-29 02:32:15.959143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.541 [2024-11-29 02:32:15.959171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.541 [2024-11-29 02:32:15.963354] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.541 [2024-11-29 02:32:15.963537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.541 [2024-11-29 02:32:15.963564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.541 [2024-11-29 02:32:15.968665] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.541 [2024-11-29 02:32:15.968803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.541 [2024-11-29 02:32:15.968831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.541 [2024-11-29 02:32:15.974709] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.541 [2024-11-29 02:32:15.974908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.541 [2024-11-29 02:32:15.974935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.541 [2024-11-29 02:32:15.980390] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.541 [2024-11-29 02:32:15.980641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.541 [2024-11-29 02:32:15.980670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.541 [2024-11-29 02:32:15.984926] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.541 [2024-11-29 02:32:15.985130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:15.985158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:15.989692] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:15.989949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:15.989976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:15.995546] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:15.995658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:15.995686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:15.999901] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:16.000010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:16.000039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:16.004278] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:16.004467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:16.004494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:16.008733] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:16.008863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:16.008891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:16.013144] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:16.013264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:16.013295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:16.017477] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:16.017673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:16.017710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:16.022045] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:16.022179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:16.022208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:16.026780] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:16.027036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:16.027065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:16.030970] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:16.031114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:16.031142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:16.035149] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:16.035309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:16.035338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:16.039462] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:16.039674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:16.039702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:16.043731] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:16.043873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:16.043901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:16.048962] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:16.049052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:16.049078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:16.054138] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:16.054372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:16.054408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:16.058841] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:16.059018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:16.059047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:16.063169] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:16.063382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:16.063418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:16.067239] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:16.067385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:16.067423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:16.071467] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:16.071571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:16.071600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:16.076597] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:16.076795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:16.076822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:16.082124] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:16.082385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:16.082422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:16.087438] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:16.087640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:16.087668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:16.092804] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:16.092973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:16.093001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:16.098193] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:16.098338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:16.098366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:16.103228] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:16.103390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:16.103427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:16.108474] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:16.108668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.542 [2024-11-29 02:32:16.108696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.542 [2024-11-29 02:32:16.113725] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.542 [2024-11-29 02:32:16.113971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.543 [2024-11-29 02:32:16.114000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.543 [2024-11-29 02:32:16.118969] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.543 [2024-11-29 02:32:16.119190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.543 [2024-11-29 02:32:16.119221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.543 [2024-11-29 02:32:16.124588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.543 [2024-11-29 02:32:16.124747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.543 [2024-11-29 02:32:16.124775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.543 [2024-11-29 02:32:16.129969] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.543 [2024-11-29 02:32:16.130163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.543 [2024-11-29 02:32:16.130190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.543 [2024-11-29 02:32:16.135386] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.543 [2024-11-29 02:32:16.135572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.543 [2024-11-29 02:32:16.135600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.543 [2024-11-29 02:32:16.140731] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.543 [2024-11-29 02:32:16.140852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.543 [2024-11-29 02:32:16.140880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.543 [2024-11-29 02:32:16.146031] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.543 [2024-11-29 02:32:16.146185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.543 [2024-11-29 02:32:16.146218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.543 [2024-11-29 02:32:16.151112] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.543 [2024-11-29 02:32:16.151268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.543 [2024-11-29 02:32:16.151295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.543 [2024-11-29 02:32:16.156322] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.543 [2024-11-29 02:32:16.156487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.543 [2024-11-29 02:32:16.156516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.543 [2024-11-29 02:32:16.161159] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.543 [2024-11-29 02:32:16.161293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.543 [2024-11-29 02:32:16.161338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.543 [2024-11-29 02:32:16.166531] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.543 [2024-11-29 02:32:16.166738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.543 [2024-11-29 02:32:16.166765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.543 [2024-11-29 02:32:16.171664] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.543 [2024-11-29 02:32:16.171787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.543 [2024-11-29 02:32:16.171815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.543 [2024-11-29 02:32:16.177115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.543 [2024-11-29 02:32:16.177249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.543 [2024-11-29 02:32:16.177276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.543 [2024-11-29 02:32:16.182570] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.543 [2024-11-29 02:32:16.182750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.543 [2024-11-29 02:32:16.182778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.543 [2024-11-29 02:32:16.187987] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.543 [2024-11-29 02:32:16.188173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.543 [2024-11-29 02:32:16.188200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.543 [2024-11-29 02:32:16.193358] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.543 [2024-11-29 02:32:16.193607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.543 [2024-11-29 02:32:16.193635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.543 [2024-11-29 02:32:16.198387] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.543 [2024-11-29 02:32:16.198588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.543 [2024-11-29 02:32:16.198615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.543 [2024-11-29 02:32:16.203191] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.543 [2024-11-29 02:32:16.203284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.543 [2024-11-29 02:32:16.203312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.543 [2024-11-29 02:32:16.208532] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.543 [2024-11-29 02:32:16.208759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.543 [2024-11-29 02:32:16.208788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.543 [2024-11-29 02:32:16.213906] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.543 [2024-11-29 02:32:16.214064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.543 [2024-11-29 02:32:16.214092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.543 [2024-11-29 02:32:16.219313] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.804 [2024-11-29 02:32:16.219572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.804 [2024-11-29 02:32:16.219601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.804 [2024-11-29 02:32:16.224037] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.804 [2024-11-29 02:32:16.224163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.804 [2024-11-29 02:32:16.224191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.804 [2024-11-29 02:32:16.228260] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.804 [2024-11-29 02:32:16.228428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.804 [2024-11-29 02:32:16.228457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.804 [2024-11-29 02:32:16.232921] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.804 [2024-11-29 02:32:16.233119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.804 [2024-11-29 02:32:16.233147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.804 [2024-11-29 02:32:16.238145] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.804 [2024-11-29 02:32:16.238327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.804 [2024-11-29 02:32:16.238355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.804 [2024-11-29 02:32:16.243236] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.804 [2024-11-29 02:32:16.243474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.804 [2024-11-29 02:32:16.243502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.804 [2024-11-29 02:32:16.249883] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.804 [2024-11-29 02:32:16.249997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.804 [2024-11-29 02:32:16.250025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.804 [2024-11-29 02:32:16.254465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.804 [2024-11-29 02:32:16.254597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.804 [2024-11-29 02:32:16.254625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.804 [2024-11-29 02:32:16.258574] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.804 [2024-11-29 02:32:16.258693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.804 [2024-11-29 02:32:16.258721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.804 [2024-11-29 02:32:16.262744] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.804 [2024-11-29 02:32:16.262856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.804 [2024-11-29 02:32:16.262883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.804 [2024-11-29 02:32:16.266935] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.804 [2024-11-29 02:32:16.267083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.804 [2024-11-29 02:32:16.267111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.804 [2024-11-29 02:32:16.272184] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.804 [2024-11-29 02:32:16.272465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.804 [2024-11-29 02:32:16.272494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.804 [2024-11-29 02:32:16.277194] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.804 [2024-11-29 02:32:16.277370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.804 [2024-11-29 02:32:16.277413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.804 [2024-11-29 02:32:16.282631] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.804 [2024-11-29 02:32:16.282804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.804 [2024-11-29 02:32:16.282832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.804 [2024-11-29 02:32:16.288371] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.804 [2024-11-29 02:32:16.288579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.804 [2024-11-29 02:32:16.288607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.804 [2024-11-29 02:32:16.293697] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.804 [2024-11-29 02:32:16.293853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.804 [2024-11-29 02:32:16.293883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.804 [2024-11-29 02:32:16.299056] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.804 [2024-11-29 02:32:16.299196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.804 [2024-11-29 02:32:16.299222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.804 [2024-11-29 02:32:16.304764] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.804 [2024-11-29 02:32:16.305027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.804 [2024-11-29 02:32:16.305075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.804 [2024-11-29 02:32:16.310537] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.804 [2024-11-29 02:32:16.310801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.804 [2024-11-29 02:32:16.310847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.804 [2024-11-29 02:32:16.316457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.804 [2024-11-29 02:32:16.316739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.804 [2024-11-29 02:32:16.316768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.804 [2024-11-29 02:32:16.322014] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.804 [2024-11-29 02:32:16.322318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.804 [2024-11-29 02:32:16.322350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.804 [2024-11-29 02:32:16.327867] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.804 [2024-11-29 02:32:16.328079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.804 [2024-11-29 02:32:16.328110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.804 [2024-11-29 02:32:16.333630] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.804 [2024-11-29 02:32:16.333763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.804 [2024-11-29 02:32:16.333792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.804 [2024-11-29 02:32:16.339053] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.804 [2024-11-29 02:32:16.339202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.804 [2024-11-29 02:32:16.339228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.804 [2024-11-29 02:32:16.344504] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.804 [2024-11-29 02:32:16.344669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.804 [2024-11-29 02:32:16.344704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.804 [2024-11-29 02:32:16.349884] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.804 [2024-11-29 02:32:16.350046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.804 [2024-11-29 02:32:16.350074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.805 [2024-11-29 02:32:16.355114] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.805 [2024-11-29 02:32:16.355342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.805 [2024-11-29 02:32:16.355370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.805 [2024-11-29 02:32:16.360520] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.805 [2024-11-29 02:32:16.360755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.805 [2024-11-29 02:32:16.360783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.805 [2024-11-29 02:32:16.365865] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.805 [2024-11-29 02:32:16.366094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.805 [2024-11-29 02:32:16.366123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.805 [2024-11-29 02:32:16.371180] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.805 [2024-11-29 02:32:16.371321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.805 [2024-11-29 02:32:16.371356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.805 [2024-11-29 02:32:16.376377] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.805 [2024-11-29 02:32:16.376563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.805 [2024-11-29 02:32:16.376591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.805 [2024-11-29 02:32:16.381701] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.805 [2024-11-29 02:32:16.381898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.805 [2024-11-29 02:32:16.381925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.805 [2024-11-29 02:32:16.386861] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.805 [2024-11-29 02:32:16.387067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.805 [2024-11-29 02:32:16.387095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.805 [2024-11-29 02:32:16.392265] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.805 [2024-11-29 02:32:16.392434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.805 [2024-11-29 02:32:16.392462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.805 [2024-11-29 02:32:16.397971] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.805 [2024-11-29 02:32:16.398245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.805 [2024-11-29 02:32:16.398273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.805 [2024-11-29 02:32:16.403382] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.805 [2024-11-29 02:32:16.403695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.805 [2024-11-29 02:32:16.403724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.805 [2024-11-29 02:32:16.408716] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.805 [2024-11-29 02:32:16.408977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.805 [2024-11-29 02:32:16.409004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.805 [2024-11-29 02:32:16.414014] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.805 [2024-11-29 02:32:16.414183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.805 [2024-11-29 02:32:16.414212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.805 [2024-11-29 02:32:16.419208] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.805 [2024-11-29 02:32:16.419374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.805 [2024-11-29 02:32:16.419409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.805 [2024-11-29 02:32:16.423670] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.805 [2024-11-29 02:32:16.423790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.805 [2024-11-29 02:32:16.423817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.805 [2024-11-29 02:32:16.428932] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.805 [2024-11-29 02:32:16.429205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.805 [2024-11-29 02:32:16.429233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.805 [2024-11-29 02:32:16.434172] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.805 [2024-11-29 02:32:16.434322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.805 [2024-11-29 02:32:16.434349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.805 [2024-11-29 02:32:16.440488] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.805 [2024-11-29 02:32:16.440678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.805 [2024-11-29 02:32:16.440706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.805 [2024-11-29 02:32:16.444973] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.805 [2024-11-29 02:32:16.445105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.805 [2024-11-29 02:32:16.445133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.805 [2024-11-29 02:32:16.449444] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x716fb0) with pdu=0x2000190fef90 00:27:12.805 [2024-11-29 02:32:16.449581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.805 [2024-11-29 02:32:16.449608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.805 00:27:12.805 Latency(us) 00:27:12.805 [2024-11-29T01:32:16.486Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:12.805 [2024-11-29T01:32:16.486Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:27:12.805 nvme0n1 : 2.00 6632.20 829.02 0.00 0.00 2405.68 1844.72 9611.95 00:27:12.805 [2024-11-29T01:32:16.486Z] =================================================================================================================== 00:27:12.805 [2024-11-29T01:32:16.486Z] Total : 6632.20 829.02 0.00 0.00 2405.68 1844.72 9611.95 00:27:12.805 0 00:27:12.805 02:32:16 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:12.805 02:32:16 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:12.805 02:32:16 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:12.805 | .driver_specific 00:27:12.805 | .nvme_error 00:27:12.805 | .status_code 00:27:12.805 | .command_transient_transport_error' 00:27:12.805 02:32:16 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:13.064 02:32:16 -- host/digest.sh@71 -- # (( 428 > 0 )) 00:27:13.064 02:32:16 -- host/digest.sh@73 -- # killprocess 232181 00:27:13.064 02:32:16 -- common/autotest_common.sh@936 -- # '[' -z 232181 ']' 00:27:13.064 02:32:16 -- common/autotest_common.sh@940 -- # kill -0 232181 00:27:13.064 02:32:16 -- common/autotest_common.sh@941 -- # uname 00:27:13.064 02:32:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:13.064 02:32:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 232181 00:27:13.322 02:32:16 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:13.322 02:32:16 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:13.322 02:32:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 232181' 00:27:13.322 killing process with pid 232181 00:27:13.322 02:32:16 -- common/autotest_common.sh@955 -- # kill 232181 00:27:13.322 Received shutdown signal, test time was about 2.000000 seconds 00:27:13.322 00:27:13.322 Latency(us) 00:27:13.322 [2024-11-29T01:32:17.003Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:13.322 [2024-11-29T01:32:17.003Z] =================================================================================================================== 00:27:13.322 [2024-11-29T01:32:17.003Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:13.322 02:32:16 -- common/autotest_common.sh@960 -- # wait 232181 00:27:13.582 02:32:17 -- host/digest.sh@115 -- # killprocess 230500 00:27:13.582 02:32:17 -- common/autotest_common.sh@936 -- # '[' -z 230500 ']' 00:27:13.582 02:32:17 -- common/autotest_common.sh@940 -- # kill -0 230500 00:27:13.582 02:32:17 -- common/autotest_common.sh@941 -- # uname 00:27:13.582 02:32:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:13.582 02:32:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 230500 00:27:13.582 02:32:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:13.582 02:32:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:13.582 02:32:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 230500' 00:27:13.582 killing process with pid 230500 00:27:13.582 02:32:17 -- common/autotest_common.sh@955 -- # kill 230500 00:27:13.582 02:32:17 -- common/autotest_common.sh@960 -- # wait 230500 00:27:13.841 00:27:13.842 real 0m17.801s 00:27:13.842 user 0m36.058s 00:27:13.842 sys 0m4.520s 00:27:13.842 02:32:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:13.842 02:32:17 -- common/autotest_common.sh@10 -- # set +x 00:27:13.842 ************************************ 00:27:13.842 END TEST nvmf_digest_error 00:27:13.842 ************************************ 00:27:13.842 02:32:17 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:27:13.842 02:32:17 -- host/digest.sh@139 -- # nvmftestfini 00:27:13.842 02:32:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:13.842 02:32:17 -- nvmf/common.sh@116 -- # sync 00:27:13.842 02:32:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:13.842 02:32:17 -- nvmf/common.sh@119 -- # set +e 00:27:13.842 02:32:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:13.842 02:32:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:13.842 rmmod nvme_tcp 00:27:13.842 rmmod nvme_fabrics 00:27:13.842 rmmod nvme_keyring 00:27:13.842 02:32:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:13.842 02:32:17 -- nvmf/common.sh@123 -- # set -e 00:27:13.842 02:32:17 -- nvmf/common.sh@124 -- # return 0 00:27:13.842 02:32:17 -- nvmf/common.sh@477 -- # '[' -n 230500 ']' 00:27:13.842 02:32:17 -- nvmf/common.sh@478 -- # killprocess 230500 00:27:13.842 02:32:17 -- common/autotest_common.sh@936 -- # '[' -z 230500 ']' 00:27:13.842 02:32:17 -- common/autotest_common.sh@940 -- # kill -0 230500 00:27:13.842 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (230500) - No such process 00:27:13.842 02:32:17 -- common/autotest_common.sh@963 -- # echo 'Process with pid 230500 is not found' 00:27:13.842 Process with pid 230500 is not found 00:27:13.842 02:32:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:13.842 02:32:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:13.842 02:32:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:13.842 02:32:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:13.842 02:32:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:13.842 02:32:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:13.842 02:32:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:13.842 02:32:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:16.423 02:32:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:16.423 00:27:16.423 real 0m38.177s 00:27:16.424 user 1m8.588s 00:27:16.424 sys 0m10.431s 00:27:16.424 02:32:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:16.424 02:32:19 -- common/autotest_common.sh@10 -- # set +x 00:27:16.424 ************************************ 00:27:16.424 END TEST nvmf_digest 00:27:16.424 ************************************ 00:27:16.424 02:32:19 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:27:16.424 02:32:19 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:27:16.424 02:32:19 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:27:16.424 02:32:19 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:16.424 02:32:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:16.424 02:32:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:16.424 02:32:19 -- common/autotest_common.sh@10 -- # set +x 00:27:16.424 ************************************ 00:27:16.424 START TEST nvmf_bdevperf 00:27:16.424 ************************************ 00:27:16.424 02:32:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:16.424 * Looking for test storage... 00:27:16.424 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:16.424 02:32:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:16.424 02:32:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:16.424 02:32:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:16.424 02:32:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:16.424 02:32:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:16.424 02:32:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:16.424 02:32:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:16.424 02:32:19 -- scripts/common.sh@335 -- # IFS=.-: 00:27:16.424 02:32:19 -- scripts/common.sh@335 -- # read -ra ver1 00:27:16.424 02:32:19 -- scripts/common.sh@336 -- # IFS=.-: 00:27:16.424 02:32:19 -- scripts/common.sh@336 -- # read -ra ver2 00:27:16.424 02:32:19 -- scripts/common.sh@337 -- # local 'op=<' 00:27:16.424 02:32:19 -- scripts/common.sh@339 -- # ver1_l=2 00:27:16.424 02:32:19 -- scripts/common.sh@340 -- # ver2_l=1 00:27:16.424 02:32:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:16.424 02:32:19 -- scripts/common.sh@343 -- # case "$op" in 00:27:16.424 02:32:19 -- scripts/common.sh@344 -- # : 1 00:27:16.424 02:32:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:16.424 02:32:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:16.424 02:32:19 -- scripts/common.sh@364 -- # decimal 1 00:27:16.424 02:32:19 -- scripts/common.sh@352 -- # local d=1 00:27:16.424 02:32:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:16.424 02:32:19 -- scripts/common.sh@354 -- # echo 1 00:27:16.424 02:32:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:16.424 02:32:19 -- scripts/common.sh@365 -- # decimal 2 00:27:16.424 02:32:19 -- scripts/common.sh@352 -- # local d=2 00:27:16.424 02:32:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:16.424 02:32:19 -- scripts/common.sh@354 -- # echo 2 00:27:16.424 02:32:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:16.424 02:32:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:16.424 02:32:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:16.424 02:32:19 -- scripts/common.sh@367 -- # return 0 00:27:16.424 02:32:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:16.424 02:32:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:16.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:16.424 --rc genhtml_branch_coverage=1 00:27:16.424 --rc genhtml_function_coverage=1 00:27:16.424 --rc genhtml_legend=1 00:27:16.424 --rc geninfo_all_blocks=1 00:27:16.424 --rc geninfo_unexecuted_blocks=1 00:27:16.424 00:27:16.424 ' 00:27:16.424 02:32:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:16.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:16.424 --rc genhtml_branch_coverage=1 00:27:16.424 --rc genhtml_function_coverage=1 00:27:16.424 --rc genhtml_legend=1 00:27:16.424 --rc geninfo_all_blocks=1 00:27:16.424 --rc geninfo_unexecuted_blocks=1 00:27:16.424 00:27:16.424 ' 00:27:16.424 02:32:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:16.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:16.424 --rc genhtml_branch_coverage=1 00:27:16.424 --rc genhtml_function_coverage=1 00:27:16.424 --rc genhtml_legend=1 00:27:16.424 --rc geninfo_all_blocks=1 00:27:16.424 --rc geninfo_unexecuted_blocks=1 00:27:16.424 00:27:16.424 ' 00:27:16.424 02:32:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:16.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:16.424 --rc genhtml_branch_coverage=1 00:27:16.424 --rc genhtml_function_coverage=1 00:27:16.424 --rc genhtml_legend=1 00:27:16.424 --rc geninfo_all_blocks=1 00:27:16.424 --rc geninfo_unexecuted_blocks=1 00:27:16.424 00:27:16.424 ' 00:27:16.424 02:32:19 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:16.424 02:32:19 -- nvmf/common.sh@7 -- # uname -s 00:27:16.424 02:32:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:16.424 02:32:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:16.424 02:32:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:16.424 02:32:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:16.424 02:32:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:16.424 02:32:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:16.424 02:32:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:16.424 02:32:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:16.424 02:32:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:16.424 02:32:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:16.424 02:32:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:16.424 02:32:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:16.424 02:32:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:16.424 02:32:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:16.424 02:32:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:16.424 02:32:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:16.424 02:32:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:16.424 02:32:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:16.424 02:32:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:16.424 02:32:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:16.424 02:32:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:16.424 02:32:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:16.424 02:32:19 -- paths/export.sh@5 -- # export PATH 00:27:16.424 02:32:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:16.424 02:32:19 -- nvmf/common.sh@46 -- # : 0 00:27:16.424 02:32:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:16.424 02:32:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:16.424 02:32:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:16.424 02:32:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:16.424 02:32:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:16.424 02:32:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:16.424 02:32:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:16.424 02:32:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:16.424 02:32:19 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:16.424 02:32:19 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:16.424 02:32:19 -- host/bdevperf.sh@24 -- # nvmftestinit 00:27:16.424 02:32:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:16.424 02:32:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:16.424 02:32:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:16.424 02:32:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:16.424 02:32:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:16.424 02:32:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:16.425 02:32:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:16.425 02:32:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:16.425 02:32:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:16.425 02:32:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:16.425 02:32:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:16.425 02:32:19 -- common/autotest_common.sh@10 -- # set +x 00:27:18.331 02:32:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:18.331 02:32:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:18.331 02:32:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:18.331 02:32:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:18.331 02:32:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:18.331 02:32:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:18.331 02:32:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:18.331 02:32:21 -- nvmf/common.sh@294 -- # net_devs=() 00:27:18.331 02:32:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:18.331 02:32:21 -- nvmf/common.sh@295 -- # e810=() 00:27:18.331 02:32:21 -- nvmf/common.sh@295 -- # local -ga e810 00:27:18.331 02:32:21 -- nvmf/common.sh@296 -- # x722=() 00:27:18.331 02:32:21 -- nvmf/common.sh@296 -- # local -ga x722 00:27:18.331 02:32:21 -- nvmf/common.sh@297 -- # mlx=() 00:27:18.331 02:32:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:18.331 02:32:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:18.331 02:32:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:18.331 02:32:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:18.331 02:32:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:18.331 02:32:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:18.331 02:32:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:18.331 02:32:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:18.331 02:32:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:18.331 02:32:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:18.331 02:32:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:18.331 02:32:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:18.331 02:32:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:18.331 02:32:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:18.331 02:32:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:18.331 02:32:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:18.331 02:32:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:18.331 02:32:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:18.331 02:32:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:18.331 02:32:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:18.331 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:18.331 02:32:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:18.331 02:32:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:18.331 02:32:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:18.331 02:32:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:18.331 02:32:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:18.331 02:32:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:18.331 02:32:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:18.331 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:18.331 02:32:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:18.331 02:32:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:18.332 02:32:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:18.332 02:32:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:18.332 02:32:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:18.332 02:32:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:18.332 02:32:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:18.332 02:32:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:18.332 02:32:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:18.332 02:32:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:18.332 02:32:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:18.332 02:32:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:18.332 02:32:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:18.332 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:18.332 02:32:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:18.332 02:32:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:18.332 02:32:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:18.332 02:32:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:18.332 02:32:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:18.332 02:32:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:18.332 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:18.332 02:32:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:18.332 02:32:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:18.332 02:32:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:18.332 02:32:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:18.332 02:32:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:18.332 02:32:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:18.332 02:32:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:18.332 02:32:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:18.332 02:32:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:18.332 02:32:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:18.332 02:32:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:18.332 02:32:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:18.332 02:32:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:18.332 02:32:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:18.332 02:32:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:18.332 02:32:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:18.332 02:32:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:18.332 02:32:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:18.332 02:32:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:18.332 02:32:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:18.332 02:32:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:18.332 02:32:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:18.332 02:32:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:18.332 02:32:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:18.332 02:32:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:18.332 02:32:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:18.332 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:18.332 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.282 ms 00:27:18.332 00:27:18.332 --- 10.0.0.2 ping statistics --- 00:27:18.332 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:18.332 rtt min/avg/max/mdev = 0.282/0.282/0.282/0.000 ms 00:27:18.332 02:32:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:18.332 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:18.332 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.079 ms 00:27:18.332 00:27:18.332 --- 10.0.0.1 ping statistics --- 00:27:18.332 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:18.332 rtt min/avg/max/mdev = 0.079/0.079/0.079/0.000 ms 00:27:18.332 02:32:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:18.332 02:32:21 -- nvmf/common.sh@410 -- # return 0 00:27:18.332 02:32:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:18.332 02:32:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:18.332 02:32:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:18.332 02:32:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:18.332 02:32:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:18.332 02:32:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:18.332 02:32:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:18.332 02:32:21 -- host/bdevperf.sh@25 -- # tgt_init 00:27:18.332 02:32:21 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:18.332 02:32:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:18.332 02:32:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:18.332 02:32:21 -- common/autotest_common.sh@10 -- # set +x 00:27:18.332 02:32:21 -- nvmf/common.sh@469 -- # nvmfpid=234586 00:27:18.332 02:32:21 -- nvmf/common.sh@470 -- # waitforlisten 234586 00:27:18.332 02:32:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:18.332 02:32:21 -- common/autotest_common.sh@829 -- # '[' -z 234586 ']' 00:27:18.332 02:32:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:18.332 02:32:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:18.332 02:32:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:18.332 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:18.332 02:32:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:18.332 02:32:21 -- common/autotest_common.sh@10 -- # set +x 00:27:18.332 [2024-11-29 02:32:21.948881] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:18.332 [2024-11-29 02:32:21.948965] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:18.332 EAL: No free 2048 kB hugepages reported on node 1 00:27:18.590 [2024-11-29 02:32:22.019365] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:18.590 [2024-11-29 02:32:22.137597] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:18.590 [2024-11-29 02:32:22.137765] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:18.590 [2024-11-29 02:32:22.137784] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:18.590 [2024-11-29 02:32:22.137799] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:18.590 [2024-11-29 02:32:22.137883] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:18.590 [2024-11-29 02:32:22.137981] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:18.590 [2024-11-29 02:32:22.137984] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:19.527 02:32:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:19.527 02:32:22 -- common/autotest_common.sh@862 -- # return 0 00:27:19.527 02:32:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:19.527 02:32:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:19.527 02:32:22 -- common/autotest_common.sh@10 -- # set +x 00:27:19.527 02:32:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:19.527 02:32:22 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:19.527 02:32:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.527 02:32:22 -- common/autotest_common.sh@10 -- # set +x 00:27:19.527 [2024-11-29 02:32:22.945222] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:19.527 02:32:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.527 02:32:22 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:19.527 02:32:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.527 02:32:22 -- common/autotest_common.sh@10 -- # set +x 00:27:19.527 Malloc0 00:27:19.527 02:32:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.527 02:32:22 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:19.527 02:32:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.527 02:32:22 -- common/autotest_common.sh@10 -- # set +x 00:27:19.527 02:32:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.527 02:32:22 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:19.527 02:32:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.527 02:32:22 -- common/autotest_common.sh@10 -- # set +x 00:27:19.527 02:32:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.527 02:32:23 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:19.527 02:32:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.527 02:32:23 -- common/autotest_common.sh@10 -- # set +x 00:27:19.527 [2024-11-29 02:32:23.004500] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:19.527 02:32:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.527 02:32:23 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:27:19.527 02:32:23 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:27:19.527 02:32:23 -- nvmf/common.sh@520 -- # config=() 00:27:19.527 02:32:23 -- nvmf/common.sh@520 -- # local subsystem config 00:27:19.527 02:32:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:19.527 02:32:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:19.527 { 00:27:19.527 "params": { 00:27:19.527 "name": "Nvme$subsystem", 00:27:19.527 "trtype": "$TEST_TRANSPORT", 00:27:19.527 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:19.527 "adrfam": "ipv4", 00:27:19.527 "trsvcid": "$NVMF_PORT", 00:27:19.527 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:19.527 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:19.527 "hdgst": ${hdgst:-false}, 00:27:19.527 "ddgst": ${ddgst:-false} 00:27:19.527 }, 00:27:19.527 "method": "bdev_nvme_attach_controller" 00:27:19.527 } 00:27:19.527 EOF 00:27:19.528 )") 00:27:19.528 02:32:23 -- nvmf/common.sh@542 -- # cat 00:27:19.528 02:32:23 -- nvmf/common.sh@544 -- # jq . 00:27:19.528 02:32:23 -- nvmf/common.sh@545 -- # IFS=, 00:27:19.528 02:32:23 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:19.528 "params": { 00:27:19.528 "name": "Nvme1", 00:27:19.528 "trtype": "tcp", 00:27:19.528 "traddr": "10.0.0.2", 00:27:19.528 "adrfam": "ipv4", 00:27:19.528 "trsvcid": "4420", 00:27:19.528 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:19.528 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:19.528 "hdgst": false, 00:27:19.528 "ddgst": false 00:27:19.528 }, 00:27:19.528 "method": "bdev_nvme_attach_controller" 00:27:19.528 }' 00:27:19.528 [2024-11-29 02:32:23.048866] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:19.528 [2024-11-29 02:32:23.048951] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid234739 ] 00:27:19.528 EAL: No free 2048 kB hugepages reported on node 1 00:27:19.528 [2024-11-29 02:32:23.114125] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:19.788 [2024-11-29 02:32:23.224633] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:19.788 Running I/O for 1 seconds... 00:27:21.169 00:27:21.169 Latency(us) 00:27:21.169 [2024-11-29T01:32:24.850Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:21.169 [2024-11-29T01:32:24.850Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:21.169 Verification LBA range: start 0x0 length 0x4000 00:27:21.169 Nvme1n1 : 1.01 12982.02 50.71 0.00 0.00 9817.54 843.47 16019.91 00:27:21.169 [2024-11-29T01:32:24.850Z] =================================================================================================================== 00:27:21.169 [2024-11-29T01:32:24.850Z] Total : 12982.02 50.71 0.00 0.00 9817.54 843.47 16019.91 00:27:21.169 02:32:24 -- host/bdevperf.sh@30 -- # bdevperfpid=234995 00:27:21.169 02:32:24 -- host/bdevperf.sh@32 -- # sleep 3 00:27:21.169 02:32:24 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:27:21.169 02:32:24 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:27:21.169 02:32:24 -- nvmf/common.sh@520 -- # config=() 00:27:21.169 02:32:24 -- nvmf/common.sh@520 -- # local subsystem config 00:27:21.170 02:32:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:21.170 02:32:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:21.170 { 00:27:21.170 "params": { 00:27:21.170 "name": "Nvme$subsystem", 00:27:21.170 "trtype": "$TEST_TRANSPORT", 00:27:21.170 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:21.170 "adrfam": "ipv4", 00:27:21.170 "trsvcid": "$NVMF_PORT", 00:27:21.170 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:21.170 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:21.170 "hdgst": ${hdgst:-false}, 00:27:21.170 "ddgst": ${ddgst:-false} 00:27:21.170 }, 00:27:21.170 "method": "bdev_nvme_attach_controller" 00:27:21.170 } 00:27:21.170 EOF 00:27:21.170 )") 00:27:21.170 02:32:24 -- nvmf/common.sh@542 -- # cat 00:27:21.170 02:32:24 -- nvmf/common.sh@544 -- # jq . 00:27:21.170 02:32:24 -- nvmf/common.sh@545 -- # IFS=, 00:27:21.170 02:32:24 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:21.170 "params": { 00:27:21.170 "name": "Nvme1", 00:27:21.170 "trtype": "tcp", 00:27:21.170 "traddr": "10.0.0.2", 00:27:21.170 "adrfam": "ipv4", 00:27:21.170 "trsvcid": "4420", 00:27:21.170 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:21.170 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:21.170 "hdgst": false, 00:27:21.170 "ddgst": false 00:27:21.170 }, 00:27:21.170 "method": "bdev_nvme_attach_controller" 00:27:21.170 }' 00:27:21.170 [2024-11-29 02:32:24.749333] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:21.170 [2024-11-29 02:32:24.749443] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid234995 ] 00:27:21.170 EAL: No free 2048 kB hugepages reported on node 1 00:27:21.170 [2024-11-29 02:32:24.808070] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:21.430 [2024-11-29 02:32:24.916438] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:21.693 Running I/O for 15 seconds... 00:27:24.231 02:32:27 -- host/bdevperf.sh@33 -- # kill -9 234586 00:27:24.231 02:32:27 -- host/bdevperf.sh@35 -- # sleep 3 00:27:24.231 [2024-11-29 02:32:27.721077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:130192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.231 [2024-11-29 02:32:27.721135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.231 [2024-11-29 02:32:27.721167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:130208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.231 [2024-11-29 02:32:27.721202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.231 [2024-11-29 02:32:27.721220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:130240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.231 [2024-11-29 02:32:27.721235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.231 [2024-11-29 02:32:27.721251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:130264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.231 [2024-11-29 02:32:27.721267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.231 [2024-11-29 02:32:27.721284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:130272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.231 [2024-11-29 02:32:27.721313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.231 [2024-11-29 02:32:27.721329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:130288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.231 [2024-11-29 02:32:27.721343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.231 [2024-11-29 02:32:27.721360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:130296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.231 [2024-11-29 02:32:27.721390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.231 [2024-11-29 02:32:27.721415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:130304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.231 [2024-11-29 02:32:27.721444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.721461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:130312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.232 [2024-11-29 02:32:27.721475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.721501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:130320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.232 [2024-11-29 02:32:27.721516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.721532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:130328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.232 [2024-11-29 02:32:27.721546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.721562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:130336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.232 [2024-11-29 02:32:27.721578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.721594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:129640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.232 [2024-11-29 02:32:27.721609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.721624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:129648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.232 [2024-11-29 02:32:27.721637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.721652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:129688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.232 [2024-11-29 02:32:27.721666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.721682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:129696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.232 [2024-11-29 02:32:27.721695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.721710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:129720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.232 [2024-11-29 02:32:27.721723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.721757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:129760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.232 [2024-11-29 02:32:27.721771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.721785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:129768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.232 [2024-11-29 02:32:27.721798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.721827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:129776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.232 [2024-11-29 02:32:27.721840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.721854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:129792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.232 [2024-11-29 02:32:27.721866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.721880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:129800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.232 [2024-11-29 02:32:27.721911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.721926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:129808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.232 [2024-11-29 02:32:27.721939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.721953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:129816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.232 [2024-11-29 02:32:27.721965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.721994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:129832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.232 [2024-11-29 02:32:27.722007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.722020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:129840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.232 [2024-11-29 02:32:27.722032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.722045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:129848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.232 [2024-11-29 02:32:27.722057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.722070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:129856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.232 [2024-11-29 02:32:27.722082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.722095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:130344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.232 [2024-11-29 02:32:27.722107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.722120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:130352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.232 [2024-11-29 02:32:27.722133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.722146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:130360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.232 [2024-11-29 02:32:27.722160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.722174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:130368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.232 [2024-11-29 02:32:27.722186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.722199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:130376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.232 [2024-11-29 02:32:27.722211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.722225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:130384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.232 [2024-11-29 02:32:27.722237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.722253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:130392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.232 [2024-11-29 02:32:27.722265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.722278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:130400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.232 [2024-11-29 02:32:27.722290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.722303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:130408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.232 [2024-11-29 02:32:27.722314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.722327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:130416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.232 [2024-11-29 02:32:27.722339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.232 [2024-11-29 02:32:27.722352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:130424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.232 [2024-11-29 02:32:27.722364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.722400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:130432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.233 [2024-11-29 02:32:27.722416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.722431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:130440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.233 [2024-11-29 02:32:27.722445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.722459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:130448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.233 [2024-11-29 02:32:27.722473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.722488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:130456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.233 [2024-11-29 02:32:27.722501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.722517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:130464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.233 [2024-11-29 02:32:27.722530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.722544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:130472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.233 [2024-11-29 02:32:27.722557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.722572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:130480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.233 [2024-11-29 02:32:27.722585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.722600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:130488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.233 [2024-11-29 02:32:27.722617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.722633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:130496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.233 [2024-11-29 02:32:27.722646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.722661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:130504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.233 [2024-11-29 02:32:27.722674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.722703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:130512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.233 [2024-11-29 02:32:27.722715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.722728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:130520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.233 [2024-11-29 02:32:27.722740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.722753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:130528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.233 [2024-11-29 02:32:27.722765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.722778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:130536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.233 [2024-11-29 02:32:27.722790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.722803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:130544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.233 [2024-11-29 02:32:27.722815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.722828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:130552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.233 [2024-11-29 02:32:27.722839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.722852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:130560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.233 [2024-11-29 02:32:27.722864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.722877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:130568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.233 [2024-11-29 02:32:27.722889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.722902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:130576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.233 [2024-11-29 02:32:27.722914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.722927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:130584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.233 [2024-11-29 02:32:27.722939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.722955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:130592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.233 [2024-11-29 02:32:27.722967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.722980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:130600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.233 [2024-11-29 02:32:27.722991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.723004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:130608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.233 [2024-11-29 02:32:27.723016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.723029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:130616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.233 [2024-11-29 02:32:27.723041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.723054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:130624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.233 [2024-11-29 02:32:27.723066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.723079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:129864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.233 [2024-11-29 02:32:27.723091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.723104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:129896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.233 [2024-11-29 02:32:27.723116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.723129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:129920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.233 [2024-11-29 02:32:27.723141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.233 [2024-11-29 02:32:27.723154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:129952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.233 [2024-11-29 02:32:27.723166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:129960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.234 [2024-11-29 02:32:27.723191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:129992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.234 [2024-11-29 02:32:27.723216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:130032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.234 [2024-11-29 02:32:27.723240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:130040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.234 [2024-11-29 02:32:27.723267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:130048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.234 [2024-11-29 02:32:27.723293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:130080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.234 [2024-11-29 02:32:27.723318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:130096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.234 [2024-11-29 02:32:27.723343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:130112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.234 [2024-11-29 02:32:27.723368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:130128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.234 [2024-11-29 02:32:27.723420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:130136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.234 [2024-11-29 02:32:27.723448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:130152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.234 [2024-11-29 02:32:27.723477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:130160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.234 [2024-11-29 02:32:27.723505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:130632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.234 [2024-11-29 02:32:27.723533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:130640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.234 [2024-11-29 02:32:27.723561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:130648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.234 [2024-11-29 02:32:27.723589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:130656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.234 [2024-11-29 02:32:27.723617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:130664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.234 [2024-11-29 02:32:27.723654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:130672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.234 [2024-11-29 02:32:27.723697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:130680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.234 [2024-11-29 02:32:27.723724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:130688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.234 [2024-11-29 02:32:27.723764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:130696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.234 [2024-11-29 02:32:27.723789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:130704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.234 [2024-11-29 02:32:27.723814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:130712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.234 [2024-11-29 02:32:27.723839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:130720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.234 [2024-11-29 02:32:27.723865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:130728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.234 [2024-11-29 02:32:27.723889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:130736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.234 [2024-11-29 02:32:27.723914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:130744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.234 [2024-11-29 02:32:27.723945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:130752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.234 [2024-11-29 02:32:27.723971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.723984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:130760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.234 [2024-11-29 02:32:27.723996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.234 [2024-11-29 02:32:27.724012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:130768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.235 [2024-11-29 02:32:27.724024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:130776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.235 [2024-11-29 02:32:27.724049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:130784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.235 [2024-11-29 02:32:27.724074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:130792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.235 [2024-11-29 02:32:27.724098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:130800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.235 [2024-11-29 02:32:27.724123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:130808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.235 [2024-11-29 02:32:27.724148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:130816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.235 [2024-11-29 02:32:27.724173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:130824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.235 [2024-11-29 02:32:27.724198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:130832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.235 [2024-11-29 02:32:27.724222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:130840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.235 [2024-11-29 02:32:27.724246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:130848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.235 [2024-11-29 02:32:27.724271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:130856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.235 [2024-11-29 02:32:27.724296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:130864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.235 [2024-11-29 02:32:27.724323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:130872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.235 [2024-11-29 02:32:27.724353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:130880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.235 [2024-11-29 02:32:27.724400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:130888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.235 [2024-11-29 02:32:27.724432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:130896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.235 [2024-11-29 02:32:27.724460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:130904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.235 [2024-11-29 02:32:27.724488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:130912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.235 [2024-11-29 02:32:27.724516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:130920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.235 [2024-11-29 02:32:27.724545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:130928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.235 [2024-11-29 02:32:27.724573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:130936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.235 [2024-11-29 02:32:27.724600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:130944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.235 [2024-11-29 02:32:27.724628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:130184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.235 [2024-11-29 02:32:27.724656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:130200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.235 [2024-11-29 02:32:27.724697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:130216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.235 [2024-11-29 02:32:27.724729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:130224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.235 [2024-11-29 02:32:27.724769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:130232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.235 [2024-11-29 02:32:27.724794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:130248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.235 [2024-11-29 02:32:27.724819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:130256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.235 [2024-11-29 02:32:27.724848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.235 [2024-11-29 02:32:27.724862] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cc740 is same with the state(5) to be set 00:27:24.235 [2024-11-29 02:32:27.724877] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:24.235 [2024-11-29 02:32:27.724886] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:24.236 [2024-11-29 02:32:27.724896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:130280 len:8 PRP1 0x0 PRP2 0x0 00:27:24.236 [2024-11-29 02:32:27.724908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.236 [2024-11-29 02:32:27.724968] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x6cc740 was disconnected and freed. reset controller. 00:27:24.236 [2024-11-29 02:32:27.725048] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:27:24.236 [2024-11-29 02:32:27.725075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.236 [2024-11-29 02:32:27.725111] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:24.236 [2024-11-29 02:32:27.725125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.236 [2024-11-29 02:32:27.725138] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:24.236 [2024-11-29 02:32:27.725150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.236 [2024-11-29 02:32:27.725162] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:24.236 [2024-11-29 02:32:27.725174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.236 [2024-11-29 02:32:27.725186] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.236 [2024-11-29 02:32:27.727227] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.236 [2024-11-29 02:32:27.727266] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.236 [2024-11-29 02:32:27.727725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.236 [2024-11-29 02:32:27.727863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.236 [2024-11-29 02:32:27.727889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.236 [2024-11-29 02:32:27.727905] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.236 [2024-11-29 02:32:27.728084] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.236 [2024-11-29 02:32:27.728224] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.236 [2024-11-29 02:32:27.728243] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.236 [2024-11-29 02:32:27.728260] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.236 [2024-11-29 02:32:27.730331] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.236 [2024-11-29 02:32:27.740025] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.236 [2024-11-29 02:32:27.740465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.236 [2024-11-29 02:32:27.740592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.236 [2024-11-29 02:32:27.740620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.236 [2024-11-29 02:32:27.740637] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.236 [2024-11-29 02:32:27.740815] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.236 [2024-11-29 02:32:27.740982] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.236 [2024-11-29 02:32:27.741001] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.236 [2024-11-29 02:32:27.741013] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.236 [2024-11-29 02:32:27.743088] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.236 [2024-11-29 02:32:27.752605] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.236 [2024-11-29 02:32:27.753012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.236 [2024-11-29 02:32:27.753140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.236 [2024-11-29 02:32:27.753181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.236 [2024-11-29 02:32:27.753198] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.236 [2024-11-29 02:32:27.753389] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.236 [2024-11-29 02:32:27.753544] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.236 [2024-11-29 02:32:27.753570] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.236 [2024-11-29 02:32:27.753590] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.236 [2024-11-29 02:32:27.755807] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.236 [2024-11-29 02:32:27.765221] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.236 [2024-11-29 02:32:27.765509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.236 [2024-11-29 02:32:27.765645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.236 [2024-11-29 02:32:27.765671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.236 [2024-11-29 02:32:27.765687] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.236 [2024-11-29 02:32:27.765834] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.236 [2024-11-29 02:32:27.766006] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.236 [2024-11-29 02:32:27.766024] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.236 [2024-11-29 02:32:27.766037] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.236 [2024-11-29 02:32:27.768013] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.236 [2024-11-29 02:32:27.777890] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.236 [2024-11-29 02:32:27.778286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.236 [2024-11-29 02:32:27.778448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.236 [2024-11-29 02:32:27.778475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.236 [2024-11-29 02:32:27.778491] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.236 [2024-11-29 02:32:27.778636] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.236 [2024-11-29 02:32:27.778822] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.236 [2024-11-29 02:32:27.778841] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.236 [2024-11-29 02:32:27.778854] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.236 [2024-11-29 02:32:27.781243] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.236 [2024-11-29 02:32:27.790541] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.236 [2024-11-29 02:32:27.790897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.236 [2024-11-29 02:32:27.791071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.236 [2024-11-29 02:32:27.791096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.236 [2024-11-29 02:32:27.791112] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.236 [2024-11-29 02:32:27.791305] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.236 [2024-11-29 02:32:27.791499] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.236 [2024-11-29 02:32:27.791520] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.236 [2024-11-29 02:32:27.791533] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.236 [2024-11-29 02:32:27.793743] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.237 [2024-11-29 02:32:27.803364] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.237 [2024-11-29 02:32:27.803695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.237 [2024-11-29 02:32:27.803816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.237 [2024-11-29 02:32:27.803846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.237 [2024-11-29 02:32:27.803862] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.237 [2024-11-29 02:32:27.803958] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.237 [2024-11-29 02:32:27.804132] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.237 [2024-11-29 02:32:27.804151] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.237 [2024-11-29 02:32:27.804163] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.237 [2024-11-29 02:32:27.806477] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.237 [2024-11-29 02:32:27.815845] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.237 [2024-11-29 02:32:27.816082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.237 [2024-11-29 02:32:27.816257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.237 [2024-11-29 02:32:27.816299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.237 [2024-11-29 02:32:27.816317] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.237 [2024-11-29 02:32:27.816442] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.237 [2024-11-29 02:32:27.816629] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.237 [2024-11-29 02:32:27.816649] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.237 [2024-11-29 02:32:27.816662] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.237 [2024-11-29 02:32:27.818846] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.237 [2024-11-29 02:32:27.828075] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.237 [2024-11-29 02:32:27.828421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.237 [2024-11-29 02:32:27.828538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.237 [2024-11-29 02:32:27.828564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.237 [2024-11-29 02:32:27.828580] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.237 [2024-11-29 02:32:27.828694] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.237 [2024-11-29 02:32:27.828867] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.237 [2024-11-29 02:32:27.828887] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.237 [2024-11-29 02:32:27.828899] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.237 [2024-11-29 02:32:27.831070] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.237 [2024-11-29 02:32:27.840808] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.237 [2024-11-29 02:32:27.841200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.237 [2024-11-29 02:32:27.841412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.237 [2024-11-29 02:32:27.841452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.237 [2024-11-29 02:32:27.841473] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.237 [2024-11-29 02:32:27.841597] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.237 [2024-11-29 02:32:27.841749] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.237 [2024-11-29 02:32:27.841768] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.237 [2024-11-29 02:32:27.841780] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.237 [2024-11-29 02:32:27.844005] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.237 [2024-11-29 02:32:27.853526] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.237 [2024-11-29 02:32:27.853932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.237 [2024-11-29 02:32:27.854143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.237 [2024-11-29 02:32:27.854169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.237 [2024-11-29 02:32:27.854185] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.237 [2024-11-29 02:32:27.854331] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.237 [2024-11-29 02:32:27.854515] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.237 [2024-11-29 02:32:27.854536] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.237 [2024-11-29 02:32:27.854548] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.237 [2024-11-29 02:32:27.856693] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.237 [2024-11-29 02:32:27.866283] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.237 [2024-11-29 02:32:27.866656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.237 [2024-11-29 02:32:27.866797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.237 [2024-11-29 02:32:27.866823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.237 [2024-11-29 02:32:27.866839] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.237 [2024-11-29 02:32:27.867017] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.237 [2024-11-29 02:32:27.867201] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.237 [2024-11-29 02:32:27.867220] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.238 [2024-11-29 02:32:27.867232] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.238 [2024-11-29 02:32:27.869462] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.238 [2024-11-29 02:32:27.878876] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.238 [2024-11-29 02:32:27.879252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.238 [2024-11-29 02:32:27.879413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.238 [2024-11-29 02:32:27.879440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.238 [2024-11-29 02:32:27.879456] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.238 [2024-11-29 02:32:27.879577] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.238 [2024-11-29 02:32:27.879771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.238 [2024-11-29 02:32:27.879790] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.238 [2024-11-29 02:32:27.879802] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.238 [2024-11-29 02:32:27.882140] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.238 [2024-11-29 02:32:27.891448] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.238 [2024-11-29 02:32:27.891727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.238 [2024-11-29 02:32:27.891901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.238 [2024-11-29 02:32:27.891927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.238 [2024-11-29 02:32:27.891943] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.238 [2024-11-29 02:32:27.892105] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.238 [2024-11-29 02:32:27.892288] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.238 [2024-11-29 02:32:27.892307] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.238 [2024-11-29 02:32:27.892319] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.238 [2024-11-29 02:32:27.894223] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.238 [2024-11-29 02:32:27.904138] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.238 [2024-11-29 02:32:27.904481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.238 [2024-11-29 02:32:27.904608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.238 [2024-11-29 02:32:27.904635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.238 [2024-11-29 02:32:27.904652] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.238 [2024-11-29 02:32:27.904876] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.238 [2024-11-29 02:32:27.905060] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.238 [2024-11-29 02:32:27.905083] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.238 [2024-11-29 02:32:27.905098] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.238 [2024-11-29 02:32:27.907591] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.497 [2024-11-29 02:32:27.916846] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.497 [2024-11-29 02:32:27.917118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.497 [2024-11-29 02:32:27.917321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.497 [2024-11-29 02:32:27.917351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.497 [2024-11-29 02:32:27.917368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.497 [2024-11-29 02:32:27.917539] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.497 [2024-11-29 02:32:27.917785] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.497 [2024-11-29 02:32:27.917804] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.497 [2024-11-29 02:32:27.917816] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.497 [2024-11-29 02:32:27.920236] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.497 [2024-11-29 02:32:27.929307] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.497 [2024-11-29 02:32:27.929616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.498 [2024-11-29 02:32:27.929730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.498 [2024-11-29 02:32:27.929756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.498 [2024-11-29 02:32:27.929772] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.498 [2024-11-29 02:32:27.929904] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.498 [2024-11-29 02:32:27.930103] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.498 [2024-11-29 02:32:27.930121] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.498 [2024-11-29 02:32:27.930134] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.498 [2024-11-29 02:32:27.932717] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.498 [2024-11-29 02:32:27.941859] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.498 [2024-11-29 02:32:27.942219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.498 [2024-11-29 02:32:27.942362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.498 [2024-11-29 02:32:27.942388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.498 [2024-11-29 02:32:27.942426] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.498 [2024-11-29 02:32:27.942645] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.498 [2024-11-29 02:32:27.942809] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.498 [2024-11-29 02:32:27.942828] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.498 [2024-11-29 02:32:27.942840] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.498 [2024-11-29 02:32:27.945084] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.498 [2024-11-29 02:32:27.954609] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.498 [2024-11-29 02:32:27.954971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.498 [2024-11-29 02:32:27.955131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.498 [2024-11-29 02:32:27.955157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.498 [2024-11-29 02:32:27.955173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.498 [2024-11-29 02:32:27.955337] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.498 [2024-11-29 02:32:27.955516] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.498 [2024-11-29 02:32:27.955540] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.498 [2024-11-29 02:32:27.955553] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.498 [2024-11-29 02:32:27.957856] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.498 [2024-11-29 02:32:27.967162] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.498 [2024-11-29 02:32:27.967569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.498 [2024-11-29 02:32:27.967752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.498 [2024-11-29 02:32:27.967778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.498 [2024-11-29 02:32:27.967794] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.498 [2024-11-29 02:32:27.968028] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.498 [2024-11-29 02:32:27.968150] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.498 [2024-11-29 02:32:27.968168] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.498 [2024-11-29 02:32:27.968180] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.498 [2024-11-29 02:32:27.970695] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.498 [2024-11-29 02:32:27.979793] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.498 [2024-11-29 02:32:27.980137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.498 [2024-11-29 02:32:27.980276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.498 [2024-11-29 02:32:27.980302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.498 [2024-11-29 02:32:27.980318] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.498 [2024-11-29 02:32:27.980507] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.498 [2024-11-29 02:32:27.980727] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.498 [2024-11-29 02:32:27.980746] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.498 [2024-11-29 02:32:27.980759] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.498 [2024-11-29 02:32:27.982948] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.498 [2024-11-29 02:32:27.992512] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.498 [2024-11-29 02:32:27.992885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.498 [2024-11-29 02:32:27.993013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.498 [2024-11-29 02:32:27.993040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.498 [2024-11-29 02:32:27.993056] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.498 [2024-11-29 02:32:27.993208] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.498 [2024-11-29 02:32:27.993382] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.498 [2024-11-29 02:32:27.993416] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.498 [2024-11-29 02:32:27.993451] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.498 [2024-11-29 02:32:27.995640] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.498 [2024-11-29 02:32:28.004880] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.498 [2024-11-29 02:32:28.005131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.498 [2024-11-29 02:32:28.005305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.498 [2024-11-29 02:32:28.005347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.498 [2024-11-29 02:32:28.005366] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.498 [2024-11-29 02:32:28.005597] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.498 [2024-11-29 02:32:28.005770] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.498 [2024-11-29 02:32:28.005794] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.498 [2024-11-29 02:32:28.005809] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.498 [2024-11-29 02:32:28.008028] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.498 [2024-11-29 02:32:28.017436] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.498 [2024-11-29 02:32:28.017702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.499 [2024-11-29 02:32:28.017879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.499 [2024-11-29 02:32:28.017905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.499 [2024-11-29 02:32:28.017922] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.499 [2024-11-29 02:32:28.018094] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.499 [2024-11-29 02:32:28.018246] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.499 [2024-11-29 02:32:28.018265] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.499 [2024-11-29 02:32:28.018277] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.499 [2024-11-29 02:32:28.020619] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.499 [2024-11-29 02:32:28.029987] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.499 [2024-11-29 02:32:28.030381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.499 [2024-11-29 02:32:28.030548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.499 [2024-11-29 02:32:28.030573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.499 [2024-11-29 02:32:28.030589] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.499 [2024-11-29 02:32:28.030779] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.499 [2024-11-29 02:32:28.030960] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.499 [2024-11-29 02:32:28.030979] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.499 [2024-11-29 02:32:28.030991] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.499 [2024-11-29 02:32:28.033186] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.499 [2024-11-29 02:32:28.042626] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.499 [2024-11-29 02:32:28.042950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.499 [2024-11-29 02:32:28.043103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.499 [2024-11-29 02:32:28.043129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.499 [2024-11-29 02:32:28.043145] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.499 [2024-11-29 02:32:28.043244] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.499 [2024-11-29 02:32:28.043473] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.499 [2024-11-29 02:32:28.043492] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.499 [2024-11-29 02:32:28.043504] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.499 [2024-11-29 02:32:28.045616] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.499 [2024-11-29 02:32:28.055125] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.499 [2024-11-29 02:32:28.055456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.499 [2024-11-29 02:32:28.055596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.499 [2024-11-29 02:32:28.055621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.499 [2024-11-29 02:32:28.055637] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.499 [2024-11-29 02:32:28.055812] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.499 [2024-11-29 02:32:28.055982] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.499 [2024-11-29 02:32:28.056001] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.499 [2024-11-29 02:32:28.056014] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.499 [2024-11-29 02:32:28.058387] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.499 [2024-11-29 02:32:28.067780] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.499 [2024-11-29 02:32:28.068199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.499 [2024-11-29 02:32:28.068357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.499 [2024-11-29 02:32:28.068383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.499 [2024-11-29 02:32:28.068408] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.499 [2024-11-29 02:32:28.068558] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.499 [2024-11-29 02:32:28.068777] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.499 [2024-11-29 02:32:28.068796] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.499 [2024-11-29 02:32:28.068809] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.499 [2024-11-29 02:32:28.070944] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.499 [2024-11-29 02:32:28.080439] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.499 [2024-11-29 02:32:28.080770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.499 [2024-11-29 02:32:28.080902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.499 [2024-11-29 02:32:28.080927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.499 [2024-11-29 02:32:28.080942] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.499 [2024-11-29 02:32:28.081038] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.499 [2024-11-29 02:32:28.081211] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.499 [2024-11-29 02:32:28.081230] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.499 [2024-11-29 02:32:28.081242] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.499 [2024-11-29 02:32:28.083688] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.499 [2024-11-29 02:32:28.093072] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.499 [2024-11-29 02:32:28.093457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.499 [2024-11-29 02:32:28.093585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.499 [2024-11-29 02:32:28.093611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.499 [2024-11-29 02:32:28.093627] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.499 [2024-11-29 02:32:28.093757] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.499 [2024-11-29 02:32:28.093944] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.499 [2024-11-29 02:32:28.093963] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.499 [2024-11-29 02:32:28.093976] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.499 [2024-11-29 02:32:28.096155] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.499 [2024-11-29 02:32:28.105390] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.499 [2024-11-29 02:32:28.105722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.499 [2024-11-29 02:32:28.105879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.499 [2024-11-29 02:32:28.105905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.499 [2024-11-29 02:32:28.105920] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.499 [2024-11-29 02:32:28.106068] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.500 [2024-11-29 02:32:28.106253] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.500 [2024-11-29 02:32:28.106272] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.500 [2024-11-29 02:32:28.106284] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.500 [2024-11-29 02:32:28.108576] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.500 [2024-11-29 02:32:28.117946] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.500 [2024-11-29 02:32:28.118297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.500 [2024-11-29 02:32:28.118477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.500 [2024-11-29 02:32:28.118504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.500 [2024-11-29 02:32:28.118520] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.500 [2024-11-29 02:32:28.118683] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.500 [2024-11-29 02:32:28.118837] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.500 [2024-11-29 02:32:28.118856] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.500 [2024-11-29 02:32:28.118868] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.500 [2024-11-29 02:32:28.121146] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.500 [2024-11-29 02:32:28.130516] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.500 [2024-11-29 02:32:28.130841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.500 [2024-11-29 02:32:28.130974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.500 [2024-11-29 02:32:28.131000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.500 [2024-11-29 02:32:28.131016] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.500 [2024-11-29 02:32:28.131163] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.500 [2024-11-29 02:32:28.131332] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.500 [2024-11-29 02:32:28.131350] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.500 [2024-11-29 02:32:28.131362] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.500 [2024-11-29 02:32:28.133737] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.500 [2024-11-29 02:32:28.143153] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.500 [2024-11-29 02:32:28.143471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.500 [2024-11-29 02:32:28.143631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.500 [2024-11-29 02:32:28.143657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.500 [2024-11-29 02:32:28.143673] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.500 [2024-11-29 02:32:28.143772] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.500 [2024-11-29 02:32:28.143988] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.500 [2024-11-29 02:32:28.144007] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.500 [2024-11-29 02:32:28.144019] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.500 [2024-11-29 02:32:28.146136] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.500 [2024-11-29 02:32:28.155856] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.500 [2024-11-29 02:32:28.156140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.500 [2024-11-29 02:32:28.156234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.500 [2024-11-29 02:32:28.156265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.500 [2024-11-29 02:32:28.156281] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.500 [2024-11-29 02:32:28.156471] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.500 [2024-11-29 02:32:28.156639] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.500 [2024-11-29 02:32:28.156658] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.500 [2024-11-29 02:32:28.156670] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.500 [2024-11-29 02:32:28.158974] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.500 [2024-11-29 02:32:28.168250] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.500 [2024-11-29 02:32:28.168643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.500 [2024-11-29 02:32:28.168775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.500 [2024-11-29 02:32:28.168802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.500 [2024-11-29 02:32:28.168818] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.500 [2024-11-29 02:32:28.169011] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.500 [2024-11-29 02:32:28.169134] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.500 [2024-11-29 02:32:28.169153] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.500 [2024-11-29 02:32:28.169165] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.500 [2024-11-29 02:32:28.171212] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.761 [2024-11-29 02:32:28.180781] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.761 [2024-11-29 02:32:28.181109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.761 [2024-11-29 02:32:28.181237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.761 [2024-11-29 02:32:28.181262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.761 [2024-11-29 02:32:28.181278] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.761 [2024-11-29 02:32:28.181501] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.761 [2024-11-29 02:32:28.181660] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.761 [2024-11-29 02:32:28.181680] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.761 [2024-11-29 02:32:28.181693] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.761 [2024-11-29 02:32:28.183959] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.761 [2024-11-29 02:32:28.193299] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.761 [2024-11-29 02:32:28.193649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.761 [2024-11-29 02:32:28.193774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.761 [2024-11-29 02:32:28.193800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.761 [2024-11-29 02:32:28.193820] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.761 [2024-11-29 02:32:28.193983] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.761 [2024-11-29 02:32:28.194136] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.761 [2024-11-29 02:32:28.194154] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.761 [2024-11-29 02:32:28.194166] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.761 [2024-11-29 02:32:28.196516] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.761 [2024-11-29 02:32:28.205896] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.761 [2024-11-29 02:32:28.206238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.761 [2024-11-29 02:32:28.206331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.761 [2024-11-29 02:32:28.206357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.761 [2024-11-29 02:32:28.206373] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.761 [2024-11-29 02:32:28.206594] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.761 [2024-11-29 02:32:28.206736] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.761 [2024-11-29 02:32:28.206754] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.761 [2024-11-29 02:32:28.206766] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.761 [2024-11-29 02:32:28.209185] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.761 [2024-11-29 02:32:28.218300] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.761 [2024-11-29 02:32:28.218666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.761 [2024-11-29 02:32:28.218809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.761 [2024-11-29 02:32:28.218835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.761 [2024-11-29 02:32:28.218850] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.761 [2024-11-29 02:32:28.219059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.761 [2024-11-29 02:32:28.219211] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.761 [2024-11-29 02:32:28.219230] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.761 [2024-11-29 02:32:28.219242] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.761 [2024-11-29 02:32:28.221428] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.761 [2024-11-29 02:32:28.230906] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.761 [2024-11-29 02:32:28.231199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.761 [2024-11-29 02:32:28.231337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.761 [2024-11-29 02:32:28.231362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.761 [2024-11-29 02:32:28.231378] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.761 [2024-11-29 02:32:28.231573] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.761 [2024-11-29 02:32:28.231787] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.761 [2024-11-29 02:32:28.231806] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.761 [2024-11-29 02:32:28.231818] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.761 [2024-11-29 02:32:28.233996] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.761 [2024-11-29 02:32:28.243316] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.761 [2024-11-29 02:32:28.243657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.761 [2024-11-29 02:32:28.243770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.761 [2024-11-29 02:32:28.243810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.761 [2024-11-29 02:32:28.243825] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.761 [2024-11-29 02:32:28.243937] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.761 [2024-11-29 02:32:28.244114] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.762 [2024-11-29 02:32:28.244132] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.762 [2024-11-29 02:32:28.244144] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.762 [2024-11-29 02:32:28.246399] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.762 [2024-11-29 02:32:28.255863] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.762 [2024-11-29 02:32:28.256178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.762 [2024-11-29 02:32:28.256273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.762 [2024-11-29 02:32:28.256298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.762 [2024-11-29 02:32:28.256314] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.762 [2024-11-29 02:32:28.256474] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.762 [2024-11-29 02:32:28.256709] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.762 [2024-11-29 02:32:28.256728] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.762 [2024-11-29 02:32:28.256740] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.762 [2024-11-29 02:32:28.258871] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.762 [2024-11-29 02:32:28.268541] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.762 [2024-11-29 02:32:28.268933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.762 [2024-11-29 02:32:28.269118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.762 [2024-11-29 02:32:28.269143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.762 [2024-11-29 02:32:28.269159] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.762 [2024-11-29 02:32:28.269367] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.762 [2024-11-29 02:32:28.269584] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.762 [2024-11-29 02:32:28.269608] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.762 [2024-11-29 02:32:28.269621] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.762 [2024-11-29 02:32:28.271873] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.762 [2024-11-29 02:32:28.281100] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.762 [2024-11-29 02:32:28.281481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.762 [2024-11-29 02:32:28.281644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.762 [2024-11-29 02:32:28.281670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.762 [2024-11-29 02:32:28.281686] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.762 [2024-11-29 02:32:28.281832] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.762 [2024-11-29 02:32:28.282017] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.762 [2024-11-29 02:32:28.282036] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.762 [2024-11-29 02:32:28.282047] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.762 [2024-11-29 02:32:28.284285] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.762 [2024-11-29 02:32:28.293616] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.762 [2024-11-29 02:32:28.293959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.762 [2024-11-29 02:32:28.294082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.762 [2024-11-29 02:32:28.294108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.762 [2024-11-29 02:32:28.294124] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.762 [2024-11-29 02:32:28.294256] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.762 [2024-11-29 02:32:28.294468] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.762 [2024-11-29 02:32:28.294488] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.762 [2024-11-29 02:32:28.294501] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.762 [2024-11-29 02:32:28.296853] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.762 [2024-11-29 02:32:28.306087] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.762 [2024-11-29 02:32:28.306458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.762 [2024-11-29 02:32:28.306545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.762 [2024-11-29 02:32:28.306569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.762 [2024-11-29 02:32:28.306584] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.762 [2024-11-29 02:32:28.306727] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.762 [2024-11-29 02:32:28.306924] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.762 [2024-11-29 02:32:28.306943] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.762 [2024-11-29 02:32:28.306960] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.762 [2024-11-29 02:32:28.309223] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.762 [2024-11-29 02:32:28.318563] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.762 [2024-11-29 02:32:28.318860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.762 [2024-11-29 02:32:28.319014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.762 [2024-11-29 02:32:28.319039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.762 [2024-11-29 02:32:28.319055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.762 [2024-11-29 02:32:28.319216] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.762 [2024-11-29 02:32:28.319388] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.762 [2024-11-29 02:32:28.319424] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.762 [2024-11-29 02:32:28.319437] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.762 [2024-11-29 02:32:28.321625] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.762 [2024-11-29 02:32:28.331181] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.762 [2024-11-29 02:32:28.331588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.762 [2024-11-29 02:32:28.331721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.762 [2024-11-29 02:32:28.331747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.762 [2024-11-29 02:32:28.331762] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.762 [2024-11-29 02:32:28.331894] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.762 [2024-11-29 02:32:28.332080] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.762 [2024-11-29 02:32:28.332098] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.762 [2024-11-29 02:32:28.332111] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.763 [2024-11-29 02:32:28.334338] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.763 [2024-11-29 02:32:28.343928] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.763 [2024-11-29 02:32:28.344286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.763 [2024-11-29 02:32:28.344472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.763 [2024-11-29 02:32:28.344498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.763 [2024-11-29 02:32:28.344514] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.763 [2024-11-29 02:32:28.344630] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.763 [2024-11-29 02:32:28.344817] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.763 [2024-11-29 02:32:28.344836] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.763 [2024-11-29 02:32:28.344848] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.763 [2024-11-29 02:32:28.347150] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.763 [2024-11-29 02:32:28.356324] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.763 [2024-11-29 02:32:28.356647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.763 [2024-11-29 02:32:28.356799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.763 [2024-11-29 02:32:28.356825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.763 [2024-11-29 02:32:28.356840] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.763 [2024-11-29 02:32:28.356987] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.763 [2024-11-29 02:32:28.357157] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.763 [2024-11-29 02:32:28.357176] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.763 [2024-11-29 02:32:28.357188] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.763 [2024-11-29 02:32:28.359386] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.763 [2024-11-29 02:32:28.368878] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.763 [2024-11-29 02:32:28.369193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.763 [2024-11-29 02:32:28.369316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.763 [2024-11-29 02:32:28.369341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.763 [2024-11-29 02:32:28.369357] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.763 [2024-11-29 02:32:28.369579] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.763 [2024-11-29 02:32:28.369722] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.763 [2024-11-29 02:32:28.369742] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.763 [2024-11-29 02:32:28.369769] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.763 [2024-11-29 02:32:28.372179] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.763 [2024-11-29 02:32:28.381484] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.763 [2024-11-29 02:32:28.381900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.763 [2024-11-29 02:32:28.382058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.763 [2024-11-29 02:32:28.382084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.763 [2024-11-29 02:32:28.382100] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.763 [2024-11-29 02:32:28.382325] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.763 [2024-11-29 02:32:28.382519] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.763 [2024-11-29 02:32:28.382540] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.763 [2024-11-29 02:32:28.382552] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.763 [2024-11-29 02:32:28.384854] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.763 [2024-11-29 02:32:28.394315] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.763 [2024-11-29 02:32:28.394729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.763 [2024-11-29 02:32:28.394916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.763 [2024-11-29 02:32:28.394942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.763 [2024-11-29 02:32:28.394958] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.763 [2024-11-29 02:32:28.395120] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.763 [2024-11-29 02:32:28.395332] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.763 [2024-11-29 02:32:28.395351] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.763 [2024-11-29 02:32:28.395363] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.763 [2024-11-29 02:32:28.397676] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.763 [2024-11-29 02:32:28.406850] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.763 [2024-11-29 02:32:28.407192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.763 [2024-11-29 02:32:28.407322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.763 [2024-11-29 02:32:28.407348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.763 [2024-11-29 02:32:28.407364] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.763 [2024-11-29 02:32:28.407541] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.763 [2024-11-29 02:32:28.407755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.763 [2024-11-29 02:32:28.407775] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.763 [2024-11-29 02:32:28.407787] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.763 [2024-11-29 02:32:28.410172] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.763 [2024-11-29 02:32:28.419514] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.763 [2024-11-29 02:32:28.419821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.763 [2024-11-29 02:32:28.419976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.763 [2024-11-29 02:32:28.420001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.763 [2024-11-29 02:32:28.420017] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.763 [2024-11-29 02:32:28.420131] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.763 [2024-11-29 02:32:28.420317] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.763 [2024-11-29 02:32:28.420335] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.763 [2024-11-29 02:32:28.420348] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.763 [2024-11-29 02:32:28.422677] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.764 [2024-11-29 02:32:28.432226] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.764 [2024-11-29 02:32:28.432602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.764 [2024-11-29 02:32:28.432736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.764 [2024-11-29 02:32:28.432762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:24.764 [2024-11-29 02:32:28.432778] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:24.764 [2024-11-29 02:32:28.432955] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:24.764 [2024-11-29 02:32:28.433140] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.764 [2024-11-29 02:32:28.433158] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.764 [2024-11-29 02:32:28.433170] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.764 [2024-11-29 02:32:28.435649] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.024 [2024-11-29 02:32:28.444958] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.024 [2024-11-29 02:32:28.445289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.024 [2024-11-29 02:32:28.445421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.024 [2024-11-29 02:32:28.445447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.024 [2024-11-29 02:32:28.445462] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.024 [2024-11-29 02:32:28.445667] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.024 [2024-11-29 02:32:28.445807] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.024 [2024-11-29 02:32:28.445825] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.024 [2024-11-29 02:32:28.445838] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.024 [2024-11-29 02:32:28.448039] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.024 [2024-11-29 02:32:28.457704] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.024 [2024-11-29 02:32:28.458031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.024 [2024-11-29 02:32:28.458196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.024 [2024-11-29 02:32:28.458222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.024 [2024-11-29 02:32:28.458238] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.024 [2024-11-29 02:32:28.458475] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.024 [2024-11-29 02:32:28.458696] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.024 [2024-11-29 02:32:28.458715] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.024 [2024-11-29 02:32:28.458727] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.025 [2024-11-29 02:32:28.460975] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.025 [2024-11-29 02:32:28.470437] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.025 [2024-11-29 02:32:28.470735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.025 [2024-11-29 02:32:28.470867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.025 [2024-11-29 02:32:28.470898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.025 [2024-11-29 02:32:28.470915] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.025 [2024-11-29 02:32:28.471107] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.025 [2024-11-29 02:32:28.471257] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.025 [2024-11-29 02:32:28.471276] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.025 [2024-11-29 02:32:28.471288] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.025 [2024-11-29 02:32:28.473079] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.025 [2024-11-29 02:32:28.482537] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.025 [2024-11-29 02:32:28.482961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.025 [2024-11-29 02:32:28.483084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.025 [2024-11-29 02:32:28.483110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.025 [2024-11-29 02:32:28.483126] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.025 [2024-11-29 02:32:28.483291] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.025 [2024-11-29 02:32:28.483450] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.025 [2024-11-29 02:32:28.483472] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.025 [2024-11-29 02:32:28.483485] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.025 [2024-11-29 02:32:28.485736] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.025 [2024-11-29 02:32:28.494925] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.025 [2024-11-29 02:32:28.495333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.025 [2024-11-29 02:32:28.495481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.025 [2024-11-29 02:32:28.495509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.025 [2024-11-29 02:32:28.495525] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.025 [2024-11-29 02:32:28.495690] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.025 [2024-11-29 02:32:28.495817] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.025 [2024-11-29 02:32:28.495836] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.025 [2024-11-29 02:32:28.495849] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.025 [2024-11-29 02:32:28.498121] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.025 [2024-11-29 02:32:28.507410] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.025 [2024-11-29 02:32:28.507818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.025 [2024-11-29 02:32:28.507968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.025 [2024-11-29 02:32:28.507993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.025 [2024-11-29 02:32:28.508015] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.025 [2024-11-29 02:32:28.508115] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.025 [2024-11-29 02:32:28.508348] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.025 [2024-11-29 02:32:28.508367] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.025 [2024-11-29 02:32:28.508406] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.025 [2024-11-29 02:32:28.510538] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.025 [2024-11-29 02:32:28.519937] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.025 [2024-11-29 02:32:28.520353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.025 [2024-11-29 02:32:28.520496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.025 [2024-11-29 02:32:28.520522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.025 [2024-11-29 02:32:28.520539] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.025 [2024-11-29 02:32:28.520687] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.025 [2024-11-29 02:32:28.520884] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.025 [2024-11-29 02:32:28.520903] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.025 [2024-11-29 02:32:28.520915] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.025 [2024-11-29 02:32:28.523121] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.025 [2024-11-29 02:32:28.532505] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.025 [2024-11-29 02:32:28.532824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.025 [2024-11-29 02:32:28.532976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.025 [2024-11-29 02:32:28.533003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.025 [2024-11-29 02:32:28.533019] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.025 [2024-11-29 02:32:28.533211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.025 [2024-11-29 02:32:28.533403] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.025 [2024-11-29 02:32:28.533423] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.025 [2024-11-29 02:32:28.533435] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.025 [2024-11-29 02:32:28.535759] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.025 [2024-11-29 02:32:28.545032] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.025 [2024-11-29 02:32:28.545381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.025 [2024-11-29 02:32:28.545479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.025 [2024-11-29 02:32:28.545505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.025 [2024-11-29 02:32:28.545521] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.025 [2024-11-29 02:32:28.545706] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.025 [2024-11-29 02:32:28.545819] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.025 [2024-11-29 02:32:28.545838] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.025 [2024-11-29 02:32:28.545850] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.025 [2024-11-29 02:32:28.548112] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.025 [2024-11-29 02:32:28.557581] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.025 [2024-11-29 02:32:28.557976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.025 [2024-11-29 02:32:28.558107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.025 [2024-11-29 02:32:28.558134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.025 [2024-11-29 02:32:28.558150] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.025 [2024-11-29 02:32:28.558345] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.025 [2024-11-29 02:32:28.558558] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.025 [2024-11-29 02:32:28.558579] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.025 [2024-11-29 02:32:28.558591] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.025 [2024-11-29 02:32:28.560790] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.025 [2024-11-29 02:32:28.570309] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.025 [2024-11-29 02:32:28.570634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.025 [2024-11-29 02:32:28.570772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.025 [2024-11-29 02:32:28.570798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.025 [2024-11-29 02:32:28.570814] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.025 [2024-11-29 02:32:28.570989] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.025 [2024-11-29 02:32:28.571173] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.025 [2024-11-29 02:32:28.571192] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.025 [2024-11-29 02:32:28.571204] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.025 [2024-11-29 02:32:28.573482] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.025 [2024-11-29 02:32:28.582763] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.025 [2024-11-29 02:32:28.583093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.025 [2024-11-29 02:32:28.583222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.026 [2024-11-29 02:32:28.583248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.026 [2024-11-29 02:32:28.583263] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.026 [2024-11-29 02:32:28.583453] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.026 [2024-11-29 02:32:28.583586] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.026 [2024-11-29 02:32:28.583607] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.026 [2024-11-29 02:32:28.583620] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.026 [2024-11-29 02:32:28.585846] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.026 [2024-11-29 02:32:28.595295] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.026 [2024-11-29 02:32:28.595589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.026 [2024-11-29 02:32:28.595723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.026 [2024-11-29 02:32:28.595748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.026 [2024-11-29 02:32:28.595764] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.026 [2024-11-29 02:32:28.595954] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.026 [2024-11-29 02:32:28.596136] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.026 [2024-11-29 02:32:28.596155] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.026 [2024-11-29 02:32:28.596167] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.026 [2024-11-29 02:32:28.598501] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.026 [2024-11-29 02:32:28.607823] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.026 [2024-11-29 02:32:28.608198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.026 [2024-11-29 02:32:28.608388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.026 [2024-11-29 02:32:28.608439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.026 [2024-11-29 02:32:28.608458] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.026 [2024-11-29 02:32:28.608605] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.026 [2024-11-29 02:32:28.608743] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.026 [2024-11-29 02:32:28.608762] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.026 [2024-11-29 02:32:28.608775] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.026 [2024-11-29 02:32:28.611074] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.026 [2024-11-29 02:32:28.620354] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.026 [2024-11-29 02:32:28.620720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.026 [2024-11-29 02:32:28.620852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.026 [2024-11-29 02:32:28.620877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.026 [2024-11-29 02:32:28.620893] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.026 [2024-11-29 02:32:28.621115] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.026 [2024-11-29 02:32:28.621282] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.026 [2024-11-29 02:32:28.621305] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.026 [2024-11-29 02:32:28.621318] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.026 [2024-11-29 02:32:28.623628] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.026 [2024-11-29 02:32:28.632791] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.026 [2024-11-29 02:32:28.633149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.026 [2024-11-29 02:32:28.633270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.026 [2024-11-29 02:32:28.633296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.026 [2024-11-29 02:32:28.633311] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.026 [2024-11-29 02:32:28.633469] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.026 [2024-11-29 02:32:28.633601] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.026 [2024-11-29 02:32:28.633621] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.026 [2024-11-29 02:32:28.633634] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.026 [2024-11-29 02:32:28.635903] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.026 [2024-11-29 02:32:28.645211] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.026 [2024-11-29 02:32:28.645592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.026 [2024-11-29 02:32:28.645726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.026 [2024-11-29 02:32:28.645765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.026 [2024-11-29 02:32:28.645781] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.026 [2024-11-29 02:32:28.645911] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.026 [2024-11-29 02:32:28.646097] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.026 [2024-11-29 02:32:28.646116] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.026 [2024-11-29 02:32:28.646128] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.026 [2024-11-29 02:32:28.648462] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.026 [2024-11-29 02:32:28.657962] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.026 [2024-11-29 02:32:28.658264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.026 [2024-11-29 02:32:28.658427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.026 [2024-11-29 02:32:28.658454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.026 [2024-11-29 02:32:28.658470] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.026 [2024-11-29 02:32:28.658667] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.026 [2024-11-29 02:32:28.658849] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.026 [2024-11-29 02:32:28.658868] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.026 [2024-11-29 02:32:28.658888] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.026 [2024-11-29 02:32:28.661281] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.026 [2024-11-29 02:32:28.670748] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.026 [2024-11-29 02:32:28.671207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.026 [2024-11-29 02:32:28.671328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.026 [2024-11-29 02:32:28.671356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.026 [2024-11-29 02:32:28.671372] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.026 [2024-11-29 02:32:28.671513] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.026 [2024-11-29 02:32:28.671680] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.026 [2024-11-29 02:32:28.671703] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.026 [2024-11-29 02:32:28.671716] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.026 [2024-11-29 02:32:28.674152] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.026 [2024-11-29 02:32:28.683418] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.026 [2024-11-29 02:32:28.683812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.026 [2024-11-29 02:32:28.684014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.026 [2024-11-29 02:32:28.684040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.026 [2024-11-29 02:32:28.684056] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.026 [2024-11-29 02:32:28.684202] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.026 [2024-11-29 02:32:28.684328] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.026 [2024-11-29 02:32:28.684347] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.026 [2024-11-29 02:32:28.684359] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.026 [2024-11-29 02:32:28.686446] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.026 [2024-11-29 02:32:28.696175] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.026 [2024-11-29 02:32:28.696511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.026 [2024-11-29 02:32:28.696647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.026 [2024-11-29 02:32:28.696673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.026 [2024-11-29 02:32:28.696689] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.026 [2024-11-29 02:32:28.696821] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.026 [2024-11-29 02:32:28.696992] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.027 [2024-11-29 02:32:28.697011] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.027 [2024-11-29 02:32:28.697023] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.027 [2024-11-29 02:32:28.699112] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.289 [2024-11-29 02:32:28.708808] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.289 [2024-11-29 02:32:28.709081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.289 [2024-11-29 02:32:28.709192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.289 [2024-11-29 02:32:28.709220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.289 [2024-11-29 02:32:28.709237] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.289 [2024-11-29 02:32:28.709383] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.289 [2024-11-29 02:32:28.709586] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.289 [2024-11-29 02:32:28.709606] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.289 [2024-11-29 02:32:28.709619] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.289 [2024-11-29 02:32:28.711968] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.289 [2024-11-29 02:32:28.721317] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.289 [2024-11-29 02:32:28.721620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.289 [2024-11-29 02:32:28.721742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.289 [2024-11-29 02:32:28.721768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.289 [2024-11-29 02:32:28.721784] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.289 [2024-11-29 02:32:28.721966] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.289 [2024-11-29 02:32:28.722136] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.289 [2024-11-29 02:32:28.722160] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.289 [2024-11-29 02:32:28.722176] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.289 [2024-11-29 02:32:28.724625] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.289 [2024-11-29 02:32:28.733930] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.289 [2024-11-29 02:32:28.734254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.289 [2024-11-29 02:32:28.734359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.289 [2024-11-29 02:32:28.734385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.289 [2024-11-29 02:32:28.734413] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.289 [2024-11-29 02:32:28.734555] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.289 [2024-11-29 02:32:28.734701] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.289 [2024-11-29 02:32:28.734721] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.289 [2024-11-29 02:32:28.734734] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.289 [2024-11-29 02:32:28.737082] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.289 [2024-11-29 02:32:28.746373] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.289 [2024-11-29 02:32:28.746767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.289 [2024-11-29 02:32:28.746929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.289 [2024-11-29 02:32:28.746956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.289 [2024-11-29 02:32:28.746973] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.289 [2024-11-29 02:32:28.747150] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.289 [2024-11-29 02:32:28.747291] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.289 [2024-11-29 02:32:28.747326] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.289 [2024-11-29 02:32:28.747342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.289 [2024-11-29 02:32:28.749785] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.289 [2024-11-29 02:32:28.759222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.289 [2024-11-29 02:32:28.759557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.289 [2024-11-29 02:32:28.759693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.289 [2024-11-29 02:32:28.759719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.289 [2024-11-29 02:32:28.759735] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.289 [2024-11-29 02:32:28.759884] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.289 [2024-11-29 02:32:28.760067] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.289 [2024-11-29 02:32:28.760086] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.289 [2024-11-29 02:32:28.760098] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.289 [2024-11-29 02:32:28.762226] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.289 [2024-11-29 02:32:28.771850] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.289 [2024-11-29 02:32:28.772131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.289 [2024-11-29 02:32:28.772258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.289 [2024-11-29 02:32:28.772283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.289 [2024-11-29 02:32:28.772299] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.289 [2024-11-29 02:32:28.772440] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.290 [2024-11-29 02:32:28.772603] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.290 [2024-11-29 02:32:28.772622] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.290 [2024-11-29 02:32:28.772635] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.290 [2024-11-29 02:32:28.774844] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.290 [2024-11-29 02:32:28.784336] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.290 [2024-11-29 02:32:28.784669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.290 [2024-11-29 02:32:28.784801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.290 [2024-11-29 02:32:28.784827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.290 [2024-11-29 02:32:28.784843] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.290 [2024-11-29 02:32:28.785035] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.290 [2024-11-29 02:32:28.785157] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.290 [2024-11-29 02:32:28.785176] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.290 [2024-11-29 02:32:28.785188] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.290 [2024-11-29 02:32:28.787504] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.290 [2024-11-29 02:32:28.796934] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.290 [2024-11-29 02:32:28.797279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.290 [2024-11-29 02:32:28.797384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.290 [2024-11-29 02:32:28.797433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.290 [2024-11-29 02:32:28.797450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.290 [2024-11-29 02:32:28.797648] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.290 [2024-11-29 02:32:28.797774] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.290 [2024-11-29 02:32:28.797793] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.290 [2024-11-29 02:32:28.797805] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.290 [2024-11-29 02:32:28.799977] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.290 [2024-11-29 02:32:28.809273] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.290 [2024-11-29 02:32:28.809672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.290 [2024-11-29 02:32:28.809840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.290 [2024-11-29 02:32:28.809866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.290 [2024-11-29 02:32:28.809882] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.290 [2024-11-29 02:32:28.810027] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.290 [2024-11-29 02:32:28.810192] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.290 [2024-11-29 02:32:28.810211] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.290 [2024-11-29 02:32:28.810223] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.290 [2024-11-29 02:32:28.812508] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.290 [2024-11-29 02:32:28.821881] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.290 [2024-11-29 02:32:28.822297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.290 [2024-11-29 02:32:28.822494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.290 [2024-11-29 02:32:28.822540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.290 [2024-11-29 02:32:28.822557] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.290 [2024-11-29 02:32:28.822731] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.290 [2024-11-29 02:32:28.822928] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.290 [2024-11-29 02:32:28.822947] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.290 [2024-11-29 02:32:28.822959] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.290 [2024-11-29 02:32:28.825426] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.290 [2024-11-29 02:32:28.834453] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.290 [2024-11-29 02:32:28.834841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.290 [2024-11-29 02:32:28.834970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.290 [2024-11-29 02:32:28.834993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.290 [2024-11-29 02:32:28.835024] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.290 [2024-11-29 02:32:28.835186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.290 [2024-11-29 02:32:28.835336] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.290 [2024-11-29 02:32:28.835354] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.290 [2024-11-29 02:32:28.835367] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.290 [2024-11-29 02:32:28.837677] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.290 [2024-11-29 02:32:28.847152] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.290 [2024-11-29 02:32:28.847546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.290 [2024-11-29 02:32:28.847713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.290 [2024-11-29 02:32:28.847739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.290 [2024-11-29 02:32:28.847755] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.290 [2024-11-29 02:32:28.847931] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.290 [2024-11-29 02:32:28.848084] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.290 [2024-11-29 02:32:28.848103] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.290 [2024-11-29 02:32:28.848115] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.290 [2024-11-29 02:32:28.850423] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.290 [2024-11-29 02:32:28.859760] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.290 [2024-11-29 02:32:28.860102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.290 [2024-11-29 02:32:28.860226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.290 [2024-11-29 02:32:28.860251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.290 [2024-11-29 02:32:28.860272] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.290 [2024-11-29 02:32:28.860433] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.290 [2024-11-29 02:32:28.860610] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.290 [2024-11-29 02:32:28.860629] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.291 [2024-11-29 02:32:28.860642] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.291 [2024-11-29 02:32:28.862780] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.291 [2024-11-29 02:32:28.872149] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.291 [2024-11-29 02:32:28.872414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.291 [2024-11-29 02:32:28.872560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.291 [2024-11-29 02:32:28.872586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.291 [2024-11-29 02:32:28.872601] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.291 [2024-11-29 02:32:28.872773] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.291 [2024-11-29 02:32:28.872941] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.291 [2024-11-29 02:32:28.872959] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.291 [2024-11-29 02:32:28.872972] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.291 [2024-11-29 02:32:28.875269] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.291 [2024-11-29 02:32:28.884669] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.291 [2024-11-29 02:32:28.885010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.291 [2024-11-29 02:32:28.885140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.291 [2024-11-29 02:32:28.885165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.291 [2024-11-29 02:32:28.885181] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.291 [2024-11-29 02:32:28.885311] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.291 [2024-11-29 02:32:28.885495] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.291 [2024-11-29 02:32:28.885515] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.291 [2024-11-29 02:32:28.885528] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.291 [2024-11-29 02:32:28.887854] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.291 [2024-11-29 02:32:28.897288] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.291 [2024-11-29 02:32:28.897674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.291 [2024-11-29 02:32:28.897771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.291 [2024-11-29 02:32:28.897795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.291 [2024-11-29 02:32:28.897810] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.291 [2024-11-29 02:32:28.897914] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.291 [2024-11-29 02:32:28.898101] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.291 [2024-11-29 02:32:28.898120] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.291 [2024-11-29 02:32:28.898132] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.291 [2024-11-29 02:32:28.900553] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.291 [2024-11-29 02:32:28.909872] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.291 [2024-11-29 02:32:28.910209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.291 [2024-11-29 02:32:28.910337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.291 [2024-11-29 02:32:28.910363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.291 [2024-11-29 02:32:28.910379] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.291 [2024-11-29 02:32:28.910538] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.291 [2024-11-29 02:32:28.910744] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.291 [2024-11-29 02:32:28.910763] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.291 [2024-11-29 02:32:28.910775] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.291 [2024-11-29 02:32:28.913113] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.291 [2024-11-29 02:32:28.922678] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.291 [2024-11-29 02:32:28.922974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.291 [2024-11-29 02:32:28.923098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.291 [2024-11-29 02:32:28.923125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.291 [2024-11-29 02:32:28.923141] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.291 [2024-11-29 02:32:28.923320] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.291 [2024-11-29 02:32:28.923520] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.291 [2024-11-29 02:32:28.923543] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.291 [2024-11-29 02:32:28.923556] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.291 [2024-11-29 02:32:28.925955] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.291 [2024-11-29 02:32:28.935284] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.291 [2024-11-29 02:32:28.935688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.291 [2024-11-29 02:32:28.935846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.291 [2024-11-29 02:32:28.935872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.291 [2024-11-29 02:32:28.935888] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.291 [2024-11-29 02:32:28.936066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.291 [2024-11-29 02:32:28.936271] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.291 [2024-11-29 02:32:28.936291] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.291 [2024-11-29 02:32:28.936303] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.291 [2024-11-29 02:32:28.938492] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.291 [2024-11-29 02:32:28.947714] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.291 [2024-11-29 02:32:28.948087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.291 [2024-11-29 02:32:28.948186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.291 [2024-11-29 02:32:28.948213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.291 [2024-11-29 02:32:28.948228] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.291 [2024-11-29 02:32:28.948429] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.291 [2024-11-29 02:32:28.948584] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.291 [2024-11-29 02:32:28.948604] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.291 [2024-11-29 02:32:28.948616] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.291 [2024-11-29 02:32:28.950940] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.291 [2024-11-29 02:32:28.960388] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.291 [2024-11-29 02:32:28.960662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.291 [2024-11-29 02:32:28.960806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.292 [2024-11-29 02:32:28.960832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.292 [2024-11-29 02:32:28.960847] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.292 [2024-11-29 02:32:28.960959] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.292 [2024-11-29 02:32:28.961130] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.292 [2024-11-29 02:32:28.961163] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.292 [2024-11-29 02:32:28.961176] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.292 [2024-11-29 02:32:28.963368] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.555 [2024-11-29 02:32:28.972865] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.555 [2024-11-29 02:32:28.973262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-29 02:32:28.973428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-29 02:32:28.973456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.555 [2024-11-29 02:32:28.973472] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.555 [2024-11-29 02:32:28.973618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.555 [2024-11-29 02:32:28.973778] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.555 [2024-11-29 02:32:28.973798] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.555 [2024-11-29 02:32:28.973831] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.555 [2024-11-29 02:32:28.975987] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.555 [2024-11-29 02:32:28.985364] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.555 [2024-11-29 02:32:28.985719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-29 02:32:28.985851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-29 02:32:28.985879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.556 [2024-11-29 02:32:28.985895] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.556 [2024-11-29 02:32:28.986070] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.556 [2024-11-29 02:32:28.986240] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.556 [2024-11-29 02:32:28.986263] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.556 [2024-11-29 02:32:28.986276] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.556 [2024-11-29 02:32:28.988680] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.556 [2024-11-29 02:32:28.997984] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.556 [2024-11-29 02:32:28.998283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-29 02:32:28.998463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-29 02:32:28.998490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.556 [2024-11-29 02:32:28.998507] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.556 [2024-11-29 02:32:28.998654] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.556 [2024-11-29 02:32:28.998830] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.556 [2024-11-29 02:32:28.998849] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.556 [2024-11-29 02:32:28.998861] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.556 [2024-11-29 02:32:29.001150] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.556 [2024-11-29 02:32:29.010477] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.556 [2024-11-29 02:32:29.010872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-29 02:32:29.011039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-29 02:32:29.011065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.556 [2024-11-29 02:32:29.011081] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.556 [2024-11-29 02:32:29.011209] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.556 [2024-11-29 02:32:29.011418] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.556 [2024-11-29 02:32:29.011439] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.556 [2024-11-29 02:32:29.011452] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.556 [2024-11-29 02:32:29.013769] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.556 [2024-11-29 02:32:29.023156] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.556 [2024-11-29 02:32:29.023561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-29 02:32:29.023747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-29 02:32:29.023773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.556 [2024-11-29 02:32:29.023789] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.556 [2024-11-29 02:32:29.023953] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.556 [2024-11-29 02:32:29.024135] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.556 [2024-11-29 02:32:29.024154] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.556 [2024-11-29 02:32:29.024166] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.556 [2024-11-29 02:32:29.026318] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.556 [2024-11-29 02:32:29.035705] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.556 [2024-11-29 02:32:29.035973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-29 02:32:29.036135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-29 02:32:29.036162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.556 [2024-11-29 02:32:29.036178] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.556 [2024-11-29 02:32:29.036360] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.556 [2024-11-29 02:32:29.036512] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.556 [2024-11-29 02:32:29.036533] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.556 [2024-11-29 02:32:29.036545] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.556 [2024-11-29 02:32:29.038626] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.556 [2024-11-29 02:32:29.048281] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.556 [2024-11-29 02:32:29.048699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-29 02:32:29.048837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-29 02:32:29.048864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.556 [2024-11-29 02:32:29.048880] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.556 [2024-11-29 02:32:29.049029] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.556 [2024-11-29 02:32:29.049155] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.556 [2024-11-29 02:32:29.049174] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.556 [2024-11-29 02:32:29.049186] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.556 [2024-11-29 02:32:29.051370] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.556 [2024-11-29 02:32:29.060830] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.556 [2024-11-29 02:32:29.061248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-29 02:32:29.061410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-29 02:32:29.061438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.556 [2024-11-29 02:32:29.061454] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.556 [2024-11-29 02:32:29.061618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.556 [2024-11-29 02:32:29.061796] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.556 [2024-11-29 02:32:29.061815] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.556 [2024-11-29 02:32:29.061828] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.556 [2024-11-29 02:32:29.064108] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.556 [2024-11-29 02:32:29.073449] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.556 [2024-11-29 02:32:29.073747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-29 02:32:29.073878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-29 02:32:29.073904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.556 [2024-11-29 02:32:29.073920] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.556 [2024-11-29 02:32:29.074066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.556 [2024-11-29 02:32:29.074243] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.557 [2024-11-29 02:32:29.074261] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.557 [2024-11-29 02:32:29.074274] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.557 [2024-11-29 02:32:29.076305] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.557 [2024-11-29 02:32:29.085784] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.557 [2024-11-29 02:32:29.086175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-29 02:32:29.086335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-29 02:32:29.086362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.557 [2024-11-29 02:32:29.086378] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.557 [2024-11-29 02:32:29.086547] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.557 [2024-11-29 02:32:29.086673] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.557 [2024-11-29 02:32:29.086693] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.557 [2024-11-29 02:32:29.086705] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.557 [2024-11-29 02:32:29.089078] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.557 [2024-11-29 02:32:29.098424] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.557 [2024-11-29 02:32:29.098711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-29 02:32:29.098856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-29 02:32:29.098883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.557 [2024-11-29 02:32:29.098898] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.557 [2024-11-29 02:32:29.099060] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.557 [2024-11-29 02:32:29.099241] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.557 [2024-11-29 02:32:29.099260] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.557 [2024-11-29 02:32:29.099272] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.557 [2024-11-29 02:32:29.101512] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.557 [2024-11-29 02:32:29.110851] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.557 [2024-11-29 02:32:29.111241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-29 02:32:29.111376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-29 02:32:29.111413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.557 [2024-11-29 02:32:29.111431] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.557 [2024-11-29 02:32:29.111593] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.557 [2024-11-29 02:32:29.111751] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.557 [2024-11-29 02:32:29.111770] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.557 [2024-11-29 02:32:29.111782] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.557 [2024-11-29 02:32:29.113927] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.557 [2024-11-29 02:32:29.123335] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.557 [2024-11-29 02:32:29.123661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-29 02:32:29.123762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-29 02:32:29.123788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.557 [2024-11-29 02:32:29.123804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.557 [2024-11-29 02:32:29.123993] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.557 [2024-11-29 02:32:29.124162] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.557 [2024-11-29 02:32:29.124181] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.557 [2024-11-29 02:32:29.124193] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.557 [2024-11-29 02:32:29.126621] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.557 [2024-11-29 02:32:29.135841] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.557 [2024-11-29 02:32:29.136198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-29 02:32:29.136321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-29 02:32:29.136352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.557 [2024-11-29 02:32:29.136368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.557 [2024-11-29 02:32:29.136541] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.557 [2024-11-29 02:32:29.136730] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.557 [2024-11-29 02:32:29.136748] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.557 [2024-11-29 02:32:29.136761] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.557 [2024-11-29 02:32:29.138969] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.557 [2024-11-29 02:32:29.148488] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.557 [2024-11-29 02:32:29.148861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-29 02:32:29.148973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-29 02:32:29.148998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.557 [2024-11-29 02:32:29.149014] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.557 [2024-11-29 02:32:29.149177] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.557 [2024-11-29 02:32:29.149361] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.557 [2024-11-29 02:32:29.149380] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.557 [2024-11-29 02:32:29.149416] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.557 [2024-11-29 02:32:29.151745] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.557 [2024-11-29 02:32:29.160999] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.557 [2024-11-29 02:32:29.161369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-29 02:32:29.161509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-29 02:32:29.161536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.557 [2024-11-29 02:32:29.161551] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.557 [2024-11-29 02:32:29.161721] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.557 [2024-11-29 02:32:29.161916] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.557 [2024-11-29 02:32:29.161934] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.558 [2024-11-29 02:32:29.161947] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.558 [2024-11-29 02:32:29.164082] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.558 [2024-11-29 02:32:29.173355] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.558 [2024-11-29 02:32:29.173675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-29 02:32:29.173785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-29 02:32:29.173824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.558 [2024-11-29 02:32:29.173845] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.558 [2024-11-29 02:32:29.173972] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.558 [2024-11-29 02:32:29.174157] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.558 [2024-11-29 02:32:29.174176] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.558 [2024-11-29 02:32:29.174189] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.558 [2024-11-29 02:32:29.176558] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.558 [2024-11-29 02:32:29.185758] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.558 [2024-11-29 02:32:29.186148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-29 02:32:29.186302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-29 02:32:29.186328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.558 [2024-11-29 02:32:29.186344] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.558 [2024-11-29 02:32:29.186488] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.558 [2024-11-29 02:32:29.186669] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.558 [2024-11-29 02:32:29.186688] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.558 [2024-11-29 02:32:29.186701] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.558 [2024-11-29 02:32:29.188960] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.558 [2024-11-29 02:32:29.198422] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.558 [2024-11-29 02:32:29.198761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-29 02:32:29.198891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-29 02:32:29.198917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.558 [2024-11-29 02:32:29.198932] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.558 [2024-11-29 02:32:29.199110] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.558 [2024-11-29 02:32:29.199281] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.558 [2024-11-29 02:32:29.199300] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.558 [2024-11-29 02:32:29.199312] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.558 [2024-11-29 02:32:29.201603] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.558 [2024-11-29 02:32:29.210959] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.558 [2024-11-29 02:32:29.211300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-29 02:32:29.211435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-29 02:32:29.211462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.558 [2024-11-29 02:32:29.211478] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.558 [2024-11-29 02:32:29.211673] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.558 [2024-11-29 02:32:29.211870] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.558 [2024-11-29 02:32:29.211890] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.558 [2024-11-29 02:32:29.211902] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.558 [2024-11-29 02:32:29.214069] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.558 [2024-11-29 02:32:29.223342] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.558 [2024-11-29 02:32:29.223624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-29 02:32:29.223778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-29 02:32:29.223805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.558 [2024-11-29 02:32:29.223821] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.558 [2024-11-29 02:32:29.224039] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.558 [2024-11-29 02:32:29.224191] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.558 [2024-11-29 02:32:29.224210] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.558 [2024-11-29 02:32:29.224222] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.558 [2024-11-29 02:32:29.226307] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.819 [2024-11-29 02:32:29.235995] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.819 [2024-11-29 02:32:29.236348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.819 [2024-11-29 02:32:29.236480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.819 [2024-11-29 02:32:29.236511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.819 [2024-11-29 02:32:29.236528] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.819 [2024-11-29 02:32:29.236677] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.819 [2024-11-29 02:32:29.236852] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.819 [2024-11-29 02:32:29.236874] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.819 [2024-11-29 02:32:29.236891] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.819 [2024-11-29 02:32:29.239270] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.819 [2024-11-29 02:32:29.248608] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.819 [2024-11-29 02:32:29.249016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.819 [2024-11-29 02:32:29.249229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.819 [2024-11-29 02:32:29.249272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.819 [2024-11-29 02:32:29.249290] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.819 [2024-11-29 02:32:29.249482] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.819 [2024-11-29 02:32:29.249657] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.819 [2024-11-29 02:32:29.249692] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.819 [2024-11-29 02:32:29.249706] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.819 [2024-11-29 02:32:29.252050] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.819 [2024-11-29 02:32:29.261001] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.819 [2024-11-29 02:32:29.261294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.819 [2024-11-29 02:32:29.261455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.819 [2024-11-29 02:32:29.261482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.819 [2024-11-29 02:32:29.261498] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.819 [2024-11-29 02:32:29.261690] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.819 [2024-11-29 02:32:29.261873] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.819 [2024-11-29 02:32:29.261892] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.819 [2024-11-29 02:32:29.261904] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.819 [2024-11-29 02:32:29.264129] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.819 [2024-11-29 02:32:29.273485] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.819 [2024-11-29 02:32:29.273830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.819 [2024-11-29 02:32:29.274004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.819 [2024-11-29 02:32:29.274030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.819 [2024-11-29 02:32:29.274046] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.819 [2024-11-29 02:32:29.274178] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.819 [2024-11-29 02:32:29.274391] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.819 [2024-11-29 02:32:29.274420] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.819 [2024-11-29 02:32:29.274432] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.819 [2024-11-29 02:32:29.276745] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.819 [2024-11-29 02:32:29.286174] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.819 [2024-11-29 02:32:29.286551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.819 [2024-11-29 02:32:29.286737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.819 [2024-11-29 02:32:29.286763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.819 [2024-11-29 02:32:29.286779] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.819 [2024-11-29 02:32:29.286972] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.819 [2024-11-29 02:32:29.287138] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.820 [2024-11-29 02:32:29.287162] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.820 [2024-11-29 02:32:29.287175] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.820 [2024-11-29 02:32:29.289560] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.820 [2024-11-29 02:32:29.298462] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.820 [2024-11-29 02:32:29.298745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.820 [2024-11-29 02:32:29.298901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.820 [2024-11-29 02:32:29.298928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.820 [2024-11-29 02:32:29.298943] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.820 [2024-11-29 02:32:29.299107] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.820 [2024-11-29 02:32:29.299293] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.820 [2024-11-29 02:32:29.299311] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.820 [2024-11-29 02:32:29.299323] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.820 [2024-11-29 02:32:29.301548] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.820 [2024-11-29 02:32:29.311043] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.820 [2024-11-29 02:32:29.311385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.820 [2024-11-29 02:32:29.311530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.820 [2024-11-29 02:32:29.311556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.820 [2024-11-29 02:32:29.311572] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.820 [2024-11-29 02:32:29.311672] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.820 [2024-11-29 02:32:29.311877] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.820 [2024-11-29 02:32:29.311896] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.820 [2024-11-29 02:32:29.311908] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.820 [2024-11-29 02:32:29.314009] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.820 [2024-11-29 02:32:29.323637] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.820 [2024-11-29 02:32:29.324017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.820 [2024-11-29 02:32:29.324182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.820 [2024-11-29 02:32:29.324208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.820 [2024-11-29 02:32:29.324225] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.820 [2024-11-29 02:32:29.324370] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.820 [2024-11-29 02:32:29.324519] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.820 [2024-11-29 02:32:29.324540] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.820 [2024-11-29 02:32:29.324557] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.820 [2024-11-29 02:32:29.326753] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.820 [2024-11-29 02:32:29.336346] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.820 [2024-11-29 02:32:29.336585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.820 [2024-11-29 02:32:29.336812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.820 [2024-11-29 02:32:29.336838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.820 [2024-11-29 02:32:29.336854] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.820 [2024-11-29 02:32:29.336999] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.820 [2024-11-29 02:32:29.337143] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.820 [2024-11-29 02:32:29.337162] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.820 [2024-11-29 02:32:29.337174] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.820 [2024-11-29 02:32:29.339377] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.820 [2024-11-29 02:32:29.349136] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.820 [2024-11-29 02:32:29.349510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.820 [2024-11-29 02:32:29.349678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.820 [2024-11-29 02:32:29.349704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.820 [2024-11-29 02:32:29.349720] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.820 [2024-11-29 02:32:29.349883] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.820 [2024-11-29 02:32:29.350052] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.820 [2024-11-29 02:32:29.350070] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.820 [2024-11-29 02:32:29.350082] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.820 [2024-11-29 02:32:29.352513] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.820 [2024-11-29 02:32:29.361738] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.820 [2024-11-29 02:32:29.362063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.820 [2024-11-29 02:32:29.362196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.820 [2024-11-29 02:32:29.362222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.820 [2024-11-29 02:32:29.362238] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.820 [2024-11-29 02:32:29.362454] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.820 [2024-11-29 02:32:29.362596] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.820 [2024-11-29 02:32:29.362616] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.820 [2024-11-29 02:32:29.362628] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.820 [2024-11-29 02:32:29.364811] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.820 [2024-11-29 02:32:29.374425] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.820 [2024-11-29 02:32:29.374745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.820 [2024-11-29 02:32:29.374867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.820 [2024-11-29 02:32:29.374892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.820 [2024-11-29 02:32:29.374908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.820 [2024-11-29 02:32:29.375104] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.820 [2024-11-29 02:32:29.375270] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.820 [2024-11-29 02:32:29.375288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.820 [2024-11-29 02:32:29.375300] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.820 [2024-11-29 02:32:29.377428] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.820 [2024-11-29 02:32:29.387035] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.820 [2024-11-29 02:32:29.387438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.820 [2024-11-29 02:32:29.387601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.820 [2024-11-29 02:32:29.387627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.820 [2024-11-29 02:32:29.387643] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.820 [2024-11-29 02:32:29.387818] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.820 [2024-11-29 02:32:29.387973] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.820 [2024-11-29 02:32:29.387991] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.820 [2024-11-29 02:32:29.388004] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.820 [2024-11-29 02:32:29.390178] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.820 [2024-11-29 02:32:29.399628] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.820 [2024-11-29 02:32:29.399893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.820 [2024-11-29 02:32:29.400067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.820 [2024-11-29 02:32:29.400092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.820 [2024-11-29 02:32:29.400107] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.820 [2024-11-29 02:32:29.400250] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.820 [2024-11-29 02:32:29.400389] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.820 [2024-11-29 02:32:29.400435] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.820 [2024-11-29 02:32:29.400448] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.820 [2024-11-29 02:32:29.402416] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.820 [2024-11-29 02:32:29.412161] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.821 [2024-11-29 02:32:29.412432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.821 [2024-11-29 02:32:29.412527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.821 [2024-11-29 02:32:29.412554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.821 [2024-11-29 02:32:29.412570] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.821 [2024-11-29 02:32:29.412742] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.821 [2024-11-29 02:32:29.412893] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.821 [2024-11-29 02:32:29.412912] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.821 [2024-11-29 02:32:29.412924] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.821 [2024-11-29 02:32:29.415346] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.821 [2024-11-29 02:32:29.424954] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.821 [2024-11-29 02:32:29.425362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.821 [2024-11-29 02:32:29.425531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.821 [2024-11-29 02:32:29.425557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.821 [2024-11-29 02:32:29.425573] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.821 [2024-11-29 02:32:29.425752] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.821 [2024-11-29 02:32:29.425920] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.821 [2024-11-29 02:32:29.425939] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.821 [2024-11-29 02:32:29.425951] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.821 [2024-11-29 02:32:29.428123] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.821 [2024-11-29 02:32:29.437432] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.821 [2024-11-29 02:32:29.437757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.821 [2024-11-29 02:32:29.437848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.821 [2024-11-29 02:32:29.437873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.821 [2024-11-29 02:32:29.437889] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.821 [2024-11-29 02:32:29.438016] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.821 [2024-11-29 02:32:29.438228] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.821 [2024-11-29 02:32:29.438247] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.821 [2024-11-29 02:32:29.438259] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.821 [2024-11-29 02:32:29.440458] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.821 [2024-11-29 02:32:29.450188] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.821 [2024-11-29 02:32:29.450540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.821 [2024-11-29 02:32:29.450722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.821 [2024-11-29 02:32:29.450748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.821 [2024-11-29 02:32:29.450763] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.821 [2024-11-29 02:32:29.450982] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.821 [2024-11-29 02:32:29.451133] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.821 [2024-11-29 02:32:29.451152] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.821 [2024-11-29 02:32:29.451164] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.821 [2024-11-29 02:32:29.453527] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.821 [2024-11-29 02:32:29.462793] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.821 [2024-11-29 02:32:29.463093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.821 [2024-11-29 02:32:29.463252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.821 [2024-11-29 02:32:29.463278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.821 [2024-11-29 02:32:29.463294] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.821 [2024-11-29 02:32:29.463481] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.821 [2024-11-29 02:32:29.463651] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.821 [2024-11-29 02:32:29.463671] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.821 [2024-11-29 02:32:29.463698] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.821 [2024-11-29 02:32:29.465922] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.821 [2024-11-29 02:32:29.475205] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.821 [2024-11-29 02:32:29.475538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.821 [2024-11-29 02:32:29.475662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.821 [2024-11-29 02:32:29.475689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.821 [2024-11-29 02:32:29.475704] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.821 [2024-11-29 02:32:29.475866] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.821 [2024-11-29 02:32:29.476012] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.821 [2024-11-29 02:32:29.476031] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.821 [2024-11-29 02:32:29.476043] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.821 [2024-11-29 02:32:29.478270] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.821 [2024-11-29 02:32:29.487867] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.821 [2024-11-29 02:32:29.488187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.821 [2024-11-29 02:32:29.488331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.821 [2024-11-29 02:32:29.488363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:25.821 [2024-11-29 02:32:29.488380] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:25.821 [2024-11-29 02:32:29.488540] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:25.821 [2024-11-29 02:32:29.488757] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.821 [2024-11-29 02:32:29.488779] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.821 [2024-11-29 02:32:29.488798] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.821 [2024-11-29 02:32:29.491066] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.081 [2024-11-29 02:32:29.500510] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.081 [2024-11-29 02:32:29.500863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.081 [2024-11-29 02:32:29.500997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.081 [2024-11-29 02:32:29.501023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.081 [2024-11-29 02:32:29.501039] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.081 [2024-11-29 02:32:29.501193] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.081 [2024-11-29 02:32:29.501365] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.081 [2024-11-29 02:32:29.501388] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.081 [2024-11-29 02:32:29.501418] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.081 [2024-11-29 02:32:29.503835] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.081 [2024-11-29 02:32:29.513035] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.081 [2024-11-29 02:32:29.513338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.081 [2024-11-29 02:32:29.513496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.081 [2024-11-29 02:32:29.513523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.081 [2024-11-29 02:32:29.513538] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.081 [2024-11-29 02:32:29.513666] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.081 [2024-11-29 02:32:29.513820] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.081 [2024-11-29 02:32:29.513839] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.081 [2024-11-29 02:32:29.513851] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.081 [2024-11-29 02:32:29.516040] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.081 [2024-11-29 02:32:29.525629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.081 [2024-11-29 02:32:29.525942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.081 [2024-11-29 02:32:29.526066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.081 [2024-11-29 02:32:29.526092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.081 [2024-11-29 02:32:29.526113] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.081 [2024-11-29 02:32:29.526280] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.081 [2024-11-29 02:32:29.526416] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.081 [2024-11-29 02:32:29.526436] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.081 [2024-11-29 02:32:29.526448] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.081 [2024-11-29 02:32:29.528492] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.081 [2024-11-29 02:32:29.538128] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.081 [2024-11-29 02:32:29.538502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.081 [2024-11-29 02:32:29.538711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.081 [2024-11-29 02:32:29.538737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.081 [2024-11-29 02:32:29.538753] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.081 [2024-11-29 02:32:29.538900] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.081 [2024-11-29 02:32:29.539040] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.081 [2024-11-29 02:32:29.539058] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.081 [2024-11-29 02:32:29.539070] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.081 [2024-11-29 02:32:29.541326] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.081 [2024-11-29 02:32:29.550675] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.081 [2024-11-29 02:32:29.550973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.082 [2024-11-29 02:32:29.551112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.082 [2024-11-29 02:32:29.551138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.082 [2024-11-29 02:32:29.551154] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.082 [2024-11-29 02:32:29.551345] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.082 [2024-11-29 02:32:29.551496] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.082 [2024-11-29 02:32:29.551516] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.082 [2024-11-29 02:32:29.551528] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.082 [2024-11-29 02:32:29.553671] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.082 [2024-11-29 02:32:29.563311] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.082 [2024-11-29 02:32:29.563632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.082 [2024-11-29 02:32:29.563777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.082 [2024-11-29 02:32:29.563802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.082 [2024-11-29 02:32:29.563817] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.082 [2024-11-29 02:32:29.563964] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.082 [2024-11-29 02:32:29.564103] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.082 [2024-11-29 02:32:29.564122] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.082 [2024-11-29 02:32:29.564134] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.082 [2024-11-29 02:32:29.566429] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.082 [2024-11-29 02:32:29.575781] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.082 [2024-11-29 02:32:29.576108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.082 [2024-11-29 02:32:29.576298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.082 [2024-11-29 02:32:29.576324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.082 [2024-11-29 02:32:29.576340] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.082 [2024-11-29 02:32:29.576493] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.082 [2024-11-29 02:32:29.576628] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.082 [2024-11-29 02:32:29.576648] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.082 [2024-11-29 02:32:29.576662] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.082 [2024-11-29 02:32:29.579113] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.082 [2024-11-29 02:32:29.588316] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.082 [2024-11-29 02:32:29.588629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.082 [2024-11-29 02:32:29.588880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.082 [2024-11-29 02:32:29.588905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.082 [2024-11-29 02:32:29.588921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.082 [2024-11-29 02:32:29.589080] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.082 [2024-11-29 02:32:29.589218] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.082 [2024-11-29 02:32:29.589237] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.082 [2024-11-29 02:32:29.589249] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.082 [2024-11-29 02:32:29.591266] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.082 [2024-11-29 02:32:29.600776] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.082 [2024-11-29 02:32:29.601054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.082 [2024-11-29 02:32:29.601239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.082 [2024-11-29 02:32:29.601264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.082 [2024-11-29 02:32:29.601281] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.082 [2024-11-29 02:32:29.601499] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.082 [2024-11-29 02:32:29.601633] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.082 [2024-11-29 02:32:29.601653] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.082 [2024-11-29 02:32:29.601666] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.082 [2024-11-29 02:32:29.603820] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.082 [2024-11-29 02:32:29.613415] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.082 [2024-11-29 02:32:29.613773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.082 [2024-11-29 02:32:29.613922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.082 [2024-11-29 02:32:29.613948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.082 [2024-11-29 02:32:29.613964] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.082 [2024-11-29 02:32:29.614129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.082 [2024-11-29 02:32:29.614316] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.082 [2024-11-29 02:32:29.614335] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.082 [2024-11-29 02:32:29.614348] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.082 [2024-11-29 02:32:29.616735] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.082 [2024-11-29 02:32:29.625895] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.082 [2024-11-29 02:32:29.626320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.082 [2024-11-29 02:32:29.626513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.082 [2024-11-29 02:32:29.626540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.082 [2024-11-29 02:32:29.626556] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.082 [2024-11-29 02:32:29.626752] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.082 [2024-11-29 02:32:29.626954] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.082 [2024-11-29 02:32:29.626973] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.082 [2024-11-29 02:32:29.626985] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.082 [2024-11-29 02:32:29.629312] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.082 [2024-11-29 02:32:29.638617] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.082 [2024-11-29 02:32:29.639040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.082 [2024-11-29 02:32:29.639196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.082 [2024-11-29 02:32:29.639224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.082 [2024-11-29 02:32:29.639240] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.082 [2024-11-29 02:32:29.639414] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.082 [2024-11-29 02:32:29.639595] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.082 [2024-11-29 02:32:29.639616] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.082 [2024-11-29 02:32:29.639634] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.082 [2024-11-29 02:32:29.641748] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.082 [2024-11-29 02:32:29.651198] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.082 [2024-11-29 02:32:29.651488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.082 [2024-11-29 02:32:29.651601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.082 [2024-11-29 02:32:29.651628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.082 [2024-11-29 02:32:29.651644] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.082 [2024-11-29 02:32:29.651760] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.082 [2024-11-29 02:32:29.651936] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.082 [2024-11-29 02:32:29.651956] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.082 [2024-11-29 02:32:29.651968] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.082 [2024-11-29 02:32:29.654260] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.082 [2024-11-29 02:32:29.663744] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.082 [2024-11-29 02:32:29.664061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.082 [2024-11-29 02:32:29.664162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.082 [2024-11-29 02:32:29.664187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.082 [2024-11-29 02:32:29.664203] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.082 [2024-11-29 02:32:29.664366] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.083 [2024-11-29 02:32:29.664521] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.083 [2024-11-29 02:32:29.664543] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.083 [2024-11-29 02:32:29.664556] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.083 [2024-11-29 02:32:29.666900] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.083 [2024-11-29 02:32:29.675929] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.083 [2024-11-29 02:32:29.676249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.083 [2024-11-29 02:32:29.676347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.083 [2024-11-29 02:32:29.676373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.083 [2024-11-29 02:32:29.676388] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.083 [2024-11-29 02:32:29.676545] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.083 [2024-11-29 02:32:29.676739] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.083 [2024-11-29 02:32:29.676758] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.083 [2024-11-29 02:32:29.676778] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.083 [2024-11-29 02:32:29.678727] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.083 [2024-11-29 02:32:29.688592] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.083 [2024-11-29 02:32:29.688978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.083 [2024-11-29 02:32:29.689141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.083 [2024-11-29 02:32:29.689167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.083 [2024-11-29 02:32:29.689183] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.083 [2024-11-29 02:32:29.689363] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.083 [2024-11-29 02:32:29.689523] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.083 [2024-11-29 02:32:29.689544] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.083 [2024-11-29 02:32:29.689557] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.083 [2024-11-29 02:32:29.691954] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.083 [2024-11-29 02:32:29.701657] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.083 [2024-11-29 02:32:29.701986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.083 [2024-11-29 02:32:29.702111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.083 [2024-11-29 02:32:29.702137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.083 [2024-11-29 02:32:29.702153] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.083 [2024-11-29 02:32:29.702253] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.083 [2024-11-29 02:32:29.702457] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.083 [2024-11-29 02:32:29.702479] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.083 [2024-11-29 02:32:29.702493] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.083 [2024-11-29 02:32:29.704833] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.083 [2024-11-29 02:32:29.714233] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.083 [2024-11-29 02:32:29.714488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.083 [2024-11-29 02:32:29.714638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.083 [2024-11-29 02:32:29.714664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.083 [2024-11-29 02:32:29.714681] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.083 [2024-11-29 02:32:29.714813] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.083 [2024-11-29 02:32:29.714988] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.083 [2024-11-29 02:32:29.715007] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.083 [2024-11-29 02:32:29.715019] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.083 [2024-11-29 02:32:29.717381] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.083 [2024-11-29 02:32:29.726758] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.083 [2024-11-29 02:32:29.727073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.083 [2024-11-29 02:32:29.727210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.083 [2024-11-29 02:32:29.727239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.083 [2024-11-29 02:32:29.727256] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.083 [2024-11-29 02:32:29.727457] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.083 [2024-11-29 02:32:29.727631] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.083 [2024-11-29 02:32:29.727651] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.083 [2024-11-29 02:32:29.727663] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.083 [2024-11-29 02:32:29.730058] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.083 [2024-11-29 02:32:29.739318] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.083 [2024-11-29 02:32:29.739723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.083 [2024-11-29 02:32:29.739872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.083 [2024-11-29 02:32:29.739900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.083 [2024-11-29 02:32:29.739916] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.083 [2024-11-29 02:32:29.740108] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.083 [2024-11-29 02:32:29.740274] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.083 [2024-11-29 02:32:29.740295] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.083 [2024-11-29 02:32:29.740308] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.083 [2024-11-29 02:32:29.742734] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.083 [2024-11-29 02:32:29.751796] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.083 [2024-11-29 02:32:29.752144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.083 [2024-11-29 02:32:29.752301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.083 [2024-11-29 02:32:29.752330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.083 [2024-11-29 02:32:29.752363] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.083 [2024-11-29 02:32:29.752530] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.083 [2024-11-29 02:32:29.752726] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.083 [2024-11-29 02:32:29.752746] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.083 [2024-11-29 02:32:29.752758] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.083 [2024-11-29 02:32:29.754935] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.343 [2024-11-29 02:32:29.764367] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.343 [2024-11-29 02:32:29.764721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.343 [2024-11-29 02:32:29.764925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.344 [2024-11-29 02:32:29.764951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.344 [2024-11-29 02:32:29.764966] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.344 [2024-11-29 02:32:29.765128] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.344 [2024-11-29 02:32:29.765298] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.344 [2024-11-29 02:32:29.765317] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.344 [2024-11-29 02:32:29.765329] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.344 [2024-11-29 02:32:29.767653] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.344 [2024-11-29 02:32:29.777030] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.344 [2024-11-29 02:32:29.777398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.344 [2024-11-29 02:32:29.777531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.344 [2024-11-29 02:32:29.777557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.344 [2024-11-29 02:32:29.777573] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.344 [2024-11-29 02:32:29.777750] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.344 [2024-11-29 02:32:29.777903] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.344 [2024-11-29 02:32:29.777922] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.344 [2024-11-29 02:32:29.777934] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.344 [2024-11-29 02:32:29.780058] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.344 [2024-11-29 02:32:29.789767] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.344 [2024-11-29 02:32:29.790108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.344 [2024-11-29 02:32:29.790229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.344 [2024-11-29 02:32:29.790255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.344 [2024-11-29 02:32:29.790271] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.344 [2024-11-29 02:32:29.790459] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.344 [2024-11-29 02:32:29.790616] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.344 [2024-11-29 02:32:29.790635] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.344 [2024-11-29 02:32:29.790648] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.344 [2024-11-29 02:32:29.792827] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.344 [2024-11-29 02:32:29.802522] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.344 [2024-11-29 02:32:29.802917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.344 [2024-11-29 02:32:29.803135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.344 [2024-11-29 02:32:29.803162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.344 [2024-11-29 02:32:29.803196] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.344 [2024-11-29 02:32:29.803424] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.344 [2024-11-29 02:32:29.803590] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.344 [2024-11-29 02:32:29.803611] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.344 [2024-11-29 02:32:29.803625] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.344 [2024-11-29 02:32:29.805725] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.344 [2024-11-29 02:32:29.815228] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.344 [2024-11-29 02:32:29.815690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.344 [2024-11-29 02:32:29.815823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.344 [2024-11-29 02:32:29.815854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.344 [2024-11-29 02:32:29.815869] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.344 [2024-11-29 02:32:29.816015] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.344 [2024-11-29 02:32:29.816198] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.344 [2024-11-29 02:32:29.816217] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.344 [2024-11-29 02:32:29.816229] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.344 [2024-11-29 02:32:29.818515] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.344 [2024-11-29 02:32:29.827728] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.344 [2024-11-29 02:32:29.828124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.344 [2024-11-29 02:32:29.828281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.344 [2024-11-29 02:32:29.828307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.344 [2024-11-29 02:32:29.828323] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.344 [2024-11-29 02:32:29.828494] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.344 [2024-11-29 02:32:29.828653] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.344 [2024-11-29 02:32:29.828687] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.344 [2024-11-29 02:32:29.828699] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.344 [2024-11-29 02:32:29.830775] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.344 [2024-11-29 02:32:29.840163] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.344 [2024-11-29 02:32:29.840504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.344 [2024-11-29 02:32:29.840664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.344 [2024-11-29 02:32:29.840689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.344 [2024-11-29 02:32:29.840719] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.344 [2024-11-29 02:32:29.840882] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.344 [2024-11-29 02:32:29.841052] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.344 [2024-11-29 02:32:29.841073] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.344 [2024-11-29 02:32:29.841086] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.344 [2024-11-29 02:32:29.843464] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.344 [2024-11-29 02:32:29.852676] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.344 [2024-11-29 02:32:29.852983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.344 [2024-11-29 02:32:29.853117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.344 [2024-11-29 02:32:29.853143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.344 [2024-11-29 02:32:29.853159] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.344 [2024-11-29 02:32:29.853376] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.344 [2024-11-29 02:32:29.853548] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.344 [2024-11-29 02:32:29.853568] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.344 [2024-11-29 02:32:29.853580] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.344 [2024-11-29 02:32:29.855735] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.344 [2024-11-29 02:32:29.865467] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.344 [2024-11-29 02:32:29.865861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.344 [2024-11-29 02:32:29.866058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.344 [2024-11-29 02:32:29.866086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.344 [2024-11-29 02:32:29.866102] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.344 [2024-11-29 02:32:29.866305] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.344 [2024-11-29 02:32:29.866496] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.344 [2024-11-29 02:32:29.866517] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.344 [2024-11-29 02:32:29.866530] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.344 [2024-11-29 02:32:29.868714] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.344 [2024-11-29 02:32:29.878246] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.344 [2024-11-29 02:32:29.878578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.344 [2024-11-29 02:32:29.878710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.344 [2024-11-29 02:32:29.878737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.344 [2024-11-29 02:32:29.878752] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.345 [2024-11-29 02:32:29.878956] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.345 [2024-11-29 02:32:29.879095] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.345 [2024-11-29 02:32:29.879114] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.345 [2024-11-29 02:32:29.879126] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.345 [2024-11-29 02:32:29.881461] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.345 [2024-11-29 02:32:29.890643] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.345 [2024-11-29 02:32:29.890985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.345 [2024-11-29 02:32:29.891108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.345 [2024-11-29 02:32:29.891134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.345 [2024-11-29 02:32:29.891149] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.345 [2024-11-29 02:32:29.891342] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.345 [2024-11-29 02:32:29.891494] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.345 [2024-11-29 02:32:29.891514] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.345 [2024-11-29 02:32:29.891527] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.345 [2024-11-29 02:32:29.893814] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.345 [2024-11-29 02:32:29.903118] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.345 [2024-11-29 02:32:29.903462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.345 [2024-11-29 02:32:29.903584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.345 [2024-11-29 02:32:29.903610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.345 [2024-11-29 02:32:29.903625] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.345 [2024-11-29 02:32:29.903757] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.345 [2024-11-29 02:32:29.903931] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.345 [2024-11-29 02:32:29.903949] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.345 [2024-11-29 02:32:29.903961] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.345 [2024-11-29 02:32:29.906202] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.345 [2024-11-29 02:32:29.915706] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.345 [2024-11-29 02:32:29.916065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.345 [2024-11-29 02:32:29.916198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.345 [2024-11-29 02:32:29.916226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.345 [2024-11-29 02:32:29.916242] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.345 [2024-11-29 02:32:29.916357] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.345 [2024-11-29 02:32:29.916549] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.345 [2024-11-29 02:32:29.916570] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.345 [2024-11-29 02:32:29.916582] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.345 [2024-11-29 02:32:29.918847] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.345 [2024-11-29 02:32:29.928436] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.345 [2024-11-29 02:32:29.928730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.345 [2024-11-29 02:32:29.928854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.345 [2024-11-29 02:32:29.928880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.345 [2024-11-29 02:32:29.928895] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.345 [2024-11-29 02:32:29.929065] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.345 [2024-11-29 02:32:29.929253] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.345 [2024-11-29 02:32:29.929277] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.345 [2024-11-29 02:32:29.929293] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.345 [2024-11-29 02:32:29.931774] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.345 [2024-11-29 02:32:29.940969] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.345 [2024-11-29 02:32:29.941305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.345 [2024-11-29 02:32:29.941451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.345 [2024-11-29 02:32:29.941478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.345 [2024-11-29 02:32:29.941494] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.345 [2024-11-29 02:32:29.941643] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.345 [2024-11-29 02:32:29.941829] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.345 [2024-11-29 02:32:29.941848] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.345 [2024-11-29 02:32:29.941860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.345 [2024-11-29 02:32:29.944236] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.345 [2024-11-29 02:32:29.953575] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.345 [2024-11-29 02:32:29.953851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.345 [2024-11-29 02:32:29.953951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.345 [2024-11-29 02:32:29.953977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.345 [2024-11-29 02:32:29.953993] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.345 [2024-11-29 02:32:29.954143] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.345 [2024-11-29 02:32:29.954370] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.345 [2024-11-29 02:32:29.954409] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.345 [2024-11-29 02:32:29.954442] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.345 [2024-11-29 02:32:29.956852] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.345 [2024-11-29 02:32:29.966296] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.345 [2024-11-29 02:32:29.966649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.345 [2024-11-29 02:32:29.966821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.345 [2024-11-29 02:32:29.966847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.345 [2024-11-29 02:32:29.966863] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.345 [2024-11-29 02:32:29.967053] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.345 [2024-11-29 02:32:29.967220] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.345 [2024-11-29 02:32:29.967239] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.345 [2024-11-29 02:32:29.967251] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.345 [2024-11-29 02:32:29.969570] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.345 [2024-11-29 02:32:29.978823] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.345 [2024-11-29 02:32:29.979139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.345 [2024-11-29 02:32:29.979251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.345 [2024-11-29 02:32:29.979277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.345 [2024-11-29 02:32:29.979293] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.345 [2024-11-29 02:32:29.979482] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.345 [2024-11-29 02:32:29.979594] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.345 [2024-11-29 02:32:29.979613] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.345 [2024-11-29 02:32:29.979625] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.345 [2024-11-29 02:32:29.981973] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.345 [2024-11-29 02:32:29.991508] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.345 [2024-11-29 02:32:29.991930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.345 [2024-11-29 02:32:29.992090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.345 [2024-11-29 02:32:29.992117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.345 [2024-11-29 02:32:29.992134] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.345 [2024-11-29 02:32:29.992327] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.345 [2024-11-29 02:32:29.992610] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.345 [2024-11-29 02:32:29.992633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.345 [2024-11-29 02:32:29.992652] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.345 [2024-11-29 02:32:29.995133] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.346 [2024-11-29 02:32:30.004955] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.346 [2024-11-29 02:32:30.005373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.346 [2024-11-29 02:32:30.005535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.346 [2024-11-29 02:32:30.005574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.346 [2024-11-29 02:32:30.005602] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.346 [2024-11-29 02:32:30.005863] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.346 [2024-11-29 02:32:30.006069] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.346 [2024-11-29 02:32:30.006099] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.346 [2024-11-29 02:32:30.006122] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.346 [2024-11-29 02:32:30.009491] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.346 [2024-11-29 02:32:30.017303] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.346 [2024-11-29 02:32:30.017607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.346 [2024-11-29 02:32:30.017741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.346 [2024-11-29 02:32:30.017770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.346 [2024-11-29 02:32:30.017795] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.346 [2024-11-29 02:32:30.017945] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.346 [2024-11-29 02:32:30.018143] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.346 [2024-11-29 02:32:30.018163] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.346 [2024-11-29 02:32:30.018177] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.346 [2024-11-29 02:32:30.020528] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.609 [2024-11-29 02:32:30.029760] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.609 [2024-11-29 02:32:30.030091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.609 [2024-11-29 02:32:30.030207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.609 [2024-11-29 02:32:30.030233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.609 [2024-11-29 02:32:30.030249] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.609 [2024-11-29 02:32:30.030457] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.609 [2024-11-29 02:32:30.030663] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.609 [2024-11-29 02:32:30.030684] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.609 [2024-11-29 02:32:30.030706] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.609 [2024-11-29 02:32:30.032995] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.609 [2024-11-29 02:32:30.042365] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.609 [2024-11-29 02:32:30.042698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.609 [2024-11-29 02:32:30.042838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.609 [2024-11-29 02:32:30.042865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.609 [2024-11-29 02:32:30.042882] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.609 [2024-11-29 02:32:30.043074] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.609 [2024-11-29 02:32:30.043200] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.609 [2024-11-29 02:32:30.043220] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.609 [2024-11-29 02:32:30.043233] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.609 [2024-11-29 02:32:30.045457] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.610 [2024-11-29 02:32:30.054955] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.610 [2024-11-29 02:32:30.055250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.610 [2024-11-29 02:32:30.055416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.610 [2024-11-29 02:32:30.055443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.610 [2024-11-29 02:32:30.055459] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.610 [2024-11-29 02:32:30.055608] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.610 [2024-11-29 02:32:30.055789] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.610 [2024-11-29 02:32:30.055808] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.610 [2024-11-29 02:32:30.055821] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.610 [2024-11-29 02:32:30.057976] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.610 [2024-11-29 02:32:30.067633] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.610 [2024-11-29 02:32:30.068032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.610 [2024-11-29 02:32:30.068199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.610 [2024-11-29 02:32:30.068225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.610 [2024-11-29 02:32:30.068241] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.610 [2024-11-29 02:32:30.068389] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.610 [2024-11-29 02:32:30.068557] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.610 [2024-11-29 02:32:30.068577] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.610 [2024-11-29 02:32:30.068590] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.610 [2024-11-29 02:32:30.071054] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.610 [2024-11-29 02:32:30.080312] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.610 [2024-11-29 02:32:30.080629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.610 [2024-11-29 02:32:30.080795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.610 [2024-11-29 02:32:30.080821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.610 [2024-11-29 02:32:30.080837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.610 [2024-11-29 02:32:30.080983] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.610 [2024-11-29 02:32:30.081140] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.610 [2024-11-29 02:32:30.081159] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.610 [2024-11-29 02:32:30.081171] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.610 [2024-11-29 02:32:30.083584] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.610 [2024-11-29 02:32:30.092965] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.610 [2024-11-29 02:32:30.093302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.610 [2024-11-29 02:32:30.093428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.610 [2024-11-29 02:32:30.093455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.610 [2024-11-29 02:32:30.093471] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.610 [2024-11-29 02:32:30.093639] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.610 [2024-11-29 02:32:30.093818] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.610 [2024-11-29 02:32:30.093836] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.610 [2024-11-29 02:32:30.093848] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.610 [2024-11-29 02:32:30.096182] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.610 [2024-11-29 02:32:30.105612] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.610 [2024-11-29 02:32:30.105939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.610 [2024-11-29 02:32:30.106117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.610 [2024-11-29 02:32:30.106143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.610 [2024-11-29 02:32:30.106159] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.610 [2024-11-29 02:32:30.106334] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.610 [2024-11-29 02:32:30.106491] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.610 [2024-11-29 02:32:30.106512] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.610 [2024-11-29 02:32:30.106526] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.610 [2024-11-29 02:32:30.108835] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.610 [2024-11-29 02:32:30.118119] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.610 [2024-11-29 02:32:30.118407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.610 [2024-11-29 02:32:30.118511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.610 [2024-11-29 02:32:30.118537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.610 [2024-11-29 02:32:30.118553] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.610 [2024-11-29 02:32:30.118685] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.610 [2024-11-29 02:32:30.118904] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.610 [2024-11-29 02:32:30.118922] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.610 [2024-11-29 02:32:30.118935] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.610 [2024-11-29 02:32:30.121188] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.610 [2024-11-29 02:32:30.130439] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.610 [2024-11-29 02:32:30.130742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.610 [2024-11-29 02:32:30.130908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.610 [2024-11-29 02:32:30.130934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.610 [2024-11-29 02:32:30.130950] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.610 [2024-11-29 02:32:30.131129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.610 [2024-11-29 02:32:30.131331] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.610 [2024-11-29 02:32:30.131350] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.610 [2024-11-29 02:32:30.131362] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.610 [2024-11-29 02:32:30.133736] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.610 [2024-11-29 02:32:30.143188] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.610 [2024-11-29 02:32:30.143522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.610 [2024-11-29 02:32:30.143651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.610 [2024-11-29 02:32:30.143677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.610 [2024-11-29 02:32:30.143693] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.610 [2024-11-29 02:32:30.143915] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.610 [2024-11-29 02:32:30.144064] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.610 [2024-11-29 02:32:30.144083] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.610 [2024-11-29 02:32:30.144094] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.610 [2024-11-29 02:32:30.146378] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.610 [2024-11-29 02:32:30.155512] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.610 [2024-11-29 02:32:30.155844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.610 [2024-11-29 02:32:30.155959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.610 [2024-11-29 02:32:30.155990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.610 [2024-11-29 02:32:30.156007] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.610 [2024-11-29 02:32:30.156203] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.610 [2024-11-29 02:32:30.156343] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.610 [2024-11-29 02:32:30.156362] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.610 [2024-11-29 02:32:30.156375] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.610 [2024-11-29 02:32:30.158579] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.610 [2024-11-29 02:32:30.167999] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.610 [2024-11-29 02:32:30.168345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.610 [2024-11-29 02:32:30.168488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.611 [2024-11-29 02:32:30.168516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.611 [2024-11-29 02:32:30.168532] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.611 [2024-11-29 02:32:30.168711] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.611 [2024-11-29 02:32:30.168896] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.611 [2024-11-29 02:32:30.168915] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.611 [2024-11-29 02:32:30.168927] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.611 [2024-11-29 02:32:30.171189] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.611 [2024-11-29 02:32:30.180600] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.611 [2024-11-29 02:32:30.180837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.611 [2024-11-29 02:32:30.181011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.611 [2024-11-29 02:32:30.181037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.611 [2024-11-29 02:32:30.181053] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.611 [2024-11-29 02:32:30.181200] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.611 [2024-11-29 02:32:30.181370] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.611 [2024-11-29 02:32:30.181389] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.611 [2024-11-29 02:32:30.181436] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.611 [2024-11-29 02:32:30.183859] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.611 [2024-11-29 02:32:30.193340] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.611 [2024-11-29 02:32:30.193654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.611 [2024-11-29 02:32:30.193792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.611 [2024-11-29 02:32:30.193818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.611 [2024-11-29 02:32:30.193838] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.611 [2024-11-29 02:32:30.194015] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.611 [2024-11-29 02:32:30.194182] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.611 [2024-11-29 02:32:30.194201] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.611 [2024-11-29 02:32:30.194214] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.611 [2024-11-29 02:32:30.196500] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.611 [2024-11-29 02:32:30.205802] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.611 [2024-11-29 02:32:30.206119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.611 [2024-11-29 02:32:30.206240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.611 [2024-11-29 02:32:30.206265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.611 [2024-11-29 02:32:30.206281] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.611 [2024-11-29 02:32:30.206426] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.611 [2024-11-29 02:32:30.206607] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.611 [2024-11-29 02:32:30.206628] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.611 [2024-11-29 02:32:30.206641] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.611 [2024-11-29 02:32:30.208723] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.611 [2024-11-29 02:32:30.218271] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.611 [2024-11-29 02:32:30.218535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.611 [2024-11-29 02:32:30.218701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.611 [2024-11-29 02:32:30.218726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.611 [2024-11-29 02:32:30.218742] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.611 [2024-11-29 02:32:30.218858] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.611 [2024-11-29 02:32:30.218970] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.611 [2024-11-29 02:32:30.218990] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.611 [2024-11-29 02:32:30.219016] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.611 [2024-11-29 02:32:30.221110] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.611 [2024-11-29 02:32:30.230888] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.611 [2024-11-29 02:32:30.231250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.611 [2024-11-29 02:32:30.231405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.611 [2024-11-29 02:32:30.231431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.611 [2024-11-29 02:32:30.231447] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.611 [2024-11-29 02:32:30.231551] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.611 [2024-11-29 02:32:30.231706] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.611 [2024-11-29 02:32:30.231742] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.611 [2024-11-29 02:32:30.231755] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.611 [2024-11-29 02:32:30.234198] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.611 [2024-11-29 02:32:30.243555] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.611 [2024-11-29 02:32:30.243878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.611 [2024-11-29 02:32:30.244000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.611 [2024-11-29 02:32:30.244026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.611 [2024-11-29 02:32:30.244042] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.611 [2024-11-29 02:32:30.244221] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.611 [2024-11-29 02:32:30.244377] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.611 [2024-11-29 02:32:30.244422] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.611 [2024-11-29 02:32:30.244437] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.611 [2024-11-29 02:32:30.246787] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.611 [2024-11-29 02:32:30.255796] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.611 [2024-11-29 02:32:30.256175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.611 [2024-11-29 02:32:30.256363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.611 [2024-11-29 02:32:30.256405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.611 [2024-11-29 02:32:30.256443] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.611 [2024-11-29 02:32:30.256596] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.611 [2024-11-29 02:32:30.256755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.611 [2024-11-29 02:32:30.256778] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.611 [2024-11-29 02:32:30.256793] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.611 [2024-11-29 02:32:30.259155] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.611 [2024-11-29 02:32:30.268316] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.611 [2024-11-29 02:32:30.268695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.611 [2024-11-29 02:32:30.268829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.611 [2024-11-29 02:32:30.268854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.611 [2024-11-29 02:32:30.268870] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.611 [2024-11-29 02:32:30.269064] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.611 [2024-11-29 02:32:30.269258] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.611 [2024-11-29 02:32:30.269292] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.611 [2024-11-29 02:32:30.269305] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.611 [2024-11-29 02:32:30.271584] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.611 [2024-11-29 02:32:30.280896] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.611 [2024-11-29 02:32:30.281245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.611 [2024-11-29 02:32:30.281378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.611 [2024-11-29 02:32:30.281415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.611 [2024-11-29 02:32:30.281432] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.611 [2024-11-29 02:32:30.281596] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.611 [2024-11-29 02:32:30.281757] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.612 [2024-11-29 02:32:30.281776] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.612 [2024-11-29 02:32:30.281788] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.612 [2024-11-29 02:32:30.284026] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.874 [2024-11-29 02:32:30.293326] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.874 [2024-11-29 02:32:30.293632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.874 [2024-11-29 02:32:30.293729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.874 [2024-11-29 02:32:30.293755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.874 [2024-11-29 02:32:30.293771] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.874 [2024-11-29 02:32:30.293934] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.874 [2024-11-29 02:32:30.294079] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.874 [2024-11-29 02:32:30.294099] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.874 [2024-11-29 02:32:30.294112] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.874 [2024-11-29 02:32:30.296296] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.874 [2024-11-29 02:32:30.305729] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.874 [2024-11-29 02:32:30.306087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.874 [2024-11-29 02:32:30.306191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.874 [2024-11-29 02:32:30.306217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.874 [2024-11-29 02:32:30.306232] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.874 [2024-11-29 02:32:30.306348] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.874 [2024-11-29 02:32:30.306521] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.874 [2024-11-29 02:32:30.306547] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.874 [2024-11-29 02:32:30.306560] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.874 [2024-11-29 02:32:30.308871] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.874 [2024-11-29 02:32:30.318266] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.874 [2024-11-29 02:32:30.318535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.874 [2024-11-29 02:32:30.318651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.874 [2024-11-29 02:32:30.318677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.874 [2024-11-29 02:32:30.318692] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.874 [2024-11-29 02:32:30.318853] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.874 [2024-11-29 02:32:30.318980] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.874 [2024-11-29 02:32:30.318998] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.874 [2024-11-29 02:32:30.319010] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.874 [2024-11-29 02:32:30.321290] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.874 [2024-11-29 02:32:30.330921] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.874 [2024-11-29 02:32:30.331319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.874 [2024-11-29 02:32:30.331478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.874 [2024-11-29 02:32:30.331505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.874 [2024-11-29 02:32:30.331521] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.874 [2024-11-29 02:32:30.331653] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.874 [2024-11-29 02:32:30.331809] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.874 [2024-11-29 02:32:30.331828] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.874 [2024-11-29 02:32:30.331840] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.874 [2024-11-29 02:32:30.334163] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.874 [2024-11-29 02:32:30.343361] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.874 [2024-11-29 02:32:30.343663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.874 [2024-11-29 02:32:30.343778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.874 [2024-11-29 02:32:30.343804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.875 [2024-11-29 02:32:30.343819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.875 [2024-11-29 02:32:30.344012] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.875 [2024-11-29 02:32:30.344135] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.875 [2024-11-29 02:32:30.344154] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.875 [2024-11-29 02:32:30.344184] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.875 [2024-11-29 02:32:30.346227] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.875 [2024-11-29 02:32:30.355876] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.875 [2024-11-29 02:32:30.356124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.875 [2024-11-29 02:32:30.356316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.875 [2024-11-29 02:32:30.356341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.875 [2024-11-29 02:32:30.356358] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.875 [2024-11-29 02:32:30.356505] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.875 [2024-11-29 02:32:30.356713] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.875 [2024-11-29 02:32:30.356732] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.875 [2024-11-29 02:32:30.356745] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.875 [2024-11-29 02:32:30.359042] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.875 [2024-11-29 02:32:30.368160] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.875 [2024-11-29 02:32:30.368555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.875 [2024-11-29 02:32:30.368721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.875 [2024-11-29 02:32:30.368747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.875 [2024-11-29 02:32:30.368763] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.875 [2024-11-29 02:32:30.368926] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.875 [2024-11-29 02:32:30.369083] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.875 [2024-11-29 02:32:30.369102] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.875 [2024-11-29 02:32:30.369114] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.875 [2024-11-29 02:32:30.371470] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.875 [2024-11-29 02:32:30.380676] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.875 [2024-11-29 02:32:30.381102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.875 [2024-11-29 02:32:30.381222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.875 [2024-11-29 02:32:30.381247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.875 [2024-11-29 02:32:30.381263] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.875 [2024-11-29 02:32:30.381425] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.875 [2024-11-29 02:32:30.381590] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.875 [2024-11-29 02:32:30.381610] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.875 [2024-11-29 02:32:30.381623] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.875 [2024-11-29 02:32:30.383910] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.875 [2024-11-29 02:32:30.393211] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.875 [2024-11-29 02:32:30.393579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.875 [2024-11-29 02:32:30.393709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.875 [2024-11-29 02:32:30.393736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.875 [2024-11-29 02:32:30.393753] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.875 [2024-11-29 02:32:30.393930] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.875 [2024-11-29 02:32:30.394083] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.875 [2024-11-29 02:32:30.394102] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.875 [2024-11-29 02:32:30.394114] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.875 [2024-11-29 02:32:30.396463] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.875 [2024-11-29 02:32:30.405888] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.875 [2024-11-29 02:32:30.406279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.875 [2024-11-29 02:32:30.406439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.875 [2024-11-29 02:32:30.406464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.875 [2024-11-29 02:32:30.406480] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.875 [2024-11-29 02:32:30.406645] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.875 [2024-11-29 02:32:30.406788] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.875 [2024-11-29 02:32:30.406821] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.875 [2024-11-29 02:32:30.406833] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.875 [2024-11-29 02:32:30.409023] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.875 [2024-11-29 02:32:30.418663] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.875 [2024-11-29 02:32:30.418943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.875 [2024-11-29 02:32:30.419133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.875 [2024-11-29 02:32:30.419158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.875 [2024-11-29 02:32:30.419173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.875 [2024-11-29 02:32:30.419316] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.875 [2024-11-29 02:32:30.419467] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.875 [2024-11-29 02:32:30.419487] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.875 [2024-11-29 02:32:30.419500] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.875 [2024-11-29 02:32:30.421745] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.875 [2024-11-29 02:32:30.431206] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.875 [2024-11-29 02:32:30.431564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.875 [2024-11-29 02:32:30.431690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.875 [2024-11-29 02:32:30.431715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.875 [2024-11-29 02:32:30.431731] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.875 [2024-11-29 02:32:30.431894] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.875 [2024-11-29 02:32:30.432063] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.876 [2024-11-29 02:32:30.432081] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.876 [2024-11-29 02:32:30.432094] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.876 [2024-11-29 02:32:30.434196] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.876 [2024-11-29 02:32:30.443739] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.876 [2024-11-29 02:32:30.444092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.876 [2024-11-29 02:32:30.444224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.876 [2024-11-29 02:32:30.444249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.876 [2024-11-29 02:32:30.444265] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.876 [2024-11-29 02:32:30.444454] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.876 [2024-11-29 02:32:30.444593] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.876 [2024-11-29 02:32:30.444612] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.876 [2024-11-29 02:32:30.444625] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.876 [2024-11-29 02:32:30.446814] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.876 [2024-11-29 02:32:30.456469] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.876 [2024-11-29 02:32:30.456786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.876 [2024-11-29 02:32:30.456918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.876 [2024-11-29 02:32:30.456944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.876 [2024-11-29 02:32:30.456959] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.876 [2024-11-29 02:32:30.457192] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.876 [2024-11-29 02:32:30.457327] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.876 [2024-11-29 02:32:30.457345] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.876 [2024-11-29 02:32:30.457358] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.876 [2024-11-29 02:32:30.459624] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.876 [2024-11-29 02:32:30.468925] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.876 [2024-11-29 02:32:30.469330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.876 [2024-11-29 02:32:30.469517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.876 [2024-11-29 02:32:30.469543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.876 [2024-11-29 02:32:30.469559] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.876 [2024-11-29 02:32:30.469717] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.876 [2024-11-29 02:32:30.469901] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.876 [2024-11-29 02:32:30.469920] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.876 [2024-11-29 02:32:30.469932] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.876 [2024-11-29 02:32:30.472233] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.876 [2024-11-29 02:32:30.481578] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.876 [2024-11-29 02:32:30.481921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.876 [2024-11-29 02:32:30.482080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.876 [2024-11-29 02:32:30.482105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.876 [2024-11-29 02:32:30.482121] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.876 [2024-11-29 02:32:30.482237] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.876 [2024-11-29 02:32:30.482425] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.876 [2024-11-29 02:32:30.482460] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.876 [2024-11-29 02:32:30.482473] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.876 [2024-11-29 02:32:30.484617] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.876 [2024-11-29 02:32:30.494073] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.876 [2024-11-29 02:32:30.494465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.876 [2024-11-29 02:32:30.494594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.876 [2024-11-29 02:32:30.494620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.876 [2024-11-29 02:32:30.494636] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.876 [2024-11-29 02:32:30.494801] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.876 [2024-11-29 02:32:30.495002] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.876 [2024-11-29 02:32:30.495022] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.876 [2024-11-29 02:32:30.495035] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.876 [2024-11-29 02:32:30.497154] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.876 [2024-11-29 02:32:30.506628] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.876 [2024-11-29 02:32:30.506990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.876 [2024-11-29 02:32:30.507148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.876 [2024-11-29 02:32:30.507174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.876 [2024-11-29 02:32:30.507194] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.876 [2024-11-29 02:32:30.507383] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.876 [2024-11-29 02:32:30.507571] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.876 [2024-11-29 02:32:30.507592] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.876 [2024-11-29 02:32:30.507605] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.876 [2024-11-29 02:32:30.509919] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.876 [2024-11-29 02:32:30.519270] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.876 [2024-11-29 02:32:30.519714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.876 [2024-11-29 02:32:30.519871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.876 [2024-11-29 02:32:30.519897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.876 [2024-11-29 02:32:30.519913] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.876 [2024-11-29 02:32:30.520108] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.876 [2024-11-29 02:32:30.520289] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.876 [2024-11-29 02:32:30.520308] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.877 [2024-11-29 02:32:30.520320] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.877 [2024-11-29 02:32:30.522524] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.877 [2024-11-29 02:32:30.531886] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.877 [2024-11-29 02:32:30.532211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.877 [2024-11-29 02:32:30.532369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.877 [2024-11-29 02:32:30.532404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.877 [2024-11-29 02:32:30.532421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.877 [2024-11-29 02:32:30.532602] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.877 [2024-11-29 02:32:30.532774] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.877 [2024-11-29 02:32:30.532793] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.877 [2024-11-29 02:32:30.532805] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.877 [2024-11-29 02:32:30.535029] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.877 [2024-11-29 02:32:30.544580] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.877 [2024-11-29 02:32:30.544851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.877 [2024-11-29 02:32:30.544948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.877 [2024-11-29 02:32:30.544973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:26.877 [2024-11-29 02:32:30.544988] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:26.877 [2024-11-29 02:32:30.545136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:26.877 [2024-11-29 02:32:30.545340] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.877 [2024-11-29 02:32:30.545359] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.877 [2024-11-29 02:32:30.545371] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.877 [2024-11-29 02:32:30.547551] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.137 [2024-11-29 02:32:30.557118] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.137 [2024-11-29 02:32:30.557462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.137 [2024-11-29 02:32:30.557583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.137 [2024-11-29 02:32:30.557609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.137 [2024-11-29 02:32:30.557625] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.137 [2024-11-29 02:32:30.557787] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.137 [2024-11-29 02:32:30.557970] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.137 [2024-11-29 02:32:30.557988] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.137 [2024-11-29 02:32:30.558000] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.137 [2024-11-29 02:32:30.560274] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.137 [2024-11-29 02:32:30.569610] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.138 [2024-11-29 02:32:30.569951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.138 [2024-11-29 02:32:30.570085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.138 [2024-11-29 02:32:30.570110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.138 [2024-11-29 02:32:30.570126] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.138 [2024-11-29 02:32:30.570306] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.138 [2024-11-29 02:32:30.570502] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.138 [2024-11-29 02:32:30.570521] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.138 [2024-11-29 02:32:30.570533] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.138 [2024-11-29 02:32:30.572900] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.138 [2024-11-29 02:32:30.582462] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.138 [2024-11-29 02:32:30.582791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.138 [2024-11-29 02:32:30.582902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.138 [2024-11-29 02:32:30.582928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.138 [2024-11-29 02:32:30.582944] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.138 [2024-11-29 02:32:30.583092] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.138 [2024-11-29 02:32:30.583253] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.138 [2024-11-29 02:32:30.583272] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.138 [2024-11-29 02:32:30.583284] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.138 [2024-11-29 02:32:30.585426] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.138 [2024-11-29 02:32:30.594958] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.138 [2024-11-29 02:32:30.595244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.138 [2024-11-29 02:32:30.595374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.138 [2024-11-29 02:32:30.595409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.138 [2024-11-29 02:32:30.595427] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.138 [2024-11-29 02:32:30.595588] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.138 [2024-11-29 02:32:30.595741] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.138 [2024-11-29 02:32:30.595760] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.138 [2024-11-29 02:32:30.595772] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.138 [2024-11-29 02:32:30.597926] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.138 [2024-11-29 02:32:30.607702] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.138 [2024-11-29 02:32:30.608066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.138 [2024-11-29 02:32:30.608194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.138 [2024-11-29 02:32:30.608220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.138 [2024-11-29 02:32:30.608236] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.138 [2024-11-29 02:32:30.608458] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.138 [2024-11-29 02:32:30.608633] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.138 [2024-11-29 02:32:30.608653] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.138 [2024-11-29 02:32:30.608666] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.138 [2024-11-29 02:32:30.610965] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.138 [2024-11-29 02:32:30.620217] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.138 [2024-11-29 02:32:30.620615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.138 [2024-11-29 02:32:30.620801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.138 [2024-11-29 02:32:30.620826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.138 [2024-11-29 02:32:30.620842] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.138 [2024-11-29 02:32:30.621006] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.138 [2024-11-29 02:32:30.621174] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.138 [2024-11-29 02:32:30.621197] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.138 [2024-11-29 02:32:30.621209] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.138 [2024-11-29 02:32:30.623507] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.138 [2024-11-29 02:32:30.632818] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.138 [2024-11-29 02:32:30.633179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.138 [2024-11-29 02:32:30.633306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.138 [2024-11-29 02:32:30.633331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.138 [2024-11-29 02:32:30.633347] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.138 [2024-11-29 02:32:30.633474] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.138 [2024-11-29 02:32:30.633635] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.138 [2024-11-29 02:32:30.633654] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.138 [2024-11-29 02:32:30.633667] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.138 [2024-11-29 02:32:30.636107] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.138 [2024-11-29 02:32:30.645409] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.138 [2024-11-29 02:32:30.645756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.138 [2024-11-29 02:32:30.645909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.138 [2024-11-29 02:32:30.645935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.138 [2024-11-29 02:32:30.645950] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.138 [2024-11-29 02:32:30.646159] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.138 [2024-11-29 02:32:30.646326] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.138 [2024-11-29 02:32:30.646345] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.138 [2024-11-29 02:32:30.646357] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.138 [2024-11-29 02:32:30.648803] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.139 [2024-11-29 02:32:30.658060] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.139 [2024-11-29 02:32:30.658325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.139 [2024-11-29 02:32:30.658460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.139 [2024-11-29 02:32:30.658486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.139 [2024-11-29 02:32:30.658502] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.139 [2024-11-29 02:32:30.658737] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.139 [2024-11-29 02:32:30.658856] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.139 [2024-11-29 02:32:30.658875] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.139 [2024-11-29 02:32:30.658892] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.139 [2024-11-29 02:32:30.661214] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.139 [2024-11-29 02:32:30.670574] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.139 [2024-11-29 02:32:30.670932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.139 [2024-11-29 02:32:30.671064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.139 [2024-11-29 02:32:30.671090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.139 [2024-11-29 02:32:30.671106] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.139 [2024-11-29 02:32:30.671282] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.139 [2024-11-29 02:32:30.671462] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.139 [2024-11-29 02:32:30.671483] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.139 [2024-11-29 02:32:30.671495] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.139 [2024-11-29 02:32:30.673784] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.139 [2024-11-29 02:32:30.682980] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.139 [2024-11-29 02:32:30.683279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.139 [2024-11-29 02:32:30.683410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.139 [2024-11-29 02:32:30.683436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.139 [2024-11-29 02:32:30.683452] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.139 [2024-11-29 02:32:30.683584] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.139 [2024-11-29 02:32:30.683758] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.139 [2024-11-29 02:32:30.683777] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.139 [2024-11-29 02:32:30.683789] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.139 [2024-11-29 02:32:30.685757] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.139 [2024-11-29 02:32:30.695556] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.139 [2024-11-29 02:32:30.695913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.139 [2024-11-29 02:32:30.696067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.139 [2024-11-29 02:32:30.696093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.139 [2024-11-29 02:32:30.696109] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.139 [2024-11-29 02:32:30.696255] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.139 [2024-11-29 02:32:30.696421] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.139 [2024-11-29 02:32:30.696455] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.139 [2024-11-29 02:32:30.696468] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.139 [2024-11-29 02:32:30.698909] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.139 [2024-11-29 02:32:30.708138] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.139 [2024-11-29 02:32:30.708471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.139 [2024-11-29 02:32:30.708565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.139 [2024-11-29 02:32:30.708591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.139 [2024-11-29 02:32:30.708606] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.139 [2024-11-29 02:32:30.708739] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.139 [2024-11-29 02:32:30.708887] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.139 [2024-11-29 02:32:30.708906] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.139 [2024-11-29 02:32:30.708919] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.139 [2024-11-29 02:32:30.711174] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.139 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 234586 Killed "${NVMF_APP[@]}" "$@" 00:27:27.139 02:32:30 -- host/bdevperf.sh@36 -- # tgt_init 00:27:27.139 02:32:30 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:27.139 02:32:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:27.139 02:32:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:27.139 02:32:30 -- common/autotest_common.sh@10 -- # set +x 00:27:27.139 [2024-11-29 02:32:30.720670] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.139 [2024-11-29 02:32:30.720944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.139 [2024-11-29 02:32:30.721071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.139 [2024-11-29 02:32:30.721097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.139 [2024-11-29 02:32:30.721114] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.139 02:32:30 -- nvmf/common.sh@469 -- # nvmfpid=235683 00:27:27.139 02:32:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:27.139 [2024-11-29 02:32:30.721280] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.139 02:32:30 -- nvmf/common.sh@470 -- # waitforlisten 235683 00:27:27.139 [2024-11-29 02:32:30.721471] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.139 [2024-11-29 02:32:30.721494] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.139 [2024-11-29 02:32:30.721509] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.139 02:32:30 -- common/autotest_common.sh@829 -- # '[' -z 235683 ']' 00:27:27.139 02:32:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:27.139 02:32:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:27.139 02:32:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:27.139 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:27.139 02:32:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:27.139 02:32:30 -- common/autotest_common.sh@10 -- # set +x 00:27:27.139 [2024-11-29 02:32:30.723735] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.139 [2024-11-29 02:32:30.733122] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.139 [2024-11-29 02:32:30.733532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.139 [2024-11-29 02:32:30.733656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.140 [2024-11-29 02:32:30.733681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.140 [2024-11-29 02:32:30.733697] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.140 [2024-11-29 02:32:30.733862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.140 [2024-11-29 02:32:30.734030] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.140 [2024-11-29 02:32:30.734052] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.140 [2024-11-29 02:32:30.734065] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.140 [2024-11-29 02:32:30.736151] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.140 [2024-11-29 02:32:30.745354] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.140 [2024-11-29 02:32:30.745662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.140 [2024-11-29 02:32:30.745795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.140 [2024-11-29 02:32:30.745822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.140 [2024-11-29 02:32:30.745838] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.140 [2024-11-29 02:32:30.746001] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.140 [2024-11-29 02:32:30.746176] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.140 [2024-11-29 02:32:30.746201] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.140 [2024-11-29 02:32:30.746217] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.140 [2024-11-29 02:32:30.748400] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.140 [2024-11-29 02:32:30.757557] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.140 [2024-11-29 02:32:30.757910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.140 [2024-11-29 02:32:30.758069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.140 [2024-11-29 02:32:30.758099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.140 [2024-11-29 02:32:30.758117] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.140 [2024-11-29 02:32:30.758319] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.140 [2024-11-29 02:32:30.758501] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.140 [2024-11-29 02:32:30.758527] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.140 [2024-11-29 02:32:30.758544] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.140 [2024-11-29 02:32:30.760927] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.140 [2024-11-29 02:32:30.764655] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:27.140 [2024-11-29 02:32:30.764740] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:27.140 [2024-11-29 02:32:30.770194] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.140 [2024-11-29 02:32:30.770525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.140 [2024-11-29 02:32:30.770674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.140 [2024-11-29 02:32:30.770703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.140 [2024-11-29 02:32:30.770721] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.140 [2024-11-29 02:32:30.770847] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.140 [2024-11-29 02:32:30.771017] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.140 [2024-11-29 02:32:30.771042] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.140 [2024-11-29 02:32:30.771059] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.140 [2024-11-29 02:32:30.773157] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.140 [2024-11-29 02:32:30.782888] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.140 [2024-11-29 02:32:30.783193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.140 [2024-11-29 02:32:30.783350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.140 [2024-11-29 02:32:30.783388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.140 [2024-11-29 02:32:30.783416] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.140 [2024-11-29 02:32:30.783564] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.140 [2024-11-29 02:32:30.783752] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.140 [2024-11-29 02:32:30.783776] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.140 [2024-11-29 02:32:30.783792] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.140 [2024-11-29 02:32:30.786067] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.140 [2024-11-29 02:32:30.795642] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.140 [2024-11-29 02:32:30.795974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.140 [2024-11-29 02:32:30.796083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.140 [2024-11-29 02:32:30.796112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.140 [2024-11-29 02:32:30.796130] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.140 [2024-11-29 02:32:30.796274] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.140 [2024-11-29 02:32:30.796420] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.140 [2024-11-29 02:32:30.796445] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.140 [2024-11-29 02:32:30.796462] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.140 [2024-11-29 02:32:30.798864] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.140 EAL: No free 2048 kB hugepages reported on node 1 00:27:27.140 [2024-11-29 02:32:30.807981] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.140 [2024-11-29 02:32:30.808226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.140 [2024-11-29 02:32:30.808329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.140 [2024-11-29 02:32:30.808355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.140 [2024-11-29 02:32:30.808372] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.140 [2024-11-29 02:32:30.808796] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.140 [2024-11-29 02:32:30.808902] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.140 [2024-11-29 02:32:30.808924] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.140 [2024-11-29 02:32:30.808939] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.140 [2024-11-29 02:32:30.811029] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.401 [2024-11-29 02:32:30.820269] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.401 [2024-11-29 02:32:30.820615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.401 [2024-11-29 02:32:30.820736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.401 [2024-11-29 02:32:30.820768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.401 [2024-11-29 02:32:30.820786] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.401 [2024-11-29 02:32:30.820953] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.401 [2024-11-29 02:32:30.821123] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.401 [2024-11-29 02:32:30.821147] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.401 [2024-11-29 02:32:30.821163] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.401 [2024-11-29 02:32:30.823599] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.401 [2024-11-29 02:32:30.832717] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.401 [2024-11-29 02:32:30.832981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.401 [2024-11-29 02:32:30.833099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.401 [2024-11-29 02:32:30.833127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.401 [2024-11-29 02:32:30.833145] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.401 [2024-11-29 02:32:30.833304] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.401 [2024-11-29 02:32:30.833502] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.401 [2024-11-29 02:32:30.833524] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.401 [2024-11-29 02:32:30.833537] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.401 [2024-11-29 02:32:30.835877] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.401 [2024-11-29 02:32:30.836357] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:27.401 [2024-11-29 02:32:30.845265] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.401 [2024-11-29 02:32:30.845771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.401 [2024-11-29 02:32:30.845950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.401 [2024-11-29 02:32:30.845979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.401 [2024-11-29 02:32:30.846001] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.401 [2024-11-29 02:32:30.846138] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.401 [2024-11-29 02:32:30.846278] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.401 [2024-11-29 02:32:30.846303] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.401 [2024-11-29 02:32:30.846323] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.401 [2024-11-29 02:32:30.848718] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.401 [2024-11-29 02:32:30.857769] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.401 [2024-11-29 02:32:30.858116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.401 [2024-11-29 02:32:30.858296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.401 [2024-11-29 02:32:30.858326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.402 [2024-11-29 02:32:30.858346] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.402 [2024-11-29 02:32:30.858563] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.402 [2024-11-29 02:32:30.858755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.402 [2024-11-29 02:32:30.858780] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.402 [2024-11-29 02:32:30.858799] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.402 [2024-11-29 02:32:30.861204] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.402 [2024-11-29 02:32:30.870289] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.402 [2024-11-29 02:32:30.870738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.402 [2024-11-29 02:32:30.870876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.402 [2024-11-29 02:32:30.870904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.402 [2024-11-29 02:32:30.870937] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.402 [2024-11-29 02:32:30.871139] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.402 [2024-11-29 02:32:30.871291] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.402 [2024-11-29 02:32:30.871315] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.402 [2024-11-29 02:32:30.871332] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.402 [2024-11-29 02:32:30.873832] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.402 [2024-11-29 02:32:30.882953] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.402 [2024-11-29 02:32:30.883267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.402 [2024-11-29 02:32:30.883428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.402 [2024-11-29 02:32:30.883472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.402 [2024-11-29 02:32:30.883490] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.402 [2024-11-29 02:32:30.883639] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.402 [2024-11-29 02:32:30.883794] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.402 [2024-11-29 02:32:30.883818] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.402 [2024-11-29 02:32:30.883835] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.402 [2024-11-29 02:32:30.886274] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.402 [2024-11-29 02:32:30.895364] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.402 [2024-11-29 02:32:30.895667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.402 [2024-11-29 02:32:30.895827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.402 [2024-11-29 02:32:30.895856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.402 [2024-11-29 02:32:30.895874] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.402 [2024-11-29 02:32:30.896034] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.402 [2024-11-29 02:32:30.896221] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.402 [2024-11-29 02:32:30.896246] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.402 [2024-11-29 02:32:30.896262] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.402 [2024-11-29 02:32:30.898648] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.402 [2024-11-29 02:32:30.907919] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.402 [2024-11-29 02:32:30.908317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.402 [2024-11-29 02:32:30.908526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.402 [2024-11-29 02:32:30.908554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.402 [2024-11-29 02:32:30.908576] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.402 [2024-11-29 02:32:30.908743] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.402 [2024-11-29 02:32:30.908918] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.402 [2024-11-29 02:32:30.908943] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.402 [2024-11-29 02:32:30.908963] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.402 [2024-11-29 02:32:30.911092] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.402 [2024-11-29 02:32:30.920604] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.402 [2024-11-29 02:32:30.920878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.402 [2024-11-29 02:32:30.921048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.402 [2024-11-29 02:32:30.921086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.402 [2024-11-29 02:32:30.921105] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.402 [2024-11-29 02:32:30.921272] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.402 [2024-11-29 02:32:30.921449] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.402 [2024-11-29 02:32:30.921473] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.402 [2024-11-29 02:32:30.921487] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.402 [2024-11-29 02:32:30.923983] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.402 [2024-11-29 02:32:30.933264] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.402 [2024-11-29 02:32:30.933557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.402 [2024-11-29 02:32:30.933688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.402 [2024-11-29 02:32:30.933728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.402 [2024-11-29 02:32:30.933746] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.402 [2024-11-29 02:32:30.933912] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.402 [2024-11-29 02:32:30.934135] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.402 [2024-11-29 02:32:30.934161] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.402 [2024-11-29 02:32:30.934177] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.402 [2024-11-29 02:32:30.936677] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.402 [2024-11-29 02:32:30.945738] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.402 [2024-11-29 02:32:30.946203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.402 [2024-11-29 02:32:30.946386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.402 [2024-11-29 02:32:30.946424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.402 [2024-11-29 02:32:30.946459] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.402 [2024-11-29 02:32:30.946576] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.402 [2024-11-29 02:32:30.946750] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.402 [2024-11-29 02:32:30.946778] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.403 [2024-11-29 02:32:30.946795] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.403 [2024-11-29 02:32:30.949037] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.403 [2024-11-29 02:32:30.956832] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:27.403 [2024-11-29 02:32:30.956969] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:27.403 [2024-11-29 02:32:30.956988] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:27.403 [2024-11-29 02:32:30.957001] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:27.403 [2024-11-29 02:32:30.957075] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:27.403 [2024-11-29 02:32:30.957103] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:27.403 [2024-11-29 02:32:30.957106] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:27.403 [2024-11-29 02:32:30.958361] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.403 [2024-11-29 02:32:30.958681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.403 [2024-11-29 02:32:30.958824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.403 [2024-11-29 02:32:30.958860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.403 [2024-11-29 02:32:30.958878] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.403 [2024-11-29 02:32:30.959076] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.403 [2024-11-29 02:32:30.959237] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.403 [2024-11-29 02:32:30.959258] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.403 [2024-11-29 02:32:30.959272] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.403 [2024-11-29 02:32:30.961324] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.403 [2024-11-29 02:32:30.970571] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.403 [2024-11-29 02:32:30.971134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.403 [2024-11-29 02:32:30.971267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.403 [2024-11-29 02:32:30.971307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.403 [2024-11-29 02:32:30.971327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.403 [2024-11-29 02:32:30.971575] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.403 [2024-11-29 02:32:30.971768] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.403 [2024-11-29 02:32:30.971798] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.403 [2024-11-29 02:32:30.971816] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.403 [2024-11-29 02:32:30.974185] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.403 [2024-11-29 02:32:30.982930] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.403 [2024-11-29 02:32:30.983306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.403 [2024-11-29 02:32:30.983455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.403 [2024-11-29 02:32:30.983485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.403 [2024-11-29 02:32:30.983507] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.403 [2024-11-29 02:32:30.983694] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.403 [2024-11-29 02:32:30.983844] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.403 [2024-11-29 02:32:30.983866] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.403 [2024-11-29 02:32:30.983883] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.403 [2024-11-29 02:32:30.985933] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.403 [2024-11-29 02:32:30.995343] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.403 [2024-11-29 02:32:30.995849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.403 [2024-11-29 02:32:30.995992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.403 [2024-11-29 02:32:30.996021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.403 [2024-11-29 02:32:30.996041] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.403 [2024-11-29 02:32:30.996187] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.403 [2024-11-29 02:32:30.996343] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.403 [2024-11-29 02:32:30.996365] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.403 [2024-11-29 02:32:30.996401] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.403 [2024-11-29 02:32:30.998659] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.403 [2024-11-29 02:32:31.007886] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.403 [2024-11-29 02:32:31.008255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.403 [2024-11-29 02:32:31.008426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.403 [2024-11-29 02:32:31.008464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.403 [2024-11-29 02:32:31.008485] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.403 [2024-11-29 02:32:31.008700] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.403 [2024-11-29 02:32:31.008853] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.403 [2024-11-29 02:32:31.008875] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.403 [2024-11-29 02:32:31.008892] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.403 [2024-11-29 02:32:31.010974] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.403 [2024-11-29 02:32:31.020345] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.403 [2024-11-29 02:32:31.020730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.403 [2024-11-29 02:32:31.020846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.403 [2024-11-29 02:32:31.020873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.403 [2024-11-29 02:32:31.020893] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.403 [2024-11-29 02:32:31.021079] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.403 [2024-11-29 02:32:31.021255] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.403 [2024-11-29 02:32:31.021289] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.403 [2024-11-29 02:32:31.021305] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.403 [2024-11-29 02:32:31.023443] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.403 [2024-11-29 02:32:31.032701] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.403 [2024-11-29 02:32:31.033208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.403 [2024-11-29 02:32:31.033353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.404 [2024-11-29 02:32:31.033383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.404 [2024-11-29 02:32:31.033413] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.404 [2024-11-29 02:32:31.033618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.404 [2024-11-29 02:32:31.033805] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.404 [2024-11-29 02:32:31.033828] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.404 [2024-11-29 02:32:31.033847] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.404 [2024-11-29 02:32:31.036019] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.404 [2024-11-29 02:32:31.045210] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.404 [2024-11-29 02:32:31.045456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.404 [2024-11-29 02:32:31.045618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.404 [2024-11-29 02:32:31.045645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.404 [2024-11-29 02:32:31.045662] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.404 [2024-11-29 02:32:31.045812] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.404 [2024-11-29 02:32:31.045977] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.404 [2024-11-29 02:32:31.046000] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.404 [2024-11-29 02:32:31.046014] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.404 [2024-11-29 02:32:31.047940] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.404 [2024-11-29 02:32:31.057467] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.404 [2024-11-29 02:32:31.057769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.404 [2024-11-29 02:32:31.057900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.404 [2024-11-29 02:32:31.057928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.404 [2024-11-29 02:32:31.057946] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.404 [2024-11-29 02:32:31.058128] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.404 [2024-11-29 02:32:31.058306] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.404 [2024-11-29 02:32:31.058328] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.404 [2024-11-29 02:32:31.058343] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.404 [2024-11-29 02:32:31.060318] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.404 [2024-11-29 02:32:31.069815] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.404 [2024-11-29 02:32:31.070163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.404 [2024-11-29 02:32:31.070299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.404 [2024-11-29 02:32:31.070328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.404 [2024-11-29 02:32:31.070345] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.404 [2024-11-29 02:32:31.070521] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.404 [2024-11-29 02:32:31.070689] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.404 [2024-11-29 02:32:31.070711] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.404 [2024-11-29 02:32:31.070726] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.404 [2024-11-29 02:32:31.072670] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.664 [2024-11-29 02:32:31.082117] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.664 [2024-11-29 02:32:31.082384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.664 [2024-11-29 02:32:31.082552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.664 [2024-11-29 02:32:31.082579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.664 [2024-11-29 02:32:31.082596] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.664 [2024-11-29 02:32:31.082792] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.664 [2024-11-29 02:32:31.082939] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.664 [2024-11-29 02:32:31.082960] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.664 [2024-11-29 02:32:31.082974] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.664 [2024-11-29 02:32:31.085071] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.664 [2024-11-29 02:32:31.094546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.664 [2024-11-29 02:32:31.094878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.664 [2024-11-29 02:32:31.095008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.664 [2024-11-29 02:32:31.095036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.664 [2024-11-29 02:32:31.095053] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.664 [2024-11-29 02:32:31.095203] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.664 [2024-11-29 02:32:31.095456] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.664 [2024-11-29 02:32:31.095479] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.664 [2024-11-29 02:32:31.095493] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.664 [2024-11-29 02:32:31.097398] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.664 [2024-11-29 02:32:31.106687] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.664 [2024-11-29 02:32:31.107003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.664 [2024-11-29 02:32:31.107108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.664 [2024-11-29 02:32:31.107140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.664 [2024-11-29 02:32:31.107165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.664 [2024-11-29 02:32:31.107330] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.664 [2024-11-29 02:32:31.107500] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.664 [2024-11-29 02:32:31.107522] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.664 [2024-11-29 02:32:31.107536] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.664 [2024-11-29 02:32:31.109448] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.664 [2024-11-29 02:32:31.119001] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.664 [2024-11-29 02:32:31.119273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.665 [2024-11-29 02:32:31.119404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.665 [2024-11-29 02:32:31.119431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.665 [2024-11-29 02:32:31.119448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.665 [2024-11-29 02:32:31.119598] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.665 [2024-11-29 02:32:31.119716] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.665 [2024-11-29 02:32:31.119753] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.665 [2024-11-29 02:32:31.119767] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.665 [2024-11-29 02:32:31.121758] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.665 [2024-11-29 02:32:31.131221] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.665 [2024-11-29 02:32:31.131519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.665 [2024-11-29 02:32:31.131650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.665 [2024-11-29 02:32:31.131678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.665 [2024-11-29 02:32:31.131695] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.665 [2024-11-29 02:32:31.131861] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.665 [2024-11-29 02:32:31.132026] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.665 [2024-11-29 02:32:31.132048] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.665 [2024-11-29 02:32:31.132062] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.665 [2024-11-29 02:32:31.134075] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.665 [2024-11-29 02:32:31.143425] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.665 [2024-11-29 02:32:31.143680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.665 [2024-11-29 02:32:31.143803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.665 [2024-11-29 02:32:31.143830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.665 [2024-11-29 02:32:31.143852] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.665 [2024-11-29 02:32:31.144002] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.665 [2024-11-29 02:32:31.144180] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.665 [2024-11-29 02:32:31.144203] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.665 [2024-11-29 02:32:31.144217] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.665 [2024-11-29 02:32:31.146312] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.665 [2024-11-29 02:32:31.155659] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.665 [2024-11-29 02:32:31.156048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.665 [2024-11-29 02:32:31.156179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.665 [2024-11-29 02:32:31.156207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.665 [2024-11-29 02:32:31.156224] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.665 [2024-11-29 02:32:31.156390] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.665 [2024-11-29 02:32:31.156553] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.665 [2024-11-29 02:32:31.156575] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.665 [2024-11-29 02:32:31.156589] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.665 [2024-11-29 02:32:31.158749] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.665 [2024-11-29 02:32:31.168037] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.665 [2024-11-29 02:32:31.168365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.665 [2024-11-29 02:32:31.168502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.665 [2024-11-29 02:32:31.168528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.665 [2024-11-29 02:32:31.168545] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.665 [2024-11-29 02:32:31.168710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.665 [2024-11-29 02:32:31.168873] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.665 [2024-11-29 02:32:31.168893] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.665 [2024-11-29 02:32:31.168907] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.665 [2024-11-29 02:32:31.170897] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.665 [2024-11-29 02:32:31.180302] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.665 [2024-11-29 02:32:31.180652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.665 [2024-11-29 02:32:31.180807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.665 [2024-11-29 02:32:31.180833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.665 [2024-11-29 02:32:31.180849] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.665 [2024-11-29 02:32:31.180987] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.665 [2024-11-29 02:32:31.181196] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.665 [2024-11-29 02:32:31.181218] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.665 [2024-11-29 02:32:31.181232] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.665 [2024-11-29 02:32:31.183286] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.665 [2024-11-29 02:32:31.192804] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.665 [2024-11-29 02:32:31.193102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.665 [2024-11-29 02:32:31.193222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.665 [2024-11-29 02:32:31.193249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.665 [2024-11-29 02:32:31.193266] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.665 [2024-11-29 02:32:31.193409] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.665 [2024-11-29 02:32:31.193602] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.665 [2024-11-29 02:32:31.193624] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.665 [2024-11-29 02:32:31.193647] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.665 [2024-11-29 02:32:31.195698] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.665 [2024-11-29 02:32:31.205024] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.665 [2024-11-29 02:32:31.205414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.665 [2024-11-29 02:32:31.205564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.665 [2024-11-29 02:32:31.205590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.665 [2024-11-29 02:32:31.205607] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.665 [2024-11-29 02:32:31.205756] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.665 [2024-11-29 02:32:31.205965] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.666 [2024-11-29 02:32:31.205986] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.666 [2024-11-29 02:32:31.206000] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.666 [2024-11-29 02:32:31.208052] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.666 [2024-11-29 02:32:31.217328] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.666 [2024-11-29 02:32:31.217630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.666 [2024-11-29 02:32:31.217780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.666 [2024-11-29 02:32:31.217807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.666 [2024-11-29 02:32:31.217824] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.666 [2024-11-29 02:32:31.217972] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.666 [2024-11-29 02:32:31.218170] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.666 [2024-11-29 02:32:31.218191] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.666 [2024-11-29 02:32:31.218206] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.666 [2024-11-29 02:32:31.220211] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.666 [2024-11-29 02:32:31.229549] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.666 [2024-11-29 02:32:31.229941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.666 [2024-11-29 02:32:31.230092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.666 [2024-11-29 02:32:31.230119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.666 [2024-11-29 02:32:31.230136] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.666 [2024-11-29 02:32:31.230269] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.666 [2024-11-29 02:32:31.230412] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.666 [2024-11-29 02:32:31.230434] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.666 [2024-11-29 02:32:31.230450] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.666 [2024-11-29 02:32:31.232380] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.666 [2024-11-29 02:32:31.241981] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.666 [2024-11-29 02:32:31.242259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.666 [2024-11-29 02:32:31.242382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.666 [2024-11-29 02:32:31.242416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.666 [2024-11-29 02:32:31.242433] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.666 [2024-11-29 02:32:31.242598] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.666 [2024-11-29 02:32:31.242823] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.666 [2024-11-29 02:32:31.242845] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.666 [2024-11-29 02:32:31.242858] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.666 [2024-11-29 02:32:31.244954] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.666 [2024-11-29 02:32:31.254223] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.666 [2024-11-29 02:32:31.254562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.666 [2024-11-29 02:32:31.254716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.666 [2024-11-29 02:32:31.254743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.666 [2024-11-29 02:32:31.254760] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.666 [2024-11-29 02:32:31.254892] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.666 [2024-11-29 02:32:31.255027] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.666 [2024-11-29 02:32:31.255050] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.666 [2024-11-29 02:32:31.255090] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.666 [2024-11-29 02:32:31.257329] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.666 [2024-11-29 02:32:31.266499] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.666 [2024-11-29 02:32:31.266810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.666 [2024-11-29 02:32:31.266933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.666 [2024-11-29 02:32:31.266960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.666 [2024-11-29 02:32:31.266977] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.666 [2024-11-29 02:32:31.267125] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.666 [2024-11-29 02:32:31.267332] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.666 [2024-11-29 02:32:31.267354] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.666 [2024-11-29 02:32:31.267368] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.666 [2024-11-29 02:32:31.269145] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.666 [2024-11-29 02:32:31.278698] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.666 [2024-11-29 02:32:31.279038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.666 [2024-11-29 02:32:31.279168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.666 [2024-11-29 02:32:31.279195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.666 [2024-11-29 02:32:31.279212] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.666 [2024-11-29 02:32:31.279362] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.666 [2024-11-29 02:32:31.279520] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.666 [2024-11-29 02:32:31.279543] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.666 [2024-11-29 02:32:31.279557] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.666 [2024-11-29 02:32:31.281535] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.666 [2024-11-29 02:32:31.290931] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.666 [2024-11-29 02:32:31.291288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.666 [2024-11-29 02:32:31.291439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.666 [2024-11-29 02:32:31.291467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.666 [2024-11-29 02:32:31.291484] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.666 [2024-11-29 02:32:31.291649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.666 [2024-11-29 02:32:31.291798] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.666 [2024-11-29 02:32:31.291820] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.667 [2024-11-29 02:32:31.291838] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.667 [2024-11-29 02:32:31.293948] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.667 [2024-11-29 02:32:31.303148] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.667 [2024-11-29 02:32:31.303376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.667 [2024-11-29 02:32:31.303516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.667 [2024-11-29 02:32:31.303544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.667 [2024-11-29 02:32:31.303560] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.667 [2024-11-29 02:32:31.303725] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.667 [2024-11-29 02:32:31.303950] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.667 [2024-11-29 02:32:31.303971] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.667 [2024-11-29 02:32:31.303985] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.667 [2024-11-29 02:32:31.306148] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.667 [2024-11-29 02:32:31.315465] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.667 [2024-11-29 02:32:31.315739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.667 [2024-11-29 02:32:31.315867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.667 [2024-11-29 02:32:31.315894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.667 [2024-11-29 02:32:31.315910] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.667 [2024-11-29 02:32:31.316043] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.667 [2024-11-29 02:32:31.316226] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.667 [2024-11-29 02:32:31.316247] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.667 [2024-11-29 02:32:31.316261] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.667 [2024-11-29 02:32:31.318189] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.667 [2024-11-29 02:32:31.327894] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.667 [2024-11-29 02:32:31.328112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.667 [2024-11-29 02:32:31.328276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.667 [2024-11-29 02:32:31.328303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.667 [2024-11-29 02:32:31.328320] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.667 [2024-11-29 02:32:31.328477] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.667 [2024-11-29 02:32:31.328659] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.667 [2024-11-29 02:32:31.328694] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.667 [2024-11-29 02:32:31.328708] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.667 [2024-11-29 02:32:31.330804] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.667 [2024-11-29 02:32:31.340258] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.667 [2024-11-29 02:32:31.340548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.667 [2024-11-29 02:32:31.340677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.667 [2024-11-29 02:32:31.340704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.667 [2024-11-29 02:32:31.340721] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.667 [2024-11-29 02:32:31.340870] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.667 [2024-11-29 02:32:31.341068] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.667 [2024-11-29 02:32:31.341090] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.667 [2024-11-29 02:32:31.341104] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.927 [2024-11-29 02:32:31.343126] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.927 [2024-11-29 02:32:31.352531] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.927 [2024-11-29 02:32:31.352856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.927 [2024-11-29 02:32:31.353005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.927 [2024-11-29 02:32:31.353032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.927 [2024-11-29 02:32:31.353049] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.928 [2024-11-29 02:32:31.353245] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.928 [2024-11-29 02:32:31.353418] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.928 [2024-11-29 02:32:31.353441] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.928 [2024-11-29 02:32:31.353455] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.928 [2024-11-29 02:32:31.355300] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.928 [2024-11-29 02:32:31.364893] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.928 [2024-11-29 02:32:31.365274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.928 [2024-11-29 02:32:31.365404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.928 [2024-11-29 02:32:31.365431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.928 [2024-11-29 02:32:31.365448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.928 [2024-11-29 02:32:31.365565] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.928 [2024-11-29 02:32:31.365716] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.928 [2024-11-29 02:32:31.365752] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.928 [2024-11-29 02:32:31.365766] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.928 [2024-11-29 02:32:31.367907] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.928 [2024-11-29 02:32:31.377155] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.928 [2024-11-29 02:32:31.377379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.928 [2024-11-29 02:32:31.377488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.928 [2024-11-29 02:32:31.377515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.928 [2024-11-29 02:32:31.377532] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.928 [2024-11-29 02:32:31.377698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.928 [2024-11-29 02:32:31.377846] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.928 [2024-11-29 02:32:31.377867] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.928 [2024-11-29 02:32:31.377881] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.928 [2024-11-29 02:32:31.380069] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.928 [2024-11-29 02:32:31.389505] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.928 [2024-11-29 02:32:31.389881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.928 [2024-11-29 02:32:31.390008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.928 [2024-11-29 02:32:31.390035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.928 [2024-11-29 02:32:31.390051] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.928 [2024-11-29 02:32:31.390249] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.928 [2024-11-29 02:32:31.390436] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.928 [2024-11-29 02:32:31.390459] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.928 [2024-11-29 02:32:31.390473] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.928 [2024-11-29 02:32:31.392541] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.928 [2024-11-29 02:32:31.401731] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.928 [2024-11-29 02:32:31.402061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.928 [2024-11-29 02:32:31.402197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.928 [2024-11-29 02:32:31.402224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.928 [2024-11-29 02:32:31.402241] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.928 [2024-11-29 02:32:31.402375] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.928 [2024-11-29 02:32:31.402568] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.928 [2024-11-29 02:32:31.402590] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.928 [2024-11-29 02:32:31.402604] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.928 [2024-11-29 02:32:31.404683] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.928 [2024-11-29 02:32:31.414134] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.928 [2024-11-29 02:32:31.414413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.928 [2024-11-29 02:32:31.414541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.928 [2024-11-29 02:32:31.414567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.928 [2024-11-29 02:32:31.414584] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.928 [2024-11-29 02:32:31.414763] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.928 [2024-11-29 02:32:31.414924] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.928 [2024-11-29 02:32:31.414945] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.928 [2024-11-29 02:32:31.414960] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.928 [2024-11-29 02:32:31.417035] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.928 [2024-11-29 02:32:31.426494] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.928 [2024-11-29 02:32:31.426716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.928 [2024-11-29 02:32:31.426838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.928 [2024-11-29 02:32:31.426865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.928 [2024-11-29 02:32:31.426882] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.928 [2024-11-29 02:32:31.427032] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.928 [2024-11-29 02:32:31.427208] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.928 [2024-11-29 02:32:31.427229] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.928 [2024-11-29 02:32:31.427243] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.928 [2024-11-29 02:32:31.429246] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.928 [2024-11-29 02:32:31.438910] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.928 [2024-11-29 02:32:31.439236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.928 [2024-11-29 02:32:31.439383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.928 [2024-11-29 02:32:31.439420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.928 [2024-11-29 02:32:31.439438] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.928 [2024-11-29 02:32:31.439587] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.929 [2024-11-29 02:32:31.439738] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.929 [2024-11-29 02:32:31.439759] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.929 [2024-11-29 02:32:31.439772] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.929 [2024-11-29 02:32:31.441834] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.929 [2024-11-29 02:32:31.450983] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.929 [2024-11-29 02:32:31.451232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.929 [2024-11-29 02:32:31.451383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.929 [2024-11-29 02:32:31.451418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.929 [2024-11-29 02:32:31.451440] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.929 [2024-11-29 02:32:31.451590] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.929 [2024-11-29 02:32:31.451739] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.929 [2024-11-29 02:32:31.451760] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.929 [2024-11-29 02:32:31.451774] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.929 [2024-11-29 02:32:31.453901] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.929 [2024-11-29 02:32:31.463213] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.929 [2024-11-29 02:32:31.463493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.929 [2024-11-29 02:32:31.463652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.929 [2024-11-29 02:32:31.463679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.929 [2024-11-29 02:32:31.463696] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.929 [2024-11-29 02:32:31.463828] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.929 [2024-11-29 02:32:31.463978] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.929 [2024-11-29 02:32:31.464000] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.929 [2024-11-29 02:32:31.464013] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.929 [2024-11-29 02:32:31.466168] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.929 [2024-11-29 02:32:31.475610] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.929 [2024-11-29 02:32:31.475949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.929 [2024-11-29 02:32:31.476073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.929 [2024-11-29 02:32:31.476101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.929 [2024-11-29 02:32:31.476118] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.929 [2024-11-29 02:32:31.476283] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.929 [2024-11-29 02:32:31.476505] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.929 [2024-11-29 02:32:31.476528] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.929 [2024-11-29 02:32:31.476542] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.929 [2024-11-29 02:32:31.478499] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.929 [2024-11-29 02:32:31.487782] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.929 [2024-11-29 02:32:31.488137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.929 [2024-11-29 02:32:31.488234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.929 [2024-11-29 02:32:31.488259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.929 [2024-11-29 02:32:31.488275] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.929 [2024-11-29 02:32:31.488439] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.929 [2024-11-29 02:32:31.488622] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.929 [2024-11-29 02:32:31.488644] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.929 [2024-11-29 02:32:31.488658] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.929 [2024-11-29 02:32:31.490818] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.929 [2024-11-29 02:32:31.499949] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.929 [2024-11-29 02:32:31.500331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.929 [2024-11-29 02:32:31.500451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.929 [2024-11-29 02:32:31.500478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.929 [2024-11-29 02:32:31.500494] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.929 [2024-11-29 02:32:31.500675] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.929 [2024-11-29 02:32:31.500838] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.929 [2024-11-29 02:32:31.500859] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.929 [2024-11-29 02:32:31.500873] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.929 [2024-11-29 02:32:31.503152] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.929 [2024-11-29 02:32:31.512071] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.929 [2024-11-29 02:32:31.512364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.929 [2024-11-29 02:32:31.512472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.929 [2024-11-29 02:32:31.512499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.929 [2024-11-29 02:32:31.512516] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.929 [2024-11-29 02:32:31.512681] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.929 [2024-11-29 02:32:31.512871] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.929 [2024-11-29 02:32:31.512892] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.929 [2024-11-29 02:32:31.512907] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.929 [2024-11-29 02:32:31.515000] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.929 [2024-11-29 02:32:31.524530] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.929 [2024-11-29 02:32:31.524838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.929 [2024-11-29 02:32:31.524941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.929 [2024-11-29 02:32:31.524969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.929 [2024-11-29 02:32:31.524986] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.929 [2024-11-29 02:32:31.525120] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.929 [2024-11-29 02:32:31.525349] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.929 [2024-11-29 02:32:31.525371] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.930 [2024-11-29 02:32:31.525408] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.930 [2024-11-29 02:32:31.527475] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.930 [2024-11-29 02:32:31.536736] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.930 [2024-11-29 02:32:31.537043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.930 [2024-11-29 02:32:31.537163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.930 [2024-11-29 02:32:31.537190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.930 [2024-11-29 02:32:31.537206] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.930 [2024-11-29 02:32:31.537340] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.930 [2024-11-29 02:32:31.537531] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.930 [2024-11-29 02:32:31.537554] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.930 [2024-11-29 02:32:31.537568] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.930 [2024-11-29 02:32:31.539539] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.930 [2024-11-29 02:32:31.549051] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.930 [2024-11-29 02:32:31.549354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.930 [2024-11-29 02:32:31.549498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.930 [2024-11-29 02:32:31.549525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.930 [2024-11-29 02:32:31.549542] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.930 [2024-11-29 02:32:31.549707] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.930 [2024-11-29 02:32:31.549887] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.930 [2024-11-29 02:32:31.549908] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.930 [2024-11-29 02:32:31.549921] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.930 [2024-11-29 02:32:31.552134] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.930 [2024-11-29 02:32:31.561336] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.930 [2024-11-29 02:32:31.561637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.930 [2024-11-29 02:32:31.561737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.930 [2024-11-29 02:32:31.561764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.930 [2024-11-29 02:32:31.561780] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.930 [2024-11-29 02:32:31.561978] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.930 [2024-11-29 02:32:31.562125] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.930 [2024-11-29 02:32:31.562151] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.930 [2024-11-29 02:32:31.562165] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.930 [2024-11-29 02:32:31.564268] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.930 [2024-11-29 02:32:31.573590] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.930 [2024-11-29 02:32:31.573905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.930 [2024-11-29 02:32:31.574027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.930 [2024-11-29 02:32:31.574054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.930 [2024-11-29 02:32:31.574070] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.930 [2024-11-29 02:32:31.574186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.930 [2024-11-29 02:32:31.574370] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.930 [2024-11-29 02:32:31.574401] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.930 [2024-11-29 02:32:31.574432] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.930 [2024-11-29 02:32:31.576499] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.930 [2024-11-29 02:32:31.585894] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.930 [2024-11-29 02:32:31.586203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.930 [2024-11-29 02:32:31.586358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.930 [2024-11-29 02:32:31.586402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.930 [2024-11-29 02:32:31.586420] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.930 [2024-11-29 02:32:31.586569] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.930 [2024-11-29 02:32:31.586748] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.930 [2024-11-29 02:32:31.586769] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.930 [2024-11-29 02:32:31.586783] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.930 [2024-11-29 02:32:31.588742] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.930 [2024-11-29 02:32:31.598138] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.930 [2024-11-29 02:32:31.598462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.930 [2024-11-29 02:32:31.598585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.930 [2024-11-29 02:32:31.598612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:27.930 [2024-11-29 02:32:31.598628] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:27.930 [2024-11-29 02:32:31.598761] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:27.930 [2024-11-29 02:32:31.598942] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.930 [2024-11-29 02:32:31.598963] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.930 [2024-11-29 02:32:31.598981] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.930 [2024-11-29 02:32:31.601015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.190 [2024-11-29 02:32:31.610442] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.190 [2024-11-29 02:32:31.610732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.190 [2024-11-29 02:32:31.610864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.190 [2024-11-29 02:32:31.610891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:28.190 [2024-11-29 02:32:31.610908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:28.190 [2024-11-29 02:32:31.611057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:28.190 [2024-11-29 02:32:31.611265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.190 [2024-11-29 02:32:31.611286] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.190 [2024-11-29 02:32:31.611300] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.190 [2024-11-29 02:32:31.613472] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.190 [2024-11-29 02:32:31.622635] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.190 [2024-11-29 02:32:31.622979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.190 [2024-11-29 02:32:31.623095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.190 [2024-11-29 02:32:31.623122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:28.190 [2024-11-29 02:32:31.623139] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:28.191 [2024-11-29 02:32:31.623288] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:28.191 [2024-11-29 02:32:31.623479] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.191 [2024-11-29 02:32:31.623503] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.191 [2024-11-29 02:32:31.623518] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.191 [2024-11-29 02:32:31.625647] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.191 [2024-11-29 02:32:31.634796] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.191 [2024-11-29 02:32:31.635152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.191 [2024-11-29 02:32:31.635319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.191 [2024-11-29 02:32:31.635345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:28.191 [2024-11-29 02:32:31.635361] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:28.191 [2024-11-29 02:32:31.635521] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:28.191 [2024-11-29 02:32:31.635686] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.191 [2024-11-29 02:32:31.635723] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.191 [2024-11-29 02:32:31.635737] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.191 [2024-11-29 02:32:31.637707] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.191 [2024-11-29 02:32:31.647038] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.191 [2024-11-29 02:32:31.647361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.191 [2024-11-29 02:32:31.647517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.191 [2024-11-29 02:32:31.647545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:28.191 [2024-11-29 02:32:31.647561] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:28.191 [2024-11-29 02:32:31.647727] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:28.191 [2024-11-29 02:32:31.647904] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.191 [2024-11-29 02:32:31.647926] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.191 [2024-11-29 02:32:31.647939] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.191 [2024-11-29 02:32:31.650001] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.191 [2024-11-29 02:32:31.659232] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.191 [2024-11-29 02:32:31.659498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.191 [2024-11-29 02:32:31.659618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.191 [2024-11-29 02:32:31.659645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:28.191 [2024-11-29 02:32:31.659661] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:28.191 [2024-11-29 02:32:31.659796] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:28.191 [2024-11-29 02:32:31.660021] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.191 [2024-11-29 02:32:31.660042] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.191 [2024-11-29 02:32:31.660055] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.191 [2024-11-29 02:32:31.662207] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.191 [2024-11-29 02:32:31.671606] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.191 [2024-11-29 02:32:31.671965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.191 [2024-11-29 02:32:31.672117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.191 [2024-11-29 02:32:31.672143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:28.191 [2024-11-29 02:32:31.672160] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:28.191 [2024-11-29 02:32:31.672293] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:28.191 [2024-11-29 02:32:31.672498] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.191 [2024-11-29 02:32:31.672520] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.191 [2024-11-29 02:32:31.672534] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.191 [2024-11-29 02:32:31.674463] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.191 [2024-11-29 02:32:31.683682] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.191 [2024-11-29 02:32:31.683971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.191 [2024-11-29 02:32:31.684125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.191 [2024-11-29 02:32:31.684151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:28.191 [2024-11-29 02:32:31.684168] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:28.191 [2024-11-29 02:32:31.684380] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:28.191 [2024-11-29 02:32:31.684556] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.191 [2024-11-29 02:32:31.684578] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.191 [2024-11-29 02:32:31.684592] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.191 [2024-11-29 02:32:31.686687] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.191 [2024-11-29 02:32:31.695958] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.191 [2024-11-29 02:32:31.696276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.191 [2024-11-29 02:32:31.696368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.191 [2024-11-29 02:32:31.696411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:28.191 [2024-11-29 02:32:31.696429] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:28.191 [2024-11-29 02:32:31.696562] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:28.191 [2024-11-29 02:32:31.696774] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.191 [2024-11-29 02:32:31.696796] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.191 [2024-11-29 02:32:31.696810] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.191 [2024-11-29 02:32:31.698888] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.191 [2024-11-29 02:32:31.708534] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.191 [2024-11-29 02:32:31.708863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.191 [2024-11-29 02:32:31.708957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.191 [2024-11-29 02:32:31.708985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:28.191 [2024-11-29 02:32:31.709002] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:28.191 [2024-11-29 02:32:31.709168] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:28.191 [2024-11-29 02:32:31.709332] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.191 [2024-11-29 02:32:31.709354] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.191 [2024-11-29 02:32:31.709367] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.191 [2024-11-29 02:32:31.711535] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.191 [2024-11-29 02:32:31.720785] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.191 [2024-11-29 02:32:31.721114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.191 [2024-11-29 02:32:31.721241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.191 [2024-11-29 02:32:31.721268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:28.191 [2024-11-29 02:32:31.721285] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:28.191 [2024-11-29 02:32:31.721444] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:28.191 [2024-11-29 02:32:31.721581] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.191 [2024-11-29 02:32:31.721603] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.191 [2024-11-29 02:32:31.721618] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.191 [2024-11-29 02:32:31.723624] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.191 02:32:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:28.191 02:32:31 -- common/autotest_common.sh@862 -- # return 0 00:27:28.191 02:32:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:28.191 02:32:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:28.191 02:32:31 -- common/autotest_common.sh@10 -- # set +x 00:27:28.191 [2024-11-29 02:32:31.732889] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.191 [2024-11-29 02:32:31.733200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.191 [2024-11-29 02:32:31.733297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.191 [2024-11-29 02:32:31.733325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:28.192 [2024-11-29 02:32:31.733343] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:28.192 [2024-11-29 02:32:31.733488] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:28.192 [2024-11-29 02:32:31.733657] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.192 [2024-11-29 02:32:31.733708] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.192 [2024-11-29 02:32:31.733722] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.192 [2024-11-29 02:32:31.735655] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.192 [2024-11-29 02:32:31.745198] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.192 [2024-11-29 02:32:31.745516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.192 [2024-11-29 02:32:31.745664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.192 [2024-11-29 02:32:31.745690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:28.192 [2024-11-29 02:32:31.745707] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:28.192 [2024-11-29 02:32:31.745860] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:28.192 [2024-11-29 02:32:31.746023] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.192 [2024-11-29 02:32:31.746055] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.192 [2024-11-29 02:32:31.746069] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.192 02:32:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:28.192 02:32:31 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:28.192 02:32:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:28.192 [2024-11-29 02:32:31.748230] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.192 02:32:31 -- common/autotest_common.sh@10 -- # set +x 00:27:28.192 [2024-11-29 02:32:31.752425] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:28.192 [2024-11-29 02:32:31.757509] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.192 [2024-11-29 02:32:31.757841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.192 [2024-11-29 02:32:31.757964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.192 02:32:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:28.192 [2024-11-29 02:32:31.757991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:28.192 [2024-11-29 02:32:31.758010] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:28.192 02:32:31 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:28.192 [2024-11-29 02:32:31.758176] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:28.192 02:32:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:28.192 [2024-11-29 02:32:31.758327] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.192 [2024-11-29 02:32:31.758348] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.192 [2024-11-29 02:32:31.758363] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.192 02:32:31 -- common/autotest_common.sh@10 -- # set +x 00:27:28.192 [2024-11-29 02:32:31.760526] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.192 [2024-11-29 02:32:31.769759] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.192 [2024-11-29 02:32:31.770079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.192 [2024-11-29 02:32:31.770231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.192 [2024-11-29 02:32:31.770257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:28.192 [2024-11-29 02:32:31.770273] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:28.192 [2024-11-29 02:32:31.770431] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:28.192 [2024-11-29 02:32:31.770552] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.192 [2024-11-29 02:32:31.770574] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.192 [2024-11-29 02:32:31.770589] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.192 [2024-11-29 02:32:31.772619] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.192 [2024-11-29 02:32:31.782243] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.192 [2024-11-29 02:32:31.782706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.192 [2024-11-29 02:32:31.782830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.192 [2024-11-29 02:32:31.782857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:28.192 [2024-11-29 02:32:31.782877] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:28.192 [2024-11-29 02:32:31.783051] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:28.192 [2024-11-29 02:32:31.783252] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.192 [2024-11-29 02:32:31.783283] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.192 [2024-11-29 02:32:31.783301] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.192 [2024-11-29 02:32:31.785686] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.192 Malloc0 00:27:28.192 02:32:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:28.192 02:32:31 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:28.192 02:32:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:28.192 02:32:31 -- common/autotest_common.sh@10 -- # set +x 00:27:28.192 [2024-11-29 02:32:31.794693] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.192 [2024-11-29 02:32:31.795053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.192 [2024-11-29 02:32:31.795186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.192 [2024-11-29 02:32:31.795214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:28.192 [2024-11-29 02:32:31.795231] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:28.192 [2024-11-29 02:32:31.795349] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:28.192 [2024-11-29 02:32:31.795544] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.192 [2024-11-29 02:32:31.795567] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.192 [2024-11-29 02:32:31.795582] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.192 02:32:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:28.192 02:32:31 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:28.192 02:32:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:28.192 02:32:31 -- common/autotest_common.sh@10 -- # set +x 00:27:28.192 [2024-11-29 02:32:31.797827] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.192 02:32:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:28.192 02:32:31 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:28.192 02:32:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:28.192 02:32:31 -- common/autotest_common.sh@10 -- # set +x 00:27:28.192 [2024-11-29 02:32:31.807120] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.192 [2024-11-29 02:32:31.807385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.192 [2024-11-29 02:32:31.807488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.192 [2024-11-29 02:32:31.807514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ad160 with addr=10.0.0.2, port=4420 00:27:28.192 [2024-11-29 02:32:31.807530] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ad160 is same with the state(5) to be set 00:27:28.192 [2024-11-29 02:32:31.807679] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ad160 (9): Bad file descriptor 00:27:28.192 [2024-11-29 02:32:31.807815] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.192 [2024-11-29 02:32:31.807836] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.192 [2024-11-29 02:32:31.807850] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.192 [2024-11-29 02:32:31.808858] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:28.192 [2024-11-29 02:32:31.809963] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.192 02:32:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:28.192 02:32:31 -- host/bdevperf.sh@38 -- # wait 234995 00:27:28.192 [2024-11-29 02:32:31.819487] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.451 [2024-11-29 02:32:31.896075] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:38.434 00:27:38.434 Latency(us) 00:27:38.434 [2024-11-29T01:32:42.115Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:38.434 [2024-11-29T01:32:42.115Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:38.434 Verification LBA range: start 0x0 length 0x4000 00:27:38.434 Nvme1n1 : 15.01 9502.43 37.12 16074.89 0.00 4989.67 615.92 18155.90 00:27:38.434 [2024-11-29T01:32:42.115Z] =================================================================================================================== 00:27:38.434 [2024-11-29T01:32:42.115Z] Total : 9502.43 37.12 16074.89 0.00 4989.67 615.92 18155.90 00:27:38.434 02:32:40 -- host/bdevperf.sh@39 -- # sync 00:27:38.434 02:32:40 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:38.434 02:32:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:38.434 02:32:40 -- common/autotest_common.sh@10 -- # set +x 00:27:38.434 02:32:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:38.434 02:32:40 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:27:38.434 02:32:40 -- host/bdevperf.sh@44 -- # nvmftestfini 00:27:38.434 02:32:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:38.434 02:32:40 -- nvmf/common.sh@116 -- # sync 00:27:38.434 02:32:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:38.434 02:32:40 -- nvmf/common.sh@119 -- # set +e 00:27:38.434 02:32:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:38.434 02:32:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:38.434 rmmod nvme_tcp 00:27:38.434 rmmod nvme_fabrics 00:27:38.434 rmmod nvme_keyring 00:27:38.435 02:32:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:38.435 02:32:40 -- nvmf/common.sh@123 -- # set -e 00:27:38.435 02:32:40 -- nvmf/common.sh@124 -- # return 0 00:27:38.435 02:32:40 -- nvmf/common.sh@477 -- # '[' -n 235683 ']' 00:27:38.435 02:32:40 -- nvmf/common.sh@478 -- # killprocess 235683 00:27:38.435 02:32:40 -- common/autotest_common.sh@936 -- # '[' -z 235683 ']' 00:27:38.435 02:32:40 -- common/autotest_common.sh@940 -- # kill -0 235683 00:27:38.435 02:32:40 -- common/autotest_common.sh@941 -- # uname 00:27:38.435 02:32:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:38.435 02:32:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 235683 00:27:38.435 02:32:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:38.435 02:32:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:38.435 02:32:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 235683' 00:27:38.435 killing process with pid 235683 00:27:38.435 02:32:40 -- common/autotest_common.sh@955 -- # kill 235683 00:27:38.435 02:32:40 -- common/autotest_common.sh@960 -- # wait 235683 00:27:38.435 02:32:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:38.435 02:32:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:38.435 02:32:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:38.435 02:32:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:38.435 02:32:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:38.435 02:32:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:38.435 02:32:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:38.435 02:32:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:39.370 02:32:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:39.370 00:27:39.370 real 0m23.450s 00:27:39.370 user 1m1.905s 00:27:39.370 sys 0m4.917s 00:27:39.370 02:32:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:39.370 02:32:42 -- common/autotest_common.sh@10 -- # set +x 00:27:39.370 ************************************ 00:27:39.370 END TEST nvmf_bdevperf 00:27:39.370 ************************************ 00:27:39.370 02:32:42 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:39.370 02:32:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:39.370 02:32:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:39.370 02:32:42 -- common/autotest_common.sh@10 -- # set +x 00:27:39.370 ************************************ 00:27:39.370 START TEST nvmf_target_disconnect 00:27:39.370 ************************************ 00:27:39.370 02:32:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:39.370 * Looking for test storage... 00:27:39.370 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:39.370 02:32:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:39.370 02:32:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:39.370 02:32:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:39.629 02:32:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:39.629 02:32:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:39.629 02:32:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:39.629 02:32:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:39.629 02:32:43 -- scripts/common.sh@335 -- # IFS=.-: 00:27:39.629 02:32:43 -- scripts/common.sh@335 -- # read -ra ver1 00:27:39.629 02:32:43 -- scripts/common.sh@336 -- # IFS=.-: 00:27:39.629 02:32:43 -- scripts/common.sh@336 -- # read -ra ver2 00:27:39.629 02:32:43 -- scripts/common.sh@337 -- # local 'op=<' 00:27:39.629 02:32:43 -- scripts/common.sh@339 -- # ver1_l=2 00:27:39.629 02:32:43 -- scripts/common.sh@340 -- # ver2_l=1 00:27:39.629 02:32:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:39.629 02:32:43 -- scripts/common.sh@343 -- # case "$op" in 00:27:39.629 02:32:43 -- scripts/common.sh@344 -- # : 1 00:27:39.629 02:32:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:39.629 02:32:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:39.629 02:32:43 -- scripts/common.sh@364 -- # decimal 1 00:27:39.629 02:32:43 -- scripts/common.sh@352 -- # local d=1 00:27:39.629 02:32:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:39.629 02:32:43 -- scripts/common.sh@354 -- # echo 1 00:27:39.629 02:32:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:39.629 02:32:43 -- scripts/common.sh@365 -- # decimal 2 00:27:39.629 02:32:43 -- scripts/common.sh@352 -- # local d=2 00:27:39.629 02:32:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:39.629 02:32:43 -- scripts/common.sh@354 -- # echo 2 00:27:39.629 02:32:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:39.629 02:32:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:39.629 02:32:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:39.629 02:32:43 -- scripts/common.sh@367 -- # return 0 00:27:39.629 02:32:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:39.629 02:32:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:39.629 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:39.629 --rc genhtml_branch_coverage=1 00:27:39.629 --rc genhtml_function_coverage=1 00:27:39.629 --rc genhtml_legend=1 00:27:39.629 --rc geninfo_all_blocks=1 00:27:39.629 --rc geninfo_unexecuted_blocks=1 00:27:39.629 00:27:39.629 ' 00:27:39.629 02:32:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:39.629 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:39.629 --rc genhtml_branch_coverage=1 00:27:39.629 --rc genhtml_function_coverage=1 00:27:39.629 --rc genhtml_legend=1 00:27:39.629 --rc geninfo_all_blocks=1 00:27:39.629 --rc geninfo_unexecuted_blocks=1 00:27:39.629 00:27:39.629 ' 00:27:39.629 02:32:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:39.629 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:39.629 --rc genhtml_branch_coverage=1 00:27:39.629 --rc genhtml_function_coverage=1 00:27:39.629 --rc genhtml_legend=1 00:27:39.629 --rc geninfo_all_blocks=1 00:27:39.629 --rc geninfo_unexecuted_blocks=1 00:27:39.629 00:27:39.629 ' 00:27:39.629 02:32:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:39.629 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:39.629 --rc genhtml_branch_coverage=1 00:27:39.629 --rc genhtml_function_coverage=1 00:27:39.629 --rc genhtml_legend=1 00:27:39.629 --rc geninfo_all_blocks=1 00:27:39.629 --rc geninfo_unexecuted_blocks=1 00:27:39.629 00:27:39.629 ' 00:27:39.629 02:32:43 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:39.629 02:32:43 -- nvmf/common.sh@7 -- # uname -s 00:27:39.629 02:32:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:39.629 02:32:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:39.629 02:32:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:39.629 02:32:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:39.629 02:32:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:39.629 02:32:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:39.629 02:32:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:39.629 02:32:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:39.629 02:32:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:39.629 02:32:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:39.629 02:32:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:39.629 02:32:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:39.629 02:32:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:39.629 02:32:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:39.629 02:32:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:39.629 02:32:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:39.629 02:32:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:39.629 02:32:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:39.629 02:32:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:39.629 02:32:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:39.629 02:32:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:39.629 02:32:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:39.629 02:32:43 -- paths/export.sh@5 -- # export PATH 00:27:39.629 02:32:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:39.629 02:32:43 -- nvmf/common.sh@46 -- # : 0 00:27:39.629 02:32:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:39.629 02:32:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:39.629 02:32:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:39.629 02:32:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:39.629 02:32:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:39.629 02:32:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:39.629 02:32:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:39.629 02:32:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:39.629 02:32:43 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:39.629 02:32:43 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:27:39.629 02:32:43 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:27:39.629 02:32:43 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:27:39.629 02:32:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:39.629 02:32:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:39.629 02:32:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:39.629 02:32:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:39.629 02:32:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:39.629 02:32:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:39.629 02:32:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:39.629 02:32:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:39.629 02:32:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:39.629 02:32:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:39.629 02:32:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:39.629 02:32:43 -- common/autotest_common.sh@10 -- # set +x 00:27:41.538 02:32:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:41.538 02:32:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:41.538 02:32:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:41.538 02:32:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:41.538 02:32:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:41.538 02:32:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:41.538 02:32:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:41.538 02:32:45 -- nvmf/common.sh@294 -- # net_devs=() 00:27:41.538 02:32:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:41.538 02:32:45 -- nvmf/common.sh@295 -- # e810=() 00:27:41.538 02:32:45 -- nvmf/common.sh@295 -- # local -ga e810 00:27:41.538 02:32:45 -- nvmf/common.sh@296 -- # x722=() 00:27:41.538 02:32:45 -- nvmf/common.sh@296 -- # local -ga x722 00:27:41.538 02:32:45 -- nvmf/common.sh@297 -- # mlx=() 00:27:41.538 02:32:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:41.538 02:32:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:41.538 02:32:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:41.538 02:32:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:41.538 02:32:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:41.538 02:32:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:41.538 02:32:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:41.538 02:32:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:41.538 02:32:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:41.538 02:32:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:41.538 02:32:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:41.538 02:32:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:41.538 02:32:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:41.538 02:32:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:41.538 02:32:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:41.538 02:32:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:41.538 02:32:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:41.538 02:32:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:41.538 02:32:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:41.538 02:32:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:41.538 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:41.538 02:32:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:41.538 02:32:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:41.538 02:32:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:41.538 02:32:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:41.538 02:32:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:41.538 02:32:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:41.538 02:32:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:41.538 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:41.538 02:32:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:41.538 02:32:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:41.538 02:32:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:41.538 02:32:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:41.538 02:32:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:41.538 02:32:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:41.538 02:32:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:41.538 02:32:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:41.538 02:32:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:41.538 02:32:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:41.538 02:32:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:41.538 02:32:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:41.538 02:32:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:41.538 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:41.538 02:32:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:41.538 02:32:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:41.538 02:32:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:41.538 02:32:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:41.538 02:32:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:41.538 02:32:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:41.538 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:41.538 02:32:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:41.538 02:32:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:41.538 02:32:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:41.538 02:32:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:41.538 02:32:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:41.538 02:32:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:41.538 02:32:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:41.538 02:32:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:41.538 02:32:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:41.538 02:32:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:41.538 02:32:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:41.538 02:32:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:41.538 02:32:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:41.538 02:32:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:41.538 02:32:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:41.538 02:32:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:41.538 02:32:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:41.538 02:32:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:41.538 02:32:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:41.538 02:32:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:41.538 02:32:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:41.538 02:32:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:41.538 02:32:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:41.538 02:32:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:41.538 02:32:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:41.538 02:32:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:41.538 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:41.538 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.324 ms 00:27:41.538 00:27:41.538 --- 10.0.0.2 ping statistics --- 00:27:41.538 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:41.538 rtt min/avg/max/mdev = 0.324/0.324/0.324/0.000 ms 00:27:41.538 02:32:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:41.538 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:41.538 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.084 ms 00:27:41.538 00:27:41.538 --- 10.0.0.1 ping statistics --- 00:27:41.538 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:41.538 rtt min/avg/max/mdev = 0.084/0.084/0.084/0.000 ms 00:27:41.538 02:32:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:41.538 02:32:45 -- nvmf/common.sh@410 -- # return 0 00:27:41.538 02:32:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:41.538 02:32:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:41.538 02:32:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:41.538 02:32:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:41.538 02:32:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:41.538 02:32:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:41.538 02:32:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:41.538 02:32:45 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:27:41.538 02:32:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:41.538 02:32:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:41.538 02:32:45 -- common/autotest_common.sh@10 -- # set +x 00:27:41.538 ************************************ 00:27:41.538 START TEST nvmf_target_disconnect_tc1 00:27:41.538 ************************************ 00:27:41.538 02:32:45 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:27:41.538 02:32:45 -- host/target_disconnect.sh@32 -- # set +e 00:27:41.538 02:32:45 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:41.797 EAL: No free 2048 kB hugepages reported on node 1 00:27:41.797 [2024-11-29 02:32:45.283669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.797 [2024-11-29 02:32:45.283951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.797 [2024-11-29 02:32:45.283984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b8b40 with addr=10.0.0.2, port=4420 00:27:41.797 [2024-11-29 02:32:45.284024] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:27:41.797 [2024-11-29 02:32:45.284055] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:27:41.797 [2024-11-29 02:32:45.284071] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:27:41.797 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:27:41.797 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:27:41.797 Initializing NVMe Controllers 00:27:41.797 02:32:45 -- host/target_disconnect.sh@33 -- # trap - ERR 00:27:41.797 02:32:45 -- host/target_disconnect.sh@33 -- # print_backtrace 00:27:41.797 02:32:45 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:27:41.797 02:32:45 -- common/autotest_common.sh@1142 -- # return 0 00:27:41.797 02:32:45 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:27:41.797 02:32:45 -- host/target_disconnect.sh@41 -- # set -e 00:27:41.797 00:27:41.797 real 0m0.099s 00:27:41.797 user 0m0.043s 00:27:41.797 sys 0m0.054s 00:27:41.797 02:32:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:41.797 02:32:45 -- common/autotest_common.sh@10 -- # set +x 00:27:41.797 ************************************ 00:27:41.797 END TEST nvmf_target_disconnect_tc1 00:27:41.797 ************************************ 00:27:41.797 02:32:45 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:27:41.797 02:32:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:41.797 02:32:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:41.797 02:32:45 -- common/autotest_common.sh@10 -- # set +x 00:27:41.797 ************************************ 00:27:41.797 START TEST nvmf_target_disconnect_tc2 00:27:41.797 ************************************ 00:27:41.797 02:32:45 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:27:41.797 02:32:45 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:27:41.797 02:32:45 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:41.798 02:32:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:41.798 02:32:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:41.798 02:32:45 -- common/autotest_common.sh@10 -- # set +x 00:27:41.798 02:32:45 -- nvmf/common.sh@469 -- # nvmfpid=238886 00:27:41.798 02:32:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:41.798 02:32:45 -- nvmf/common.sh@470 -- # waitforlisten 238886 00:27:41.798 02:32:45 -- common/autotest_common.sh@829 -- # '[' -z 238886 ']' 00:27:41.798 02:32:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:41.798 02:32:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:41.798 02:32:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:41.798 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:41.798 02:32:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:41.798 02:32:45 -- common/autotest_common.sh@10 -- # set +x 00:27:41.798 [2024-11-29 02:32:45.371949] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:41.798 [2024-11-29 02:32:45.372026] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:41.798 EAL: No free 2048 kB hugepages reported on node 1 00:27:41.798 [2024-11-29 02:32:45.439278] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:42.056 [2024-11-29 02:32:45.550979] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:42.056 [2024-11-29 02:32:45.551126] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:42.056 [2024-11-29 02:32:45.551149] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:42.056 [2024-11-29 02:32:45.551162] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:42.056 [2024-11-29 02:32:45.551251] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:42.056 [2024-11-29 02:32:45.551315] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:42.056 [2024-11-29 02:32:45.551380] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:42.056 [2024-11-29 02:32:45.551384] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:42.990 02:32:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:42.990 02:32:46 -- common/autotest_common.sh@862 -- # return 0 00:27:42.990 02:32:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:42.990 02:32:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:42.990 02:32:46 -- common/autotest_common.sh@10 -- # set +x 00:27:42.990 02:32:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:42.990 02:32:46 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:42.990 02:32:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:42.990 02:32:46 -- common/autotest_common.sh@10 -- # set +x 00:27:42.990 Malloc0 00:27:42.990 02:32:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:42.990 02:32:46 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:42.990 02:32:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:42.990 02:32:46 -- common/autotest_common.sh@10 -- # set +x 00:27:42.990 [2024-11-29 02:32:46.390337] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:42.990 02:32:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:42.990 02:32:46 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:42.990 02:32:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:42.990 02:32:46 -- common/autotest_common.sh@10 -- # set +x 00:27:42.990 02:32:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:42.990 02:32:46 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:42.990 02:32:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:42.990 02:32:46 -- common/autotest_common.sh@10 -- # set +x 00:27:42.990 02:32:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:42.990 02:32:46 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:42.990 02:32:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:42.990 02:32:46 -- common/autotest_common.sh@10 -- # set +x 00:27:42.990 [2024-11-29 02:32:46.418637] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:42.990 02:32:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:42.990 02:32:46 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:42.990 02:32:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:42.990 02:32:46 -- common/autotest_common.sh@10 -- # set +x 00:27:42.990 02:32:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:42.990 02:32:46 -- host/target_disconnect.sh@50 -- # reconnectpid=239046 00:27:42.990 02:32:46 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:42.990 02:32:46 -- host/target_disconnect.sh@52 -- # sleep 2 00:27:42.990 EAL: No free 2048 kB hugepages reported on node 1 00:27:44.900 02:32:48 -- host/target_disconnect.sh@53 -- # kill -9 238886 00:27:44.900 02:32:48 -- host/target_disconnect.sh@55 -- # sleep 2 00:27:44.900 Read completed with error (sct=0, sc=8) 00:27:44.900 starting I/O failed 00:27:44.900 Read completed with error (sct=0, sc=8) 00:27:44.900 starting I/O failed 00:27:44.900 Read completed with error (sct=0, sc=8) 00:27:44.900 starting I/O failed 00:27:44.900 Read completed with error (sct=0, sc=8) 00:27:44.900 starting I/O failed 00:27:44.900 Read completed with error (sct=0, sc=8) 00:27:44.900 starting I/O failed 00:27:44.900 Read completed with error (sct=0, sc=8) 00:27:44.900 starting I/O failed 00:27:44.900 Read completed with error (sct=0, sc=8) 00:27:44.900 starting I/O failed 00:27:44.900 Read completed with error (sct=0, sc=8) 00:27:44.900 starting I/O failed 00:27:44.900 Read completed with error (sct=0, sc=8) 00:27:44.900 starting I/O failed 00:27:44.900 Read completed with error (sct=0, sc=8) 00:27:44.900 starting I/O failed 00:27:44.900 Read completed with error (sct=0, sc=8) 00:27:44.900 starting I/O failed 00:27:44.900 Read completed with error (sct=0, sc=8) 00:27:44.900 starting I/O failed 00:27:44.900 Read completed with error (sct=0, sc=8) 00:27:44.900 starting I/O failed 00:27:44.900 Read completed with error (sct=0, sc=8) 00:27:44.900 starting I/O failed 00:27:44.900 Read completed with error (sct=0, sc=8) 00:27:44.900 starting I/O failed 00:27:44.900 Read completed with error (sct=0, sc=8) 00:27:44.900 starting I/O failed 00:27:44.900 Read completed with error (sct=0, sc=8) 00:27:44.900 starting I/O failed 00:27:44.900 Write completed with error (sct=0, sc=8) 00:27:44.900 starting I/O failed 00:27:44.900 Write completed with error (sct=0, sc=8) 00:27:44.900 starting I/O failed 00:27:44.900 Read completed with error (sct=0, sc=8) 00:27:44.900 starting I/O failed 00:27:44.900 Read completed with error (sct=0, sc=8) 00:27:44.900 starting I/O failed 00:27:44.900 Write completed with error (sct=0, sc=8) 00:27:44.900 starting I/O failed 00:27:44.900 Write completed with error (sct=0, sc=8) 00:27:44.900 starting I/O failed 00:27:44.900 Write completed with error (sct=0, sc=8) 00:27:44.900 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 [2024-11-29 02:32:48.442688] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 [2024-11-29 02:32:48.442992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 [2024-11-29 02:32:48.443343] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Read completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 Write completed with error (sct=0, sc=8) 00:27:44.901 starting I/O failed 00:27:44.901 [2024-11-29 02:32:48.443680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:44.901 [2024-11-29 02:32:48.443873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.901 [2024-11-29 02:32:48.444022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.901 [2024-11-29 02:32:48.444053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:44.901 qpair failed and we were unable to recover it. 00:27:44.901 [2024-11-29 02:32:48.444192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.901 [2024-11-29 02:32:48.444321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.901 [2024-11-29 02:32:48.444351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.901 qpair failed and we were unable to recover it. 00:27:44.901 [2024-11-29 02:32:48.444473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.444566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.444593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.444743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.444832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.444860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.444983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.445097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.445124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.445222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.445344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.445372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.445476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.445595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.445622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.445726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.445813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.445840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.446010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.446204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.446231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.446445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.446538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.446565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.446662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.446789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.446816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.446944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.447089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.447115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.447237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.447344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.447371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.447534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.447621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.447648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.447741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.447903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.447929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.448040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.448178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.448204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.448358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.448471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.448498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.448588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.448669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.448705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.448841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.449008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.449035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.449193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.449285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.449312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.449466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.449567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.449594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.449680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.449804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.449831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.449918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.450111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.450138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.450217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.450339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.450365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.450465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.450570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.450597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.450687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.450834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.450861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.450960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.451081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.451108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.451231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.451376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.451415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.451511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.451625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.451653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.451772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.451893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.902 [2024-11-29 02:32:48.451919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.902 qpair failed and we were unable to recover it. 00:27:44.902 [2024-11-29 02:32:48.452064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.452156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.452182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.452326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.452475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.452503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.452626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.452750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.452776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.452874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.453036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.453062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.453185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.453305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.453331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.453463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.453572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.453598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.453692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.453812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.453856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.454080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.454205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.454232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.454314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.454405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.454432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.454523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.454643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.454686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.454835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.454959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.454986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.455130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.455280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.455307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.455453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.455650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.455679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.455790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.455899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.455928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.456075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.456284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.456327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.456459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.456648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.456675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.456795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.456890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.456917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.457058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.457178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.457204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.457431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.457579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.457605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.457727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.457821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.457848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.457961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.458076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.458102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.458218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.458367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.458400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.458548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.458665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.458692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.458808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.458927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.458953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.459068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.459161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.459188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.459367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.459469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.459497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.459622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.459738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.459764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.459914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.460037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.903 [2024-11-29 02:32:48.460064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.903 qpair failed and we were unable to recover it. 00:27:44.903 [2024-11-29 02:32:48.460191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.460310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.460336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.460434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.460522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.460552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.460641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.460793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.460819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.460922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.461041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.461071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.461195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.461311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.461337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.461484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.461605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.461632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.461761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.461851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.461878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.461978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.462097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.462124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.462247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.462367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.462400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.462488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.462604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.462631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.462715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.462833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.462860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.462978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.463093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.463120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.463239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.463385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.463417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.463535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.463680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.463711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.463804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.463925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.463952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.464070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.464190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.464217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.464332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.464430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.464458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.464576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.464732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.464759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.464906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.465022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.465050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.465164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.465277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.465304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.465450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.465566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.465593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.465706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.465831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.465858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.465949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.466028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.466055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.466203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.466321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.466352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.466475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.466576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.466604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.466732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.466825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.466852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.466997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.467111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.467137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.467226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.467376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.467408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.904 qpair failed and we were unable to recover it. 00:27:44.904 [2024-11-29 02:32:48.467546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.467666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.904 [2024-11-29 02:32:48.467696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.905 qpair failed and we were unable to recover it. 00:27:44.905 [2024-11-29 02:32:48.467825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.467934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.467960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.905 qpair failed and we were unable to recover it. 00:27:44.905 [2024-11-29 02:32:48.468069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.468165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.468192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.905 qpair failed and we were unable to recover it. 00:27:44.905 [2024-11-29 02:32:48.468273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.468362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.468402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.905 qpair failed and we were unable to recover it. 00:27:44.905 [2024-11-29 02:32:48.468547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.468665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.468703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.905 qpair failed and we were unable to recover it. 00:27:44.905 [2024-11-29 02:32:48.468794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.468940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.468971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.905 qpair failed and we were unable to recover it. 00:27:44.905 [2024-11-29 02:32:48.469065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.469192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.469218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.905 qpair failed and we were unable to recover it. 00:27:44.905 [2024-11-29 02:32:48.469345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.469471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.469498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.905 qpair failed and we were unable to recover it. 00:27:44.905 [2024-11-29 02:32:48.469585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.469706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.469733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.905 qpair failed and we were unable to recover it. 00:27:44.905 [2024-11-29 02:32:48.469856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.469980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.470007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.905 qpair failed and we were unable to recover it. 00:27:44.905 [2024-11-29 02:32:48.470127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.470274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.470300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.905 qpair failed and we were unable to recover it. 00:27:44.905 [2024-11-29 02:32:48.470385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.470514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.470541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.905 qpair failed and we were unable to recover it. 00:27:44.905 [2024-11-29 02:32:48.470687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.470803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.470831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.905 qpair failed and we were unable to recover it. 00:27:44.905 [2024-11-29 02:32:48.470973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.471113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.471140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.905 qpair failed and we were unable to recover it. 00:27:44.905 [2024-11-29 02:32:48.471235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.471352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.471379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.905 qpair failed and we were unable to recover it. 00:27:44.905 [2024-11-29 02:32:48.471508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.471628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.471655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.905 qpair failed and we were unable to recover it. 00:27:44.905 [2024-11-29 02:32:48.471806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.471931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.471959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.905 qpair failed and we were unable to recover it. 00:27:44.905 [2024-11-29 02:32:48.472099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.472218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.472245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.905 qpair failed and we were unable to recover it. 00:27:44.905 [2024-11-29 02:32:48.472364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.472521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.472549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.905 qpair failed and we were unable to recover it. 00:27:44.905 [2024-11-29 02:32:48.472643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.472789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.472815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.905 qpair failed and we were unable to recover it. 00:27:44.905 [2024-11-29 02:32:48.472914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.473031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.473057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.905 qpair failed and we were unable to recover it. 00:27:44.905 [2024-11-29 02:32:48.473201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.473332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.473360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.905 qpair failed and we were unable to recover it. 00:27:44.905 [2024-11-29 02:32:48.473491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.473649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.473678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.905 qpair failed and we were unable to recover it. 00:27:44.905 [2024-11-29 02:32:48.473851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.474007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.905 [2024-11-29 02:32:48.474034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.905 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.474155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.474297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.474323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.474445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.474566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.474593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.474685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.474864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.474892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.475008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.475087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.475114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.475209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.475330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.475356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.475446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.475563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.475589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.475702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.475817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.475844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.475967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.476060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.476087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.476207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.476356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.476383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.476507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.476630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.476656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.476759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.476882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.476908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.476993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.477107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.477134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.477259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.477382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.477438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.477562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.477707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.477734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.477862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.478008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.478035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.478182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.478273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.478301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.478401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.478594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.478621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.478740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.478842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.478869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.479016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.479139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.479166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.479285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.479405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.479433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.479552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.479667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.479694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.479782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.479891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.479917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.480055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.480154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.480190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.480317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.480434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.480461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.480552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.480638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.480663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.480793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.480906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.480931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.481024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.481117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.481143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.481255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.481369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.481402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.906 qpair failed and we were unable to recover it. 00:27:44.906 [2024-11-29 02:32:48.481497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.906 [2024-11-29 02:32:48.481608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.481650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.481772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.481891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.481916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.482038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.482202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.482231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.482364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.482461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.482488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.482659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.482803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.482846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.483033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.483120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.483146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.483295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.483419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.483448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.483536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.483654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.483681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.483764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.483855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.483882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.484005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.484099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.484126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.484217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.484359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.484402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.484521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.484619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.484647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.484774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.484886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.484913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.485063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.485178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.485205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.485354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.485510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.485538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.485626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.485708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.485734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.485826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.485947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.485974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.486091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.486177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.486203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.486352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.486473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.486501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.486627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.486715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.486742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.486901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.487025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.487052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.487206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.487350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.487376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.487504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.487616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.487642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.487739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.487850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.487877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.487971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.488072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.488099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.488182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.488274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.488300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.488400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.488502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.488529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.488677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.488800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.488827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.488941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.489057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.907 [2024-11-29 02:32:48.489084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.907 qpair failed and we were unable to recover it. 00:27:44.907 [2024-11-29 02:32:48.489196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.489317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.489344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.489466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.489586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.489613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.489759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.489871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.489898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.490045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.490163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.490189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.490296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.490387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.490421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.490535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.490627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.490654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.490773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.490863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.490890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.491011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.491123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.491150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.491274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.491399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.491427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.491544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.491664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.491693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.491792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.491937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.491963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.492085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.492232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.492259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.492371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.492510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.492537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.492669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.492804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.492833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.492947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.493037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.493062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.493173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.493324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.493350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.493461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.493577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.493603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.493725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.493811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.493836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.493939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.494038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.494064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.494209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.494334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.494362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.494494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.494609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.494650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.494742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.494876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.494901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.495015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.495131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.495156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.495252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.495335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.495361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.495533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.495644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.495669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.495765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.495908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.495941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.496058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.496176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.496201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.496293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.496409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.496435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.908 [2024-11-29 02:32:48.496551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.496674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.908 [2024-11-29 02:32:48.496708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.908 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.496795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.496909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.496934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.497054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.497147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.497171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.497288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.497410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.497436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.497518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.497634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.497659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.497754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.497864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.497905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.498036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.498199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.498225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.498347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.498496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.498522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.498652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.498835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.498861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.498987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.499130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.499156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.499245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.499366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.499391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.499520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.499640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.499666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.499782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.499896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.499923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.500087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.500177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.500219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.500336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.500425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.500452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.500596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.500720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.500746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.500865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.500975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.501000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.501121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.501239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.501264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.501382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.501467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.501493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.501610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.501696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.501722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.501859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.501945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.501973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.502205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.502294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.502320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.502422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.502570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.502596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.502739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.502881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.502907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.503029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.503182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.503207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.503315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.503450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.503476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.503590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.503681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.503706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.503801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.503882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.503908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.504017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.504117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.504144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.909 [2024-11-29 02:32:48.504253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.504374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.909 [2024-11-29 02:32:48.504415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.909 qpair failed and we were unable to recover it. 00:27:44.910 [2024-11-29 02:32:48.504534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.504615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.504640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.910 qpair failed and we were unable to recover it. 00:27:44.910 [2024-11-29 02:32:48.504794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.504951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.504979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.910 qpair failed and we were unable to recover it. 00:27:44.910 [2024-11-29 02:32:48.505108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.505234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.505263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.910 qpair failed and we were unable to recover it. 00:27:44.910 [2024-11-29 02:32:48.505415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.505538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.505563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.910 qpair failed and we were unable to recover it. 00:27:44.910 [2024-11-29 02:32:48.505675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.505785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.505810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.910 qpair failed and we were unable to recover it. 00:27:44.910 [2024-11-29 02:32:48.505895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.506006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.506031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.910 qpair failed and we were unable to recover it. 00:27:44.910 [2024-11-29 02:32:48.506137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.506252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.506279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.910 qpair failed and we were unable to recover it. 00:27:44.910 [2024-11-29 02:32:48.506399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.506490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.506516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.910 qpair failed and we were unable to recover it. 00:27:44.910 [2024-11-29 02:32:48.506671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.506800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.506832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.910 qpair failed and we were unable to recover it. 00:27:44.910 [2024-11-29 02:32:48.506950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.507066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.507092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.910 qpair failed and we were unable to recover it. 00:27:44.910 [2024-11-29 02:32:48.507218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.507308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.507333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.910 qpair failed and we were unable to recover it. 00:27:44.910 [2024-11-29 02:32:48.507476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.507564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.507590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.910 qpair failed and we were unable to recover it. 00:27:44.910 [2024-11-29 02:32:48.507683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.507768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.507795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.910 qpair failed and we were unable to recover it. 00:27:44.910 [2024-11-29 02:32:48.507904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.508021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.508047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.910 qpair failed and we were unable to recover it. 00:27:44.910 [2024-11-29 02:32:48.508161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.508250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.508274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.910 qpair failed and we were unable to recover it. 00:27:44.910 [2024-11-29 02:32:48.508391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.508521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.508547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.910 qpair failed and we were unable to recover it. 00:27:44.910 [2024-11-29 02:32:48.508707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.508878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.508903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.910 qpair failed and we were unable to recover it. 00:27:44.910 [2024-11-29 02:32:48.509047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.509187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.509212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.910 qpair failed and we were unable to recover it. 00:27:44.910 [2024-11-29 02:32:48.509331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.509450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.509480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.910 qpair failed and we were unable to recover it. 00:27:44.910 [2024-11-29 02:32:48.509627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.509720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.509745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.910 qpair failed and we were unable to recover it. 00:27:44.910 [2024-11-29 02:32:48.509836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.509950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.509975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.910 qpair failed and we were unable to recover it. 00:27:44.910 [2024-11-29 02:32:48.510085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.510173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.510198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.910 qpair failed and we were unable to recover it. 00:27:44.910 [2024-11-29 02:32:48.510307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.510451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.510478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.910 qpair failed and we were unable to recover it. 00:27:44.910 [2024-11-29 02:32:48.510573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.510693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.510718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.910 qpair failed and we were unable to recover it. 00:27:44.910 [2024-11-29 02:32:48.510838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.510945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.910 [2024-11-29 02:32:48.510971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.511125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.511253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.511280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.511429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.511548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.511574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.511673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.511791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.511816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.511938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.512027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.512054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.512176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.512295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.512320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.512442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.512557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.512583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.512747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.512858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.512883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.512976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.513064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.513090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.513200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.513320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.513345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.513447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.513558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.513584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.513693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.513817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.513845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.514009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.514123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.514151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.514314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.514478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.514504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.514622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.514737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.514763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.514904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.514998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.515023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.515182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.515323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.515348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.515472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.515605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.515633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.515789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.515896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.515922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.516063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.516158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.516185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.516333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.516457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.516483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.516574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.516692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.516719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.516851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.516979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.517007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.517171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.517294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.517320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.517466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.517578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.517604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.517692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.517807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.517832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.517983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.518072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.518097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.518238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.518380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.518413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.518504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.518621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.518646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.911 qpair failed and we were unable to recover it. 00:27:44.911 [2024-11-29 02:32:48.518790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.518907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.911 [2024-11-29 02:32:48.518932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.519047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.519189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.519214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.519324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.519434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.519460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.519555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.519703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.519728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.519849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.519962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.519987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.520100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.520212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.520237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.520378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.520500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.520529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.520617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.520767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.520792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.520927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.521087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.521115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.521281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.521434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.521460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.521554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.521710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.521735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.521857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.521972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.521998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.522128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.522268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.522293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.522380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.522479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.522505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.522607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.522705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.522730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.522821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.522909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.522935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.523118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.523260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.523285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.523434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.523576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.523612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.523730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.523844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.523870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.523961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.524054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.524080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.524200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.524278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.524303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.524412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.524540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.524566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.524679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.524802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.524828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.525005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.525146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.525171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.525316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.525447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.525477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.525616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.525760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.525786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.525931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.526018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.526062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.526224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.526378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.526425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.526549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.526685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.526710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.912 [2024-11-29 02:32:48.526826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.526985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.912 [2024-11-29 02:32:48.527011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.912 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.527102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.527236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.527264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.527406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.527519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.527544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.527662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.527797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.527827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.527982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.528087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.528116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.528280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.528371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.528413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.528499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.528585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.528612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.528736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.528876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.528903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.529028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.529118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.529143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.529296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.529419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.529446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.529569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.529712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.529738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.529865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.529983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.530008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.530098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.530187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.530212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.530333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.530445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.530472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.530591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.530678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.530705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.530819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.530936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.530962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.531078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.531163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.531189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.531337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.531437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.531464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.531579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.531707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.531736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.531869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.531992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.532036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.532123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.532233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.532258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.532409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.532505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.532530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.532624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.532727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.532752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.532863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.532974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.532999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.533085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.533202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.533228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.533326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.533446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.533473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.533619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.533736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.533761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.533869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.533988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.534017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.534159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.534245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.534275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.913 [2024-11-29 02:32:48.534375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.534503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.913 [2024-11-29 02:32:48.534530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.913 qpair failed and we were unable to recover it. 00:27:44.914 [2024-11-29 02:32:48.534617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.534754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.534783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.914 qpair failed and we were unable to recover it. 00:27:44.914 [2024-11-29 02:32:48.534900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.535018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.535046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.914 qpair failed and we were unable to recover it. 00:27:44.914 [2024-11-29 02:32:48.535161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.535247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.535272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.914 qpair failed and we were unable to recover it. 00:27:44.914 [2024-11-29 02:32:48.535361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.535461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.535488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.914 qpair failed and we were unable to recover it. 00:27:44.914 [2024-11-29 02:32:48.535602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.535687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.535712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.914 qpair failed and we were unable to recover it. 00:27:44.914 [2024-11-29 02:32:48.535857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.535942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.535967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.914 qpair failed and we were unable to recover it. 00:27:44.914 [2024-11-29 02:32:48.536111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.536231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.536257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.914 qpair failed and we were unable to recover it. 00:27:44.914 [2024-11-29 02:32:48.536411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.536522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.536548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.914 qpair failed and we were unable to recover it. 00:27:44.914 [2024-11-29 02:32:48.536633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.536720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.536745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.914 qpair failed and we were unable to recover it. 00:27:44.914 [2024-11-29 02:32:48.536877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.536974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.536999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.914 qpair failed and we were unable to recover it. 00:27:44.914 [2024-11-29 02:32:48.537141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.537264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.537290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.914 qpair failed and we were unable to recover it. 00:27:44.914 [2024-11-29 02:32:48.537416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.537530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.537556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.914 qpair failed and we were unable to recover it. 00:27:44.914 [2024-11-29 02:32:48.537643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.537734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.537759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.914 qpair failed and we were unable to recover it. 00:27:44.914 [2024-11-29 02:32:48.537851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.537960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.538002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.914 qpair failed and we were unable to recover it. 00:27:44.914 [2024-11-29 02:32:48.538144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.538264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.538290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.914 qpair failed and we were unable to recover it. 00:27:44.914 [2024-11-29 02:32:48.538411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.538501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.538527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.914 qpair failed and we were unable to recover it. 00:27:44.914 [2024-11-29 02:32:48.538641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.538762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.538788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.914 qpair failed and we were unable to recover it. 00:27:44.914 [2024-11-29 02:32:48.538885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.539000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.539026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.914 qpair failed and we were unable to recover it. 00:27:44.914 [2024-11-29 02:32:48.539139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.539281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.539307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.914 qpair failed and we were unable to recover it. 00:27:44.914 [2024-11-29 02:32:48.539401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.539481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.539506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.914 qpair failed and we were unable to recover it. 00:27:44.914 [2024-11-29 02:32:48.539624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.539766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.539792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.914 qpair failed and we were unable to recover it. 00:27:44.914 [2024-11-29 02:32:48.539930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.540048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.540076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.914 qpair failed and we were unable to recover it. 00:27:44.914 [2024-11-29 02:32:48.540194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.540311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.540338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.914 qpair failed and we were unable to recover it. 00:27:44.914 [2024-11-29 02:32:48.540478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.540595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.540621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.914 qpair failed and we were unable to recover it. 00:27:44.914 [2024-11-29 02:32:48.540722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.540810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.914 [2024-11-29 02:32:48.540836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.914 qpair failed and we were unable to recover it. 00:27:44.914 [2024-11-29 02:32:48.540954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.541069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.541095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.541217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.541358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.541384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.541498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.541614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.541648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.541804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.541932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.541975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.542067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.542180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.542206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.542302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.542388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.542439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.542571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.542647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.542672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.542820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.542912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.542938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.543057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.543198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.543224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.543317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.543404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.543431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.543549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.543639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.543665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.543786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.543872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.543915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.544059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.544145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.544171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.544263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.544372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.544416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.544538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.544649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.544683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.544845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.544933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.544962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.545097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.545212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.545238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.545349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.545466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.545492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.545583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.545704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.545730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.545854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.545934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.545959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.546059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.546200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.546244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.546379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.546561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.546587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.546680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.546818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.546844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.546924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.547039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.547065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.547182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.547333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.547362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.547501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.547591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.547616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.547711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.547853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.547879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.548016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.548165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.548190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.548289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.548370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.915 [2024-11-29 02:32:48.548402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.915 qpair failed and we were unable to recover it. 00:27:44.915 [2024-11-29 02:32:48.548508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.548638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.548667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.548832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.548953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.548978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.549091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.549218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.549243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.549398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.549512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.549539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.549674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.549756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.549784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.549957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.550076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.550101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.550228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.550343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.550368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.550503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.550625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.550651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.550779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.550872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.550898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.550980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.551097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.551138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.551231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.551366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.551424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.551547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.551628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.551654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.551842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.551935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.551962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.552064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.552185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.552211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.552321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.552435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.552462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.552601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.552755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.552784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.552922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.553043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.553071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.553187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.553328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.553354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.553446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.553587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.553612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.553753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.553889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.553919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.554055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.554189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.554214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.554322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.554432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.554461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.554590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.554708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.554736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.554879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.554964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.554991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.555093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.555225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.555253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.555425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.555536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.555561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.555688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.555774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.555799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.555966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.556094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.556123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.916 qpair failed and we were unable to recover it. 00:27:44.916 [2024-11-29 02:32:48.556284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.556371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.916 [2024-11-29 02:32:48.556405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.556524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.556678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.556705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.556817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.556976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.557009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.557133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.557274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.557299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.557387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.557469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.557496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.557616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.557775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.557801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.557944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.558063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.558088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.558203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.558341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.558367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.558547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.558685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.558722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.558867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.558980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.559009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.559117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.559263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.559289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.559420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.559542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.559568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.559686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.559820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.559847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.559983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.560102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.560129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.560288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.560413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.560442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.560611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.560703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.560730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.560811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.560921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.560947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.561034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.561200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.561229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.561356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.561518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.561549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.561732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.561872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.561914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.562043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.562168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.562196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.562345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.562435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.562462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.562580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.562699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.562725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.562809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.562951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.562977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.563105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.563243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.563268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.563400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.563525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.563551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.563659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.563783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.563827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.563949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.564067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.564092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.564214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.564303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.564329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.917 qpair failed and we were unable to recover it. 00:27:44.917 [2024-11-29 02:32:48.564451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.564561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.917 [2024-11-29 02:32:48.564588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.918 qpair failed and we were unable to recover it. 00:27:44.918 [2024-11-29 02:32:48.564708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.564815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.564841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.918 qpair failed and we were unable to recover it. 00:27:44.918 [2024-11-29 02:32:48.564961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.565075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.565102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.918 qpair failed and we were unable to recover it. 00:27:44.918 [2024-11-29 02:32:48.565227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.565353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.565379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.918 qpair failed and we were unable to recover it. 00:27:44.918 [2024-11-29 02:32:48.565531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.565646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.565673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.918 qpair failed and we were unable to recover it. 00:27:44.918 [2024-11-29 02:32:48.565764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.565873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.565899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.918 qpair failed and we were unable to recover it. 00:27:44.918 [2024-11-29 02:32:48.566026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.566173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.566202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.918 qpair failed and we were unable to recover it. 00:27:44.918 [2024-11-29 02:32:48.566341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.566431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.566458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.918 qpair failed and we were unable to recover it. 00:27:44.918 [2024-11-29 02:32:48.566584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.566679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.566710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.918 qpair failed and we were unable to recover it. 00:27:44.918 [2024-11-29 02:32:48.566841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.566970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.566996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.918 qpair failed and we were unable to recover it. 00:27:44.918 [2024-11-29 02:32:48.567171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.567308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.567334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.918 qpair failed and we were unable to recover it. 00:27:44.918 [2024-11-29 02:32:48.567452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.567574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.567600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.918 qpair failed and we were unable to recover it. 00:27:44.918 [2024-11-29 02:32:48.567743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.567837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.567866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.918 qpair failed and we were unable to recover it. 00:27:44.918 [2024-11-29 02:32:48.568014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.568111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.568136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.918 qpair failed and we were unable to recover it. 00:27:44.918 [2024-11-29 02:32:48.568231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.568327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.568352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.918 qpair failed and we were unable to recover it. 00:27:44.918 [2024-11-29 02:32:48.568470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.568614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.568639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.918 qpair failed and we were unable to recover it. 00:27:44.918 [2024-11-29 02:32:48.568763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.568907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.568933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.918 qpair failed and we were unable to recover it. 00:27:44.918 [2024-11-29 02:32:48.569076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.569169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.569194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.918 qpair failed and we were unable to recover it. 00:27:44.918 [2024-11-29 02:32:48.569304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.569450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.569479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.918 qpair failed and we were unable to recover it. 00:27:44.918 [2024-11-29 02:32:48.569646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.569758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.569784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.918 qpair failed and we were unable to recover it. 00:27:44.918 [2024-11-29 02:32:48.569870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.569959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.569984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.918 qpair failed and we were unable to recover it. 00:27:44.918 [2024-11-29 02:32:48.570145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.570298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.570326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.918 qpair failed and we were unable to recover it. 00:27:44.918 [2024-11-29 02:32:48.570433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.570522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.570551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.918 qpair failed and we were unable to recover it. 00:27:44.918 [2024-11-29 02:32:48.570656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.570755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.570780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.918 qpair failed and we were unable to recover it. 00:27:44.918 [2024-11-29 02:32:48.570895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.571043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.918 [2024-11-29 02:32:48.571069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:44.918 qpair failed and we were unable to recover it. 00:27:44.918 [2024-11-29 02:32:48.571154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.188 [2024-11-29 02:32:48.571268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.188 [2024-11-29 02:32:48.571294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.188 qpair failed and we were unable to recover it. 00:27:45.188 [2024-11-29 02:32:48.571413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.188 [2024-11-29 02:32:48.571494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.188 [2024-11-29 02:32:48.571519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.188 qpair failed and we were unable to recover it. 00:27:45.188 [2024-11-29 02:32:48.571660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.188 [2024-11-29 02:32:48.571828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.188 [2024-11-29 02:32:48.571870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.188 qpair failed and we were unable to recover it. 00:27:45.188 [2024-11-29 02:32:48.571959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.188 [2024-11-29 02:32:48.572045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.188 [2024-11-29 02:32:48.572070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.188 qpair failed and we were unable to recover it. 00:27:45.188 [2024-11-29 02:32:48.572199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.188 [2024-11-29 02:32:48.572316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.188 [2024-11-29 02:32:48.572341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.188 qpair failed and we were unable to recover it. 00:27:45.188 [2024-11-29 02:32:48.572456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.188 [2024-11-29 02:32:48.572569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.188 [2024-11-29 02:32:48.572602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.188 qpair failed and we were unable to recover it. 00:27:45.188 [2024-11-29 02:32:48.572744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.188 [2024-11-29 02:32:48.572826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.188 [2024-11-29 02:32:48.572852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.188 qpair failed and we were unable to recover it. 00:27:45.188 [2024-11-29 02:32:48.572945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.188 [2024-11-29 02:32:48.573035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.188 [2024-11-29 02:32:48.573061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.188 qpair failed and we were unable to recover it. 00:27:45.188 [2024-11-29 02:32:48.573167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.188 [2024-11-29 02:32:48.573286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.188 [2024-11-29 02:32:48.573314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.188 qpair failed and we were unable to recover it. 00:27:45.188 [2024-11-29 02:32:48.573476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.188 [2024-11-29 02:32:48.573628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.188 [2024-11-29 02:32:48.573657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.188 qpair failed and we were unable to recover it. 00:27:45.188 [2024-11-29 02:32:48.573804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.188 [2024-11-29 02:32:48.573942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.188 [2024-11-29 02:32:48.573967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.188 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.574102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.574198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.574226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.574349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.574507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.574534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.574614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.574737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.574762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.574914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.575023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.575066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.575185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.575270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.575315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.575463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.575574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.575601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.575712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.575849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.575878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.576034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.576152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.576178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.576255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.576371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.576403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.576536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.576665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.576693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.576855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.577001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.577027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.577143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.577225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.577251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.577373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.577466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.577492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.577608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.577723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.577748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.577862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.577981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.578015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.578190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.578346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.578374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.578480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.578570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.578598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.578768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.578861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.578887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.578995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.579088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.579133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.579250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.579430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.579459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.579604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.579746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.579771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.579885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.580024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.580050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.580170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.580334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.580364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.580537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.580653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.580678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.580848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.580977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.581006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.581099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.581224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.581252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.581360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.581476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.581501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.189 qpair failed and we were unable to recover it. 00:27:45.189 [2024-11-29 02:32:48.581596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.189 [2024-11-29 02:32:48.581706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.581731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.190 qpair failed and we were unable to recover it. 00:27:45.190 [2024-11-29 02:32:48.581830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.581908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.581933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.190 qpair failed and we were unable to recover it. 00:27:45.190 [2024-11-29 02:32:48.582019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.582138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.582165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.190 qpair failed and we were unable to recover it. 00:27:45.190 [2024-11-29 02:32:48.582251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.582409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.582453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.190 qpair failed and we were unable to recover it. 00:27:45.190 [2024-11-29 02:32:48.582599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.582710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.582739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.190 qpair failed and we were unable to recover it. 00:27:45.190 [2024-11-29 02:32:48.582904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.583052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.583077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.190 qpair failed and we were unable to recover it. 00:27:45.190 [2024-11-29 02:32:48.583212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.583367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.583437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.190 qpair failed and we were unable to recover it. 00:27:45.190 [2024-11-29 02:32:48.583583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.583715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.583744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.190 qpair failed and we were unable to recover it. 00:27:45.190 [2024-11-29 02:32:48.583908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.584051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.584080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.190 qpair failed and we were unable to recover it. 00:27:45.190 [2024-11-29 02:32:48.584173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.584343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.584372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.190 qpair failed and we were unable to recover it. 00:27:45.190 [2024-11-29 02:32:48.584509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.584662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.584690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.190 qpair failed and we were unable to recover it. 00:27:45.190 [2024-11-29 02:32:48.584859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.584960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.584986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.190 qpair failed and we were unable to recover it. 00:27:45.190 [2024-11-29 02:32:48.585128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.585214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.585241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.190 qpair failed and we were unable to recover it. 00:27:45.190 [2024-11-29 02:32:48.585399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.585514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.585539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.190 qpair failed and we were unable to recover it. 00:27:45.190 [2024-11-29 02:32:48.585672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.585810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.585835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.190 qpair failed and we were unable to recover it. 00:27:45.190 [2024-11-29 02:32:48.585980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.586094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.586120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.190 qpair failed and we were unable to recover it. 00:27:45.190 [2024-11-29 02:32:48.586207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.586325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.586351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.190 qpair failed and we were unable to recover it. 00:27:45.190 [2024-11-29 02:32:48.586480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.586577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.586604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.190 qpair failed and we were unable to recover it. 00:27:45.190 [2024-11-29 02:32:48.586702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.586815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.586846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.190 qpair failed and we were unable to recover it. 00:27:45.190 [2024-11-29 02:32:48.586936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.587048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.587073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.190 qpair failed and we were unable to recover it. 00:27:45.190 [2024-11-29 02:32:48.587217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.587307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.587333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.190 qpair failed and we were unable to recover it. 00:27:45.190 [2024-11-29 02:32:48.587447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.587570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.587599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.190 qpair failed and we were unable to recover it. 00:27:45.190 [2024-11-29 02:32:48.587717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.587813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.587840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.190 qpair failed and we were unable to recover it. 00:27:45.190 [2024-11-29 02:32:48.588009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.588150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.588176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.190 qpair failed and we were unable to recover it. 00:27:45.190 [2024-11-29 02:32:48.588291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.190 [2024-11-29 02:32:48.588433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.588459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.191 qpair failed and we were unable to recover it. 00:27:45.191 [2024-11-29 02:32:48.588625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.588751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.588780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.191 qpair failed and we were unable to recover it. 00:27:45.191 [2024-11-29 02:32:48.588922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.589032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.589058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.191 qpair failed and we were unable to recover it. 00:27:45.191 [2024-11-29 02:32:48.589218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.589346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.589374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.191 qpair failed and we were unable to recover it. 00:27:45.191 [2024-11-29 02:32:48.589549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.589701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.589727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.191 qpair failed and we were unable to recover it. 00:27:45.191 [2024-11-29 02:32:48.589852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.589991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.590016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.191 qpair failed and we were unable to recover it. 00:27:45.191 [2024-11-29 02:32:48.590171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.590262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.590288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.191 qpair failed and we were unable to recover it. 00:27:45.191 [2024-11-29 02:32:48.590405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.590541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.590567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.191 qpair failed and we were unable to recover it. 00:27:45.191 [2024-11-29 02:32:48.590711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.590822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.590848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.191 qpair failed and we were unable to recover it. 00:27:45.191 [2024-11-29 02:32:48.590968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.591060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.591108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.191 qpair failed and we were unable to recover it. 00:27:45.191 [2024-11-29 02:32:48.591265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.591431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.591458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.191 qpair failed and we were unable to recover it. 00:27:45.191 [2024-11-29 02:32:48.591579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.591692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.591719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.191 qpair failed and we were unable to recover it. 00:27:45.191 [2024-11-29 02:32:48.591862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.591989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.592019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.191 qpair failed and we were unable to recover it. 00:27:45.191 [2024-11-29 02:32:48.592149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.592240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.592266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.191 qpair failed and we were unable to recover it. 00:27:45.191 [2024-11-29 02:32:48.592384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.592508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.592535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.191 qpair failed and we were unable to recover it. 00:27:45.191 [2024-11-29 02:32:48.592617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.592735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.592761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.191 qpair failed and we were unable to recover it. 00:27:45.191 [2024-11-29 02:32:48.592895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.593067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.593093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.191 qpair failed and we were unable to recover it. 00:27:45.191 [2024-11-29 02:32:48.593211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.593327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.593353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.191 qpair failed and we were unable to recover it. 00:27:45.191 [2024-11-29 02:32:48.593448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.593564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.593592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.191 qpair failed and we were unable to recover it. 00:27:45.191 [2024-11-29 02:32:48.593693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.593804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.593830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.191 qpair failed and we were unable to recover it. 00:27:45.191 [2024-11-29 02:32:48.593940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.594082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.594108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.191 qpair failed and we were unable to recover it. 00:27:45.191 [2024-11-29 02:32:48.594249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.594408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.594438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.191 qpair failed and we were unable to recover it. 00:27:45.191 [2024-11-29 02:32:48.594567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.594703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.594729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.191 qpair failed and we were unable to recover it. 00:27:45.191 [2024-11-29 02:32:48.594875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.594956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.594983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.191 qpair failed and we were unable to recover it. 00:27:45.191 [2024-11-29 02:32:48.595164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.595310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.595336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.191 qpair failed and we were unable to recover it. 00:27:45.191 [2024-11-29 02:32:48.595475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.595581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.191 [2024-11-29 02:32:48.595611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.191 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.595752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.595872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.595898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.192 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.596048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.596192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.596218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.192 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.596332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.596451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.596477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.192 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.596597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.596677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.596703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.192 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.596813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.596952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.596978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.192 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.597121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.597273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.597303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.192 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.597467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.597584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.597610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.192 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.597748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.597924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.597950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.192 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.598068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.598181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.598207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.192 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.598354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.598515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.598563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.192 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.598744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.598859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.598885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.192 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.599001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.599131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.599160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.192 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.599307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.599421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.599448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.192 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.599586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.599721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.599748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.192 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.599866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.599971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.600001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.192 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.600168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.600290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.600316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.192 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.600417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.600548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.600578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.192 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.600703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.600803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.600831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.192 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.600953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.601063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.601089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.192 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.601180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.601259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.601285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.192 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.601407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.601575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.601603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.192 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.601746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.601888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.601914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.192 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.602031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.602151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.602176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.192 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.602337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.602442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.602471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.192 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.602614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.602730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.602755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.192 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.602836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.602951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.602976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.192 qpair failed and we were unable to recover it. 00:27:45.192 [2024-11-29 02:32:48.603073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.192 [2024-11-29 02:32:48.603163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.603189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.193 qpair failed and we were unable to recover it. 00:27:45.193 [2024-11-29 02:32:48.603300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.603412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.603438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.193 qpair failed and we were unable to recover it. 00:27:45.193 [2024-11-29 02:32:48.603534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.603673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.603702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.193 qpair failed and we were unable to recover it. 00:27:45.193 [2024-11-29 02:32:48.603844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.603961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.603987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.193 qpair failed and we were unable to recover it. 00:27:45.193 [2024-11-29 02:32:48.604136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.604277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.604319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.193 qpair failed and we were unable to recover it. 00:27:45.193 [2024-11-29 02:32:48.604468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.604549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.604575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.193 qpair failed and we were unable to recover it. 00:27:45.193 [2024-11-29 02:32:48.604664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.604776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.604805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.193 qpair failed and we were unable to recover it. 00:27:45.193 [2024-11-29 02:32:48.604926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.605040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.605067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.193 qpair failed and we were unable to recover it. 00:27:45.193 [2024-11-29 02:32:48.605210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.605305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.605333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.193 qpair failed and we were unable to recover it. 00:27:45.193 [2024-11-29 02:32:48.605479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.605575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.605603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.193 qpair failed and we were unable to recover it. 00:27:45.193 [2024-11-29 02:32:48.605749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.605824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.605851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.193 qpair failed and we were unable to recover it. 00:27:45.193 [2024-11-29 02:32:48.605991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.606159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.606186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.193 qpair failed and we were unable to recover it. 00:27:45.193 [2024-11-29 02:32:48.606305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.606422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.606448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.193 qpair failed and we were unable to recover it. 00:27:45.193 [2024-11-29 02:32:48.606573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.606717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.606742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.193 qpair failed and we were unable to recover it. 00:27:45.193 [2024-11-29 02:32:48.606909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.607055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.607081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.193 qpair failed and we were unable to recover it. 00:27:45.193 [2024-11-29 02:32:48.607202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.607315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.607358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.193 qpair failed and we were unable to recover it. 00:27:45.193 [2024-11-29 02:32:48.607478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.607599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.607625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.193 qpair failed and we were unable to recover it. 00:27:45.193 [2024-11-29 02:32:48.607742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.607884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.607910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.193 qpair failed and we were unable to recover it. 00:27:45.193 [2024-11-29 02:32:48.608002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.608088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.608114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.193 qpair failed and we were unable to recover it. 00:27:45.193 [2024-11-29 02:32:48.608257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.193 [2024-11-29 02:32:48.608368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.608401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.608547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.608652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.608681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.608807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.608924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.608967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.609115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.609222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.609248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.609346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.609490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.609517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.609662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.609783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.609809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.609930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.610047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.610074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.610222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.610346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.610375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.610508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.610612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.610638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.610780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.610902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.610928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.611050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.611184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.611214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.611371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.611497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.611526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.611653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.611766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.611792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.611903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.612029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.612057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.612155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.612246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.612275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.612388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.612478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.612509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.612626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.612724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.612751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.612866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.613022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.613048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.613163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.613281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.613309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.613457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.613566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.613593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.613688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.613800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.613827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.613914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.614031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.614057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.614177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.614294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.614320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.614444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.614567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.614592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.614716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.614830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.614856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.614973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.615083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.615111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.615249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.615374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.615420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.615586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.615699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.615725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.615889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.616026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.194 [2024-11-29 02:32:48.616052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.194 qpair failed and we were unable to recover it. 00:27:45.194 [2024-11-29 02:32:48.616174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.616288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.616313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.616439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.616526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.616552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.616649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.616769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.616794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.616885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.617002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.617028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.617146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.617259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.617285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.617403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.617515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.617542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.617661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.617769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.617796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.617918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.618024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.618051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.618201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.618318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.618343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.618461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.618604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.618629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.618750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.618870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.618895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.619038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.619193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.619222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.619385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.619523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.619550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.619694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.619835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.619861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.620004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.620105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.620133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.620256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.620382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.620417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.620586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.620726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.620750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.620917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.621062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.621088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.621242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.621405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.621449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.621595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.621721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.621761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.621938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.622057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.622084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.622194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.622360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.622403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.622565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.622682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.622718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.622834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.622928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.622969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.623051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.623160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.623185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.623296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.623423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.623450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.623567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.623716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.623742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.623874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.623977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.624010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.195 [2024-11-29 02:32:48.624152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.624297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.195 [2024-11-29 02:32:48.624322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.195 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.624433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.624561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.624601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.624746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.624902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.624945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.625060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.625199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.625225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.625336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.625439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.625469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.625624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.625753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.625794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.625901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.626014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.626039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.626177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.626343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.626369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.626484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.626645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.626674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.626850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.626971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.627001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.627114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.627244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.627271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.627428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.627573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.627599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.627746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.627860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.627885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.628026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.628164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.628191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.628338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.628482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.628509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.628652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.628732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.628757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.628899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.629017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.629044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.629164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.629270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.629297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.629416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.629516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.629541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.629638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.629732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.629759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.629866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.629958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.630000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.630143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.630258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.630285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.630372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.630507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.630549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.630662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.630779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.630806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.630924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.631041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.631067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.631213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.631330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.631356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.631493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.631639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.631665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.631758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.631837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.631863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.632015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.632153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.632196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.196 [2024-11-29 02:32:48.632310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.632434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.196 [2024-11-29 02:32:48.632460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.196 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.632571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.632687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.632712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.632824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.632945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.632973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.633058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.633180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.633208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.633320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.633452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.633478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.633569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.633686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.633711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.633827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.633941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.633966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.634079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.634177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.634203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.634345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.634444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.634469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.634557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.634692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.634738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.634888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.635001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.635027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.635119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.635239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.635264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.635420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.635550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.635579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.635732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.635873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.635898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.636041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.636180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.636206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.636351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.636498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.636524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.636607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.636693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.636721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.636840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.636991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.637017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.637180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.637270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.637296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.637421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.637530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.637555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.637673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.637826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.637853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.637950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.638065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.638096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.638242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.638360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.638400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.638560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.638676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.638712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.638872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.639012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.639038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.639119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.639258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.639284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.639450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.639559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.639604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.639689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.639831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.639857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.640011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.640130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.640157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.197 [2024-11-29 02:32:48.640257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.640400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.197 [2024-11-29 02:32:48.640429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.197 qpair failed and we were unable to recover it. 00:27:45.198 [2024-11-29 02:32:48.640522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.640617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.640646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.198 qpair failed and we were unable to recover it. 00:27:45.198 [2024-11-29 02:32:48.640796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.640933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.640959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.198 qpair failed and we were unable to recover it. 00:27:45.198 [2024-11-29 02:32:48.641053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.641167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.641193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.198 qpair failed and we were unable to recover it. 00:27:45.198 [2024-11-29 02:32:48.641318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.641437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.641463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.198 qpair failed and we were unable to recover it. 00:27:45.198 [2024-11-29 02:32:48.641584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.641740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.641765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.198 qpair failed and we were unable to recover it. 00:27:45.198 [2024-11-29 02:32:48.641883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.642014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.642040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.198 qpair failed and we were unable to recover it. 00:27:45.198 [2024-11-29 02:32:48.642131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.642241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.642266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.198 qpair failed and we were unable to recover it. 00:27:45.198 [2024-11-29 02:32:48.642354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.642479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.642505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.198 qpair failed and we were unable to recover it. 00:27:45.198 [2024-11-29 02:32:48.642625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.642773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.642798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.198 qpair failed and we were unable to recover it. 00:27:45.198 [2024-11-29 02:32:48.642942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.643085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.643110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.198 qpair failed and we were unable to recover it. 00:27:45.198 [2024-11-29 02:32:48.643232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.643348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.643373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.198 qpair failed and we were unable to recover it. 00:27:45.198 [2024-11-29 02:32:48.643533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.643649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.643677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.198 qpair failed and we were unable to recover it. 00:27:45.198 [2024-11-29 02:32:48.643823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.643942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.643969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.198 qpair failed and we were unable to recover it. 00:27:45.198 [2024-11-29 02:32:48.644084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.644206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.644232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.198 qpair failed and we were unable to recover it. 00:27:45.198 [2024-11-29 02:32:48.644371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.644476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.644502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.198 qpair failed and we were unable to recover it. 00:27:45.198 [2024-11-29 02:32:48.644665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.644753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.644782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.198 qpair failed and we were unable to recover it. 00:27:45.198 [2024-11-29 02:32:48.644917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.645010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.645036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.198 qpair failed and we were unable to recover it. 00:27:45.198 [2024-11-29 02:32:48.645137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.645254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.645280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.198 qpair failed and we were unable to recover it. 00:27:45.198 [2024-11-29 02:32:48.645438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.645594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.645620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.198 qpair failed and we were unable to recover it. 00:27:45.198 [2024-11-29 02:32:48.645777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.645857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.645882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.198 qpair failed and we were unable to recover it. 00:27:45.198 [2024-11-29 02:32:48.645979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.646089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.646115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.198 qpair failed and we were unable to recover it. 00:27:45.198 [2024-11-29 02:32:48.646235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.646327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.646352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.198 qpair failed and we were unable to recover it. 00:27:45.198 [2024-11-29 02:32:48.646490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.646597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.646623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.198 qpair failed and we were unable to recover it. 00:27:45.198 [2024-11-29 02:32:48.646777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.646874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.646899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.198 qpair failed and we were unable to recover it. 00:27:45.198 [2024-11-29 02:32:48.647060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.198 [2024-11-29 02:32:48.647219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.647245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.647369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.647482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.647508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.647623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.647709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.647735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.647880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.648038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.648067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.648213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.648303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.648329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.648450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.648547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.648573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.648690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.648777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.648805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.648957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.649070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.649096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.649271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.649416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.649443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.649563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.649652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.649679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.649823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.649932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.649958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.650109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.650193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.650219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.650339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.650472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.650498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.650646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.650772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.650798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.650966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.651107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.651133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.651254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.651441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.651468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.651587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.651736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.651763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.651932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.652063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.652089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.652207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.652387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.652427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.652546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.652633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.652659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.652813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.652945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.652974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.653108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.653263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.653289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.653406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.653522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.653548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.653712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.653875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.653901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.654046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.654135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.654162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.654314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.654424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.654451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.654545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.654666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.654703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.654825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.654976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.655001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.655114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.655234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.655260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.199 qpair failed and we were unable to recover it. 00:27:45.199 [2024-11-29 02:32:48.655411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.655544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.199 [2024-11-29 02:32:48.655573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.655692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.655810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.655839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.655938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.656054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.656081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.656223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.656385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.656421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.656608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.656753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.656779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.656908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.657047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.657074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.657259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.657346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.657372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.657495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.657612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.657638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.657767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.657909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.657935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.658090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.658230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.658255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.658383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.658515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.658544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.658686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.658810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.658836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.658944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.659047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.659072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.659166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.659309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.659335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.659437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.659584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.659610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.659742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.659852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.659877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.660006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.660101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.660126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.660240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.660347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.660375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.660510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.660626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.660651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.660795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.660909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.660937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.661044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.661156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.661181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.661301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.661412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.661438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.661561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.661731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.661759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.661886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.662001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.662026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.662128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.662213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.662256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.662405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.662526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.662569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.662690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.662842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.662868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.663034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.663193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.663223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.663355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.663500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.663529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.200 qpair failed and we were unable to recover it. 00:27:45.200 [2024-11-29 02:32:48.663644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.200 [2024-11-29 02:32:48.663756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.663782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.663889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.663987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.664022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.664115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.664268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.664297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.664439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.664535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.664560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.664657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.664774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.664799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.664940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.665070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.665098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.665261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.665387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.665433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.665564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.665665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.665693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.665814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.665966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.665994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.666101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.666212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.666237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.666362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.666469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.666513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.666643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.666821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.666855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.666974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.667094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.667120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.667267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.667380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.667411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.667506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.667652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.667681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.667812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.667949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.667975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.668066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.668210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.668236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.668350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.668497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.668523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.668646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.668742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.668767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.668914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.669012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.669039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.669175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.669330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.669359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.669504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.669624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.669649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.669773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.669861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.669904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.670024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.670143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.670168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.670351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.670474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.670501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.670626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.670770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.670795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.670932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.671068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.671094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.671212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.671354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.671380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.671524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.671676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.671704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.201 qpair failed and we were unable to recover it. 00:27:45.201 [2024-11-29 02:32:48.671836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.671993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.201 [2024-11-29 02:32:48.672021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.202 qpair failed and we were unable to recover it. 00:27:45.202 [2024-11-29 02:32:48.672133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.672249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.672275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.202 qpair failed and we were unable to recover it. 00:27:45.202 [2024-11-29 02:32:48.672413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.672566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.672593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.202 qpair failed and we were unable to recover it. 00:27:45.202 [2024-11-29 02:32:48.672756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.672886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.672915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.202 qpair failed and we were unable to recover it. 00:27:45.202 [2024-11-29 02:32:48.673055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.673172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.673197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.202 qpair failed and we were unable to recover it. 00:27:45.202 [2024-11-29 02:32:48.673363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.673485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.673513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.202 qpair failed and we were unable to recover it. 00:27:45.202 [2024-11-29 02:32:48.673668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.673807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.673832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.202 qpair failed and we were unable to recover it. 00:27:45.202 [2024-11-29 02:32:48.673951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.674091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.674117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.202 qpair failed and we were unable to recover it. 00:27:45.202 [2024-11-29 02:32:48.674261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.674343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.674366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.202 qpair failed and we were unable to recover it. 00:27:45.202 [2024-11-29 02:32:48.674469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.674591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.674614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.202 qpair failed and we were unable to recover it. 00:27:45.202 [2024-11-29 02:32:48.674739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.674829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.674853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.202 qpair failed and we were unable to recover it. 00:27:45.202 [2024-11-29 02:32:48.674970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.675093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.675119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.202 qpair failed and we were unable to recover it. 00:27:45.202 [2024-11-29 02:32:48.675250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.675325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.675348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.202 qpair failed and we were unable to recover it. 00:27:45.202 [2024-11-29 02:32:48.675441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.675587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.675610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.202 qpair failed and we were unable to recover it. 00:27:45.202 [2024-11-29 02:32:48.675690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.675781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.675806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.202 qpair failed and we were unable to recover it. 00:27:45.202 [2024-11-29 02:32:48.675901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.675993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.676018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.202 qpair failed and we were unable to recover it. 00:27:45.202 [2024-11-29 02:32:48.676132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.676255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.676279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.202 qpair failed and we were unable to recover it. 00:27:45.202 [2024-11-29 02:32:48.676370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.676510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.676538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.202 qpair failed and we were unable to recover it. 00:27:45.202 [2024-11-29 02:32:48.676656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.676801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.676828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.202 qpair failed and we were unable to recover it. 00:27:45.202 [2024-11-29 02:32:48.676948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.677047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.677072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.202 qpair failed and we were unable to recover it. 00:27:45.202 [2024-11-29 02:32:48.677164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.677278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.677304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.202 qpair failed and we were unable to recover it. 00:27:45.202 [2024-11-29 02:32:48.677430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.677552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.677578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.202 qpair failed and we were unable to recover it. 00:27:45.202 [2024-11-29 02:32:48.677723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.677838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.677863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.202 qpair failed and we were unable to recover it. 00:27:45.202 [2024-11-29 02:32:48.677982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.678079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.678109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.202 qpair failed and we were unable to recover it. 00:27:45.202 [2024-11-29 02:32:48.678199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.678315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.678343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.202 qpair failed and we were unable to recover it. 00:27:45.202 [2024-11-29 02:32:48.678437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.678553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.678580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.202 qpair failed and we were unable to recover it. 00:27:45.202 [2024-11-29 02:32:48.678676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.202 [2024-11-29 02:32:48.678761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.678786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.678907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.679024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.679051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.679168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.679281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.679307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.679396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.679523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.679550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.679677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.679796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.679822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.679913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.680003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.680040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.680208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.680334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.680366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.680491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.680585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.680611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.680707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.680789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.680814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.680911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.681029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.681054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.681177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.681291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.681316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.681422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.681517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.681543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.681665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.681780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.681805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.681898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.682007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.682034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.682122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.682254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.682280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.682376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.682485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.682510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.682629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.682743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.682769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.682915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.683000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.683025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.683119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.683212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.683238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.683327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.683413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.683438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.683546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.683639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.683665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.683783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.683897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.683922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.684036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.684157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.684181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.684276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.684360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.684385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.684485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.684601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.684626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.684718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.684802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.684832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.684931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.685072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.685098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.685242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.685385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.685417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.685537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.685637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.685663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.203 qpair failed and we were unable to recover it. 00:27:45.203 [2024-11-29 02:32:48.685783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.203 [2024-11-29 02:32:48.685877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.685904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.685991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.686133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.686158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.686256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.686363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.686388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.686502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.686619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.686645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.686740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.686859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.686885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.687002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.687130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.687156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.687250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.687341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.687368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.687481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.687606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.687632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.687725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.687812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.687838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.687955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.688042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.688068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.688160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.688277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.688303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.688404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.688503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.688528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.688639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.688718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.688743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.688831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.688926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.688952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.689068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.689157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.689183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.689278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.689399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.689426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.689544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.689664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.689690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.689788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.689881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.689908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.690023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.690164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.690191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.690276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.690368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.690407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.690538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.690650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.690676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.690763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.690886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.690913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.691028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.691143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.691170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.691271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.691365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.691390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.691501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.691618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.691644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.691761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.691844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.691870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.691987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.692110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.692136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.692222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.692316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.692342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.692439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.692528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.692553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.204 qpair failed and we were unable to recover it. 00:27:45.204 [2024-11-29 02:32:48.692646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.204 [2024-11-29 02:32:48.692789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.692816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.692911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.693053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.693080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.693213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.693364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.693390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.693540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.693631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.693657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.693771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.693889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.693916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.694015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.694133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.694159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.694256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.694337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.694363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.694525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.694607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.694633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.694748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.694831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.694857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.694970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.695085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.695111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.695228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.695345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.695372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.695504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.695589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.695616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.695716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.695861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.695888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.695984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.696125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.696151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.696248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.696342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.696368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.696511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.696604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.696630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.696721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.696832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.696858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.696950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.697066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.697093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.697216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.697417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.697454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.697572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.697687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.697714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.697855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.697973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.697999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.698094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.698238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.698264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.698358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.698452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.698478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.698689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.698790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.698816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.698914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.699027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.699052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.699171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.699256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.699282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.699428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.699517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.699542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.699631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.699782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.699808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.699938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.700052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.700078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.205 qpair failed and we were unable to recover it. 00:27:45.205 [2024-11-29 02:32:48.700166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.205 [2024-11-29 02:32:48.700279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.700306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.700399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.700529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.700556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.700679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.700765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.700796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.700887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.700976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.701002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.701144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.701263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.701289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.701380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.701524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.701550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.701671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.701799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.701825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.701943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.702057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.702083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.702164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.702246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.702272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.702365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.702453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.702477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.702567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.702719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.702745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.702856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.702965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.702990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.703088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.703212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.703238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.703334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.703426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.703455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.703594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.703721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.703746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.703896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.704017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.704043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.704133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.704228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.704254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.704418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.704515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.704542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.704638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.704727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.704753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.704849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.704942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.704967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.705084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.705174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.705201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.705315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.705456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.705483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.705602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.705739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.705765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.705908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.706038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.706065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.706189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.706271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.706297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.706417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.706546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.706572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.706663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.706756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.706781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.706899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.706992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.206 [2024-11-29 02:32:48.707018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.206 qpair failed and we were unable to recover it. 00:27:45.206 [2024-11-29 02:32:48.707111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.707201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.707227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.207 qpair failed and we were unable to recover it. 00:27:45.207 [2024-11-29 02:32:48.707313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.707409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.707446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.207 qpair failed and we were unable to recover it. 00:27:45.207 [2024-11-29 02:32:48.707564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.707659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.707697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.207 qpair failed and we were unable to recover it. 00:27:45.207 [2024-11-29 02:32:48.707792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.707899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.707926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.207 qpair failed and we were unable to recover it. 00:27:45.207 [2024-11-29 02:32:48.708025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.708122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.708148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.207 qpair failed and we were unable to recover it. 00:27:45.207 [2024-11-29 02:32:48.708244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.708360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.708387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.207 qpair failed and we were unable to recover it. 00:27:45.207 [2024-11-29 02:32:48.708481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.708569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.708594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.207 qpair failed and we were unable to recover it. 00:27:45.207 [2024-11-29 02:32:48.708737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.708878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.708905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.207 qpair failed and we were unable to recover it. 00:27:45.207 [2024-11-29 02:32:48.709001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.709117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.709143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.207 qpair failed and we were unable to recover it. 00:27:45.207 [2024-11-29 02:32:48.709268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.709355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.709381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.207 qpair failed and we were unable to recover it. 00:27:45.207 [2024-11-29 02:32:48.709508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.709664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.709696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.207 qpair failed and we were unable to recover it. 00:27:45.207 [2024-11-29 02:32:48.709842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.709956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.709982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.207 qpair failed and we were unable to recover it. 00:27:45.207 [2024-11-29 02:32:48.710121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.710236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.710261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.207 qpair failed and we were unable to recover it. 00:27:45.207 [2024-11-29 02:32:48.710348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.710433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.710458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.207 qpair failed and we were unable to recover it. 00:27:45.207 [2024-11-29 02:32:48.710579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.710693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.710729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.207 qpair failed and we were unable to recover it. 00:27:45.207 [2024-11-29 02:32:48.710826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.710914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.710940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.207 qpair failed and we were unable to recover it. 00:27:45.207 [2024-11-29 02:32:48.711058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.711146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.711171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.207 qpair failed and we were unable to recover it. 00:27:45.207 [2024-11-29 02:32:48.711290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.711410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.711440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.207 qpair failed and we were unable to recover it. 00:27:45.207 [2024-11-29 02:32:48.711558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.711674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.711710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.207 qpair failed and we were unable to recover it. 00:27:45.207 [2024-11-29 02:32:48.711830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.711942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.711969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.207 qpair failed and we were unable to recover it. 00:27:45.207 [2024-11-29 02:32:48.712055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.712170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.712196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.207 qpair failed and we were unable to recover it. 00:27:45.207 [2024-11-29 02:32:48.712321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.712414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.712445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.207 qpair failed and we were unable to recover it. 00:27:45.207 [2024-11-29 02:32:48.712542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.712654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.712681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.207 qpair failed and we were unable to recover it. 00:27:45.207 [2024-11-29 02:32:48.712774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.712882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.712908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.207 qpair failed and we were unable to recover it. 00:27:45.207 [2024-11-29 02:32:48.713022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.713108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.207 [2024-11-29 02:32:48.713134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.207 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.713250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.713428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.713459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.713578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.713786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.713812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.713907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.714018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.714045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.714159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.714275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.714301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.714399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.714490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.714517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.714610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.714725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.714751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.714871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.714986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.715012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.715101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.715206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.715232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.715328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.715427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.715453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.715577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.715674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.715700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.715819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.715936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.715961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.716064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.716153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.716181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.716278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.716390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.716443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.716543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.716660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.716686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.716777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.716865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.716891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.717007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.717123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.717149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.717237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.717322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.717347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.717497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.717609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.717635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.717754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.717847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.717873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.717964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.718058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.718084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.718168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.718266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.718293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.718433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.718574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.718600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.718691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.718817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.718843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.718932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.719074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.719100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.719221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.719345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.719372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.719478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.719595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.719622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.719743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.719858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.719885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.719967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.720088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.720114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.208 [2024-11-29 02:32:48.720208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.720316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.208 [2024-11-29 02:32:48.720341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.208 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.720485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.720563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.720589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.720711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.720852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.720877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.720984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.721081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.721108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.721253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.721372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.721404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.721526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.721615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.721643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.721775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.721892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.721918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.722038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.722127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.722153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.722242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.722342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.722367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.722520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.722612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.722637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.722790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.722882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.722907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.723026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.723119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.723146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.723243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.723336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.723361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.723452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.723570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.723596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.723674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.723758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.723784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.723884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.724025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.724051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.724141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.724224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.724250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.724390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.724559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.724586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.724707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.724786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.724812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.724911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.725004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.725031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.725148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.725263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.725289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.725385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.725513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.725539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.725629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.725719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.725745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.725861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.725947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.725978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.726066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.726205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.726231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.726326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.726427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.726455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.726550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.726670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.726696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.726791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.726881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.726906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.727003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.727096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.727122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.727208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.727329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.209 [2024-11-29 02:32:48.727354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.209 qpair failed and we were unable to recover it. 00:27:45.209 [2024-11-29 02:32:48.727454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.727536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.727561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.727673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.727768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.727794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.727915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.728005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.728032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.728149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.728276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.728303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.728406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.728552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.728578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.728665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.728776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.728803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.728922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.729010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.729036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.729160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.729281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.729307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.729423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.729509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.729535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.729626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.729708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.729733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.729828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.729912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.729939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.730030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.730172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.730199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.730325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.730418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.730445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.730565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.730650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.730675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.730792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.730909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.730935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.731026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.731146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.731172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.731293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.731406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.731433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.731524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.731607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.731634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.731730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.731872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.731898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.732015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.732100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.732125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.732270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.732404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.732431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.732548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.732661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.732687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.732789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.732864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.732890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.732978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.733066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.733092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.733183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.733308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.733335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.733429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.733517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.733543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.733656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.733739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.733765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.733860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.734005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.734032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.734127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.734218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.210 [2024-11-29 02:32:48.734246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.210 qpair failed and we were unable to recover it. 00:27:45.210 [2024-11-29 02:32:48.734364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.734491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.734518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.734605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.734693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.734719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.734803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.734919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.734946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.735069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.735187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.735214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.735326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.735438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.735465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.735595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.735707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.735738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.735818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.735910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.735936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.736052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.736199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.736226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.736344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.736429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.736456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.736541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.736627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.736653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.736768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.736852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.736877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.736970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.737120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.737145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.737257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.737344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.737371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.737492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.737580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.737607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.737751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.737830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.737855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.737981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.738122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.738148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.738296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.738409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.738435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.738527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.738645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.738671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.738753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.738868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.738894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.738988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.739076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.739101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.739223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.739323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.739348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.739473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.739558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.739584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.739705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.739822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.739848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.739968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.740086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.740111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.740253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.740338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.740364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.740457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.740573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.740600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.740728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.740823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.740848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.740941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.741082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.741108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.741202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.741283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.741309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.211 qpair failed and we were unable to recover it. 00:27:45.211 [2024-11-29 02:32:48.741457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.211 [2024-11-29 02:32:48.741569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.741594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.212 qpair failed and we were unable to recover it. 00:27:45.212 [2024-11-29 02:32:48.741686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.741832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.741858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.212 qpair failed and we were unable to recover it. 00:27:45.212 [2024-11-29 02:32:48.741972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.742088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.742115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.212 qpair failed and we were unable to recover it. 00:27:45.212 [2024-11-29 02:32:48.742234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.742351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.742378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.212 qpair failed and we were unable to recover it. 00:27:45.212 [2024-11-29 02:32:48.742468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.742585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.742610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.212 qpair failed and we were unable to recover it. 00:27:45.212 [2024-11-29 02:32:48.742699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.742814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.742840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.212 qpair failed and we were unable to recover it. 00:27:45.212 [2024-11-29 02:32:48.742966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.743085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.743111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.212 qpair failed and we were unable to recover it. 00:27:45.212 [2024-11-29 02:32:48.743211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.743297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.743324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.212 qpair failed and we were unable to recover it. 00:27:45.212 [2024-11-29 02:32:48.743443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.743533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.743558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.212 qpair failed and we were unable to recover it. 00:27:45.212 [2024-11-29 02:32:48.743703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.743819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.743845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.212 qpair failed and we were unable to recover it. 00:27:45.212 [2024-11-29 02:32:48.743931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.744012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.744038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.212 qpair failed and we were unable to recover it. 00:27:45.212 [2024-11-29 02:32:48.744155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.744271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.744296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.212 qpair failed and we were unable to recover it. 00:27:45.212 [2024-11-29 02:32:48.744496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.744594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.744620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.212 qpair failed and we were unable to recover it. 00:27:45.212 [2024-11-29 02:32:48.744714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.744809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.744836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.212 qpair failed and we were unable to recover it. 00:27:45.212 [2024-11-29 02:32:48.744930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.745117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.745144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.212 qpair failed and we were unable to recover it. 00:27:45.212 [2024-11-29 02:32:48.745290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.745425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.745453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.212 qpair failed and we were unable to recover it. 00:27:45.212 [2024-11-29 02:32:48.745542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.745623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.745650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.212 qpair failed and we were unable to recover it. 00:27:45.212 [2024-11-29 02:32:48.745791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.745897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.745924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.212 qpair failed and we were unable to recover it. 00:27:45.212 [2024-11-29 02:32:48.746014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.746121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.746146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.212 qpair failed and we were unable to recover it. 00:27:45.212 [2024-11-29 02:32:48.746265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.746382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.746413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.212 qpair failed and we were unable to recover it. 00:27:45.212 [2024-11-29 02:32:48.746529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.746626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.746652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.212 qpair failed and we were unable to recover it. 00:27:45.212 [2024-11-29 02:32:48.746767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.746883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.746908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.212 qpair failed and we were unable to recover it. 00:27:45.212 [2024-11-29 02:32:48.746996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.747141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.747167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.212 qpair failed and we were unable to recover it. 00:27:45.212 [2024-11-29 02:32:48.747288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.747417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.747443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.212 qpair failed and we were unable to recover it. 00:27:45.212 [2024-11-29 02:32:48.747564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.747665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.747691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.212 qpair failed and we were unable to recover it. 00:27:45.212 [2024-11-29 02:32:48.747810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.747923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.212 [2024-11-29 02:32:48.747948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.212 qpair failed and we were unable to recover it. 00:27:45.212 [2024-11-29 02:32:48.748034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.748120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.748146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.748288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.748403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.748435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.748527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.748668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.748695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.748791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.748906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.748932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.749015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.749109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.749134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.749256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.749364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.749390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.749548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.749667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.749693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.749789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.749881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.749908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.750031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.750165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.750192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.750277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.750372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.750404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.750528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.750658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.750684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.750797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.750942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.750967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.751097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.751217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.751243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.751336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.751441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.751467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.751557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.751675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.751701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.751820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.751937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.751963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.752078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.752197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.752223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.752312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.752440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.752467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.752558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.752679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.752704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.752816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.752932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.752958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.753073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.753168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.753194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.753309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.753403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.753429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.753528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.753718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.753745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.753890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.753981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.754008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.754128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.754224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.754250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.754367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.754487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.754515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.754634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.754721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.754747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.754864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.754956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.754984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.755097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.755238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.213 [2024-11-29 02:32:48.755266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.213 qpair failed and we were unable to recover it. 00:27:45.213 [2024-11-29 02:32:48.755390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.755491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.755518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.755605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.755725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.755751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.755897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.756016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.756041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.756130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.756225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.756250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.756346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.756465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.756493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.756611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.756726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.756751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.756870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.756961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.756987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.757081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.757164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.757191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.757277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.757368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.757406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.757495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.757613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.757638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.757750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.757867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.757894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.758013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.758122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.758148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.758249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.758398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.758425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.758526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.758671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.758698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.758817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.758933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.758959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.759046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.759183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.759212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.759343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.759475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.759502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.759625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.759747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.759773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.759924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.760012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.760039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.760134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.760251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.760278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.760405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.760530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.760556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.760642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.760727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.760753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.760840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.760947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.760973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.761065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.761157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.761188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.761303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.761422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.761449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.761569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.761678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.761704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.761805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.761898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.761924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.762041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.762134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.762161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.214 [2024-11-29 02:32:48.762251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.762340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.214 [2024-11-29 02:32:48.762366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.214 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.762493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.762575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.762602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.762719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.762864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.762891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.762992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.763113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.763139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.763225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.763337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.763363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.763467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.763584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.763610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.763731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.763846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.763872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.763955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.764072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.764098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.764186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.764275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.764302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.764383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.764484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.764509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.764631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.764750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.764776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.764897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.765016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.765042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.765136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.765254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.765282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.765406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.765529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.765556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.765642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.765725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.765753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.765855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.765944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.765970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.766086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.766169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.766195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.766318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.766424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.766452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.766570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.766692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.766718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.766812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.766897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.766923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.767068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.767153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.767178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.767276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.767368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.767399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.767492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.767571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.767596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.767732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.767869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.767896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.768010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.768130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.768156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.768274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.768415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.768457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.768565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.768658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.768685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.768802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.768914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.768940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.769053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.769146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.769174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.769264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.769356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.215 [2024-11-29 02:32:48.769382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.215 qpair failed and we were unable to recover it. 00:27:45.215 [2024-11-29 02:32:48.769514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.769662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.769688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.216 qpair failed and we were unable to recover it. 00:27:45.216 [2024-11-29 02:32:48.769835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.769916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.769942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.216 qpair failed and we were unable to recover it. 00:27:45.216 [2024-11-29 02:32:48.770067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.770160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.770188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.216 qpair failed and we were unable to recover it. 00:27:45.216 [2024-11-29 02:32:48.770312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.770399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.770426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.216 qpair failed and we were unable to recover it. 00:27:45.216 [2024-11-29 02:32:48.770620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.770737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.770764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.216 qpair failed and we were unable to recover it. 00:27:45.216 [2024-11-29 02:32:48.770862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.771003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.771030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.216 qpair failed and we were unable to recover it. 00:27:45.216 [2024-11-29 02:32:48.771152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.771269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.771300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.216 qpair failed and we were unable to recover it. 00:27:45.216 [2024-11-29 02:32:48.771420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.771507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.771533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.216 qpair failed and we were unable to recover it. 00:27:45.216 [2024-11-29 02:32:48.771677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.771794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.771820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.216 qpair failed and we were unable to recover it. 00:27:45.216 [2024-11-29 02:32:48.771909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.771990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.772015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.216 qpair failed and we were unable to recover it. 00:27:45.216 [2024-11-29 02:32:48.772140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.772292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.772318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.216 qpair failed and we were unable to recover it. 00:27:45.216 [2024-11-29 02:32:48.772437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.772555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.772582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.216 qpair failed and we were unable to recover it. 00:27:45.216 [2024-11-29 02:32:48.772701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.772787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.772813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.216 qpair failed and we were unable to recover it. 00:27:45.216 [2024-11-29 02:32:48.772935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.773032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.773059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.216 qpair failed and we were unable to recover it. 00:27:45.216 [2024-11-29 02:32:48.773168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.773251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.773277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.216 qpair failed and we were unable to recover it. 00:27:45.216 [2024-11-29 02:32:48.773424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.773515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.773541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.216 qpair failed and we were unable to recover it. 00:27:45.216 [2024-11-29 02:32:48.773652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.773734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.773760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.216 qpair failed and we were unable to recover it. 00:27:45.216 [2024-11-29 02:32:48.773880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.774035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.774062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.216 qpair failed and we were unable to recover it. 00:27:45.216 [2024-11-29 02:32:48.774156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.774235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.774261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.216 qpair failed and we were unable to recover it. 00:27:45.216 [2024-11-29 02:32:48.774362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.774448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.774474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.216 qpair failed and we were unable to recover it. 00:27:45.216 [2024-11-29 02:32:48.774594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.774772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.774799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.216 qpair failed and we were unable to recover it. 00:27:45.216 [2024-11-29 02:32:48.774896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.774991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.775018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.216 qpair failed and we were unable to recover it. 00:27:45.216 [2024-11-29 02:32:48.775163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.775255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.775282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.216 qpair failed and we were unable to recover it. 00:27:45.216 [2024-11-29 02:32:48.775399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.775487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.775513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.216 qpair failed and we were unable to recover it. 00:27:45.216 [2024-11-29 02:32:48.775674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.775770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.775808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.216 qpair failed and we were unable to recover it. 00:27:45.216 [2024-11-29 02:32:48.775932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.776041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.216 [2024-11-29 02:32:48.776068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.216 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.776146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.776260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.776287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.776373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.776498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.776525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.776616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.776724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.776751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.776871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.776976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.777002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.777120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.777230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.777257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.777419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.777515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.777541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.777649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.777777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.777803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.777902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.778020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.778047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.778164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.778302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.778328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.778418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.778526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.778552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.778670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.778770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.778796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.778926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.779035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.779062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.779183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.779269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.779296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.779383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.779503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.779530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.779619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.779701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.779727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.779825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.779966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.779993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.780088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.780214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.780243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.780404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.780540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.780567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.780687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.780812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.780838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.780930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.781074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.781101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.781218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.781305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.781331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.781426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.781545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.781571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.781711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.781805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.781831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.781949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.782099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.782125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.782250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.782338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.782366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.782498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.782587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.782612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.782733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.782872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.782898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.782991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.783108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.783134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.217 [2024-11-29 02:32:48.783279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.783398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.217 [2024-11-29 02:32:48.783424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.217 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.783569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.783684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.783710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.783856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.784000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.784027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.784119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.784220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.784250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.784337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.784445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.784471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.784566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.784650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.784677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.784795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.784883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.784909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.785028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.785105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.785131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.785253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.785368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.785400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.785486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.785572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.785598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.785710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.785821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.785847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.785936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.786019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.786045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.786135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.786251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.786278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.786365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.786513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.786540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.786689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.786770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.786796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.786886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.786966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.786991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.787071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.787198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.787224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.787338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.787427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.787454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.787577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.787696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.787722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.787815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.787910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.787936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.788023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.788104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.788130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.788272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.788401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.788444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.788566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.788652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.788678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.788809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.788904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.788930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.789060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.789176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.789201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.789315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.789414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.789442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.789562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.789685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.789712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.789827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.789921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.789947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.790038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.790157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.790183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.790277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.790388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.218 [2024-11-29 02:32:48.790419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.218 qpair failed and we were unable to recover it. 00:27:45.218 [2024-11-29 02:32:48.790529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.790616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.790642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.790733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.790822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.790848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.790951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.791039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.791066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.791165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.791307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.791333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.791455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.791554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.791582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.791711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.791855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.791881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.791974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.792057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.792083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.792203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.792302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.792329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.792461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.792573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.792599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.792713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.792793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.792819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.792914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.793056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.793082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.793197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.793317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.793343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.793431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.793528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.793555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.793639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.793719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.793745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.793837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.793984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.794011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.794111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.794226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.794252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.794370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.794477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.794504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.794592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.794707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.794734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.794817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.794937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.794963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.795073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.795159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.795185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.795325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.795488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.795516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.795615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.795703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.795730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.795828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.795968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.795994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.796076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.796163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.796189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.796288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.796379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.796414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.796534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.796622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.796648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.796740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.796830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.796856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.796947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.797061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.797088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.797199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.797321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.219 [2024-11-29 02:32:48.797346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.219 qpair failed and we were unable to recover it. 00:27:45.219 [2024-11-29 02:32:48.797474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.797594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.797620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.797746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.797829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.797855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.797971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.798060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.798086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.798231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.798341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.798367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.798460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.798549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.798577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.798697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.798814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.798840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.798942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.799022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.799048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.799166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.799264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.799293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.799381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.799519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.799545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.799623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.799704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.799731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.799819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.799910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.799936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.800047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.800131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.800158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.800244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.800360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.800385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.800519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.800595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.800621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.800743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.800835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.800861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.800956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.801085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.801111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.801204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.801291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.801317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.801434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.801553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.801579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.801673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.801797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.801824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.801909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.802008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.802034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.802126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.802232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.802258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.802388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.802538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.802564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.802677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.802771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.802797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.802885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.802998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.803025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.803146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.803231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.803258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.803404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.803500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.803527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.803609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.803739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.803766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.803892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.803978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.804005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.220 qpair failed and we were unable to recover it. 00:27:45.220 [2024-11-29 02:32:48.804125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.804215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.220 [2024-11-29 02:32:48.804241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.221 qpair failed and we were unable to recover it. 00:27:45.221 [2024-11-29 02:32:48.804391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.804510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.804536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.221 qpair failed and we were unable to recover it. 00:27:45.221 [2024-11-29 02:32:48.804623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.804732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.804758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.221 qpair failed and we were unable to recover it. 00:27:45.221 [2024-11-29 02:32:48.804843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.804989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.805015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.221 qpair failed and we were unable to recover it. 00:27:45.221 [2024-11-29 02:32:48.805109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.805230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.805256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.221 qpair failed and we were unable to recover it. 00:27:45.221 [2024-11-29 02:32:48.805348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.805499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.805526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.221 qpair failed and we were unable to recover it. 00:27:45.221 [2024-11-29 02:32:48.805611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.805721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.805747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.221 qpair failed and we were unable to recover it. 00:27:45.221 [2024-11-29 02:32:48.805865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.806015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.806041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.221 qpair failed and we were unable to recover it. 00:27:45.221 [2024-11-29 02:32:48.806159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.806270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.806301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.221 qpair failed and we were unable to recover it. 00:27:45.221 [2024-11-29 02:32:48.806391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.806493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.806519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.221 qpair failed and we were unable to recover it. 00:27:45.221 [2024-11-29 02:32:48.806644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.806727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.806753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.221 qpair failed and we were unable to recover it. 00:27:45.221 [2024-11-29 02:32:48.806844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.806957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.806983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.221 qpair failed and we were unable to recover it. 00:27:45.221 [2024-11-29 02:32:48.807109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.807189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.807215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.221 qpair failed and we were unable to recover it. 00:27:45.221 [2024-11-29 02:32:48.807300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.807419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.807446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.221 qpair failed and we were unable to recover it. 00:27:45.221 [2024-11-29 02:32:48.807532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.807646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.807672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.221 qpair failed and we were unable to recover it. 00:27:45.221 [2024-11-29 02:32:48.807827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.807908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.807934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.221 qpair failed and we were unable to recover it. 00:27:45.221 [2024-11-29 02:32:48.808044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.808137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.808164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.221 qpair failed and we were unable to recover it. 00:27:45.221 [2024-11-29 02:32:48.808257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.808336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.808362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.221 qpair failed and we were unable to recover it. 00:27:45.221 [2024-11-29 02:32:48.808457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.808550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.808577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.221 qpair failed and we were unable to recover it. 00:27:45.221 [2024-11-29 02:32:48.808663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.808808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.808834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.221 qpair failed and we were unable to recover it. 00:27:45.221 [2024-11-29 02:32:48.808937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.809051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.809077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.221 qpair failed and we were unable to recover it. 00:27:45.221 [2024-11-29 02:32:48.809211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.809300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.809328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.221 qpair failed and we were unable to recover it. 00:27:45.221 [2024-11-29 02:32:48.809482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.809602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.809629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.221 qpair failed and we were unable to recover it. 00:27:45.221 [2024-11-29 02:32:48.809742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.809855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.809881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.221 qpair failed and we were unable to recover it. 00:27:45.221 [2024-11-29 02:32:48.809971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.810111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.810137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.221 qpair failed and we were unable to recover it. 00:27:45.221 [2024-11-29 02:32:48.810230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.810324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.810351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.221 qpair failed and we were unable to recover it. 00:27:45.221 [2024-11-29 02:32:48.810469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.810561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.221 [2024-11-29 02:32:48.810587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.810715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.810860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.810887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.811004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.811088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.811115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.811210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.811324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.811351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.811486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.811596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.811622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.811751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.811842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.811869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.811992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.812115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.812142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.812237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.812347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.812378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.812521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.812638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.812664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.812790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.812906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.812934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.813029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.813133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.813159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.813253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.813366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.813406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.813505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.813589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.813615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.813723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.813860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.813911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.814071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.814224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.814270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.814426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.814538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.814572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.814683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.814835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.814864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.815020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.815138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.815166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.815299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.815411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.815441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.815553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.815713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.815762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.815903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.816046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.816079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.816176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.816302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.816333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.816467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.816576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.816606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.816738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.816913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.816947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.817076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.817200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.817233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.817332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.817471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.817506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.817595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.817719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.817752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.817884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.817972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.818000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.818121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.818212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.818244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.222 qpair failed and we were unable to recover it. 00:27:45.222 [2024-11-29 02:32:48.818337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.818439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.222 [2024-11-29 02:32:48.818473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.818598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.818688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.818719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.818840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.818982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.819014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.819146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.819273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.819303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.819408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.819545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.819578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.819726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.819900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.819933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.820033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.820137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.820169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.820298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.820415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.820444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.820577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.820691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.820718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.820838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.820930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.820956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.821072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.821157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.821184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.821328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.821441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.821468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.821619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.821769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.821798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.821921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.822090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.822135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.822269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.822412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.822441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.822576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.822664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.822692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.822810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.822929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.822958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.823084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.823216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.823258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.823351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.823491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.823518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.823645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.823759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.823785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.823898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.824058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.824083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.824193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.824317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.824343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.824467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.824553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.824579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.824667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.824785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.824812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.824945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.825038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.825072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.825197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.825358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.825384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.825479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.825571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.825597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.825716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.825880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.825909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.826005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.826180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.826209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.223 qpair failed and we were unable to recover it. 00:27:45.223 [2024-11-29 02:32:48.826323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.826468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.223 [2024-11-29 02:32:48.826495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.826578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.826676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.826702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.826810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.826934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.826964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.827056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.827208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.827235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.827355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.827441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.827468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.827553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.827635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.827661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.827792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.827902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.827929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.828069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.828176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.828205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.828341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.828436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.828462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.828541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.828661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.828686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.828799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.828957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.828986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.829116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.829210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.829241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.829352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.829491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.829518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.829636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.829752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.829778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.829898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.829982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.830013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.830170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.830268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.830298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.830446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.830587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.830617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.830742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.830837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.830867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.830980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.831148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.831177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.831308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.831422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.831449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.831567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.831674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.831703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.831828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.831917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.831945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.832082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.832186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.832215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.832347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.832431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.832458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.832548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.832640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.832667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.832786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.832868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.832895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.832979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.833098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.833144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.833294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.833406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.833432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.833524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.833606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.833631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.224 [2024-11-29 02:32:48.833750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.833892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.224 [2024-11-29 02:32:48.833919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.224 qpair failed and we were unable to recover it. 00:27:45.225 [2024-11-29 02:32:48.834036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.834176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.834203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.225 qpair failed and we were unable to recover it. 00:27:45.225 [2024-11-29 02:32:48.834320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.834436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.834464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.225 qpair failed and we were unable to recover it. 00:27:45.225 [2024-11-29 02:32:48.834550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.834697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.834724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.225 qpair failed and we were unable to recover it. 00:27:45.225 [2024-11-29 02:32:48.834814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.834927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.834953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.225 qpair failed and we were unable to recover it. 00:27:45.225 [2024-11-29 02:32:48.835044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.835164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.835190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.225 qpair failed and we were unable to recover it. 00:27:45.225 [2024-11-29 02:32:48.835323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.835457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.835484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.225 qpair failed and we were unable to recover it. 00:27:45.225 [2024-11-29 02:32:48.835614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.835732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.835762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.225 qpair failed and we were unable to recover it. 00:27:45.225 [2024-11-29 02:32:48.835857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.835999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.836025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.225 qpair failed and we were unable to recover it. 00:27:45.225 [2024-11-29 02:32:48.836142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.836220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.836246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.225 qpair failed and we were unable to recover it. 00:27:45.225 [2024-11-29 02:32:48.836336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.836461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.836488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.225 qpair failed and we were unable to recover it. 00:27:45.225 [2024-11-29 02:32:48.836573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.836685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.836712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.225 qpair failed and we were unable to recover it. 00:27:45.225 [2024-11-29 02:32:48.836819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.836937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.836965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.225 qpair failed and we were unable to recover it. 00:27:45.225 [2024-11-29 02:32:48.837109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.837224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.837250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.225 qpair failed and we were unable to recover it. 00:27:45.225 [2024-11-29 02:32:48.837343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.837482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.837508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.225 qpair failed and we were unable to recover it. 00:27:45.225 [2024-11-29 02:32:48.837620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.837738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.837763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.225 qpair failed and we were unable to recover it. 00:27:45.225 [2024-11-29 02:32:48.837849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.837975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.838001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.225 qpair failed and we were unable to recover it. 00:27:45.225 [2024-11-29 02:32:48.838091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.838196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.838228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.225 qpair failed and we were unable to recover it. 00:27:45.225 [2024-11-29 02:32:48.838336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.838461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.838493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.225 qpair failed and we were unable to recover it. 00:27:45.225 [2024-11-29 02:32:48.838642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.838763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.838790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.225 qpair failed and we were unable to recover it. 00:27:45.225 [2024-11-29 02:32:48.838907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.839024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.839050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.225 qpair failed and we were unable to recover it. 00:27:45.225 [2024-11-29 02:32:48.839172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.839264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.839290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.225 qpair failed and we were unable to recover it. 00:27:45.225 [2024-11-29 02:32:48.839379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.839499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.839525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.225 qpair failed and we were unable to recover it. 00:27:45.225 [2024-11-29 02:32:48.839642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.839722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.839747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.225 qpair failed and we were unable to recover it. 00:27:45.225 [2024-11-29 02:32:48.839875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.839991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.840016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.225 qpair failed and we were unable to recover it. 00:27:45.225 [2024-11-29 02:32:48.840114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.840197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.840223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.225 qpair failed and we were unable to recover it. 00:27:45.225 [2024-11-29 02:32:48.840343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.225 [2024-11-29 02:32:48.840534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.840562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.840709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.840827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.840853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.840950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.841070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.841096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.841175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.841298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.841324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.841438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.841555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.841581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.841678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.841793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.841822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.841943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.842029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.842055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.842173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.842259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.842285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.842404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.842596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.842622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.842736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.842856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.842882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.842968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.843048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.843074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.843164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.843282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.843308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.843405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.843516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.843555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.843705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.843899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.843951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.844067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.844190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.844219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.844347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.844498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.844549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.844701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.844841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.844870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.844967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.845112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.845143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.845274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.845405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.845434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.845555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.845719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.845748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.845866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.846016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.846046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.846140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.846289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.846322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.846457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.846609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.846640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.846776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.846919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.846949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.847056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.847165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.847194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.847325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.847484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.847517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.847618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.847735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.847767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.847897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.848021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.848052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.848176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.848293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.848323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.226 qpair failed and we were unable to recover it. 00:27:45.226 [2024-11-29 02:32:48.848436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.226 [2024-11-29 02:32:48.848564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.848594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.848691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.848801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.848843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.848983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.849121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.849151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.849270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.849417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.849447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.849602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.849694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.849724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.849819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.849948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.849980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.850105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.850264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.850296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.850422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.850517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.850544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.850671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.850776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.850808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.850909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.851003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.851032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.851157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.851254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.851285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.851400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.851485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.851516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.851620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.851730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.851763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.851866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.851959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.851987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.852117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.852268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.852302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.852431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.852579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.852608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.852712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.852831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.852861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.852984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.853093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.853124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.853232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.853363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.853407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.853519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.853604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.853631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.853752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.853869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.853897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.854017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.854135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.854161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.854259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.854359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.854385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.854517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.854621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.854655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.854759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.854860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.854889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.855012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.855118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.855147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.855272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.855379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.855409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.855524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.855657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.855686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.227 [2024-11-29 02:32:48.855783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.855880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.227 [2024-11-29 02:32:48.855910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.227 qpair failed and we were unable to recover it. 00:27:45.228 [2024-11-29 02:32:48.856012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.228 [2024-11-29 02:32:48.856100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.228 [2024-11-29 02:32:48.856129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.228 qpair failed and we were unable to recover it. 00:27:45.228 [2024-11-29 02:32:48.856243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.228 [2024-11-29 02:32:48.856370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.228 [2024-11-29 02:32:48.856402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.228 qpair failed and we were unable to recover it. 00:27:45.509 [2024-11-29 02:32:48.856499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.856587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.856613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.509 qpair failed and we were unable to recover it. 00:27:45.509 [2024-11-29 02:32:48.856740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.856838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.856868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.509 qpair failed and we were unable to recover it. 00:27:45.509 [2024-11-29 02:32:48.857008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.857110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.857146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.509 qpair failed and we were unable to recover it. 00:27:45.509 [2024-11-29 02:32:48.857249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.857390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.857446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.509 qpair failed and we were unable to recover it. 00:27:45.509 [2024-11-29 02:32:48.857591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.857688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.857718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.509 qpair failed and we were unable to recover it. 00:27:45.509 [2024-11-29 02:32:48.857831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.857952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.857981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.509 qpair failed and we were unable to recover it. 00:27:45.509 [2024-11-29 02:32:48.858092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.858195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.858224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.509 qpair failed and we were unable to recover it. 00:27:45.509 [2024-11-29 02:32:48.858328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.858458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.858486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.509 qpair failed and we were unable to recover it. 00:27:45.509 [2024-11-29 02:32:48.858613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.858709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.858738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.509 qpair failed and we were unable to recover it. 00:27:45.509 [2024-11-29 02:32:48.858868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.859003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.859032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.509 qpair failed and we were unable to recover it. 00:27:45.509 [2024-11-29 02:32:48.859158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.859253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.859281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.509 qpair failed and we were unable to recover it. 00:27:45.509 [2024-11-29 02:32:48.859397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.859485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.859511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.509 qpair failed and we were unable to recover it. 00:27:45.509 [2024-11-29 02:32:48.859618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.859769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.859798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.509 qpair failed and we were unable to recover it. 00:27:45.509 [2024-11-29 02:32:48.859934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.860031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.860060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.509 qpair failed and we were unable to recover it. 00:27:45.509 [2024-11-29 02:32:48.860150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.860269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.860295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.509 qpair failed and we were unable to recover it. 00:27:45.509 [2024-11-29 02:32:48.860382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.860498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.860525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.509 qpair failed and we were unable to recover it. 00:27:45.509 [2024-11-29 02:32:48.860661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.860784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.860814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.509 qpair failed and we were unable to recover it. 00:27:45.509 [2024-11-29 02:32:48.860942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.861033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.861061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.509 qpair failed and we were unable to recover it. 00:27:45.509 [2024-11-29 02:32:48.861189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.861352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.509 [2024-11-29 02:32:48.861378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.861476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.861566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.861593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.861704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.861815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.861841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.861926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.862017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.862043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.862127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.862245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.862271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.862367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.862491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.862517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.862637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.862747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.862773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.862887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.862972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.862998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.863109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.863206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.863233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.863328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.863439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.863466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.863587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.863683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.863710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.863829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.863943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.863970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.864056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.864177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.864204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.864314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.864417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.864460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.864552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.864696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.864721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.864811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.864935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.864961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.865105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.865196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.865222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.865312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.865457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.865484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.865600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.865720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.865746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.865832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.865914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.865941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.866085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.866171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.866197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.866297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.866422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.866449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.866568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.866711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.866737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.866821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.866941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.866967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.867084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.867205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.867231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.867327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.867472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.867504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.867630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.867716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.867743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.867863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.867941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.867968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.868085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.868173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.868200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.510 qpair failed and we were unable to recover it. 00:27:45.510 [2024-11-29 02:32:48.868295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.510 [2024-11-29 02:32:48.868407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.868434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.868545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.868632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.868658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.868852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.868948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.868976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.869096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.869211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.869237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.869324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.869444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.869471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.869596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.869715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.869741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.869861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.869984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.870010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.870097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.870213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.870239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.870332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.870444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.870471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.870556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.870692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.870719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.870803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.870887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.870913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.871030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.871123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.871150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.871267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.871365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.871391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.871521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.871611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.871637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.871731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.871818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.871844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.871971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.872050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.872076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.872185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.872266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.872292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.872436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.872563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.872590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.872711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.872821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.872848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.872957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.873072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.873098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.873185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.873311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.873337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.873430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.873543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.873570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.873693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.873806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.873832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.873976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.874099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.874126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.874256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.874370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.874401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.874523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.874648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.874675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.874818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.874912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.874938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.875088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.875182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.875210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.875358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.875454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.875480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.511 qpair failed and we were unable to recover it. 00:27:45.511 [2024-11-29 02:32:48.875574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.511 [2024-11-29 02:32:48.875726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.875752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.875904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.875991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.876018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.876170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.876285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.876311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.876406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.876494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.876520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.876633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.876751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.876778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.876873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.876963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.876989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.877085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.877176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.877204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.877302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.877443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.877470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.877565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.877655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.877682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.877764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.877874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.877901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.878013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.878139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.878167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.878263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.878361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.878387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.878513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.878604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.878630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.878727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.878839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.878864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.878958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.879067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.879093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.879207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.879321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.879347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.879444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.879555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.879582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.879673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.879790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.879816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.879907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.879985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.880016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.880104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.880192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.880219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.880341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.880432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.880459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.880544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.880655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.880681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.880797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.880888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.880913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.881036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.881131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.881156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.881264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.881448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.881491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.881573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.881671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.881697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.881812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.881931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.881957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.882043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.882158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.882184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.882262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.882412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.882439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.512 qpair failed and we were unable to recover it. 00:27:45.512 [2024-11-29 02:32:48.882564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.512 [2024-11-29 02:32:48.882643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.882670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.513 qpair failed and we were unable to recover it. 00:27:45.513 [2024-11-29 02:32:48.882759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.882845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.882872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.513 qpair failed and we were unable to recover it. 00:27:45.513 [2024-11-29 02:32:48.882987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.883101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.883127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.513 qpair failed and we were unable to recover it. 00:27:45.513 [2024-11-29 02:32:48.883225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.883335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.883360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.513 qpair failed and we were unable to recover it. 00:27:45.513 [2024-11-29 02:32:48.883464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.883561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.883587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.513 qpair failed and we were unable to recover it. 00:27:45.513 [2024-11-29 02:32:48.883670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.883784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.883811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.513 qpair failed and we were unable to recover it. 00:27:45.513 [2024-11-29 02:32:48.883893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.883985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.884012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.513 qpair failed and we were unable to recover it. 00:27:45.513 [2024-11-29 02:32:48.884139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.884255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.884281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.513 qpair failed and we were unable to recover it. 00:27:45.513 [2024-11-29 02:32:48.884399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.884515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.884542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.513 qpair failed and we were unable to recover it. 00:27:45.513 [2024-11-29 02:32:48.884629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.884710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.884736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.513 qpair failed and we were unable to recover it. 00:27:45.513 [2024-11-29 02:32:48.884838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.884943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.884969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.513 qpair failed and we were unable to recover it. 00:27:45.513 [2024-11-29 02:32:48.885084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.885177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.885203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.513 qpair failed and we were unable to recover it. 00:27:45.513 [2024-11-29 02:32:48.885325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.885423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.885450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.513 qpair failed and we were unable to recover it. 00:27:45.513 [2024-11-29 02:32:48.885570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.885647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.885673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.513 qpair failed and we were unable to recover it. 00:27:45.513 [2024-11-29 02:32:48.885765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.885858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.885885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.513 qpair failed and we were unable to recover it. 00:27:45.513 [2024-11-29 02:32:48.886016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.886102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.886130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.513 qpair failed and we were unable to recover it. 00:27:45.513 [2024-11-29 02:32:48.886209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.886325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.886352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.513 qpair failed and we were unable to recover it. 00:27:45.513 [2024-11-29 02:32:48.886475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.886574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.886600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.513 qpair failed and we were unable to recover it. 00:27:45.513 [2024-11-29 02:32:48.886711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.886803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.886829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.513 qpair failed and we were unable to recover it. 00:27:45.513 [2024-11-29 02:32:48.886978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.887069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.887095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.513 qpair failed and we were unable to recover it. 00:27:45.513 [2024-11-29 02:32:48.887179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.887308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.887334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.513 qpair failed and we were unable to recover it. 00:27:45.513 [2024-11-29 02:32:48.887451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.887545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.887571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.513 qpair failed and we were unable to recover it. 00:27:45.513 [2024-11-29 02:32:48.887694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.887786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.887812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.513 qpair failed and we were unable to recover it. 00:27:45.513 [2024-11-29 02:32:48.887926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.888018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.888044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.513 qpair failed and we were unable to recover it. 00:27:45.513 [2024-11-29 02:32:48.888136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.888219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.513 [2024-11-29 02:32:48.888245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.513 qpair failed and we were unable to recover it. 00:27:45.513 [2024-11-29 02:32:48.888349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.888477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.888503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.888636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.888719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.888745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.888845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.888928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.888955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.889038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.889152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.889178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.889322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.889465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.889491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.889615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.889707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.889738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.889854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.889964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.889990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.890082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.890224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.890251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.890337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.890428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.890455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.890574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.890690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.890715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.890802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.890917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.890943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.891058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.891174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.891200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.891294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.891418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.891445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.891567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.891695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.891721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.891810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.891922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.891948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.892036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.892155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.892202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.892340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.892500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.892528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.892617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.892698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.892724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.892840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.892980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.893007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.893130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.893243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.893269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.893412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.893499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.893526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.893669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.893762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.893788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.893871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.893985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.894011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.894108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.894224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.894250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.894367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.894491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.894518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.894630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.894716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.894742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.894863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.894954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.894980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.895073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.895192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.895220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.895313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.895456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.514 [2024-11-29 02:32:48.895483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.514 qpair failed and we were unable to recover it. 00:27:45.514 [2024-11-29 02:32:48.895632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.895718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.895744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.895830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.895916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.895944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.896062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.896157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.896183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.896304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.896445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.896473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.896555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.896683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.896709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.896800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.896945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.896971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.897095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.897182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.897207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.897333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.897423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.897450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.897542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.897629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.897655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.897782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.897896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.897922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.898046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.898154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.898180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.898312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.898403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.898446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.898561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.898654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.898680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.898797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.898881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.898908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.899031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.899117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.899143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.899227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.899370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.899404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.899515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.899592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.899619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.899767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.899862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.899890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.899979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.900064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.900090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.900181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.900267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.900293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.900380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.900529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.900556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.900669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.900781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.900807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.900924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.901016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.901042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.901125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.901208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.901234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.901318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.901459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.901486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.901615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.901710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.901739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.901864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.901972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.901998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.902128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.902212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.902243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.515 [2024-11-29 02:32:48.902341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.902455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.515 [2024-11-29 02:32:48.902482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.515 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.902568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.902653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.902679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.902800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.902916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.902942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.903088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.903200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.903243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.903368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.903488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.903514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.903599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.903716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.903743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.903833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.903918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.903944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.904032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.904126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.904152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.904263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.904350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.904376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.904473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.904614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.904641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.904763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.904865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.904891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.905004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.905111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.905137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.905230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.905348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.905374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.905468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.905586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.905613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.905722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.905832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.905858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.905935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.906055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.906081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.906192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.906278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.906304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.906434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.906575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.906601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.906694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.906809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.906835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.906917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.907061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.907087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.907176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.907257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.907284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.907375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.907458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.907485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.907568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.907655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.907682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.907812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.907960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.907986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.908130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.908265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.908291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.908422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.908514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.908541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.908634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.908777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.908803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.908896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.908982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.909008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.909090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.909215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.909241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.516 [2024-11-29 02:32:48.909369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.909490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.516 [2024-11-29 02:32:48.909516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.516 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.909613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.909733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.909759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.909888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.909982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.910010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.910097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.910197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.910223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.910338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.910436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.910464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.910558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.910683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.910709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.910802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.910893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.910919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.911063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.911204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.911230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.911318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.911433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.911460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.911551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.911643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.911670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.911817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.911945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.911971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.912056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.912150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.912178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.912306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.912449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.912476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.912592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.912703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.912729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.912856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.912950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.912976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.913063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.913176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.913202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.913294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.913405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.913431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.913561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.913675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.913702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.913781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.913893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.913919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.914034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.914125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.914151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.914246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.914355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.914381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.914508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.914617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.914648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.914750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.914865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.914891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.914985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.915103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.915129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.915250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.915330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.915357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.915454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.915535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.915561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.915659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.915787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.915813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.915898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.916008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.916034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.916156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.916301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.916327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.517 [2024-11-29 02:32:48.916427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.916536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.517 [2024-11-29 02:32:48.916562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.517 qpair failed and we were unable to recover it. 00:27:45.518 [2024-11-29 02:32:48.916657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.916750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.916776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.518 qpair failed and we were unable to recover it. 00:27:45.518 [2024-11-29 02:32:48.916861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.916974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.917002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.518 qpair failed and we were unable to recover it. 00:27:45.518 [2024-11-29 02:32:48.917116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.917225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.917251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.518 qpair failed and we were unable to recover it. 00:27:45.518 [2024-11-29 02:32:48.917366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.917486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.917513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.518 qpair failed and we were unable to recover it. 00:27:45.518 [2024-11-29 02:32:48.917642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.917763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.917791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.518 qpair failed and we were unable to recover it. 00:27:45.518 [2024-11-29 02:32:48.917905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.917984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.918011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.518 qpair failed and we were unable to recover it. 00:27:45.518 [2024-11-29 02:32:48.918153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.918292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.918318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.518 qpair failed and we were unable to recover it. 00:27:45.518 [2024-11-29 02:32:48.918412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.918529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.918556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.518 qpair failed and we were unable to recover it. 00:27:45.518 [2024-11-29 02:32:48.918650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.918739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.918766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.518 qpair failed and we were unable to recover it. 00:27:45.518 [2024-11-29 02:32:48.918910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.919000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.919025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.518 qpair failed and we were unable to recover it. 00:27:45.518 [2024-11-29 02:32:48.919150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.919277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.919303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.518 qpair failed and we were unable to recover it. 00:27:45.518 [2024-11-29 02:32:48.919423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.919540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.919566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.518 qpair failed and we were unable to recover it. 00:27:45.518 [2024-11-29 02:32:48.919663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.919756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.919782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.518 qpair failed and we were unable to recover it. 00:27:45.518 [2024-11-29 02:32:48.919903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.920012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.920039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.518 qpair failed and we were unable to recover it. 00:27:45.518 [2024-11-29 02:32:48.920155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.920237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.920264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.518 qpair failed and we were unable to recover it. 00:27:45.518 [2024-11-29 02:32:48.920391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.920495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.920521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.518 qpair failed and we were unable to recover it. 00:27:45.518 [2024-11-29 02:32:48.920646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.920741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.920767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.518 qpair failed and we were unable to recover it. 00:27:45.518 [2024-11-29 02:32:48.920914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.921000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.921026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.518 qpair failed and we were unable to recover it. 00:27:45.518 [2024-11-29 02:32:48.921168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.921287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.921313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.518 qpair failed and we were unable to recover it. 00:27:45.518 [2024-11-29 02:32:48.921414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.921526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.921552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.518 qpair failed and we were unable to recover it. 00:27:45.518 [2024-11-29 02:32:48.921639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.921721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.921748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.518 qpair failed and we were unable to recover it. 00:27:45.518 [2024-11-29 02:32:48.921876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.921987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.922013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.518 qpair failed and we were unable to recover it. 00:27:45.518 [2024-11-29 02:32:48.922096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.922247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.922273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.518 qpair failed and we were unable to recover it. 00:27:45.518 [2024-11-29 02:32:48.922375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.922499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.922527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.518 qpair failed and we were unable to recover it. 00:27:45.518 [2024-11-29 02:32:48.922671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.922781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.922808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.518 qpair failed and we were unable to recover it. 00:27:45.518 [2024-11-29 02:32:48.922900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.518 [2024-11-29 02:32:48.922976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.923002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.923119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.923215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.923242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.923367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.923494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.923520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.923636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.923725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.923751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.923836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.923922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.923949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.924040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.924163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.924190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.924277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.924367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.924398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.924509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.924637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.924667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.924789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.924882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.924908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.925022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.925133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.925159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.925276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.925398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.925425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.925545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.925664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.925690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.925785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.925883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.925909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.926025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.926142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.926168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.926279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.926400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.926427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.926512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.926590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.926616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.926710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.926793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.926821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.926916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.927027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.927058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.927178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.927319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.927346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.927465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.927587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.927614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.927730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.927847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.927873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.927992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.928083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.928110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.928225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.928367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.928416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.928540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.928636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.928661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.928805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.928882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.928908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.929018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.929132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.929159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.929248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.929387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.929422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.929512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.929618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.929644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.929762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.929856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.929883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.519 qpair failed and we were unable to recover it. 00:27:45.519 [2024-11-29 02:32:48.930007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.930128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.519 [2024-11-29 02:32:48.930154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.930274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.930372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.930408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.930503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.930592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.930619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.930739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.930852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.930879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.930997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.931119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.931145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.931230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.931325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.931353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.931478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.931570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.931597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.931696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.931812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.931838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.931957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.932067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.932093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.932230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.932324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.932368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.932468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.932561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.932587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.932695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.932778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.932804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.932925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.933035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.933062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.933152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.933242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.933269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.933365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.933492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.933518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.933611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.933725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.933751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.933864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.933953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.933980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.934123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.934241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.934267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.934362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.934481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.934507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.934595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.934713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.934739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.934857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.934951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.934977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.935091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.935241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.935267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.935357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.935474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.935501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.935598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.935723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.935750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.935839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.935937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.935963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.936059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.936185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.936211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.936292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.936418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.936446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.936596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.936736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.936763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.936855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.936970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.936996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.520 qpair failed and we were unable to recover it. 00:27:45.520 [2024-11-29 02:32:48.937087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.937204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.520 [2024-11-29 02:32:48.937236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.937358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.937445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.937471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.937563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.937648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.937676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.937792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.937915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.937941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.938038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.938132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.938160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.938288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.938407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.938434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.938544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.938633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.938659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.938753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.938837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.938863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.938971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.939086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.939112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.939254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.939372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.939402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.939486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.939601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.939626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.939746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.939844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.939870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.939989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.940101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.940127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.940261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.940383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.940452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.940613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.940733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.940759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.940883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.941013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.941040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.941162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.941276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.941303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.941427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.941520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.941546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.941676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.941794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.941820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.941963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.942104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.942130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.942242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.942333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.942359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.942493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.942577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.942603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.942681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.942763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.942789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.942869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.942989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.943015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.943101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.943218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.943244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.943365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.943485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.943511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.943613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.943720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.943746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.943831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.943944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.943970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.521 qpair failed and we were unable to recover it. 00:27:45.521 [2024-11-29 02:32:48.944072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.944147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.521 [2024-11-29 02:32:48.944174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.944269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.944384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.944417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.944510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.944599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.944623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.944729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.944911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.944963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.945114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.945250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.945278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.945369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.945511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.945544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.945647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.945777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.945808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.945905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.946029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.946057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.946149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.946268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.946299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.946419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.946555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.946585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.946717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.946809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.946838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.946936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.947059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.947089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.947187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.947315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.947343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.947537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.947674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.947704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.947857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.947979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.948007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.948127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.948224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.948256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.948385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.948553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.948584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.948733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.948856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.948889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.949013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.949121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.949154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.949261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.949385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.949425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.949550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.949698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.949729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.949835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.949981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.950014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.950139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.950230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.950258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.950386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.950546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.950577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.950678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.950809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.950840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.950981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.951095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.951120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.951235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.951346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.951371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.522 qpair failed and we were unable to recover it. 00:27:45.522 [2024-11-29 02:32:48.951478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.522 [2024-11-29 02:32:48.951610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.951639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.523 qpair failed and we were unable to recover it. 00:27:45.523 [2024-11-29 02:32:48.951776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.951912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.951942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.523 qpair failed and we were unable to recover it. 00:27:45.523 [2024-11-29 02:32:48.952068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.952198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.952227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.523 qpair failed and we were unable to recover it. 00:27:45.523 [2024-11-29 02:32:48.952361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.952470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.952497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.523 qpair failed and we were unable to recover it. 00:27:45.523 [2024-11-29 02:32:48.952612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.952698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.952725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.523 qpair failed and we were unable to recover it. 00:27:45.523 [2024-11-29 02:32:48.952836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.952934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.952964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.523 qpair failed and we were unable to recover it. 00:27:45.523 [2024-11-29 02:32:48.953054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.953148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.953195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.523 qpair failed and we were unable to recover it. 00:27:45.523 [2024-11-29 02:32:48.953314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.953411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.953439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.523 qpair failed and we were unable to recover it. 00:27:45.523 [2024-11-29 02:32:48.953546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.953701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.953730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.523 qpair failed and we were unable to recover it. 00:27:45.523 [2024-11-29 02:32:48.953886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.953988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.954017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.523 qpair failed and we were unable to recover it. 00:27:45.523 [2024-11-29 02:32:48.954175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.954306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.954335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.523 qpair failed and we were unable to recover it. 00:27:45.523 [2024-11-29 02:32:48.954459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.954552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.954578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.523 qpair failed and we were unable to recover it. 00:27:45.523 [2024-11-29 02:32:48.954723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.954872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.954902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.523 qpair failed and we were unable to recover it. 00:27:45.523 [2024-11-29 02:32:48.955027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.955147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.955176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.523 qpair failed and we were unable to recover it. 00:27:45.523 [2024-11-29 02:32:48.955303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.955405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.955448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.523 qpair failed and we were unable to recover it. 00:27:45.523 [2024-11-29 02:32:48.955559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.955645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.955686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.523 qpair failed and we were unable to recover it. 00:27:45.523 [2024-11-29 02:32:48.955814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.955907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.955935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.523 qpair failed and we were unable to recover it. 00:27:45.523 [2024-11-29 02:32:48.956040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.956134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.956164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.523 qpair failed and we were unable to recover it. 00:27:45.523 [2024-11-29 02:32:48.956301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.956404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.956447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.523 qpair failed and we were unable to recover it. 00:27:45.523 [2024-11-29 02:32:48.956536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.956647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.956672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.523 qpair failed and we were unable to recover it. 00:27:45.523 [2024-11-29 02:32:48.956813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.956954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.956982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.523 qpair failed and we were unable to recover it. 00:27:45.523 [2024-11-29 02:32:48.957082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.957177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.957206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.523 qpair failed and we were unable to recover it. 00:27:45.523 [2024-11-29 02:32:48.957337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.957471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.957499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.523 qpair failed and we were unable to recover it. 00:27:45.523 [2024-11-29 02:32:48.957620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.957735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.957761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.523 qpair failed and we were unable to recover it. 00:27:45.523 [2024-11-29 02:32:48.957885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.957983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.958011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.523 qpair failed and we were unable to recover it. 00:27:45.523 [2024-11-29 02:32:48.958116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.958214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.523 [2024-11-29 02:32:48.958240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.523 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.958362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.958489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.958515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.958642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.958769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.958795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.958880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.959048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.959077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.959185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.959315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.959341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.959456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.959539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.959565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.959661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.959748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.959776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.959888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.960014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.960043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.960140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.960253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.960279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.960390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.960505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.960531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.960647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.960735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.960761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.960857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.960970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.960996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.961114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.961255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.961281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.961378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.961474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.961500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.961589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.961703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.961729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.961813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.961931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.961957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.962088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.962206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.962232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.962316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.962430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.962456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.962542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.962624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.962649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.962758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.962843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.962869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.963017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.963098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.963124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.963244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.963342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.963371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.963479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.963598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.963623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.963744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.963863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.963890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.963981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.964084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.964110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.964227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.964312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.964338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.964450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.964561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.964587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.964709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.964818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.964844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.964965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.965052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.965078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.524 [2024-11-29 02:32:48.965179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.965300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.524 [2024-11-29 02:32:48.965326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.524 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.965434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.965524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.965549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.965667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.965758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.965785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.965872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.965996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.966026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.966114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.966188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.966214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.966310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.966426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.966454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.966578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.966673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.966700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.966816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.966932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.966960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.967062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.967180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.967206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.967295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.967437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.967463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.967609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.967700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.967726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.967820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.967902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.967927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.968072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.968179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.968205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.968318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.968424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.968451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.968549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.968633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.968660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.968780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.968900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.968926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.969050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.969165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.969191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.969280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.969370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.969402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.969516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.969626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.969653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.969744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.969834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.969859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.969968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.970057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.970083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.970228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.970338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.970363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.970468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.970592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.970618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.970738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.970848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.970873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.970994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.971117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.971142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.971264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.971379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.971411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.971511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.971603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.971629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.971724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.971817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.971844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.971987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.972080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.972106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.972187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.972304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.525 [2024-11-29 02:32:48.972331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.525 qpair failed and we were unable to recover it. 00:27:45.525 [2024-11-29 02:32:48.972413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.972501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.972527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.972620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.972703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.972728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.972873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.972991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.973017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.973136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.973284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.973310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.973425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.973524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.973550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.973672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.973760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.973787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.973875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.973964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.973991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.974116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.974231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.974256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.974346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.974463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.974490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.974581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.974698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.974724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.974817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.974902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.974928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.975044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.975135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.975162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.975279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.975426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.975453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.975550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.975646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.975672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.975768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.975891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.975922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.976015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.976107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.976132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.976246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.976366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.976409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.976492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.976603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.976628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.976716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.976808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.976833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.976953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.977044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.977069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.977195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.977333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.977358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.977483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.977604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.977629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.977712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.977796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.977821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.977935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.978057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.978082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.978228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.978350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.978380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.978512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.978626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.978652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.978747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.978836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.978861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.978953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.979036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.979061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.979178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.979266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.526 [2024-11-29 02:32:48.979292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.526 qpair failed and we were unable to recover it. 00:27:45.526 [2024-11-29 02:32:48.979378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.979478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.979504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.527 qpair failed and we were unable to recover it. 00:27:45.527 [2024-11-29 02:32:48.979601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.979721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.979747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.527 qpair failed and we were unable to recover it. 00:27:45.527 [2024-11-29 02:32:48.979864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.979949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.979974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.527 qpair failed and we were unable to recover it. 00:27:45.527 [2024-11-29 02:32:48.980082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.980189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.980214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.527 qpair failed and we were unable to recover it. 00:27:45.527 [2024-11-29 02:32:48.980307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.980428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.980454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.527 qpair failed and we were unable to recover it. 00:27:45.527 [2024-11-29 02:32:48.980546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.980632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.980657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.527 qpair failed and we were unable to recover it. 00:27:45.527 [2024-11-29 02:32:48.980783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.980926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.980951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.527 qpair failed and we were unable to recover it. 00:27:45.527 [2024-11-29 02:32:48.981067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.981190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.981215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.527 qpair failed and we were unable to recover it. 00:27:45.527 [2024-11-29 02:32:48.981358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.981456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.981483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.527 qpair failed and we were unable to recover it. 00:27:45.527 [2024-11-29 02:32:48.981575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.981713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.981738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.527 qpair failed and we were unable to recover it. 00:27:45.527 [2024-11-29 02:32:48.981832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.981918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.981943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.527 qpair failed and we were unable to recover it. 00:27:45.527 [2024-11-29 02:32:48.982053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.982180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.982206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.527 qpair failed and we were unable to recover it. 00:27:45.527 [2024-11-29 02:32:48.982296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.982415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.982441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.527 qpair failed and we were unable to recover it. 00:27:45.527 [2024-11-29 02:32:48.982563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.982647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.982673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.527 qpair failed and we were unable to recover it. 00:27:45.527 [2024-11-29 02:32:48.982768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.982860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.982885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.527 qpair failed and we were unable to recover it. 00:27:45.527 [2024-11-29 02:32:48.983008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.983124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.983150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.527 qpair failed and we were unable to recover it. 00:27:45.527 [2024-11-29 02:32:48.983250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.983335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.983362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.527 qpair failed and we were unable to recover it. 00:27:45.527 [2024-11-29 02:32:48.983456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.983571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.983599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.527 qpair failed and we were unable to recover it. 00:27:45.527 [2024-11-29 02:32:48.983725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.983866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.983892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.527 qpair failed and we were unable to recover it. 00:27:45.527 [2024-11-29 02:32:48.983981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.984073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.984099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.527 qpair failed and we were unable to recover it. 00:27:45.527 [2024-11-29 02:32:48.984189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.984302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.984329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.527 qpair failed and we were unable to recover it. 00:27:45.527 [2024-11-29 02:32:48.984435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.984550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.984576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.527 qpair failed and we were unable to recover it. 00:27:45.527 [2024-11-29 02:32:48.984666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.984758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.984783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.527 qpair failed and we were unable to recover it. 00:27:45.527 [2024-11-29 02:32:48.984899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.985017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.985042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.527 qpair failed and we were unable to recover it. 00:27:45.527 [2024-11-29 02:32:48.985188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.985276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.985302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.527 qpair failed and we were unable to recover it. 00:27:45.527 [2024-11-29 02:32:48.985416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.985497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.527 [2024-11-29 02:32:48.985522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.527 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.985641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.985739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.985766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.985885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.985970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.985996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.986086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.986203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.986229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.986350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.986437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.986463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.986545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.986638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.986663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.986776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.986888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.986914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.987000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.987118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.987143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.987287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.987382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.987413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.987557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.987647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.987673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.987794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.987910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.987936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.988058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.988168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.988201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.988337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.988444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.988488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.988609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.988723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.988748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.988845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.988923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.988949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.989036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.989121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.989146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.989235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.989373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.989405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.989521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.989609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.989635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.989726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.989814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.989839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.989936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.990059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.990085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.990182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.990270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.990296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.990385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.990531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.990557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.990716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.990799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.990825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.990962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.991080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.991105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.991188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.991313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.991339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.991459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.991555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.991580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.991675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.991817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.991852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.991973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.992062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.992087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.992181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.992281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.992310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.528 [2024-11-29 02:32:48.992461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.992579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.528 [2024-11-29 02:32:48.992606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.528 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.992753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.992862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.992888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.993004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.993093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.993120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.993250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.993364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.993389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.993543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.993632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.993660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.993755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.993896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.993922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.994040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.994158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.994185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.994305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.994447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.994473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.994596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.994769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.994795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.994883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.994962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.994988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.995106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.995218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.995243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.995364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.995460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.995488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.995611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.995722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.995747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.995862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.995967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.996001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.996108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.996201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.996230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.996333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.996485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.996518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.996641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.996736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.996772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.996899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.997005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.997034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.997166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.997270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.997298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.997405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.997506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.997531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.997628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.997772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.997797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.997906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.998033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.998062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.998192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.998291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.998319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.998425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.998547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.998573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.998670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.998757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.998800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.998924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.999053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.999081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.999214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.999381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.999411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.999506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.999596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.999622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:48.999769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.999882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:48.999907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.529 qpair failed and we were unable to recover it. 00:27:45.529 [2024-11-29 02:32:49.000014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:49.000114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.529 [2024-11-29 02:32:49.000144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.000263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.000444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.000472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.000589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.000701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.000727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.000856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.000966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.000993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.001134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.001256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.001305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.001432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.001544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.001570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.001684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.001823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.001851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.001979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.002106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.002135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.002246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.002341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.002368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.002492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.002598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.002627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.002780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.002900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.002929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.003061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.003185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.003214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.003349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.003478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.003505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.003647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.003741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.003770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.003930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.004028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.004058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.004165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.004321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.004350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.004476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.004612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.004641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.004741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.004865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.004895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.005020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.005125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.005154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.005252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.005380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.005416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.005555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.005689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.005718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.005823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.005930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.005959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.006057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.006176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.006205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.006307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.006407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.006450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.006581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.006694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.006724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.006889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.007018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.007047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.007171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.007269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.007296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.007417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.007499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.007526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.007662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.007785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.007814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.530 qpair failed and we were unable to recover it. 00:27:45.530 [2024-11-29 02:32:49.007913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.008013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.530 [2024-11-29 02:32:49.008042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.008135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.008253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.008282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.008456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.008600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.008626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.008761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.008885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.008913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.009068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.009216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.009245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.009343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.009508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.009535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.009623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.009734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.009760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.009872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.010021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.010051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.010151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.010286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.010315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.010454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.010599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.010625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.010730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.010884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.010913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.011078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.011200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.011229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.011399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.011536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.011562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.011651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.011851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.011881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.012040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.012145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.012174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.012352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.012488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.012518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.012641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.012752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.012781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.012901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.013036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.013064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.013154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.013283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.013311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.013446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.013563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.013589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.013724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.013857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.013886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.014014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.014138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.014168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.014315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.014453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.014483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.014598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.014714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.014741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.014859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.014990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.015019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.015147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.015307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.015337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.015472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.015558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.015589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.015720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.015841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.015866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.016005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.016139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.016168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.531 qpair failed and we were unable to recover it. 00:27:45.531 [2024-11-29 02:32:49.016322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.016483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.531 [2024-11-29 02:32:49.016508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.532 qpair failed and we were unable to recover it. 00:27:45.532 [2024-11-29 02:32:49.016628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.016796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.016824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.532 qpair failed and we were unable to recover it. 00:27:45.532 [2024-11-29 02:32:49.016962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.017054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.017080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.532 qpair failed and we were unable to recover it. 00:27:45.532 [2024-11-29 02:32:49.017243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.017336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.017361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.532 qpair failed and we were unable to recover it. 00:27:45.532 [2024-11-29 02:32:49.017487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.017603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.017630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.532 qpair failed and we were unable to recover it. 00:27:45.532 [2024-11-29 02:32:49.017800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.017922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.017949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.532 qpair failed and we were unable to recover it. 00:27:45.532 [2024-11-29 02:32:49.018048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.018226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.018256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.532 qpair failed and we were unable to recover it. 00:27:45.532 [2024-11-29 02:32:49.018359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.018494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.018524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.532 qpair failed and we were unable to recover it. 00:27:45.532 [2024-11-29 02:32:49.018687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.018827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.018870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.532 qpair failed and we were unable to recover it. 00:27:45.532 [2024-11-29 02:32:49.019024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.019139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.019167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.532 qpair failed and we were unable to recover it. 00:27:45.532 [2024-11-29 02:32:49.019328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.019467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.019496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.532 qpair failed and we were unable to recover it. 00:27:45.532 [2024-11-29 02:32:49.019631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.019734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.019765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.532 qpair failed and we were unable to recover it. 00:27:45.532 [2024-11-29 02:32:49.019880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.019999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.020025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.532 qpair failed and we were unable to recover it. 00:27:45.532 [2024-11-29 02:32:49.020146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.020262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.020289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.532 qpair failed and we were unable to recover it. 00:27:45.532 [2024-11-29 02:32:49.020444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.020541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.020567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.532 qpair failed and we were unable to recover it. 00:27:45.532 [2024-11-29 02:32:49.020686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.020798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.020823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.532 qpair failed and we were unable to recover it. 00:27:45.532 [2024-11-29 02:32:49.020971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.021092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.021117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.532 qpair failed and we were unable to recover it. 00:27:45.532 [2024-11-29 02:32:49.021236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.021326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.021352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.532 qpair failed and we were unable to recover it. 00:27:45.532 [2024-11-29 02:32:49.021481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.021565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.021591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.532 qpair failed and we were unable to recover it. 00:27:45.532 [2024-11-29 02:32:49.021696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.021831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.021857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.532 qpair failed and we were unable to recover it. 00:27:45.532 [2024-11-29 02:32:49.021970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.022080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.022106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.532 qpair failed and we were unable to recover it. 00:27:45.532 [2024-11-29 02:32:49.022270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.022400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.022428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.532 qpair failed and we were unable to recover it. 00:27:45.532 [2024-11-29 02:32:49.022521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.022616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.022646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.532 qpair failed and we were unable to recover it. 00:27:45.532 [2024-11-29 02:32:49.022750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.022871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.532 [2024-11-29 02:32:49.022897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.532 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.023012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.023089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.023115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.023204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.023318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.023345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.023466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.023554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.023580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.023725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.023832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.023860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.024024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.024165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.024192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.024313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.024411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.024447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.024567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.024728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.024756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.024896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.025010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.025035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.025190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.025281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.025307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.025448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.025549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.025578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.025711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.025838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.025866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.025971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.026091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.026120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.026231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.026309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.026334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.026478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.026589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.026618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.026780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.026926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.026963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.027115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.027253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.027282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.027427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.027544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.027571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.027714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.027874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.027901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.028069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.028197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.028223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.028389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.028547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.028572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.028700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.028787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.028813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.028928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.029099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.029128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.029287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.029843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.029878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.030037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.030164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.030192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.030328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.030458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.030489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.030613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.030742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.030781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.030920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.031042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.031072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.031205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.031297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.031326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.031503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.031649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.533 [2024-11-29 02:32:49.031708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.533 qpair failed and we were unable to recover it. 00:27:45.533 [2024-11-29 02:32:49.031856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.032015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.032044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.032199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.032332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.032362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.032529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.032655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.032681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.032802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.032896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.032921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.033023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.033116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.033159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.033272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.033408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.033451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.033548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.033631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.033668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.033787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.033906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.033932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.034051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.034188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.034216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.034346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.034488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.034518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.034668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.034818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.034844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.034990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.035115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.035142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.035300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.035426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.035466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.036341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.036521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.036561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.036670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.036834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.036863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.037007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.037161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.037206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.037338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.037475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.037505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.037602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.037730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.037759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.037916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.038072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.038102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.038233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.038323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.038349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.038479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.038666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.038692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.038818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.038985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.039016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.039164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.039264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.039291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.039446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.039541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.039570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.039708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.039808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.039837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.039942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.040069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.040100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.040198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.040289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.040318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.040469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.040562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.040590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.040757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.040883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.534 [2024-11-29 02:32:49.040911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.534 qpair failed and we were unable to recover it. 00:27:45.534 [2024-11-29 02:32:49.041042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.041193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.041222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.041319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.041454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.041483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.041616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.041741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.041766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.041893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.042060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.042089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.042221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.042347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.042377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.042520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.042608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.042638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.042786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.042915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.042941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.043046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.043175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.043206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.043315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.043446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.043477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.043581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.043718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.043748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.043891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.044007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.044033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.044114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.044299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.044325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.044452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.044592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.044620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.044777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.044900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.044929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.045068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.045188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.045215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.045311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.045432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.045481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.045578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.045716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.045746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.045903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.045994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.046023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.046178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.046288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.046314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.046448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.046580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.046606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.046699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.046808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.046837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.046987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.047066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.047092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.047193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.047308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.047335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.047468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.047574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.047603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.047719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.047839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.047883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.047973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.048097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.048141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.048307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.048416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.048454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.048573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.048680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.048710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.048814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.048906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.048937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.535 qpair failed and we were unable to recover it. 00:27:45.535 [2024-11-29 02:32:49.049107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.535 [2024-11-29 02:32:49.049201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.049227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.536 qpair failed and we were unable to recover it. 00:27:45.536 [2024-11-29 02:32:49.049317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.049448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.049475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.536 qpair failed and we were unable to recover it. 00:27:45.536 [2024-11-29 02:32:49.049568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.049662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.049688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.536 qpair failed and we were unable to recover it. 00:27:45.536 [2024-11-29 02:32:49.049799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.049877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.049903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.536 qpair failed and we were unable to recover it. 00:27:45.536 [2024-11-29 02:32:49.050025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.050184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.050213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.536 qpair failed and we were unable to recover it. 00:27:45.536 [2024-11-29 02:32:49.050328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.050416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.050443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.536 qpair failed and we were unable to recover it. 00:27:45.536 [2024-11-29 02:32:49.050535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.050677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.050706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.536 qpair failed and we were unable to recover it. 00:27:45.536 [2024-11-29 02:32:49.050811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.050943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.050973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.536 qpair failed and we were unable to recover it. 00:27:45.536 [2024-11-29 02:32:49.051100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.051191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.051220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.536 qpair failed and we were unable to recover it. 00:27:45.536 [2024-11-29 02:32:49.051342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.051451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.051477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.536 qpair failed and we were unable to recover it. 00:27:45.536 [2024-11-29 02:32:49.051569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.051731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.051760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.536 qpair failed and we were unable to recover it. 00:27:45.536 [2024-11-29 02:32:49.051890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.052043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.052073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.536 qpair failed and we were unable to recover it. 00:27:45.536 [2024-11-29 02:32:49.052206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.052303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.052332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.536 qpair failed and we were unable to recover it. 00:27:45.536 [2024-11-29 02:32:49.052452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.052578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.052604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.536 qpair failed and we were unable to recover it. 00:27:45.536 [2024-11-29 02:32:49.052695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.052836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.052862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.536 qpair failed and we were unable to recover it. 00:27:45.536 [2024-11-29 02:32:49.052980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.053091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.053117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.536 qpair failed and we were unable to recover it. 00:27:45.536 [2024-11-29 02:32:49.053237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.053328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.053357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.536 qpair failed and we were unable to recover it. 00:27:45.536 [2024-11-29 02:32:49.053474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.053557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.053583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.536 qpair failed and we were unable to recover it. 00:27:45.536 [2024-11-29 02:32:49.053668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.053791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.053817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.536 qpair failed and we were unable to recover it. 00:27:45.536 [2024-11-29 02:32:49.053969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.054068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.054098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.536 qpair failed and we were unable to recover it. 00:27:45.536 [2024-11-29 02:32:49.054222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.054323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.054352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.536 qpair failed and we were unable to recover it. 00:27:45.536 [2024-11-29 02:32:49.054493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.054597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.054623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.536 qpair failed and we were unable to recover it. 00:27:45.536 [2024-11-29 02:32:49.054746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.054843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.054872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.536 qpair failed and we were unable to recover it. 00:27:45.536 [2024-11-29 02:32:49.055023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.055154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.055183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.536 qpair failed and we were unable to recover it. 00:27:45.536 [2024-11-29 02:32:49.055318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.055487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.536 [2024-11-29 02:32:49.055515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.536 qpair failed and we were unable to recover it. 00:27:45.536 [2024-11-29 02:32:49.055607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.055728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.055754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.055867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.055965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.055994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.056126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.056259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.056285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.056419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.056585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.056614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.056753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.056868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.056898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.057022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.057155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.057184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.057282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.057415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.057446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.057604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.057726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.057756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.057898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.057993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.058019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.058137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.058240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.058267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.058365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.058492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.058520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.058647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.058746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.058775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.058886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.058976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.059002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.059087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.059206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.059234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.059328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.059440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.059467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.059585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.059712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.059742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.059855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.059938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.059964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.060084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.060205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.060231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.060351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.060479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.060506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.060598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.060739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.060765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.060882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.060967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.060994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.061111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.061196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.061240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.061405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.061503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.061533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.061655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.061782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.061811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.061926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.062044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.062070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.062225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.062369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.062422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.062540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.062639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.062668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.062799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.062934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.062963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.063092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.063212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.537 [2024-11-29 02:32:49.063241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.537 qpair failed and we were unable to recover it. 00:27:45.537 [2024-11-29 02:32:49.063407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.063515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.063539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.063657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.063799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.063829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.063966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.064116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.064146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.064240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.064361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.064389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.064511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.064599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.064624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.064762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.064862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.064891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.064986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.065090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.065117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.065251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.065400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.065427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.065552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.065663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.065688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.065801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.065899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.065927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.066081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.066237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.066265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.066415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.066525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.066551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.066634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.066782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.066807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.066969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.067063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.067093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.067200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.067330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.067359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.067512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.067608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.067633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.067715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.067832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.067863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.067992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.068122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.068150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.068267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.068407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.068451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.068546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.068651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.068693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.068838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.068962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.068987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.069106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.069252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.069280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.069375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.069494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.069520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.069608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.069716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.069742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.069893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.069981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.070006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.070172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.070298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.070326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.070463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.070560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.070590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.070727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.070892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.070918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.071061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.071181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.538 [2024-11-29 02:32:49.071208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.538 qpair failed and we were unable to recover it. 00:27:45.538 [2024-11-29 02:32:49.071323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.071444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.071472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.071591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.071682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.071707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.071820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.071931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.071957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.072067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.072154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.072181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.072324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.072426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.072469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.072561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.072649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.072674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.072790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.072906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.072931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.073047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.073140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.073167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.073333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.073474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.073501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.073591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.073717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.073745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.073919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.074058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.074084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.074176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.074291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.074317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.074521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.074637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.074663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.074791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.074910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.074938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.075103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.075234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.075262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.075377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.075500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.075526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.075640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.075804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.075833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.075933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.076064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.076092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.076204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.076339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.076368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.076487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.076598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.076623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.076759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.076864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.076892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.077033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.077120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.077145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.077309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.077438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.077480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.077601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.077693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.077718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.077851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.077977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.078005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.078163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.078258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.078288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.078443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.078537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.078564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.078683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.078804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.078829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.078960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.079100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.539 [2024-11-29 02:32:49.079131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.539 qpair failed and we were unable to recover it. 00:27:45.539 [2024-11-29 02:32:49.079222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.079405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.079434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.079552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.079668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.079694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.079814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.079934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.079959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.080127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.080230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.080260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.080347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.080510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.080538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.080661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.080765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.080795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.080933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.081076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.081102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.081210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.081312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.081342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.081473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.081584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.081611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.081707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.081875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.081919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.082087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.082196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.082221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.082360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.082488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.082514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.082634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.082777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.082802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.082924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.083031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.083074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.083212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.083310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.083338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.083461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.083577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.083602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.083717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.083856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.083884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.083985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.084104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.084132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.084262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.084417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.084444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.084622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.084739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.084765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.084905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.085038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.085068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.085201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.085356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.085384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.085555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.085673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.085699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.085884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.085967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.085992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.086109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.086247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.086274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.086422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.086513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.086539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.086653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.086799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.086824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.086933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.087051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.087079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.087171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.087323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.087351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.540 qpair failed and we were unable to recover it. 00:27:45.540 [2024-11-29 02:32:49.087537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.540 [2024-11-29 02:32:49.087655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.087682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.541 qpair failed and we were unable to recover it. 00:27:45.541 [2024-11-29 02:32:49.087806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.087926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.087951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.541 qpair failed and we were unable to recover it. 00:27:45.541 [2024-11-29 02:32:49.088069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.088173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.088200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.541 qpair failed and we were unable to recover it. 00:27:45.541 [2024-11-29 02:32:49.088364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.088483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.088508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.541 qpair failed and we were unable to recover it. 00:27:45.541 [2024-11-29 02:32:49.088657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.088760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.088787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.541 qpair failed and we were unable to recover it. 00:27:45.541 [2024-11-29 02:32:49.088953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.089045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.089070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.541 qpair failed and we were unable to recover it. 00:27:45.541 [2024-11-29 02:32:49.089225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.089344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.089372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.541 qpair failed and we were unable to recover it. 00:27:45.541 [2024-11-29 02:32:49.089518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.089637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.089663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.541 qpair failed and we were unable to recover it. 00:27:45.541 [2024-11-29 02:32:49.089802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.089955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.089983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.541 qpair failed and we were unable to recover it. 00:27:45.541 [2024-11-29 02:32:49.090099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.090190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.090215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.541 qpair failed and we were unable to recover it. 00:27:45.541 [2024-11-29 02:32:49.090302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.090413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.090465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.541 qpair failed and we were unable to recover it. 00:27:45.541 [2024-11-29 02:32:49.090586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.090681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.090722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.541 qpair failed and we were unable to recover it. 00:27:45.541 [2024-11-29 02:32:49.090860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.090992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.091019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.541 qpair failed and we were unable to recover it. 00:27:45.541 [2024-11-29 02:32:49.091132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.091277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.091302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.541 qpair failed and we were unable to recover it. 00:27:45.541 [2024-11-29 02:32:49.091433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.091569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.091595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.541 qpair failed and we were unable to recover it. 00:27:45.541 [2024-11-29 02:32:49.091742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.091861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.091890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.541 qpair failed and we were unable to recover it. 00:27:45.541 [2024-11-29 02:32:49.092054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.092186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.092214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.541 qpair failed and we were unable to recover it. 00:27:45.541 [2024-11-29 02:32:49.092402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.092571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.092597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.541 qpair failed and we were unable to recover it. 00:27:45.541 [2024-11-29 02:32:49.092742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.092869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.092897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.541 qpair failed and we were unable to recover it. 00:27:45.541 [2024-11-29 02:32:49.092999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.093149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.093188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.541 qpair failed and we were unable to recover it. 00:27:45.541 [2024-11-29 02:32:49.093320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.093459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.093489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.541 qpair failed and we were unable to recover it. 00:27:45.541 [2024-11-29 02:32:49.093625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.093757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.093782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.541 qpair failed and we were unable to recover it. 00:27:45.541 [2024-11-29 02:32:49.093868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.094024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.094054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.541 qpair failed and we were unable to recover it. 00:27:45.541 [2024-11-29 02:32:49.094191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.094321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.094349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.541 qpair failed and we were unable to recover it. 00:27:45.541 [2024-11-29 02:32:49.094496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.094608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.094634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.541 qpair failed and we were unable to recover it. 00:27:45.541 [2024-11-29 02:32:49.094750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.094893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.541 [2024-11-29 02:32:49.094918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.541 qpair failed and we were unable to recover it. 00:27:45.541 [2024-11-29 02:32:49.095056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.095223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.095248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.095379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.095509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.095534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.095655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.095746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.095771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.095856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.095953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.095979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.096098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.096269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.096297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.096408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.096535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.096568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.096693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.096821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.096849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.096991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.097071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.097096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.097226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.097362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.097387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.097511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.097597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.097621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.097788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.097941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.097969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.098078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.098192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.098217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.098361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.098511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.098537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.098630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.098756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.098784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.098946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.099074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.099102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.099290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.099459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.099485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.099631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.099780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.099809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.099904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.100005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.100032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.100169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.100299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.100327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.100469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.100568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.100593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.100708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.100875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.100903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.101053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.101216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.101244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.101341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.101489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.101515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.101623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.101718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.101744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.101890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.102035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.102064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.102192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.102327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.102355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.102518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.102634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.102660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.102783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.102874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.102900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.103076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.103199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.103227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.542 qpair failed and we were unable to recover it. 00:27:45.542 [2024-11-29 02:32:49.103344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.542 [2024-11-29 02:32:49.103532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.103558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.103689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.103818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.103846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.103991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.104132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.104157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.104256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.104374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.104412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.104524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.104641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.104665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.104791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.104926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.104954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.105093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.105177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.105203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.105333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.105509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.105535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.105626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.105723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.105765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.105924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.106044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.106072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.106208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.106321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.106349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.106486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.106612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.106636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.106721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.106878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.106905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.107039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.107163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.107191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.107296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.107438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.107465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.107609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.107717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.107745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.107875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.107990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.108018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.108114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.108221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.108255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.108424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.108573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.108616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.108736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.108865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.108893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.108987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.109113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.109142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.109273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.109407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.109446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.109584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.109701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.109726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.109862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.109963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.109991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.110115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.110266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.110293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.110418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.110520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.110548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.110664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.110771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.110796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.110911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.111027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.111074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.111216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.111306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.111331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.543 qpair failed and we were unable to recover it. 00:27:45.543 [2024-11-29 02:32:49.111458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.543 [2024-11-29 02:32:49.111533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.111558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.111647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.111763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.111788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.111918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.112072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.112100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.112194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.112282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.112323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.112483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.112603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.112628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.112748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.112863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.112888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.113000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.113084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.113112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.113211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.113368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.113404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.113542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.113659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.113686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.113819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.113897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.113922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.114016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.114187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.114216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.114375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.114522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.114548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.114628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.114721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.114746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.114864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.114983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.115009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.115140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.115271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.115296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.115481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.115571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.115596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.115772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.115902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.115932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.116071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.116200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.116225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.116321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.116497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.116526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.116626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.116744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.116771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.116900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.117026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.117056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.117160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.117310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.117345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.117469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.117596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.117622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.117740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.117865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.117894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.118057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.118895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.118928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.119075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.119216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.119242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.119410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.119557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.119582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.119706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.119821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.119849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.120008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.120166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.120194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.544 qpair failed and we were unable to recover it. 00:27:45.544 [2024-11-29 02:32:49.120333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.544 [2024-11-29 02:32:49.120467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.120493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.545 qpair failed and we were unable to recover it. 00:27:45.545 [2024-11-29 02:32:49.120589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.120738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.120764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.545 qpair failed and we were unable to recover it. 00:27:45.545 [2024-11-29 02:32:49.120924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.121050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.121078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.545 qpair failed and we were unable to recover it. 00:27:45.545 [2024-11-29 02:32:49.121177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.121278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.121306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.545 qpair failed and we were unable to recover it. 00:27:45.545 [2024-11-29 02:32:49.121444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.121562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.121587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.545 qpair failed and we were unable to recover it. 00:27:45.545 [2024-11-29 02:32:49.121717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.121815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.121840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.545 qpair failed and we were unable to recover it. 00:27:45.545 [2024-11-29 02:32:49.121962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.122117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.122142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.545 qpair failed and we were unable to recover it. 00:27:45.545 [2024-11-29 02:32:49.122258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.122369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.122402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.545 qpair failed and we were unable to recover it. 00:27:45.545 [2024-11-29 02:32:49.122563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.122672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.122704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.545 qpair failed and we were unable to recover it. 00:27:45.545 [2024-11-29 02:32:49.122875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.123008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.123037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.545 qpair failed and we were unable to recover it. 00:27:45.545 [2024-11-29 02:32:49.123192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.123288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.123322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.545 qpair failed and we were unable to recover it. 00:27:45.545 [2024-11-29 02:32:49.123475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.123567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.123594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.545 qpair failed and we were unable to recover it. 00:27:45.545 [2024-11-29 02:32:49.123726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.123818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.123844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.545 qpair failed and we were unable to recover it. 00:27:45.545 [2024-11-29 02:32:49.123930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.124053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.124079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.545 qpair failed and we were unable to recover it. 00:27:45.545 [2024-11-29 02:32:49.124160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.124332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.124360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.545 qpair failed and we were unable to recover it. 00:27:45.545 [2024-11-29 02:32:49.124485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.124632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.124658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.545 qpair failed and we were unable to recover it. 00:27:45.545 [2024-11-29 02:32:49.124811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.124935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.124960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.545 qpair failed and we were unable to recover it. 00:27:45.545 [2024-11-29 02:32:49.125086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.125245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.125273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.545 qpair failed and we were unable to recover it. 00:27:45.545 [2024-11-29 02:32:49.125428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.125544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.125571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.545 qpair failed and we were unable to recover it. 00:27:45.545 [2024-11-29 02:32:49.125690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.125842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.125870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.545 qpair failed and we were unable to recover it. 00:27:45.545 [2024-11-29 02:32:49.125982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.126080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.126106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.545 qpair failed and we were unable to recover it. 00:27:45.545 [2024-11-29 02:32:49.126198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.126314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.126339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.545 qpair failed and we were unable to recover it. 00:27:45.545 [2024-11-29 02:32:49.126477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.126560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.126586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.545 qpair failed and we were unable to recover it. 00:27:45.545 [2024-11-29 02:32:49.126753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.126879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.126907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.545 qpair failed and we were unable to recover it. 00:27:45.545 [2024-11-29 02:32:49.127047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.127131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.127156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.545 qpair failed and we were unable to recover it. 00:27:45.545 [2024-11-29 02:32:49.127298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.127403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.545 [2024-11-29 02:32:49.127432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.545 qpair failed and we were unable to recover it. 00:27:45.545 [2024-11-29 02:32:49.127577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.127721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.127750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.127886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.128040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.128068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.128180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.128298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.128324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.128477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.128595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.128620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.128741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.128844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.128872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.129017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.129144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.129179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.129344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.129442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.129467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.129583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.129703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.129746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.129847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.129966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.129994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.130149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.130276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.130304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.130448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.130564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.130589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.130725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.130877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.130905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.131015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.131184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.131210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.131333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.131462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.131488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.131631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.131740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.131765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.131907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.132007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.132035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.132163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.132277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.132302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.132454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.132567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.132593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.132682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.132772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.132798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.132933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.133024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.133053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.133197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.133313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.133338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.133490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.133607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.133632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.133721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.133832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.133857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.133999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.134123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.134151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.134252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.134379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.134414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.134548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.134716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.134745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.134888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.134965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.134991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.135090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.135210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.135235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.135343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.135462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.546 [2024-11-29 02:32:49.135488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.546 qpair failed and we were unable to recover it. 00:27:45.546 [2024-11-29 02:32:49.135637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.135783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.135808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.135923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.136049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.136075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.136208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.136340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.136368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.136512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.136620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.136646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.136744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.136861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.136887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.137034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.137149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.137175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.137314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.137425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.137457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.137599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.137723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.137765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.137920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.138055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.138081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.138203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.138346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.138371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.139374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.139548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.139579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.139685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.139830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.139859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.140018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.140153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.140181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.140334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.140449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.140475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.140623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.140717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.140743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.140890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.141029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.141055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.141204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.141290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.141316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.141438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.141587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.141613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.141710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.141823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.141848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.141997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.142089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.142114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.142242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.142375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.142408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.142537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.142657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.142682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.142760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.142849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.142874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.142962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.143084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.143109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.143199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.143343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.143368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.143469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.143612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.143638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.143785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.143929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.143954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.144076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.144241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.144269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.144405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.144523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.144549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.547 qpair failed and we were unable to recover it. 00:27:45.547 [2024-11-29 02:32:49.144669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.547 [2024-11-29 02:32:49.144811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.144836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.144948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.145056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.145082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.145174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.145290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.145316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.145407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.145531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.145557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.145703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.145786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.145811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.145901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.145988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.146014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.146133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.146278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.146303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.146390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.146488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.146513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.146659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.146782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.146807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.146905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.146998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.147022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.147120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.147263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.147288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.147422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.147531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.147557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.147653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.147764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.147790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.147983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.148105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.148131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.148252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.148329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.148354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.148480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.148606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.148631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.148753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.148842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.148869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.148985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.149129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.149155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.149246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.149360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.149389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.149544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.149637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.149663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.149785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.149895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.149920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.150063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.150187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.150213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.150329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.150423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.150450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.150575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.150685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.150710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.150799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.150889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.150916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.151036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.151125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.151169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.151310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.151404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.151429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.151575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.151695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.151721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.151841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.151958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.151988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.548 qpair failed and we were unable to recover it. 00:27:45.548 [2024-11-29 02:32:49.152118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.548 [2024-11-29 02:32:49.152229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.152254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.152404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.152523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.152549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.152666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.152786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.152811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.152958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.153077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.153103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.153214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.153343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.153368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.153520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.153610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.153635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.153751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.153892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.153917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.154015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.154154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.154180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.154300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.154427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.154454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.154573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.154688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.154713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.154846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.154993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.155018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.155147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.155263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.155288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.155375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.155482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.155510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.155650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.155776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.155802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.155945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.156088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.156113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.156236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.156376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.156409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.156552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.156642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.156668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.156759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.156852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.156878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.156993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.157081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.157107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.157257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.157373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.157407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.157539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.157653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.157678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.157759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.157899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.157925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.158011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.158134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.158159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.158288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.158450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.158476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.158599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.158726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.158751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.158895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.159041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.159066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.159189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.159305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.159329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.159425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.159521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.159546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.159640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.159738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.159765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.549 qpair failed and we were unable to recover it. 00:27:45.549 [2024-11-29 02:32:49.159847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.549 [2024-11-29 02:32:49.159931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.159956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.550 qpair failed and we were unable to recover it. 00:27:45.550 [2024-11-29 02:32:49.160076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.160169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.160194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.550 qpair failed and we were unable to recover it. 00:27:45.550 [2024-11-29 02:32:49.160315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.160432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.160458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.550 qpair failed and we were unable to recover it. 00:27:45.550 [2024-11-29 02:32:49.160542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.160635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.160660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.550 qpair failed and we were unable to recover it. 00:27:45.550 [2024-11-29 02:32:49.160769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.160875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.160900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.550 qpair failed and we were unable to recover it. 00:27:45.550 [2024-11-29 02:32:49.161027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.161170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.161195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.550 qpair failed and we were unable to recover it. 00:27:45.550 [2024-11-29 02:32:49.161323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.161472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.161498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.550 qpair failed and we were unable to recover it. 00:27:45.550 [2024-11-29 02:32:49.161611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.161733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.161758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.550 qpair failed and we were unable to recover it. 00:27:45.550 [2024-11-29 02:32:49.161879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.162005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.162031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.550 qpair failed and we were unable to recover it. 00:27:45.550 [2024-11-29 02:32:49.162147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.162260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.162287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.550 qpair failed and we were unable to recover it. 00:27:45.550 [2024-11-29 02:32:49.162388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.162494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.162519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.550 qpair failed and we were unable to recover it. 00:27:45.550 [2024-11-29 02:32:49.162602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.162722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.162752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.550 qpair failed and we were unable to recover it. 00:27:45.550 [2024-11-29 02:32:49.162894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.163009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.163034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.550 qpair failed and we were unable to recover it. 00:27:45.550 [2024-11-29 02:32:49.163157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.163276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.163301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.550 qpair failed and we were unable to recover it. 00:27:45.550 [2024-11-29 02:32:49.163453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.163575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.163602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.550 qpair failed and we were unable to recover it. 00:27:45.550 [2024-11-29 02:32:49.163721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.163861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.163887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.550 qpair failed and we were unable to recover it. 00:27:45.550 [2024-11-29 02:32:49.163979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.164066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.164091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.550 qpair failed and we were unable to recover it. 00:27:45.550 [2024-11-29 02:32:49.164210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.164340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.164366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.550 qpair failed and we were unable to recover it. 00:27:45.550 [2024-11-29 02:32:49.164488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.164571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.164597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.550 qpair failed and we were unable to recover it. 00:27:45.550 [2024-11-29 02:32:49.164718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.164826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.164851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.550 qpair failed and we were unable to recover it. 00:27:45.550 [2024-11-29 02:32:49.164942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.165064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.165089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.550 qpair failed and we were unable to recover it. 00:27:45.550 [2024-11-29 02:32:49.165206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.165351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.165376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.550 qpair failed and we were unable to recover it. 00:27:45.550 [2024-11-29 02:32:49.165511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.165627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.165653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.550 qpair failed and we were unable to recover it. 00:27:45.550 [2024-11-29 02:32:49.165770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.165861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.165887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.550 qpair failed and we were unable to recover it. 00:27:45.550 [2024-11-29 02:32:49.166014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.166134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.166159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.550 qpair failed and we were unable to recover it. 00:27:45.550 [2024-11-29 02:32:49.166244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.166356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.550 [2024-11-29 02:32:49.166382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.830 qpair failed and we were unable to recover it. 00:27:45.830 [2024-11-29 02:32:49.166545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.830 [2024-11-29 02:32:49.166635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.830 [2024-11-29 02:32:49.166661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.830 qpair failed and we were unable to recover it. 00:27:45.830 [2024-11-29 02:32:49.166753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.830 [2024-11-29 02:32:49.166843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.830 [2024-11-29 02:32:49.166868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.830 qpair failed and we were unable to recover it. 00:27:45.830 [2024-11-29 02:32:49.166986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.167097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.167122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.167212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.167329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.167354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.167512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.167635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.167661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.167761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.167857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.167884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.167990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.168080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.168107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.168196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.168342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.168367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.168505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.168595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.168620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.168712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.168829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.168854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.168946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.169031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.169056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.169141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.169250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.169276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.169425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.169543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.169568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.169691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.169831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.169857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.169946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.170032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.170057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.170170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.170258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.170284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.170413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.170518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.170544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.170670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.170830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.170856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.170979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.171125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.171151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.171290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.171403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.171430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.171529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.171676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.171701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.171842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.172052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.172080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.172257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.172365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.172390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.172549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.172642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.172668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.172818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.172946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.172971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.173056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.173168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.173194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.173278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.173427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.173453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.173570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.173692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.173718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.173832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.173921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.173946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.174069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.174154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.831 [2024-11-29 02:32:49.174179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.831 qpair failed and we were unable to recover it. 00:27:45.831 [2024-11-29 02:32:49.174301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.174442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.174469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.174563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.174661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.174686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.174810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.174932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.174957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.175051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.175155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.175182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.175348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.175487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.175513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.175634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.175802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.175830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.175958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.176068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.176098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.176205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.176331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.176356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.176459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.176561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.176590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.176703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.176866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.176892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.177038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.177129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.177157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.177312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.177408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.177450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.177543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.177655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.177683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.177812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.177938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.177967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.178075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.178248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.178277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.178442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.178555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.178580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.178724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.178851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.178879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.179056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.179184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.179212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.179336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.179464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.179490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.179621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.179759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.179787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.179894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.179998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.180027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.180200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.180337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.180364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.180521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.180597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.180623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.180723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.180830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.180871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.181029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.181123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.181151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.181276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.181367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.181417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.181513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.181634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.181660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.181806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.181930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.181957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.182084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.182242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.832 [2024-11-29 02:32:49.182270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.832 qpair failed and we were unable to recover it. 00:27:45.832 [2024-11-29 02:32:49.182405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.182517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.182543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.182681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.182831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.182873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.182970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.183098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.183126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.183214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.183303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.183331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.183458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.183553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.183578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.183662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.183806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.183831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.183988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.184078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.184106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.184271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.184369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.184404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.184514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.184664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.184708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.184880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.185004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.185033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.185156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.185312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.185341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.185484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.185581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.185606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.185730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.185847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.185873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.185965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.186125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.186153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.186255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.186415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.186458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.186552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.186636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.186661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.186804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.186934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.186961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.187086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.187178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.187205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.187327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.187465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.187496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.187591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.187754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.187782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.187935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.188097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.188125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.188239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.188341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.188383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.188508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.188633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.188658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.188754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.188883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.188910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.189067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.189186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.189214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.189377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.189483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.189509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.189637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.189779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.189807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.189960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.190053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.190082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.190216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.190339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.833 [2024-11-29 02:32:49.190372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.833 qpair failed and we were unable to recover it. 00:27:45.833 [2024-11-29 02:32:49.190527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.190625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.190650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.190747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.190860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.190888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.190988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.191127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.191168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.191265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.191352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.191380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.191532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.191641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.191666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.191794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.191917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.191944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.192071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.192157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.192185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.192294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.192423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.192465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.192564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.192654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.192680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.192797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.192957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.192985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.193122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.193226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.193254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.193359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.193512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.193538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.193633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.193754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.193779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.193920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.194005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.194031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.194142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.194274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.194302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.194435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.194548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.194573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.194664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.194749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.194774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.194860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.194947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.194973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.195119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.195234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.195260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.195384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.195502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.195528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.195650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.195763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.195793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.195947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.196103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.196151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.196251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.196525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.196555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.196658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.196772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.196803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.196973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.197100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.197129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.197266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.197453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.197503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.197625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.197852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.197880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.197986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.198135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.198166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.198287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.198410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.834 [2024-11-29 02:32:49.198449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.834 qpair failed and we were unable to recover it. 00:27:45.834 [2024-11-29 02:32:49.198557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.198678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.198710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.835 qpair failed and we were unable to recover it. 00:27:45.835 [2024-11-29 02:32:49.198877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.199003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.199042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:45.835 qpair failed and we were unable to recover it. 00:27:45.835 [2024-11-29 02:32:49.199242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.199381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.199426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:45.835 qpair failed and we were unable to recover it. 00:27:45.835 [2024-11-29 02:32:49.199559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.199700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.199736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:45.835 qpair failed and we were unable to recover it. 00:27:45.835 [2024-11-29 02:32:49.199907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.200065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.200119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:45.835 qpair failed and we were unable to recover it. 00:27:45.835 [2024-11-29 02:32:49.200239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.200375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.200433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:45.835 qpair failed and we were unable to recover it. 00:27:45.835 [2024-11-29 02:32:49.200601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.200782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.200821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:45.835 qpair failed and we were unable to recover it. 00:27:45.835 [2024-11-29 02:32:49.200975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.201202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.201241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:45.835 qpair failed and we were unable to recover it. 00:27:45.835 [2024-11-29 02:32:49.201405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.201535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.201563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:45.835 qpair failed and we were unable to recover it. 00:27:45.835 [2024-11-29 02:32:49.201702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.201805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.201833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:45.835 qpair failed and we were unable to recover it. 00:27:45.835 [2024-11-29 02:32:49.201977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.202116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.202145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:45.835 qpair failed and we were unable to recover it. 00:27:45.835 [2024-11-29 02:32:49.202250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.202388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.202443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:45.835 qpair failed and we were unable to recover it. 00:27:45.835 [2024-11-29 02:32:49.202592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.202824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.202863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:45.835 qpair failed and we were unable to recover it. 00:27:45.835 [2024-11-29 02:32:49.203051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.203204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.203236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.835 qpair failed and we were unable to recover it. 00:27:45.835 [2024-11-29 02:32:49.203365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.203522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.203569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.835 qpair failed and we were unable to recover it. 00:27:45.835 [2024-11-29 02:32:49.203700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.203832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.203885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.835 qpair failed and we were unable to recover it. 00:27:45.835 [2024-11-29 02:32:49.203989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.204093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.204120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.835 qpair failed and we were unable to recover it. 00:27:45.835 [2024-11-29 02:32:49.204243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.204360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.204387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.835 qpair failed and we were unable to recover it. 00:27:45.835 [2024-11-29 02:32:49.204510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.204629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.204658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.835 qpair failed and we were unable to recover it. 00:27:45.835 [2024-11-29 02:32:49.204806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.204911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.204947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.835 qpair failed and we were unable to recover it. 00:27:45.835 [2024-11-29 02:32:49.205075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.205198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.205227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.835 qpair failed and we were unable to recover it. 00:27:45.835 [2024-11-29 02:32:49.205328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.205458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.205504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.835 qpair failed and we were unable to recover it. 00:27:45.835 [2024-11-29 02:32:49.205604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.205727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.205756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.835 qpair failed and we were unable to recover it. 00:27:45.835 [2024-11-29 02:32:49.205884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.205989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.206017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.835 qpair failed and we were unable to recover it. 00:27:45.835 [2024-11-29 02:32:49.206125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.835 [2024-11-29 02:32:49.206241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.206271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.206374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.206498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.206525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.206626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.206759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.206793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.206943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.207048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.207077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.207173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.207284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.207310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.207403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.207493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.207518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.207666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.207793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.207821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.207924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.208031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.208072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.208153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.208244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.208270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.208369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.208489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.208518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.208656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.208755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.208783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.208916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.209043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.209072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.209177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.209324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.209349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.209446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.209532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.209557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.209706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.209793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.209836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.209932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.210055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.210083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.210199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.210315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.210340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.210433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.210557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.210591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.210724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.210831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.210861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.210984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.211112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.211140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.211274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.211369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.211402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.211490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.211613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.211638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.211738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.211833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.211858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.211993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.212112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.212139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.212288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.212409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.212435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.212560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.212645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.212672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.212765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.212856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.212881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.213035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.213192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.213220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.213358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.213457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.213483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.836 qpair failed and we were unable to recover it. 00:27:45.836 [2024-11-29 02:32:49.213610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.836 [2024-11-29 02:32:49.213695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.213720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.213832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.213914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.213940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.214079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.214178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.214205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.214343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.214490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.214515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.214599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.214723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.214749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.214869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.214983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.215008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.215094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.215205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.215230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.215318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.215404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.215430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.215521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.215609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.215635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.215727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.215853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.215878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.215997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.216116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.216141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.216232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.216343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.216367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.216485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.216613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.216639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.216743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.216825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.216850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.216928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.217015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.217040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.217122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.217206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.217231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.217308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.217419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.217445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.217544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.217626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.217652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.217738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.217853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.217878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.217991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.218103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.218128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.218220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.218367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.218406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.218534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.218650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.218675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.218761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.218850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.218874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.218995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.219110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.219135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.219224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.219343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.219367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.219469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.219562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.219588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.219706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.219823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.219849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.219942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.220045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.220070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.220153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.220269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.220294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.837 qpair failed and we were unable to recover it. 00:27:45.837 [2024-11-29 02:32:49.220416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.837 [2024-11-29 02:32:49.220532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.220562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.220648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.220779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.220803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.220912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.221004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.221029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.221117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.221209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.221234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.221388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.221523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.221549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.221670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.221782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.221808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.221923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.222009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.222035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.222116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.222275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.222300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.222390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.222515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.222540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.222623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.222712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.222736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.222837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.222978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.223003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.223130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.223216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.223241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.223335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.223419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.223444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.223563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.223678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.223703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.223789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.223880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.223905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.224004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.224086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.224112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.224210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.224330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.224356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.224449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.224570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.224594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.224691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.224782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.224807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.224917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.225030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.225055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.225176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.225301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.225327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.225423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.225502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.225527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.225645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.225763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.225788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.225870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.225953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.225979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.226080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.226168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.226194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.226306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.226416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.226442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.226559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.226646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.226670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.226792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.226914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.226940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.227031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.227144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.227168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.838 qpair failed and we were unable to recover it. 00:27:45.838 [2024-11-29 02:32:49.227262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.838 [2024-11-29 02:32:49.227347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.227372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.227499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.227585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.227611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.227704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.227798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.227823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.227967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.228076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.228102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.228188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.228311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.228336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.228434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.228525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.228551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.228638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.228754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.228779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.228872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.228964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.228989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.229106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.229196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.229221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.229310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.229465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.229490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.229604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.229729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.229753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.229841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.229952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.229976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.230091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.230210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.230236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.230327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.230446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.230472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.230562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.230652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.230677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.230802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.230897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.230922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.231040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.231128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.231153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.231265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.231362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.231387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.231508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.231596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.231621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.231744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.231847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.231871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.231990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.232082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.232106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.232220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.232365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.232390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.232494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.232589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.232617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.232710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.232801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.232825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.232918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.232999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.233025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.233113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.233197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.233221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.233317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.233455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.233480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.233578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.233686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.233711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.839 qpair failed and we were unable to recover it. 00:27:45.839 [2024-11-29 02:32:49.233796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.233910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.839 [2024-11-29 02:32:49.233934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.840 qpair failed and we were unable to recover it. 00:27:45.840 [2024-11-29 02:32:49.234078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.234160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.234184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.840 qpair failed and we were unable to recover it. 00:27:45.840 [2024-11-29 02:32:49.234279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.234366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.234391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.840 qpair failed and we were unable to recover it. 00:27:45.840 [2024-11-29 02:32:49.234529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.234609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.234633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.840 qpair failed and we were unable to recover it. 00:27:45.840 [2024-11-29 02:32:49.234752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.234845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.234869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.840 qpair failed and we were unable to recover it. 00:27:45.840 [2024-11-29 02:32:49.234958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.235050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.235076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.840 qpair failed and we were unable to recover it. 00:27:45.840 [2024-11-29 02:32:49.235164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.235254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.235278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.840 qpair failed and we were unable to recover it. 00:27:45.840 [2024-11-29 02:32:49.235405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.235495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.235519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.840 qpair failed and we were unable to recover it. 00:27:45.840 [2024-11-29 02:32:49.235619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.235712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.235737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.840 qpair failed and we were unable to recover it. 00:27:45.840 [2024-11-29 02:32:49.235833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.235924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.235950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.840 qpair failed and we were unable to recover it. 00:27:45.840 [2024-11-29 02:32:49.236042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.236152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.236176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.840 qpair failed and we were unable to recover it. 00:27:45.840 [2024-11-29 02:32:49.236271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.236364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.236389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.840 qpair failed and we were unable to recover it. 00:27:45.840 [2024-11-29 02:32:49.236517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.236599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.236624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.840 qpair failed and we were unable to recover it. 00:27:45.840 [2024-11-29 02:32:49.236739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.236832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.236857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.840 qpair failed and we were unable to recover it. 00:27:45.840 [2024-11-29 02:32:49.236973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.237114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.237139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.840 qpair failed and we were unable to recover it. 00:27:45.840 [2024-11-29 02:32:49.237233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.237379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.237411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.840 qpair failed and we were unable to recover it. 00:27:45.840 [2024-11-29 02:32:49.237529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.237646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.237671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.840 qpair failed and we were unable to recover it. 00:27:45.840 [2024-11-29 02:32:49.237770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.237886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.237910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.840 qpair failed and we were unable to recover it. 00:27:45.840 [2024-11-29 02:32:49.238037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.238178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.238202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.840 qpair failed and we were unable to recover it. 00:27:45.840 [2024-11-29 02:32:49.238322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.238449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.238474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.840 qpair failed and we were unable to recover it. 00:27:45.840 [2024-11-29 02:32:49.238563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.238675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.238699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.840 qpair failed and we were unable to recover it. 00:27:45.840 [2024-11-29 02:32:49.238828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.238918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.238943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.840 qpair failed and we were unable to recover it. 00:27:45.840 [2024-11-29 02:32:49.239064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.239155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.239179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.840 qpair failed and we were unable to recover it. 00:27:45.840 [2024-11-29 02:32:49.239304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.239407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.239433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.840 qpair failed and we were unable to recover it. 00:27:45.840 [2024-11-29 02:32:49.239529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.239622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.239647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.840 qpair failed and we were unable to recover it. 00:27:45.840 [2024-11-29 02:32:49.239751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.239849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.239875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.840 qpair failed and we were unable to recover it. 00:27:45.840 [2024-11-29 02:32:49.239976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.840 [2024-11-29 02:32:49.240055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.240080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.240194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.240334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.240360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.240456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.240543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.240568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.240664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.240762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.240787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.240904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.240990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.241017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.241111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.241234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.241259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.241345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.241442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.241467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.241566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.241674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.241698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.241810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.241898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.241923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.242015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.242107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.242133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.242214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.242331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.242355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.242468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.242557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.242583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.242704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.242851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.242875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.242972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.243064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.243090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.243187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.243305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.243329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.243444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.243563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.243588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.243670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.243787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.243812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.243955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.244038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.244062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.244185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.244279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.244303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.244398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.244487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.244515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.244611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.244703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.244727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.244818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.244942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.244966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.245082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.245200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.245225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.245319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.245405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.245430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.245529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.245616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.245642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.245766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.245884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.245909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.246032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.246117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.246144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.246259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.246368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.246413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.841 qpair failed and we were unable to recover it. 00:27:45.841 [2024-11-29 02:32:49.246535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.246680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.841 [2024-11-29 02:32:49.246705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.246826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.246975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.247001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.247095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.247211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.247236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.247357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.247450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.247477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.247592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.247680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.247706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.247824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.247921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.247946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.248038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.248151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.248175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.248313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.248439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.248465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.248553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.248643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.248668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.248763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.248855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.248880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.248992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.249094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.249118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.249226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.249368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.249399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.249521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.249637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.249662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.249783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.249869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.249893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.250013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.250157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.250181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.250276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.250369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.250400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.250494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.250577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.250601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.250694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.250838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.250863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.250955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.251071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.251095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.251195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.251286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.251311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.251409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.251498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.251522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.251638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.251719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.251744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.251827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.251909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.251934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.252021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.252128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.252153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.252244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.252320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.252344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.252457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.252543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.252568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.252659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.252744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.252769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.252885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.253001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.253026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.253136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.253241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.253265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.842 qpair failed and we were unable to recover it. 00:27:45.842 [2024-11-29 02:32:49.253411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.842 [2024-11-29 02:32:49.253538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.253564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.253655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.253745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.253770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.253889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.254006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.254031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.254119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.254263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.254293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.254383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.254479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.254506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.254628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.254718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.254743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.254836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.254918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.254942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.255081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.255172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.255197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.255327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.255441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.255467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.255554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.255697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.255722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.255835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.255919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.255944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.256030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.256148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.256172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.256267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.256348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.256373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.256510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.256613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.256646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.256805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.256970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.257016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.257192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.257315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.257346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.257464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.257556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.257583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.257707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.257798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.257829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.257979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.258130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.258157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.258311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.258409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.258440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.258599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.258737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.258785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.258921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.259058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.259085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.259178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.259307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.259337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.259465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.259599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.259629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.259758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.259857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.259884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.260012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.260099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.260129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.260249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.260373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.260409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.260563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.260709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.260737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.260870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.260985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.261016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.843 qpair failed and we were unable to recover it. 00:27:45.843 [2024-11-29 02:32:49.261132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.843 [2024-11-29 02:32:49.261264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.261292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.844 qpair failed and we were unable to recover it. 00:27:45.844 [2024-11-29 02:32:49.261421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.261554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.261586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.844 qpair failed and we were unable to recover it. 00:27:45.844 [2024-11-29 02:32:49.261712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.261814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.261841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.844 qpair failed and we were unable to recover it. 00:27:45.844 [2024-11-29 02:32:49.261970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.262091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.262117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:45.844 qpair failed and we were unable to recover it. 00:27:45.844 [2024-11-29 02:32:49.262246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.262337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.262362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.844 qpair failed and we were unable to recover it. 00:27:45.844 [2024-11-29 02:32:49.262503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.262617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.262645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.844 qpair failed and we were unable to recover it. 00:27:45.844 [2024-11-29 02:32:49.262749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.262881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.262909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.844 qpair failed and we were unable to recover it. 00:27:45.844 [2024-11-29 02:32:49.263046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.263149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.263177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.844 qpair failed and we were unable to recover it. 00:27:45.844 [2024-11-29 02:32:49.263318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.263458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.263487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.844 qpair failed and we were unable to recover it. 00:27:45.844 [2024-11-29 02:32:49.263594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.263717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.263744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.844 qpair failed and we were unable to recover it. 00:27:45.844 [2024-11-29 02:32:49.263847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.263948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.263976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.844 qpair failed and we were unable to recover it. 00:27:45.844 [2024-11-29 02:32:49.264113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.264244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.264272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.844 qpair failed and we were unable to recover it. 00:27:45.844 [2024-11-29 02:32:49.264382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.264503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.264528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.844 qpair failed and we were unable to recover it. 00:27:45.844 [2024-11-29 02:32:49.264647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.264747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.264775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.844 qpair failed and we were unable to recover it. 00:27:45.844 [2024-11-29 02:32:49.264935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.265060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.265088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.844 qpair failed and we were unable to recover it. 00:27:45.844 [2024-11-29 02:32:49.265227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.265365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.265390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.844 qpair failed and we were unable to recover it. 00:27:45.844 [2024-11-29 02:32:49.265519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.265645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.265673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.844 qpair failed and we were unable to recover it. 00:27:45.844 [2024-11-29 02:32:49.265778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.265906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.265934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.844 qpair failed and we were unable to recover it. 00:27:45.844 [2024-11-29 02:32:49.266090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.266188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.266216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.844 qpair failed and we were unable to recover it. 00:27:45.844 [2024-11-29 02:32:49.266335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.266460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.266486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.844 qpair failed and we were unable to recover it. 00:27:45.844 [2024-11-29 02:32:49.266596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.266719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.266746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.844 qpair failed and we were unable to recover it. 00:27:45.844 [2024-11-29 02:32:49.266878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.266983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.267011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.844 qpair failed and we were unable to recover it. 00:27:45.844 [2024-11-29 02:32:49.267134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.267263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.267292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.844 qpair failed and we were unable to recover it. 00:27:45.844 [2024-11-29 02:32:49.267402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.267538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.267563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.844 qpair failed and we were unable to recover it. 00:27:45.844 [2024-11-29 02:32:49.267697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.267821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.267849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.844 qpair failed and we were unable to recover it. 00:27:45.844 [2024-11-29 02:32:49.267978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.268082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.844 [2024-11-29 02:32:49.268110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.844 qpair failed and we were unable to recover it. 00:27:45.844 [2024-11-29 02:32:49.268253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.268341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.268366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.268487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.268618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.268647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.268746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.268870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.268897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.269019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.269149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.269177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.269303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.269438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.269464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.269574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.269685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.269710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.269818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.269944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.269971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.270079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.270207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.270235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.270335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.270447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.270473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.270574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.270670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.270701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.270848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.270946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.270973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.271082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.271209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.271236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.271342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.271455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.271480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.271615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.271745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.271772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.271897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.272006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.272033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.272125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.272282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.272310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.272412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.272525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.272550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.272693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.272816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.272843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.272968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.273095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.273123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.273252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.273377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.273412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.273556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.273645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.273671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.273788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.273907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.273935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.274100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.274205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.274234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.274370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.274486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.274513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.274659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.274759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.274783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.274908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.274987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.275012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.275091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.275172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.275197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.275311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.275428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.275453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.275545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.275684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.845 [2024-11-29 02:32:49.275708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.845 qpair failed and we were unable to recover it. 00:27:45.845 [2024-11-29 02:32:49.275806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.275896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.275921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.276045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.276158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.276182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.276275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.276364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.276390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.276479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.276567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.276591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.276716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.276834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.276860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.276979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.277072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.277096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.277182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.277271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.277296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.277375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.277494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.277518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.277608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.277689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.277714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.277856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.277939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.277964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.278084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.278195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.278220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.278313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.278418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.278443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.278538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.278623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.278650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.278764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.278908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.278933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.279020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.279133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.279158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.279257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.279338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.279362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.279464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.279576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.279600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.279687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.279807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.279831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.279960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.280045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.280070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.280188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.280273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.280297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.280384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.280480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.280507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.280632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.280715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.280740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.280861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.280970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.280995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.281109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.281200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.281224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.281371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.281502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.281527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.281676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.281791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.281817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.281908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.281995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.282021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.282117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.282258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.282282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.282378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.282494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.846 [2024-11-29 02:32:49.282520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.846 qpair failed and we were unable to recover it. 00:27:45.846 [2024-11-29 02:32:49.282602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.282716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.282740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.282860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.282943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.282968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.283085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.283201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.283231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.283381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.283500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.283525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.283641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.283737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.283761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.283905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.284017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.284041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.284161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.284277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.284301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.284418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.284528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.284553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.284651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.284728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.284753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.284845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.284958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.284982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.285128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.285247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.285272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.285397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.285497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.285522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.285667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.285779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.285803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.285926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.286042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.286067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.286152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.286244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.286268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.286358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.286477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.286502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.286643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.286761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.286785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.286901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.286986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.287010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.287129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.287242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.287267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.287386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.287483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.287508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.287625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.287735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.287760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.287881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.287969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.287994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.288108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.288219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.288244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.288370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.288472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.288499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.288615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.288757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.288782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.288878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.288998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.289023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.289110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.289227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.289253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.289374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.289535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.289561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.289657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.289799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.289824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.847 qpair failed and we were unable to recover it. 00:27:45.847 [2024-11-29 02:32:49.289910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.847 [2024-11-29 02:32:49.290053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.290078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.290155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.290271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.290296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.290423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.290545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.290571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.290656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.290756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.290780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.290900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.290997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.291023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.291136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.291288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.291312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.291413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.291496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.291521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.291645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.291757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.291781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.291872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.291985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.292009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.292129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.292215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.292239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.292367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.292487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.292512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.292608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.292699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.292723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.292814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.292904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.292928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.293049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.293139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.293165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.293289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.293412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.293437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.293555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.293650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.293675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.293760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.293854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.293878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.293971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.294061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.294085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.294219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.294306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.294330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.294420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.294538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.294562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.294658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.294749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.294773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.294892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.295002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.295027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.295115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.295194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.295218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.295306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.295404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.295430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.295547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.295667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.295696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.295811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.295922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.295947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.296061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.296209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.296234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.296319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.296408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.296434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.296579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.296672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.296696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.848 qpair failed and we were unable to recover it. 00:27:45.848 [2024-11-29 02:32:49.296785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.848 [2024-11-29 02:32:49.296903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.296929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.849 qpair failed and we were unable to recover it. 00:27:45.849 [2024-11-29 02:32:49.297027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.297108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.297133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.849 qpair failed and we were unable to recover it. 00:27:45.849 [2024-11-29 02:32:49.297221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.297364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.297389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.849 qpair failed and we were unable to recover it. 00:27:45.849 [2024-11-29 02:32:49.297498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.297588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.297613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.849 qpair failed and we were unable to recover it. 00:27:45.849 [2024-11-29 02:32:49.297702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.297791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.297815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.849 qpair failed and we were unable to recover it. 00:27:45.849 [2024-11-29 02:32:49.297906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.298050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.298074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.849 qpair failed and we were unable to recover it. 00:27:45.849 [2024-11-29 02:32:49.298195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.298281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.298305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.849 qpair failed and we were unable to recover it. 00:27:45.849 [2024-11-29 02:32:49.298422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.298534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.298558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.849 qpair failed and we were unable to recover it. 00:27:45.849 [2024-11-29 02:32:49.298687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.298796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.298820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.849 qpair failed and we were unable to recover it. 00:27:45.849 [2024-11-29 02:32:49.298939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.299022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.299046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.849 qpair failed and we were unable to recover it. 00:27:45.849 [2024-11-29 02:32:49.299165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.299286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.299311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.849 qpair failed and we were unable to recover it. 00:27:45.849 [2024-11-29 02:32:49.299405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.299529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.299554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.849 qpair failed and we were unable to recover it. 00:27:45.849 [2024-11-29 02:32:49.299641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.299748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.299772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.849 qpair failed and we were unable to recover it. 00:27:45.849 [2024-11-29 02:32:49.299897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.300008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.300033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.849 qpair failed and we were unable to recover it. 00:27:45.849 [2024-11-29 02:32:49.300125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.300211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.300236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.849 qpair failed and we were unable to recover it. 00:27:45.849 [2024-11-29 02:32:49.300348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.300461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.300486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.849 qpair failed and we were unable to recover it. 00:27:45.849 [2024-11-29 02:32:49.300595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.300711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.300735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.849 qpair failed and we were unable to recover it. 00:27:45.849 [2024-11-29 02:32:49.300823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.300906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.300931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.849 qpair failed and we were unable to recover it. 00:27:45.849 [2024-11-29 02:32:49.301049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.301161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.301186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.849 qpair failed and we were unable to recover it. 00:27:45.849 [2024-11-29 02:32:49.301301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.301387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.301417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.849 qpair failed and we were unable to recover it. 00:27:45.849 [2024-11-29 02:32:49.301529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.301655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.301679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.849 qpair failed and we were unable to recover it. 00:27:45.849 [2024-11-29 02:32:49.301794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.301880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.301904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.849 qpair failed and we were unable to recover it. 00:27:45.849 [2024-11-29 02:32:49.302029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.302147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.302170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.849 qpair failed and we were unable to recover it. 00:27:45.849 [2024-11-29 02:32:49.302258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.302366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.302413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.849 qpair failed and we were unable to recover it. 00:27:45.849 [2024-11-29 02:32:49.302546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.302689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.302713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.849 qpair failed and we were unable to recover it. 00:27:45.849 [2024-11-29 02:32:49.302836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.302929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.302953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.849 qpair failed and we were unable to recover it. 00:27:45.849 [2024-11-29 02:32:49.303095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.849 [2024-11-29 02:32:49.303181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.303206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.303297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.303416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.303441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.303535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.303618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.303642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.303763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.303878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.303904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.304024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.304170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.304196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.304293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.304406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.304440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.304538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.304625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.304650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.304777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.304894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.304920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.305038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.305154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.305181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.305298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.305398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.305424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.305512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.305602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.305631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.305780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.305873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.305898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.306020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.306103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.306128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.306243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.306332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.306357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.306468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.306611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.306637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.306729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.306820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.306845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.306932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.307024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.307050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.307195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.307278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.307303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.307391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.307519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.307543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.307633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.307729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.307754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.307876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.308003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.308028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.308133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.308226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.308251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.308339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.308434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.308460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.308546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.308690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.308715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.308816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.308901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.308925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.309018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.309103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.309128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.309244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.309358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.309383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.309543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.309651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.309675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.309759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.309870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.309894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.850 qpair failed and we were unable to recover it. 00:27:45.850 [2024-11-29 02:32:49.309984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.850 [2024-11-29 02:32:49.310066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.310090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.310183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.310279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.310305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.310444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.310583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.310608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.310723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.310815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.310840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.310958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.311100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.311125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.311238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.311329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.311353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.311456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.311549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.311574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.311668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.311754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.311779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.311873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.312005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.312030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.312124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.312214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.312240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.312366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.312460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.312485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.312566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.312653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.312679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.312769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.312850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.312874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.312973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.313065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.313090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.313192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.313332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.313357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.313479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.313595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.313619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.313708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.313832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.313857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.313957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.314071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.314097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.314193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.314332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.314357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.314455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.314551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.314575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.314661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.314801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.314826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.314922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.315009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.315033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.315139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.315224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.315249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.315336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.315452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.315477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.315566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.315677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.315703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.315804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.315946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.315971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.316089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.316178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.316203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.316317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.316423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.316449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.316564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.316650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.316675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.851 qpair failed and we were unable to recover it. 00:27:45.851 [2024-11-29 02:32:49.316797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.851 [2024-11-29 02:32:49.316883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.316907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.316997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.317137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.317162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.317259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.317353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.317378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.317473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.317588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.317616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.317738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.317829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.317853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.317950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.318033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.318058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.318199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.318287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.318313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.318412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.318525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.318550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.318635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.318761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.318786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.318882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.319020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.319044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.319161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.319248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.319272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.319357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.319447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.319472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.319590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.319679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.319703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.319817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.319929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.319953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.320044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.320155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.320179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.320301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.320421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.320447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.320552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.320647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.320672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.320771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.320860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.320884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.321001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.321089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.321113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.321196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.321319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.321343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.321438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.321524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.321548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.321670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.321759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.321784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.321892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.321982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.322006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.322121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.322213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.322237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.322361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.322488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.322514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.322609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.322729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.322755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.322875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.322961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.322986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.323076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.323189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.323214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.323304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.323384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.323415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.852 qpair failed and we were unable to recover it. 00:27:45.852 [2024-11-29 02:32:49.323511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.852 [2024-11-29 02:32:49.323595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.323621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.853 qpair failed and we were unable to recover it. 00:27:45.853 [2024-11-29 02:32:49.323702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.323816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.323841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.853 qpair failed and we were unable to recover it. 00:27:45.853 [2024-11-29 02:32:49.323924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.324036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.324060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.853 qpair failed and we were unable to recover it. 00:27:45.853 [2024-11-29 02:32:49.324174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.324257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.324281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.853 qpair failed and we were unable to recover it. 00:27:45.853 [2024-11-29 02:32:49.324382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.324497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.324522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.853 qpair failed and we were unable to recover it. 00:27:45.853 [2024-11-29 02:32:49.324665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.324759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.324784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.853 qpair failed and we were unable to recover it. 00:27:45.853 [2024-11-29 02:32:49.324900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.324989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.325014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.853 qpair failed and we were unable to recover it. 00:27:45.853 [2024-11-29 02:32:49.325112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.325230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.325254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.853 qpair failed and we were unable to recover it. 00:27:45.853 [2024-11-29 02:32:49.325352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.325449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.325474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.853 qpair failed and we were unable to recover it. 00:27:45.853 [2024-11-29 02:32:49.325561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.325649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.325674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.853 qpair failed and we were unable to recover it. 00:27:45.853 [2024-11-29 02:32:49.325766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.325848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.325873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.853 qpair failed and we were unable to recover it. 00:27:45.853 [2024-11-29 02:32:49.325985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.326098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.326122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.853 qpair failed and we were unable to recover it. 00:27:45.853 [2024-11-29 02:32:49.326214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.326329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.326354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.853 qpair failed and we were unable to recover it. 00:27:45.853 [2024-11-29 02:32:49.326452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.326571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.326597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.853 qpair failed and we were unable to recover it. 00:27:45.853 [2024-11-29 02:32:49.326693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.326817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.326843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.853 qpair failed and we were unable to recover it. 00:27:45.853 [2024-11-29 02:32:49.326989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.327111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.327136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.853 qpair failed and we were unable to recover it. 00:27:45.853 [2024-11-29 02:32:49.327252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.327368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.327400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.853 qpair failed and we were unable to recover it. 00:27:45.853 [2024-11-29 02:32:49.327497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.327589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.327615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.853 qpair failed and we were unable to recover it. 00:27:45.853 [2024-11-29 02:32:49.327704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.327805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.327831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.853 qpair failed and we were unable to recover it. 00:27:45.853 [2024-11-29 02:32:49.327950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.328065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.328090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.853 qpair failed and we were unable to recover it. 00:27:45.853 [2024-11-29 02:32:49.328188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.328306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.328331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.853 qpair failed and we were unable to recover it. 00:27:45.853 [2024-11-29 02:32:49.328473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.328558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.328584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.853 qpair failed and we were unable to recover it. 00:27:45.853 [2024-11-29 02:32:49.328710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.328862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.328887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.853 qpair failed and we were unable to recover it. 00:27:45.853 [2024-11-29 02:32:49.329031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.329115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.329141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.853 qpair failed and we were unable to recover it. 00:27:45.853 [2024-11-29 02:32:49.329289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.329404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.329429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.853 qpair failed and we were unable to recover it. 00:27:45.853 [2024-11-29 02:32:49.329514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.329601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.853 [2024-11-29 02:32:49.329630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.329716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.329834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.329859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.329953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.330074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.330098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.330194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.330277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.330301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.330413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.330499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.330524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.330608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.330686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.330712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.330832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.330926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.330951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.331041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.331156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.331181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.331297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.331407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.331432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.331548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.331669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.331693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.331810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.331927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.331951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.332076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.332216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.332241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.332390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.332488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.332513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.332611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.332701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.332725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.332814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.332928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.332953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.333074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.333164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.333189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.333274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.333400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.333426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.333545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.333625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.333650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.333743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.333833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.333857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.333984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.334103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.334128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.334249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.334337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.334362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.334465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.334555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.334580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.334700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.334822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.334847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.334941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.335054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.335080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.335197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.335286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.335311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.335404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.335487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.335511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.335628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.335722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.335748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.335874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.335955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.335979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.336096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.336183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.336208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.854 qpair failed and we were unable to recover it. 00:27:45.854 [2024-11-29 02:32:49.336303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.336421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.854 [2024-11-29 02:32:49.336446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.336563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.336705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.336730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.336817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.336913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.336939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.337068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.337164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.337189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.337282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.337373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.337405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.337555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.337641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.337673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.337812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.337914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.337941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.338067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.338188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.338215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.338314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.338404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.338433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.338518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.338614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.338641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.338791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.338934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.338964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.339098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.339238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.339265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.339387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.339489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.339520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.339616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.339739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.339764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.339912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.340036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.340061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.340211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.340292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.340317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.340440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.340558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.340584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.340727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.340844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.340870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.340988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.341103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.341128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.341244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.341334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.341360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.341479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.341565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.341590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.341707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.341796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.341821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.341907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.341991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.342023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.342115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.342199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.342224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.342304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.342397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.342424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.342519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.342631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.342657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.342777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.342920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.342946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.343044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.343130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.343156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.343269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.343399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.343426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.855 qpair failed and we were unable to recover it. 00:27:45.855 [2024-11-29 02:32:49.343525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.855 [2024-11-29 02:32:49.343641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.343666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.343788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.343873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.343899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.344018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.344139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.344165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.344258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.344345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.344376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.344528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.344620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.344646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.344738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.344853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.344879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.345030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.345155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.345180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.345272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.345368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.345402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.345528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.345651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.345677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.345768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.345882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.345907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.346006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.346119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.346144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.346271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.346389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.346423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.346519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.346635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.346660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.346744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.346863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.346893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.347011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.347102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.347127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.347238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.347329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.347354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.347476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.347617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.347642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.347744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.347861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.347888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.347985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.348099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.348126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.348229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.348349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.348374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.348471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.348559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.348584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.348702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.348789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.348814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.348934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.349018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.349044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.349133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.349252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.349277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.349366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.349454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.349480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.349570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.349712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.349738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.349855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.349967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.349992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.350081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.350197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.350223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.350341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.350433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.856 [2024-11-29 02:32:49.350460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.856 qpair failed and we were unable to recover it. 00:27:45.856 [2024-11-29 02:32:49.350577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.350689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.350714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.350801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.350919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.350944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.351085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.351206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.351231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.351314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.351408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.351434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.351521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.351639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.351665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.351790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.351905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.351930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.352021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.352106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.352132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.352248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.352339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.352365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.352453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.352571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.352596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.352696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.352803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.352828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.352914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.352995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.353021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.353109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.353233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.353259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.353370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.353486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.353512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.353630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.353717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.353743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.353864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.353975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.354000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.354090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.354184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.354210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.354328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.354441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.354467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.354557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.354701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.354726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.354837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.354953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.354979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.355092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.355233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.355259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.355349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.355440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.355467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.355586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.355665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.355691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.355812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.355897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.355923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.356009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.356096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.356121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.356217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.356330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.356356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.356488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.356579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.356604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.356702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.356796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.356821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.356943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.357034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.357060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.857 qpair failed and we were unable to recover it. 00:27:45.857 [2024-11-29 02:32:49.357145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.357256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.857 [2024-11-29 02:32:49.357282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.858 qpair failed and we were unable to recover it. 00:27:45.858 [2024-11-29 02:32:49.357378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.357501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.357528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.858 qpair failed and we were unable to recover it. 00:27:45.858 [2024-11-29 02:32:49.357644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.357754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.357780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.858 qpair failed and we were unable to recover it. 00:27:45.858 [2024-11-29 02:32:49.357864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.357991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.358016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.858 qpair failed and we were unable to recover it. 00:27:45.858 [2024-11-29 02:32:49.358099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.358217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.358242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.858 qpair failed and we were unable to recover it. 00:27:45.858 [2024-11-29 02:32:49.358361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.358483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.358509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.858 qpair failed and we were unable to recover it. 00:27:45.858 [2024-11-29 02:32:49.358653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.358748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.358773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.858 qpair failed and we were unable to recover it. 00:27:45.858 [2024-11-29 02:32:49.358894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.359044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.359070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.858 qpair failed and we were unable to recover it. 00:27:45.858 [2024-11-29 02:32:49.359162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.359276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.359301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.858 qpair failed and we were unable to recover it. 00:27:45.858 [2024-11-29 02:32:49.359430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.359550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.359575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.858 qpair failed and we were unable to recover it. 00:27:45.858 [2024-11-29 02:32:49.359670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.359811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.359837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.858 qpair failed and we were unable to recover it. 00:27:45.858 [2024-11-29 02:32:49.359924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.360012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.360037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.858 qpair failed and we were unable to recover it. 00:27:45.858 [2024-11-29 02:32:49.360127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.360245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.360271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.858 qpair failed and we were unable to recover it. 00:27:45.858 [2024-11-29 02:32:49.360390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.360510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.360537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.858 qpair failed and we were unable to recover it. 00:27:45.858 [2024-11-29 02:32:49.360657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.360778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.360804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.858 qpair failed and we were unable to recover it. 00:27:45.858 [2024-11-29 02:32:49.360924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.361013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.361040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.858 qpair failed and we were unable to recover it. 00:27:45.858 [2024-11-29 02:32:49.361123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.361241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.361266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.858 qpair failed and we were unable to recover it. 00:27:45.858 [2024-11-29 02:32:49.361400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.361486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.361511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.858 qpair failed and we were unable to recover it. 00:27:45.858 [2024-11-29 02:32:49.361626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.361741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.361767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.858 qpair failed and we were unable to recover it. 00:27:45.858 [2024-11-29 02:32:49.361913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.361998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.362023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.858 qpair failed and we were unable to recover it. 00:27:45.858 [2024-11-29 02:32:49.362163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.362315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.362340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.858 qpair failed and we were unable to recover it. 00:27:45.858 [2024-11-29 02:32:49.362459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.362599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.362624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.858 qpair failed and we were unable to recover it. 00:27:45.858 [2024-11-29 02:32:49.362742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.362835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.362862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.858 qpair failed and we were unable to recover it. 00:27:45.858 [2024-11-29 02:32:49.362981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.363065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.363090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.858 qpair failed and we were unable to recover it. 00:27:45.858 [2024-11-29 02:32:49.363212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.363327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.363353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.858 qpair failed and we were unable to recover it. 00:27:45.858 [2024-11-29 02:32:49.363456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.363566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.858 [2024-11-29 02:32:49.363591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.858 qpair failed and we were unable to recover it. 00:27:45.858 [2024-11-29 02:32:49.363712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.363857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.363882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.363978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.364093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.364118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.364199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.364278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.364304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.364401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.364523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.364549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.364634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.364735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.364760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.364882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.364965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.364990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.365106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.365220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.365245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.365366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.365492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.365518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.365608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.365728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.365754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.365845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.365929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.365954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.366100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.366217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.366242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.366377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.366476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.366502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.366623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.366768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.366794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.366908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.367021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.367046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.367159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.367301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.367327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.367478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.367567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.367593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.367679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.367824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.367850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.367967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.368054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.368079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.368177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.368293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.368318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.368439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.368554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.368580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.368669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.368780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.368805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.368896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.369018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.369045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.369194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.369276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.369302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.369430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.369545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.369571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.369687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.369803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.369829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.369953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.370071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.370097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.370180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.370267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.370293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.370416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.370559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.370584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.370704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.370850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.859 [2024-11-29 02:32:49.370875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.859 qpair failed and we were unable to recover it. 00:27:45.859 [2024-11-29 02:32:49.370988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.371074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.371100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.371250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.371366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.371391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.371527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.371619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.371646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.371765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.371877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.371902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.372036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.372155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.372181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.372330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.372414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.372441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.372522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.372641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.372666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.372751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.372867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.372892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.372986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.373104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.373130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.373243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.373361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.373386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.373481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.373595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.373620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.373738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.373822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.373849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.373974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.374097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.374122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.374235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.374373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.374413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.374546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.374670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.374696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.374816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.374928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.374954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.375073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.375151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.375177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.375286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.375403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.375429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.375544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.375690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.375716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.375811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.375905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.375931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.376042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.376129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.376154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.376265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.376354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.376380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.376513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.376661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.376687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.376806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.376897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.376923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.377024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.377166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.377192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.377309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.377429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.377455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.377549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.377659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.377684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.377804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.377894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.377921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.860 qpair failed and we were unable to recover it. 00:27:45.860 [2024-11-29 02:32:49.378032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.860 [2024-11-29 02:32:49.378122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.378149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.378293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.378372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.378404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.378527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.378617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.378643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.378734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.378818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.378844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.378967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.379087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.379117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.379232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.379376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.379407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.379530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.379615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.379640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.379725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.379844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.379870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.380009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.380108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.380133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.380273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.380423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.380449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.380538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.380683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.380708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.380854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.380993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.381019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.381136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.381275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.381300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.381384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.381479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.381505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.381588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.381700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.381729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.381870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.381979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.382004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.382147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.382260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.382285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.382428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.382522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.382548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.382663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.382775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.382800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.382890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.383008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.383033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.383151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.383266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.383291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.383389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.383511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.383537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.383622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.383710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.383735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.383848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.383968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.383993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.384116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.384230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.384260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.384406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.384493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.384519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.384609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.384736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.384761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.384846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.384931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.384956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.385044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.385151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.861 [2024-11-29 02:32:49.385177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.861 qpair failed and we were unable to recover it. 00:27:45.861 [2024-11-29 02:32:49.385273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.385361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.385387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.862 qpair failed and we were unable to recover it. 00:27:45.862 [2024-11-29 02:32:49.385484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.385602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.385627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.862 qpair failed and we were unable to recover it. 00:27:45.862 [2024-11-29 02:32:49.385712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.385830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.385855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.862 qpair failed and we were unable to recover it. 00:27:45.862 [2024-11-29 02:32:49.385969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.386086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.386112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.862 qpair failed and we were unable to recover it. 00:27:45.862 [2024-11-29 02:32:49.386263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.386352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.386377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.862 qpair failed and we were unable to recover it. 00:27:45.862 [2024-11-29 02:32:49.386488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.386637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.386667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.862 qpair failed and we were unable to recover it. 00:27:45.862 [2024-11-29 02:32:49.386784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.386876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.386901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.862 qpair failed and we were unable to recover it. 00:27:45.862 [2024-11-29 02:32:49.387014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.387134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.387159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.862 qpair failed and we were unable to recover it. 00:27:45.862 [2024-11-29 02:32:49.387249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.387337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.387363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.862 qpair failed and we were unable to recover it. 00:27:45.862 [2024-11-29 02:32:49.387494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.387639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.387664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.862 qpair failed and we were unable to recover it. 00:27:45.862 [2024-11-29 02:32:49.387752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.387896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.387922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.862 qpair failed and we were unable to recover it. 00:27:45.862 [2024-11-29 02:32:49.388007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.388100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.388126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.862 qpair failed and we were unable to recover it. 00:27:45.862 [2024-11-29 02:32:49.388214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.388301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.388326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.862 qpair failed and we were unable to recover it. 00:27:45.862 [2024-11-29 02:32:49.388441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.388521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.388547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.862 qpair failed and we were unable to recover it. 00:27:45.862 [2024-11-29 02:32:49.388667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.388758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.388784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.862 qpair failed and we were unable to recover it. 00:27:45.862 [2024-11-29 02:32:49.388896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.388989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.389015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.862 qpair failed and we were unable to recover it. 00:27:45.862 [2024-11-29 02:32:49.389112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.389232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.389257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.862 qpair failed and we were unable to recover it. 00:27:45.862 [2024-11-29 02:32:49.389377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.389500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.389526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.862 qpair failed and we were unable to recover it. 00:27:45.862 [2024-11-29 02:32:49.389647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.389732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.389757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.862 qpair failed and we were unable to recover it. 00:27:45.862 [2024-11-29 02:32:49.389872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.389982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.390008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.862 qpair failed and we were unable to recover it. 00:27:45.862 [2024-11-29 02:32:49.390129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.390250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.390276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.862 qpair failed and we were unable to recover it. 00:27:45.862 [2024-11-29 02:32:49.390423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.390541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.390566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.862 qpair failed and we were unable to recover it. 00:27:45.862 [2024-11-29 02:32:49.390680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.390769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.390796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.862 qpair failed and we were unable to recover it. 00:27:45.862 [2024-11-29 02:32:49.390915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.390999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.391025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.862 qpair failed and we were unable to recover it. 00:27:45.862 [2024-11-29 02:32:49.391147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.391269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.391294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.862 qpair failed and we were unable to recover it. 00:27:45.862 [2024-11-29 02:32:49.391441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.862 [2024-11-29 02:32:49.391524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.391549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.391647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.391768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.391793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.391912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.392027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.392052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.392141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.392255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.392282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.392407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.392550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.392575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.392696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.392772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.392797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.392916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.393065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.393091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.393212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.393350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.393375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.393479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.393564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.393589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.393714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.393831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.393856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.393942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.394051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.394076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.394172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.394288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.394313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.394435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.394527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.394553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.394639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.394761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.394787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.394906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.395044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.395069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.395152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.395292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.395317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.395404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.395555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.395580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.395699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.395841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.395867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.395984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.396101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.396128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.396210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.396328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.396354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.396488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.396604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.396631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.396720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.396833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.396858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.396977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.397095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.397120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.397265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.397382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.397418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.397505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.397680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.397705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.397824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.397967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.397992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.398074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.398154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.398181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.398269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.398423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.398450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.863 [2024-11-29 02:32:49.398595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.398681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.863 [2024-11-29 02:32:49.398707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.863 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.398863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.398987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.399012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.399105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.399186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.399212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.399303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.399417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.399444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.399562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.399644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.399670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.399785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.399870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.399895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.400021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.400099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.400125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.400213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.400300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.400326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.400473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.400588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.400613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.400761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.400877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.400903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.400998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.401105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.401130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.401247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.401360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.401385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.401541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.401628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.401654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.401773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.401861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.401887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.402005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.402120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.402146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.402231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.402374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.402406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.402557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.402677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.402702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.402844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.402935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.402960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.403107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.403224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.403250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.403342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.403484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.403510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.403632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.403749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.403775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.403900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.404020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.404046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.404190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.404306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.404331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.404487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.404604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.404629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.404747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.404891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.404917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.405010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.405123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.405149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.405229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.405371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.405402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.405525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.405667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.405692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.405812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.405956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.405981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.864 [2024-11-29 02:32:49.406068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.406186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.864 [2024-11-29 02:32:49.406211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.864 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.406364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.406497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.406524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.406670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.406783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.406808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.406958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.407043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.407069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.407170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.407267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.407293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.407410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.407496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.407522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.407643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.407734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.407760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.407845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.407988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.408013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.408125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.408215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.408241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.408352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.408462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.408490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.408636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.408749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.408775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.408868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.409016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.409042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.409163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.409287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.409313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.409461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.409551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.409576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.409732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.409840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.409866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.409985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.410126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.410151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.410295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.410439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.410465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.410551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.410637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.410663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.410800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.410911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.410937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.411032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.411147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.411173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.411290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.411406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.411432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.411577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.411693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.411720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.411833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.411917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.411943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.412066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.412182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.412208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.412342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.412458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.412484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.412627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.412745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.412770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.412887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.413004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.413031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.413185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.413306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.413332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.413453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.413566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.413591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.865 qpair failed and we were unable to recover it. 00:27:45.865 [2024-11-29 02:32:49.413679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.865 [2024-11-29 02:32:49.413765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.413791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.413884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.413973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.414000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.414127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.414239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.414264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.414347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.414430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.414457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.414573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.414657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.414682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.414801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.414917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.414942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.415062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.415144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.415170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.415254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.415369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.415403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.415493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.415635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.415661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.415781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.415900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.415926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.416044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.416129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.416159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.416246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.416333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.416359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.416492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.416637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.416663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.416746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.416832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.416857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.416979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.417064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.417089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.417210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.417298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.417327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.417421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.417533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.417559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.417656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.417802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.417827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.417962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.418083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.418109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.418231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.418325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.418350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.418479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.418590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.418616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.418695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.418838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.418863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.418954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.419040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.419065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.419164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.419306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.419332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.419424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.419508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.419534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.419652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.419745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.419776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.419928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.420047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.420073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.420189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.420274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.420301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.420415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.420560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.420585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.866 qpair failed and we were unable to recover it. 00:27:45.866 [2024-11-29 02:32:49.420675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.866 [2024-11-29 02:32:49.420821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.420847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.867 qpair failed and we were unable to recover it. 00:27:45.867 [2024-11-29 02:32:49.420972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.421082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.421107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.867 qpair failed and we were unable to recover it. 00:27:45.867 [2024-11-29 02:32:49.421221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.421371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.421405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.867 qpair failed and we were unable to recover it. 00:27:45.867 [2024-11-29 02:32:49.421496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.421607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.421632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.867 qpair failed and we were unable to recover it. 00:27:45.867 [2024-11-29 02:32:49.421751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.421865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.421890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.867 qpair failed and we were unable to recover it. 00:27:45.867 [2024-11-29 02:32:49.422036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.422162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.422187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.867 qpair failed and we were unable to recover it. 00:27:45.867 [2024-11-29 02:32:49.422269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.422385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.422445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.867 qpair failed and we were unable to recover it. 00:27:45.867 [2024-11-29 02:32:49.422529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.422645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.422672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.867 qpair failed and we were unable to recover it. 00:27:45.867 [2024-11-29 02:32:49.422761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.422855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.422881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.867 qpair failed and we were unable to recover it. 00:27:45.867 [2024-11-29 02:32:49.423026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.423134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.423160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.867 qpair failed and we were unable to recover it. 00:27:45.867 [2024-11-29 02:32:49.423282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.423406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.423432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.867 qpair failed and we were unable to recover it. 00:27:45.867 [2024-11-29 02:32:49.423527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.423638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.423663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.867 qpair failed and we were unable to recover it. 00:27:45.867 [2024-11-29 02:32:49.423804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.423919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.423944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.867 qpair failed and we were unable to recover it. 00:27:45.867 [2024-11-29 02:32:49.424068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.424207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.424232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.867 qpair failed and we were unable to recover it. 00:27:45.867 [2024-11-29 02:32:49.424352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.424438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.424465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.867 qpair failed and we were unable to recover it. 00:27:45.867 [2024-11-29 02:32:49.424582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.424710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.424735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.867 qpair failed and we were unable to recover it. 00:27:45.867 [2024-11-29 02:32:49.424854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.424968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.424999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.867 qpair failed and we were unable to recover it. 00:27:45.867 [2024-11-29 02:32:49.425129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.425214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.425239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.867 qpair failed and we were unable to recover it. 00:27:45.867 [2024-11-29 02:32:49.425354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.425498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.425524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.867 qpair failed and we were unable to recover it. 00:27:45.867 [2024-11-29 02:32:49.425603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.425688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.425714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.867 qpair failed and we were unable to recover it. 00:27:45.867 [2024-11-29 02:32:49.425796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.425938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.425964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.867 qpair failed and we were unable to recover it. 00:27:45.867 [2024-11-29 02:32:49.426051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.426168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.426193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.867 qpair failed and we were unable to recover it. 00:27:45.867 [2024-11-29 02:32:49.426317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.426440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.426465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.867 qpair failed and we were unable to recover it. 00:27:45.867 [2024-11-29 02:32:49.426550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.426669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.426696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.867 qpair failed and we were unable to recover it. 00:27:45.867 [2024-11-29 02:32:49.426816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.426932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.426958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.867 qpair failed and we were unable to recover it. 00:27:45.867 [2024-11-29 02:32:49.427047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.427188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.867 [2024-11-29 02:32:49.427214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.867 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.427293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.427376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.427409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.427537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.427683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.427708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.427798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.427914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.427940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.428059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.428177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.428202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.428288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.428429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.428455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.428540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.428626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.428652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.428735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.428883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.428908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.429033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.429142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.429167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.429289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.429407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.429434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.429521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.429637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.429662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.429783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.429892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.429918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.430038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.430158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.430184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.430334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.430430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.430456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.430569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.430688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.430713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.430812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.430926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.430951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.431067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.431213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.431238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.431350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.431500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.431526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.431647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.431787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.431813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.431907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.431988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.432013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.432132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.432277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.432302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.432420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.432537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.432563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.432713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.432798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.432824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.432963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.433110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.433135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.433269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.433385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.433416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.433536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.433663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.433688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.433775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.433901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.433926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.434039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.434149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.434174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.434332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.434416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.434442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.868 qpair failed and we were unable to recover it. 00:27:45.868 [2024-11-29 02:32:49.434584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.868 [2024-11-29 02:32:49.434711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.434736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.434883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.434977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.435004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.435090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.435207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.435233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.435356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.435450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.435478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.435600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.435716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.435741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.435825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.435915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.435941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.436064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.436180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.436206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.436295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.436440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.436467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.436589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.436706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.436731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.436811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.436904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.436929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.437045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.437192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.437218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.437368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.437462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.437488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.437600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.437728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.437753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.437890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.438000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.438025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.438110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.438222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.438248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.438347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.438462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.438488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.438598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.438686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.438712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.438830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.438951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.438977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.439119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.439234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.439259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.439407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.439552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.439578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.439695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.439812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.439837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.439981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.440075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.440101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.440217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.440337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.440362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.440499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.440616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.440641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.440730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.440841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.440866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.440957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.441045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.441071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.441161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.441271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.441296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.441389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.441481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.441508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.441631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.441746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.441773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.869 qpair failed and we were unable to recover it. 00:27:45.869 [2024-11-29 02:32:49.441916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.869 [2024-11-29 02:32:49.442031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.442058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.442173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.442260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.442287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.442386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.442515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.442540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.442630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.442717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.442743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.442897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.443011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.443035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.443180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.443260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.443285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.443408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.443508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.443537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.443717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.443835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.443864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.443970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.444104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.444130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.444258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.444404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.444430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.444600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.444717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.444804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.444938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.445112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.445140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.445278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.445400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.445443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.445612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.445740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.445770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.445932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.446076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.446101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.446225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.446342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.446368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.446545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.446656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.446699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.446831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.447006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.447034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.447147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.447263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.447289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.447375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.447471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.447497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.447591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.447681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.447706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.447853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.447968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.447993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.448138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.448257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.448283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.448405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.448519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.448562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.448685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.448820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.448846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.448992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.449106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.449131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.449252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.449336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.449362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.449530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.449709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.449736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.449863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.449999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.870 [2024-11-29 02:32:49.450024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.870 qpair failed and we were unable to recover it. 00:27:45.870 [2024-11-29 02:32:49.450137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.450252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.450278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.871 qpair failed and we were unable to recover it. 00:27:45.871 [2024-11-29 02:32:49.450450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.450578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.450606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.871 qpair failed and we were unable to recover it. 00:27:45.871 [2024-11-29 02:32:49.450751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.450859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.450885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.871 qpair failed and we were unable to recover it. 00:27:45.871 [2024-11-29 02:32:49.450999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.451091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.451116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.871 qpair failed and we were unable to recover it. 00:27:45.871 [2024-11-29 02:32:49.451258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.451340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.451365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.871 qpair failed and we were unable to recover it. 00:27:45.871 [2024-11-29 02:32:49.451507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.451659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.451688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.871 qpair failed and we were unable to recover it. 00:27:45.871 [2024-11-29 02:32:49.451847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.451989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.452014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.871 qpair failed and we were unable to recover it. 00:27:45.871 [2024-11-29 02:32:49.452132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.452302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.452327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.871 qpair failed and we were unable to recover it. 00:27:45.871 [2024-11-29 02:32:49.452461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.452571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.452613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.871 qpair failed and we were unable to recover it. 00:27:45.871 [2024-11-29 02:32:49.452773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.452884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.452925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.871 qpair failed and we were unable to recover it. 00:27:45.871 [2024-11-29 02:32:49.453087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.453206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.453232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.871 qpair failed and we were unable to recover it. 00:27:45.871 [2024-11-29 02:32:49.453345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.453435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.453479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.871 qpair failed and we were unable to recover it. 00:27:45.871 [2024-11-29 02:32:49.453635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.453853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.453881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.871 qpair failed and we were unable to recover it. 00:27:45.871 [2024-11-29 02:32:49.454055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.454167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.454193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.871 qpair failed and we were unable to recover it. 00:27:45.871 [2024-11-29 02:32:49.454323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.454459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.454489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.871 qpair failed and we were unable to recover it. 00:27:45.871 [2024-11-29 02:32:49.454616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.454840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.454869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.871 qpair failed and we were unable to recover it. 00:27:45.871 [2024-11-29 02:32:49.455011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.455143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.455169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.871 qpair failed and we were unable to recover it. 00:27:45.871 [2024-11-29 02:32:49.455292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.455406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.455450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.871 qpair failed and we were unable to recover it. 00:27:45.871 [2024-11-29 02:32:49.455642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.455833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.455884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.871 qpair failed and we were unable to recover it. 00:27:45.871 [2024-11-29 02:32:49.456049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.456131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.456156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.871 qpair failed and we were unable to recover it. 00:27:45.871 [2024-11-29 02:32:49.456301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.456402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.456448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.871 qpair failed and we were unable to recover it. 00:27:45.871 [2024-11-29 02:32:49.456620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.456907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.456957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.871 qpair failed and we were unable to recover it. 00:27:45.871 [2024-11-29 02:32:49.457096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.457211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.457236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.871 qpair failed and we were unable to recover it. 00:27:45.871 [2024-11-29 02:32:49.457334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.457444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.457473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.871 qpair failed and we were unable to recover it. 00:27:45.871 [2024-11-29 02:32:49.457602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.457793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.457823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.871 qpair failed and we were unable to recover it. 00:27:45.871 [2024-11-29 02:32:49.458009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.871 [2024-11-29 02:32:49.458147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.458173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.458259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.458380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.458436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.458563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.458702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.458728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.458819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.458939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.458964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.459080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.459234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.459259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.459389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.459490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.459516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.459636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.459783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.459808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.459931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.460013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.460038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.460156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.460272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.460298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.460385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.460508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.460534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.460654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.460740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.460772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.460892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.461037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.461062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.461153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.461296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.461322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.461466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.461556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.461582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.461729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.461872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.461897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.461991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.462099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.462125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.462246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.462336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.462362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.462490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.462602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.462628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.462745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.462826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.462852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.462969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.463117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.463142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.463288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.463431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.463461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.463577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.463708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.463735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.463835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.463950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.463976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.464119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.464205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.464230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.464380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.464502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.464529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.464625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.464753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.464778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.464871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.464991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.465016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.465103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.465219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.465244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.465342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.465458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.465485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.872 qpair failed and we were unable to recover it. 00:27:45.872 [2024-11-29 02:32:49.465605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.872 [2024-11-29 02:32:49.465726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.465751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.465844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.465937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.465967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.466107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.466217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.466243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.466333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.466421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.466447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.466542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.466628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.466654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.466767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.466859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.466885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.466987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.467102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.467128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.467274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.467414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.467440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.467526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.467683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.467708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.467852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.467992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.468017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.468135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.468223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.468249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.468339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.468482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.468513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.468603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.468746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.468771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.468891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.469011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.469037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.469150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.469271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.469296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.469420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.469506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.469531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.469626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.469746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.469771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.469894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.469976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.470001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.470101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.470182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.470207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.470297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.470410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.470436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.470555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.470641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.470668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.470754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.470844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.470870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.470988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.471106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.471133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.471228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.471306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.471331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.471417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.471537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.471562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.471685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.471824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.471849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.471961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.472079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.472105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.472219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.472367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.472398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.472545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.472637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.873 [2024-11-29 02:32:49.472662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.873 qpair failed and we were unable to recover it. 00:27:45.873 [2024-11-29 02:32:49.472772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.472890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.472916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.472997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.473114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.473139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.473233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.473350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.473376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.473502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.473593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.473619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.473735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.473846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.473871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.473992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.474111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.474136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.474260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.474371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.474404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.474524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.474653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.474679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.474800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.474887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.474914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.475011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.475155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.475180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.475300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.475381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.475414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.475534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.475652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.475678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.475766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.475918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.475944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.476069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.476185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.476210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.476332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.476438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.476464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.476550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.476691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.476717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.476836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.476919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.476944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.477037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.477155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.477180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.477330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.477458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.477484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.477606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.477721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.477746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.477838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.477953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.477979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.478121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.478211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.478237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.478369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.478528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.478554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.478683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.478778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.478804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.478891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.479003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.479028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.479115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.479230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.479255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.479366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.479520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.479546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.479663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.479783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.479808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.874 qpair failed and we were unable to recover it. 00:27:45.874 [2024-11-29 02:32:49.479924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.480008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.874 [2024-11-29 02:32:49.480034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.480130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.480223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.480248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.480340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.480463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.480489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.480611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.480704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.480730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.480843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.480997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.481023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.481118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.481234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.481259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.481379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.481505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.481531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.481623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.481739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.481765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.481880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.482026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.482051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.482194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.482284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.482308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.482430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.482518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.482543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.482686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.482772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.482797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.482890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.482977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.483003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.483128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.483269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.483295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.483380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.483538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.483564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.483691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.483818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.483844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.483967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.484084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.484110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.484231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.484314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.484339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.484434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.484544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.484570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.484683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.484825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.484851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.484971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.485086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.485111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.485199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.485320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.485345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.485472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.485563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.485588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.485677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.485795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.485821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.485919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.486029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.486055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.486154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.486300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.486326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.486456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.486590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.486615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.486734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.486853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.486879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.486957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.487048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.487073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.487190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.487278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.487304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.487453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.487540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.875 [2024-11-29 02:32:49.487567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.875 qpair failed and we were unable to recover it. 00:27:45.875 [2024-11-29 02:32:49.487694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.876 [2024-11-29 02:32:49.487888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.876 [2024-11-29 02:32:49.487914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.876 qpair failed and we were unable to recover it. 00:27:45.876 [2024-11-29 02:32:49.488026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.876 [2024-11-29 02:32:49.488144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.876 [2024-11-29 02:32:49.488170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.876 qpair failed and we were unable to recover it. 00:27:45.876 [2024-11-29 02:32:49.488267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.876 [2024-11-29 02:32:49.488363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.876 [2024-11-29 02:32:49.488389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.876 qpair failed and we were unable to recover it. 00:27:45.876 [2024-11-29 02:32:49.488526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.876 [2024-11-29 02:32:49.488611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.876 [2024-11-29 02:32:49.488637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:45.876 qpair failed and we were unable to recover it. 00:27:45.876 [2024-11-29 02:32:49.488738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.488867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.488892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.164 qpair failed and we were unable to recover it. 00:27:46.164 [2024-11-29 02:32:49.489038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.489141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.489166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.164 qpair failed and we were unable to recover it. 00:27:46.164 [2024-11-29 02:32:49.489263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.489343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.489369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.164 qpair failed and we were unable to recover it. 00:27:46.164 [2024-11-29 02:32:49.489472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.489555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.489582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.164 qpair failed and we were unable to recover it. 00:27:46.164 [2024-11-29 02:32:49.489674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.489758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.489783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.164 qpair failed and we were unable to recover it. 00:27:46.164 [2024-11-29 02:32:49.489873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.489992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.490018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.164 qpair failed and we were unable to recover it. 00:27:46.164 [2024-11-29 02:32:49.490148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.490237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.490263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.164 qpair failed and we were unable to recover it. 00:27:46.164 [2024-11-29 02:32:49.490355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.490502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.490529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.164 qpair failed and we were unable to recover it. 00:27:46.164 [2024-11-29 02:32:49.490674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.490757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.490783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.164 qpair failed and we were unable to recover it. 00:27:46.164 [2024-11-29 02:32:49.490875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.490989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.491013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.164 qpair failed and we were unable to recover it. 00:27:46.164 [2024-11-29 02:32:49.491128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.491215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.491239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.164 qpair failed and we were unable to recover it. 00:27:46.164 [2024-11-29 02:32:49.491366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.491498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.491524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.164 qpair failed and we were unable to recover it. 00:27:46.164 [2024-11-29 02:32:49.491652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.491774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.491799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.164 qpair failed and we were unable to recover it. 00:27:46.164 [2024-11-29 02:32:49.491917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.492035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.492060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.164 qpair failed and we were unable to recover it. 00:27:46.164 [2024-11-29 02:32:49.492151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.492279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.492305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.164 qpair failed and we were unable to recover it. 00:27:46.164 [2024-11-29 02:32:49.492431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.492549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.492575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.164 qpair failed and we were unable to recover it. 00:27:46.164 [2024-11-29 02:32:49.492664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.492780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.492805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.164 qpair failed and we were unable to recover it. 00:27:46.164 [2024-11-29 02:32:49.492919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.493032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.493056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.164 qpair failed and we were unable to recover it. 00:27:46.164 [2024-11-29 02:32:49.493145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.493228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.493254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.164 qpair failed and we were unable to recover it. 00:27:46.164 [2024-11-29 02:32:49.493370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.493495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.493521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.164 qpair failed and we were unable to recover it. 00:27:46.164 [2024-11-29 02:32:49.493612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.493701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.493727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.164 qpair failed and we were unable to recover it. 00:27:46.164 [2024-11-29 02:32:49.493848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.493931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.164 [2024-11-29 02:32:49.493955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.494076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.494191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.494215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.494305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.494447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.494472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.494569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.494681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.494706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.494820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.494903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.494929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.495042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.495185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.495211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.495303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.495442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.495468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.495614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.495733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.495759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.495858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.495973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.495999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.496113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.496203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.496230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.496351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.496481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.496508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.496621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.496794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.496819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.496933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.497052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.497077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.497196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.497311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.497336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.497444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.497589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.497614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.497736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.497812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.497838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.497985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.498102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.498127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.498224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.498312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.498337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.498422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.498542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.498567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.498681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.498778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.498804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.498916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.499028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.499053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.499152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.499263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.499289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.499379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.499503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.499529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.499610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.499719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.499744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.499829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.499940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.499965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.500052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.500159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.500184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.500320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.500437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.500463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.500583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.500674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.500699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.500810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.500901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.500926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.165 qpair failed and we were unable to recover it. 00:27:46.165 [2024-11-29 02:32:49.501038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.165 [2024-11-29 02:32:49.501155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.501184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.501304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.501416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.501443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.501527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.501643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.501668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.501764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.501881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.501907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.502028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.502163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.502189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.502304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.502435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.502462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.502582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.502724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.502749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.502862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.502951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.502978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.503125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.503246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.503272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.503423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.503535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.503560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.503671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.503780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.503809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.503930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.504069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.504094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.504183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.504298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.504322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.504414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.504525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.504551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.504645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.504762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.504787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.504887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.505017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.505043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.505132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.505220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.505245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.505367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.505549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.505576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.505700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.505783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.505810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.505941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.506047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.506073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.506190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.506309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.506340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.506497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.506619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.506644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.506738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.506855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.506881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.506972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.507069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.507095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.507211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.507299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.507324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.507475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.507582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.507612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.507768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.507898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.507927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.508060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.508171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.508197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.166 [2024-11-29 02:32:49.508327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.508406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.166 [2024-11-29 02:32:49.508432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.166 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.508555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.508635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.508661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.508776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.508896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.508926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.509050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.509131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.509158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.509242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.509372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.509426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.509555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.509670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.509695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.509842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.509941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.509966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.510083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.510198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.510223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.510369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.510473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.510498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.510594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.510735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.510761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.510876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.510992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.511017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.511163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.511279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.511304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.511400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.511519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.511545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.511674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.511793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.511820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.511948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.512096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.512121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.512208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.512329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.512354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.512466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.512553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.512578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.512693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.512807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.512832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.512947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.513064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.513090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.513208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.513329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.513354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.513494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.513636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.513661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.513805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.513921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.513947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.514068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.514152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.514177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.514326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.514425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.514451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.514544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.514634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.514659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.514804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.514948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.514974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.515067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.515150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.515177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.515289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.515410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.515437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.515585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.515714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.515739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.167 [2024-11-29 02:32:49.515882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.516004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.167 [2024-11-29 02:32:49.516029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.167 qpair failed and we were unable to recover it. 00:27:46.168 [2024-11-29 02:32:49.516118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.516270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.516295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.168 qpair failed and we were unable to recover it. 00:27:46.168 [2024-11-29 02:32:49.516415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.516546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.516571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.168 qpair failed and we were unable to recover it. 00:27:46.168 [2024-11-29 02:32:49.516685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.516825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.516850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.168 qpair failed and we were unable to recover it. 00:27:46.168 [2024-11-29 02:32:49.516988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.517128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.517154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.168 qpair failed and we were unable to recover it. 00:27:46.168 [2024-11-29 02:32:49.517244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.517331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.517356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.168 qpair failed and we were unable to recover it. 00:27:46.168 [2024-11-29 02:32:49.517498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.517611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.517637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.168 qpair failed and we were unable to recover it. 00:27:46.168 [2024-11-29 02:32:49.517721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.517829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.517855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.168 qpair failed and we were unable to recover it. 00:27:46.168 [2024-11-29 02:32:49.517980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.518097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.518124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.168 qpair failed and we were unable to recover it. 00:27:46.168 [2024-11-29 02:32:49.518252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.518342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.518368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.168 qpair failed and we were unable to recover it. 00:27:46.168 [2024-11-29 02:32:49.518509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.518620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.518646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.168 qpair failed and we were unable to recover it. 00:27:46.168 [2024-11-29 02:32:49.518740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.518850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.518876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.168 qpair failed and we were unable to recover it. 00:27:46.168 [2024-11-29 02:32:49.518966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.519080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.519106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.168 qpair failed and we were unable to recover it. 00:27:46.168 [2024-11-29 02:32:49.519221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.519364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.519389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.168 qpair failed and we were unable to recover it. 00:27:46.168 [2024-11-29 02:32:49.519497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.519580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.519606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.168 qpair failed and we were unable to recover it. 00:27:46.168 [2024-11-29 02:32:49.519723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.519815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.519841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.168 qpair failed and we were unable to recover it. 00:27:46.168 [2024-11-29 02:32:49.519949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.520058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.520084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.168 qpair failed and we were unable to recover it. 00:27:46.168 [2024-11-29 02:32:49.520228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.520380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.520414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.168 qpair failed and we were unable to recover it. 00:27:46.168 [2024-11-29 02:32:49.520501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.520590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.520615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.168 qpair failed and we were unable to recover it. 00:27:46.168 [2024-11-29 02:32:49.520734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.520847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.520874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.168 qpair failed and we were unable to recover it. 00:27:46.168 [2024-11-29 02:32:49.520969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.521095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.521120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.168 qpair failed and we were unable to recover it. 00:27:46.168 [2024-11-29 02:32:49.521213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.521332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.521357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.168 qpair failed and we were unable to recover it. 00:27:46.168 [2024-11-29 02:32:49.521485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.521578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.521603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.168 qpair failed and we were unable to recover it. 00:27:46.168 [2024-11-29 02:32:49.521693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.521813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.521838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.168 qpair failed and we were unable to recover it. 00:27:46.168 [2024-11-29 02:32:49.521967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.522092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.168 [2024-11-29 02:32:49.522118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.168 qpair failed and we were unable to recover it. 00:27:46.168 [2024-11-29 02:32:49.522205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.522318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.522343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.522483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.522601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.522626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.522740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.522879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.522905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.523061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.523202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.523227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.523316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.523440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.523466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.523559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.523636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.523661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.523764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.523848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.523874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.523966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.524080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.524105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.524191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.524309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.524335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.524465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.524612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.524638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.524723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.524836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.524863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.524960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.525071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.525097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.525242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.525399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.525426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.525542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.525657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.525683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.525772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.525882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.525908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.526024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.526108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.526134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.526250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.526363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.526389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.526546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.526624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.526649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.526768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.526859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.526885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.527015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.527195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.527225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.527347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.527465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.527510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.527652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.527807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.527851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.527995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.528144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.528172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.528305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.528401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.528429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.528529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.528642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.528668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.528763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.528898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.528943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.529095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.529222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.529249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.529371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.529538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.529565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.169 [2024-11-29 02:32:49.529657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.529773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.169 [2024-11-29 02:32:49.529799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.169 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.529895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.529996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.530023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.530117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.530228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.530255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.530349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.530481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.530508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.530654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.530745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.530771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.530892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.530980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.531007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.531125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.531247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.531273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.531391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.531515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.531541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.531687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.531806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.531833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.531955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.532071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.532098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.532219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.532308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.532334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.532469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.532629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.532674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.532811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.532949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.532975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.533122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.533241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.533268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.533357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.533499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.533529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.533682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.533801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.533830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.533995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.534104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.534130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.534250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.534338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.534364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.534467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.534583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.534608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.534725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.534839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.534865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.534981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.535099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.535126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.535247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.535406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.535432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.535525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.535618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.535644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.535792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.535902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.535928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.536052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.536153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.536179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.536272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.536386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.536420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.536569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.536650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.536676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.536829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.536947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.536973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.537068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.537190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.537215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.170 qpair failed and we were unable to recover it. 00:27:46.170 [2024-11-29 02:32:49.537303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.537425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.170 [2024-11-29 02:32:49.537452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.537570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.537715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.537741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.537866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.537960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.537986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.538128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.538251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.538277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.538401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.538514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.538540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.538659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.538756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.538783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.538932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.539044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.539069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.539154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.539243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.539269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.539369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.539469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.539496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.539614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.539758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.539784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.539910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.539997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.540023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.540146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.540263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.540291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.540381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.540509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.540539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.540636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.540766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.540792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.540887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.541002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.541028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.541146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.541263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.541289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.541382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.541534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.541578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.541710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.541882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.541908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.542043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.542189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.542214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.542334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.542498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.542544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.542680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.542845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.542889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.543008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.543121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.543147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.543272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.543421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.543452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.543543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.543656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.543682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.543774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.543868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.543894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.544041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.544158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.544183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.544278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.544433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.544459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.544575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.544690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.544715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.544865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.544951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.544977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.171 qpair failed and we were unable to recover it. 00:27:46.171 [2024-11-29 02:32:49.545063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.171 [2024-11-29 02:32:49.545202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.545228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.545373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.545542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.545568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.545696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.545825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.545853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.545993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.546101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.546130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.546226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.546340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.546365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.546496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.546610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.546635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.546715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.546801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.546827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.546918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.547065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.547090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.547210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.547332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.547358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.547485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.547560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.547586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.547735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.547821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.547845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.547948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.548070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.548096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.548207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.548329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.548355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.548515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.548639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.548669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.548791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.548907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.548932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.549050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.549148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.549175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.549293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.549376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.549410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.549536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.549679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.549705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.549793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.549903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.549929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.550016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.550104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.550129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.550239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.550378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.550412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.550535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.550658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.550683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.550795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.550884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.550910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.551004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.551146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.551172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.551333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.551473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.551517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.551685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.551841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.551886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.552036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.552125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.552151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.552244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.552388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.552420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.552536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.552664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.552708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.172 qpair failed and we were unable to recover it. 00:27:46.172 [2024-11-29 02:32:49.552857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.172 [2024-11-29 02:32:49.552985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.553010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.173 qpair failed and we were unable to recover it. 00:27:46.173 [2024-11-29 02:32:49.553106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.553201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.553228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.173 qpair failed and we were unable to recover it. 00:27:46.173 [2024-11-29 02:32:49.553348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.553495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.553521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.173 qpair failed and we were unable to recover it. 00:27:46.173 [2024-11-29 02:32:49.553647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.553734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.553760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.173 qpair failed and we were unable to recover it. 00:27:46.173 [2024-11-29 02:32:49.553912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.554054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.554079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.173 qpair failed and we were unable to recover it. 00:27:46.173 [2024-11-29 02:32:49.554171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.554288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.554313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.173 qpair failed and we were unable to recover it. 00:27:46.173 [2024-11-29 02:32:49.554433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.554520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.554546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.173 qpair failed and we were unable to recover it. 00:27:46.173 [2024-11-29 02:32:49.554666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.554751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.554777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.173 qpair failed and we were unable to recover it. 00:27:46.173 [2024-11-29 02:32:49.554925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.555022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.555047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.173 qpair failed and we were unable to recover it. 00:27:46.173 [2024-11-29 02:32:49.555132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.555230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.555255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.173 qpair failed and we were unable to recover it. 00:27:46.173 [2024-11-29 02:32:49.555349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.555468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.555495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.173 qpair failed and we were unable to recover it. 00:27:46.173 [2024-11-29 02:32:49.555609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.555726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.555752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.173 qpair failed and we were unable to recover it. 00:27:46.173 [2024-11-29 02:32:49.555876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.555989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.556014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.173 qpair failed and we were unable to recover it. 00:27:46.173 [2024-11-29 02:32:49.556130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.556224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.556250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.173 qpair failed and we were unable to recover it. 00:27:46.173 [2024-11-29 02:32:49.556368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.556519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.556546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.173 qpair failed and we were unable to recover it. 00:27:46.173 [2024-11-29 02:32:49.556702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.556815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.556840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.173 qpair failed and we were unable to recover it. 00:27:46.173 [2024-11-29 02:32:49.556929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.557057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.557083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.173 qpair failed and we were unable to recover it. 00:27:46.173 [2024-11-29 02:32:49.557173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.557265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.557290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.173 qpair failed and we were unable to recover it. 00:27:46.173 [2024-11-29 02:32:49.557380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.557483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.557509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.173 qpair failed and we were unable to recover it. 00:27:46.173 [2024-11-29 02:32:49.557599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.557709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.557734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.173 qpair failed and we were unable to recover it. 00:27:46.173 [2024-11-29 02:32:49.557831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.557929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.557954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.173 qpair failed and we were unable to recover it. 00:27:46.173 [2024-11-29 02:32:49.558073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.558187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.558213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.173 qpair failed and we were unable to recover it. 00:27:46.173 [2024-11-29 02:32:49.558310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.558403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.558430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.173 qpair failed and we were unable to recover it. 00:27:46.173 [2024-11-29 02:32:49.558529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.558674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.173 [2024-11-29 02:32:49.558699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.173 qpair failed and we were unable to recover it. 00:27:46.173 [2024-11-29 02:32:49.558791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.558936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.558962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.559084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.559230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.559257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.559370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.559479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.559508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.559614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.559753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.559797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.559944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.560058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.560083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.560201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.560290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.560316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.560454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.560562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.560588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.560706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.560817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.560842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.560947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.561067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.561092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.561211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.561354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.561380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.561495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.561612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.561639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.561735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.561889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.561914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.562067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.562219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.562244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.562331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.562414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.562439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.562584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.562703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.562731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.562831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.562916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.562942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.563034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.563150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.563175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.563296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.563416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.563441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.563593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.563688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.563713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.563792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.563906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.563931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.564055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.564172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.564197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.564355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.564457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.564483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.564608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.564720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.564746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.564864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.564978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.565003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.565128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.565277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.565301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.565427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.565553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.565579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.565735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.565871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.565914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.566030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.566121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.566147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.174 [2024-11-29 02:32:49.566269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.566363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.174 [2024-11-29 02:32:49.566388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.174 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.566514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.566635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.566660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.566780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.566896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.566921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.567076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.567165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.567191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.567292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.567410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.567436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.567581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.567697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.567723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.567841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.567987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.568012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.568108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.568199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.568226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.568347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.568449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.568476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.568624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.568771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.568796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.568931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.569044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.569069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.569217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.569334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.569359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.569502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.569656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.569701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.569823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.569919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.569945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.570069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.570185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.570211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.570329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.570470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.570497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.570593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.570710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.570736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.570850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.570990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.571016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.571125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.571243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.571270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.571362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.571511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.571541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.571679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.571817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.571843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.571989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.572109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.572135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.572253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.572342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.572368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.572483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.572643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.572687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.572834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.572953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.572979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.573129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.573244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.573269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.573390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.573510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.573538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.573688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.573824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.573850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.573975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.574090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.574116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.175 qpair failed and we were unable to recover it. 00:27:46.175 [2024-11-29 02:32:49.574263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.175 [2024-11-29 02:32:49.574380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.574415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.574505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.574620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.574645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.574757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.574839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.574864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.574990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.575107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.575132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.575286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.575407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.575433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.575564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.575713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.575742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.575878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.575990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.576016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.576174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.576267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.576293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.576457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.576621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.576647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.576767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.576884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.576910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.577023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.577141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.577166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.577292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.577415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.577442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.577563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.577653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.577680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.577774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.577887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.577913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.578033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.578145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.578172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.578304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.578429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.578456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.578546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.578657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.578682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.578800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.578885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.578910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.579024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.579111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.579136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.579251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.579345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.579372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.579529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.579650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.579676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.579773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.579887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.579912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.580034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.580151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.580177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.580305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.580448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.580475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.580568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.580655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.580682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.580772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.580867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.580894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.581012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.581108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.581135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.581257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.581414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.581441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.581565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.581712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.581738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.176 qpair failed and we were unable to recover it. 00:27:46.176 [2024-11-29 02:32:49.581822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.176 [2024-11-29 02:32:49.581942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.581968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.177 qpair failed and we were unable to recover it. 00:27:46.177 [2024-11-29 02:32:49.582057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.582211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.582237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.177 qpair failed and we were unable to recover it. 00:27:46.177 [2024-11-29 02:32:49.582334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.582472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.582515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.177 qpair failed and we were unable to recover it. 00:27:46.177 [2024-11-29 02:32:49.582681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.582829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.582858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.177 qpair failed and we were unable to recover it. 00:27:46.177 [2024-11-29 02:32:49.582994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.583117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.583142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.177 qpair failed and we were unable to recover it. 00:27:46.177 [2024-11-29 02:32:49.583286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.583403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.583434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.177 qpair failed and we were unable to recover it. 00:27:46.177 [2024-11-29 02:32:49.583549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.583710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.583737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.177 qpair failed and we were unable to recover it. 00:27:46.177 [2024-11-29 02:32:49.583854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.584003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.584028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.177 qpair failed and we were unable to recover it. 00:27:46.177 [2024-11-29 02:32:49.584127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.584224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.584249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.177 qpair failed and we were unable to recover it. 00:27:46.177 [2024-11-29 02:32:49.584377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.584479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.584506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.177 qpair failed and we were unable to recover it. 00:27:46.177 [2024-11-29 02:32:49.584604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.584750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.584775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.177 qpair failed and we were unable to recover it. 00:27:46.177 [2024-11-29 02:32:49.584921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.585038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.585064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.177 qpair failed and we were unable to recover it. 00:27:46.177 [2024-11-29 02:32:49.585184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.585303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.585328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.177 qpair failed and we were unable to recover it. 00:27:46.177 [2024-11-29 02:32:49.585446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.585564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.585591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.177 qpair failed and we were unable to recover it. 00:27:46.177 [2024-11-29 02:32:49.585735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.585879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.585904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.177 qpair failed and we were unable to recover it. 00:27:46.177 [2024-11-29 02:32:49.586023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.586168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.586198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.177 qpair failed and we were unable to recover it. 00:27:46.177 [2024-11-29 02:32:49.586291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.586418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.586445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.177 qpair failed and we were unable to recover it. 00:27:46.177 [2024-11-29 02:32:49.586559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.586641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.586666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.177 qpair failed and we were unable to recover it. 00:27:46.177 [2024-11-29 02:32:49.586823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.586969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.586995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.177 qpair failed and we were unable to recover it. 00:27:46.177 [2024-11-29 02:32:49.587117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.587230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.587254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.177 qpair failed and we were unable to recover it. 00:27:46.177 [2024-11-29 02:32:49.587408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.587551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.587576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.177 qpair failed and we were unable to recover it. 00:27:46.177 [2024-11-29 02:32:49.587702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.587866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.587891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.177 qpair failed and we were unable to recover it. 00:27:46.177 [2024-11-29 02:32:49.588042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.588134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.588159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.177 qpair failed and we were unable to recover it. 00:27:46.177 [2024-11-29 02:32:49.588301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.588436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.588466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.177 qpair failed and we were unable to recover it. 00:27:46.177 [2024-11-29 02:32:49.588589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.588699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.588725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.177 qpair failed and we were unable to recover it. 00:27:46.177 [2024-11-29 02:32:49.588870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.588979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.177 [2024-11-29 02:32:49.589009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.589115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.589206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.589233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.589348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.589457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.589485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.589600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.589721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.589746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.589886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.590040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.590066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.590189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.590327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.590353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.590499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.590679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.590722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.590856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.591017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.591043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.591164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.591295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.591321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.591442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.591533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.591560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.591678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.591820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.591851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.592000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.592113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.592138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.592233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.592346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.592372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.592496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.592613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.592638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.592733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.592845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.592870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.592963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.593053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.593080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.593200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.593311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.593337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.593457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.593572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.593598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.593713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.593851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.593895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.594024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.594137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.594162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.594280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.594402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.594428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.594580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.594750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.594775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.594872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.594988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.595015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.595113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.595228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.595253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.595345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.595486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.595513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.595636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.595729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.595753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.595898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.596016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.596042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.596193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.596316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.596341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.596433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.596546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.596571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.178 qpair failed and we were unable to recover it. 00:27:46.178 [2024-11-29 02:32:49.596658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.178 [2024-11-29 02:32:49.596805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.596831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.596977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.597120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.597146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.597270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.597391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.597433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.597612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.597739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.597768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.597931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.598073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.598099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.598196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.598309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.598335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.598433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.598556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.598587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.598757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.598873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.598898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.599048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.599165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.599190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.599309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.599428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.599455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.599573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.599714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.599739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.599861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.599976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.600001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.600136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.600221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.600247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.600366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.600504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.600530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.600647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.600792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.600818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.600937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.601027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.601053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.601179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.601320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.601344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.601438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.601546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.601574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.601709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.601823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.601864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.601987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.602082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.602110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.602225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.602307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.602333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.602456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.602578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.602605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.602703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.602815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.602841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.602959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.603103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.603128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.603277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.603404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.603432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.603528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.603645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.603671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.603788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.603906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.603932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.604027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.604116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.604142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.604259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.604368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.604401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.179 qpair failed and we were unable to recover it. 00:27:46.179 [2024-11-29 02:32:49.604498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.179 [2024-11-29 02:32:49.604586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.604613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.604705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.604813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.604839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.604984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.605102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.605128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.605252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.605374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.605408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.605561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.605687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.605712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.605861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.605999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.606025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.606144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.606291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.606316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.606454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.606608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.606636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.606762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.606907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.606934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.607048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.607192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.607218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.607339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.607460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.607487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.607614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.607722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.607748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.607893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.608008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.608033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.608134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.608253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.608279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.608368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.608516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.608542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.608690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.608807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.608832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.608980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.609073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.609098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.609202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.609320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.609345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.609441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.609558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.609583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.609705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.609851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.609876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.609970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.610086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.610111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.610203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.610321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.610346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.610469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.610592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.610618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.610755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.610882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.610909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.611061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.611154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.611181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.611302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.611412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.611456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.611611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.611806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.611834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.611945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.612063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.612088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.612231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.612324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.180 [2024-11-29 02:32:49.612350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.180 qpair failed and we were unable to recover it. 00:27:46.180 [2024-11-29 02:32:49.612474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.612652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.612680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.612807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.612997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.613025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.613192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.613307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.613333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.613484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.613686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.613756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.613977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.614102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.614130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.614304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.614403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.614447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.614642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.614835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.614885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.615029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.615217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.615242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.615338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.615476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.615506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.615677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.615904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.615972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.616133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.616274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.616300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.616390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.616523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.616552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.616687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.616798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.616843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.617008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.617122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.617147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.617245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.617368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.617402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.617577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.617676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.617705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.617858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.617994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.618019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.618139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.618226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.618251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.618380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.618523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.618553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.618738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.618895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.618923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.619060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.619149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.619174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.619288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.619407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.619452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.619573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.619748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.619776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.619888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.619984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.620009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.620124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.620271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.620297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.620436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.620547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.620589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.620695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.620874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.620899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.621014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.621123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.621148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.181 [2024-11-29 02:32:49.621280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.621397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.181 [2024-11-29 02:32:49.621423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.181 qpair failed and we were unable to recover it. 00:27:46.182 [2024-11-29 02:32:49.621590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.621782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.621810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.182 qpair failed and we were unable to recover it. 00:27:46.182 [2024-11-29 02:32:49.621947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.622065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.622091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.182 qpair failed and we were unable to recover it. 00:27:46.182 [2024-11-29 02:32:49.622208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.622322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.622347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.182 qpair failed and we were unable to recover it. 00:27:46.182 [2024-11-29 02:32:49.622469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.622688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.622716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.182 qpair failed and we were unable to recover it. 00:27:46.182 [2024-11-29 02:32:49.622839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.622965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.622991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.182 qpair failed and we were unable to recover it. 00:27:46.182 [2024-11-29 02:32:49.623118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.623264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.623289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.182 qpair failed and we were unable to recover it. 00:27:46.182 [2024-11-29 02:32:49.623408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.623578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.623606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.182 qpair failed and we were unable to recover it. 00:27:46.182 [2024-11-29 02:32:49.623763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.623933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.623962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.182 qpair failed and we were unable to recover it. 00:27:46.182 [2024-11-29 02:32:49.624069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.624184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.624209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.182 qpair failed and we were unable to recover it. 00:27:46.182 [2024-11-29 02:32:49.624304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.624397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.624423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.182 qpair failed and we were unable to recover it. 00:27:46.182 [2024-11-29 02:32:49.624551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.624678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.624706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.182 qpair failed and we were unable to recover it. 00:27:46.182 [2024-11-29 02:32:49.624794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.624921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.624947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.182 qpair failed and we were unable to recover it. 00:27:46.182 [2024-11-29 02:32:49.625065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.625179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.625206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.182 qpair failed and we were unable to recover it. 00:27:46.182 [2024-11-29 02:32:49.625331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.625481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.625511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.182 qpair failed and we were unable to recover it. 00:27:46.182 [2024-11-29 02:32:49.625699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.625822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.625863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.182 qpair failed and we were unable to recover it. 00:27:46.182 [2024-11-29 02:32:49.625979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.626097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.626123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.182 qpair failed and we were unable to recover it. 00:27:46.182 [2024-11-29 02:32:49.626243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.626388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.626420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.182 qpair failed and we were unable to recover it. 00:27:46.182 [2024-11-29 02:32:49.626542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.626664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.626689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.182 qpair failed and we were unable to recover it. 00:27:46.182 [2024-11-29 02:32:49.626803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.626894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.626919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.182 qpair failed and we were unable to recover it. 00:27:46.182 [2024-11-29 02:32:49.627011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.627133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.627158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.182 qpair failed and we were unable to recover it. 00:27:46.182 [2024-11-29 02:32:49.627253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.627371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.627403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.182 qpair failed and we were unable to recover it. 00:27:46.182 [2024-11-29 02:32:49.627526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.627665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.627691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.182 qpair failed and we were unable to recover it. 00:27:46.182 [2024-11-29 02:32:49.627801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.627912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.627937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.182 qpair failed and we were unable to recover it. 00:27:46.182 [2024-11-29 02:32:49.628048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.628137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.628163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.182 qpair failed and we were unable to recover it. 00:27:46.182 [2024-11-29 02:32:49.628248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.628365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.182 [2024-11-29 02:32:49.628399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.182 qpair failed and we were unable to recover it. 00:27:46.182 [2024-11-29 02:32:49.628486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.628627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.628657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.628770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.628858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.628885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.628973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.629073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.629099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.629217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.629307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.629332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.629416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.629505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.629532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.629642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.629762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.629788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.629879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.630009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.630034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.630119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.630234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.630260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.630384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.630475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.630501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.630594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.630713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.630738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.630851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.630941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.630972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.631085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.631177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.631202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.631320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.631431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.631457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.631578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.631660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.631685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.631777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.631873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.631899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.632009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.632123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.632149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.632270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.632358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.632384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.632515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.632605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.632630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.632772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.632850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.632875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.632971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.633086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.633112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.633236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.633351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.633381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.633514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.633625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.633650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.633739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.633825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.633852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.633942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.634043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.634069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.634163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.634281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.634306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.634391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.634492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.634517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.634639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.634751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.634777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.634894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.635012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.635038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.183 [2024-11-29 02:32:49.635186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.635330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.183 [2024-11-29 02:32:49.635356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.183 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.635508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.635620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.635646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.635725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.635854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.635884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.636007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.636119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.636144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.636268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.636346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.636371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.636527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.636655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.636680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.636798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.636884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.636911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.637007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.637091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.637116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.637266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.637352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.637378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.637501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.637613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.637638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.637788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.637870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.637897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.637986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.638101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.638127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.638247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.638389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.638430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.638557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.638670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.638696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.638817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.638937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.638963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.639048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.639141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.639168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.639301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.639387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.639421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.639538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.639627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.639652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.639800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.639927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.639953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.640038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.640128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.640153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.640269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.640423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.640450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.640579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.640695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.640720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.640809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.640929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.640956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.641063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.641177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.641203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.641297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.641414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.641440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.641540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.641682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.641707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.641790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.641879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.641906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.642021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.642107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.642133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.642258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.642409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.642435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.184 [2024-11-29 02:32:49.642515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.642653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.184 [2024-11-29 02:32:49.642678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.184 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.642796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.642912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.642937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.643026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.643109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.643135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.643261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.643350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.643375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.643508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.643595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.643620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.643737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.643830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.643855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.643968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.644108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.644134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.644229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.644343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.644368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.644517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.644630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.644655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.644772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.644886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.644911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.644989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.645070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.645096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.645185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.645295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.645322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.645468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.645590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.645616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.645731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.645847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.645872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.646021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.646163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.646188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.646309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.646390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.646423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.646514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.646631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.646657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.646777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.646918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.646942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.647034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.647181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.647206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.647336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.647463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.647489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.647575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.647669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.647695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.647795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.647883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.647908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.648025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.648115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.648140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.648261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.648403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.648430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.648570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.648652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.648678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.648801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.648912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.648937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.649056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.649172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.649197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.649317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.649429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.649456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.649549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.649697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.649722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.185 qpair failed and we were unable to recover it. 00:27:46.185 [2024-11-29 02:32:49.649870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.185 [2024-11-29 02:32:49.650021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.650046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.186 qpair failed and we were unable to recover it. 00:27:46.186 [2024-11-29 02:32:49.650134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.650245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.650270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.186 qpair failed and we were unable to recover it. 00:27:46.186 [2024-11-29 02:32:49.650400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.650487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.650513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.186 qpair failed and we were unable to recover it. 00:27:46.186 [2024-11-29 02:32:49.650592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.650709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.650735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.186 qpair failed and we were unable to recover it. 00:27:46.186 [2024-11-29 02:32:49.650834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.650974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.650999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.186 qpair failed and we were unable to recover it. 00:27:46.186 [2024-11-29 02:32:49.651092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.651210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.651235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.186 qpair failed and we were unable to recover it. 00:27:46.186 [2024-11-29 02:32:49.651323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.651469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.651495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.186 qpair failed and we were unable to recover it. 00:27:46.186 [2024-11-29 02:32:49.651608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.651701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.651727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.186 qpair failed and we were unable to recover it. 00:27:46.186 [2024-11-29 02:32:49.651823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.651966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.651992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.186 qpair failed and we were unable to recover it. 00:27:46.186 [2024-11-29 02:32:49.652073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.652167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.652193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.186 qpair failed and we were unable to recover it. 00:27:46.186 [2024-11-29 02:32:49.652337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.652477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.652503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.186 qpair failed and we were unable to recover it. 00:27:46.186 [2024-11-29 02:32:49.652623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.652743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.652768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.186 qpair failed and we were unable to recover it. 00:27:46.186 [2024-11-29 02:32:49.652893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.652978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.653003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.186 qpair failed and we were unable to recover it. 00:27:46.186 [2024-11-29 02:32:49.653122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.653204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.653230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.186 qpair failed and we were unable to recover it. 00:27:46.186 [2024-11-29 02:32:49.653380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.653509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.653535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.186 qpair failed and we were unable to recover it. 00:27:46.186 [2024-11-29 02:32:49.653652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.653773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.653798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.186 qpair failed and we were unable to recover it. 00:27:46.186 [2024-11-29 02:32:49.653915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.654062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.654087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.186 qpair failed and we were unable to recover it. 00:27:46.186 [2024-11-29 02:32:49.654209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.654328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.654353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.186 qpair failed and we were unable to recover it. 00:27:46.186 [2024-11-29 02:32:49.654453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.654598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.654623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.186 qpair failed and we were unable to recover it. 00:27:46.186 [2024-11-29 02:32:49.654705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.654824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.654849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.186 qpair failed and we were unable to recover it. 00:27:46.186 [2024-11-29 02:32:49.654946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.655031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.655057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.186 qpair failed and we were unable to recover it. 00:27:46.186 [2024-11-29 02:32:49.655167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.655280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.655306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.186 qpair failed and we were unable to recover it. 00:27:46.186 [2024-11-29 02:32:49.655426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.655555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.655581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.186 qpair failed and we were unable to recover it. 00:27:46.186 [2024-11-29 02:32:49.655697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.655793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.655818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.186 qpair failed and we were unable to recover it. 00:27:46.186 [2024-11-29 02:32:49.655917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.656034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.656060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.186 qpair failed and we were unable to recover it. 00:27:46.186 [2024-11-29 02:32:49.656203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.656292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.656317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.186 qpair failed and we were unable to recover it. 00:27:46.186 [2024-11-29 02:32:49.656431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.656514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.186 [2024-11-29 02:32:49.656540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.656621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.656711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.656736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.656864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.656961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.656987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.657071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.657151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.657176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.657323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.657441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.657468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.657561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.657677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.657702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.657826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.657967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.657992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.658140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.658233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.658259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.658375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.658506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.658533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.658619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.658766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.658791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.658906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.659019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.659044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.659162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.659274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.659300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.659405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.659518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.659545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.659665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.659748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.659773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.659860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.659977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.660002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.660120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.660264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.660289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.660380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.660483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.660510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.660605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.660714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.660739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.660853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.660961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.660986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.661075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.661201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.661227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.661318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.661421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.661448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.661542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.661622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.661648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.661761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.661876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.661903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.662042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.662151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.662176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.662296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.662388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.662423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.662507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.662625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.662650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.662769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.662890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.662915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.663026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.663138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.663163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.187 [2024-11-29 02:32:49.663285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.663406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.187 [2024-11-29 02:32:49.663431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.187 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.663551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.663699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.663725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.663845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.663924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.663949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.664065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.664146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.664171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.664254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.664366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.664391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.664489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.664573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.664600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.664750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.664867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.664892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.664982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.665099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.665125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.665212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.665304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.665330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.665439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.665531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.665556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.665640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.665727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.665752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.665872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.665960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.665989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.666076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.666184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.666209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.666326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.666475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.666501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.666624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.666718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.666743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.666860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.666969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.666994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.667092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.667178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.667203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.667323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.667474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.667501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.667624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.667773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.667798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.667952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.668072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.668098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.668244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.668397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.668424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.668515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.668603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.668633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.668728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.668811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.668837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.668936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.669025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.669050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.669172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.669279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.669305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.669390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.669529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.669556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.669642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.669755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.669780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.669933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.670078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.670103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.670221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.670336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.670361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.188 qpair failed and we were unable to recover it. 00:27:46.188 [2024-11-29 02:32:49.670516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.670602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.188 [2024-11-29 02:32:49.670627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.670772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.670878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.670903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.671021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.671165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.671195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.671314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.671426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.671453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.671577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.671715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.671740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.671852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.671941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.671966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.672077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.672157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.672182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.672305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.672424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.672450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.672576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.672669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.672693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.672812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.672930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.672955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.673043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.673154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.673180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.673327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.673471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.673496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.673618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.673760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.673789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.673911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.674001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.674026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.674170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.674279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.674305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.674400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.674519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.674544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.674657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.674780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.674806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.674922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.675029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.675054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.675146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.675258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.675283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.675413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.675492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.675518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.675600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.675689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.675714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.675836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.675963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.675987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.676107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.676223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.676248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.676384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.676511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.676538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.676683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.676800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.676826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.676949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.677071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.677097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.677255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.677341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.677366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.677485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.677576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.677603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.677716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.677801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.677826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.189 qpair failed and we were unable to recover it. 00:27:46.189 [2024-11-29 02:32:49.677940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.189 [2024-11-29 02:32:49.678062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.678087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.678169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.678284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.678309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.678430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.678553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.678578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.678694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.678837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.678862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.678952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.679061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.679086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.679205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.679314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.679340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.679462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.679546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.679572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.679717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.679830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.679855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.679981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.680089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.680114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.680195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.680308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.680333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.680429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.680507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.680532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.680680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.680804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.680829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.680914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.680996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.681021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.681142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.681257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.681284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.681413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.681543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.681569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.681691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.681829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.681854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.681951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.682066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.682091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.682209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.682304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.682329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.682419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.682561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.682586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.682733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.682852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.682878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.682998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.683075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.683100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.683213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.683301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.683328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.683448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.683568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.683594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.683686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.683810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.683835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.683930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.684015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.684040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.684152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.684276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.684301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.684431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.684550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.684576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.684690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.684833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.684858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.684942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.685027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.190 [2024-11-29 02:32:49.685051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.190 qpair failed and we were unable to recover it. 00:27:46.190 [2024-11-29 02:32:49.685150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.685298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.685324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.191 qpair failed and we were unable to recover it. 00:27:46.191 [2024-11-29 02:32:49.685480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.685622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.685647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.191 qpair failed and we were unable to recover it. 00:27:46.191 [2024-11-29 02:32:49.685793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.685909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.685935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.191 qpair failed and we were unable to recover it. 00:27:46.191 [2024-11-29 02:32:49.686043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.686133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.686158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.191 qpair failed and we were unable to recover it. 00:27:46.191 [2024-11-29 02:32:49.686236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.686322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.686347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.191 qpair failed and we were unable to recover it. 00:27:46.191 [2024-11-29 02:32:49.686449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.686608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.686633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.191 qpair failed and we were unable to recover it. 00:27:46.191 [2024-11-29 02:32:49.686777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.686872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.686897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.191 qpair failed and we were unable to recover it. 00:27:46.191 [2024-11-29 02:32:49.687014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.687127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.687153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.191 qpair failed and we were unable to recover it. 00:27:46.191 [2024-11-29 02:32:49.687295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.687420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.687447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.191 qpair failed and we were unable to recover it. 00:27:46.191 [2024-11-29 02:32:49.687568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.687686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.687712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.191 qpair failed and we were unable to recover it. 00:27:46.191 [2024-11-29 02:32:49.687806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.687919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.687944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.191 qpair failed and we were unable to recover it. 00:27:46.191 [2024-11-29 02:32:49.688029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.688105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.688130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.191 qpair failed and we were unable to recover it. 00:27:46.191 [2024-11-29 02:32:49.688213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.688322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.688347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.191 qpair failed and we were unable to recover it. 00:27:46.191 [2024-11-29 02:32:49.688497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.688614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.688640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.191 qpair failed and we were unable to recover it. 00:27:46.191 [2024-11-29 02:32:49.688724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.688864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.688889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.191 qpair failed and we were unable to recover it. 00:27:46.191 [2024-11-29 02:32:49.688980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.689128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.689153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.191 qpair failed and we were unable to recover it. 00:27:46.191 [2024-11-29 02:32:49.689243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.689400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.689426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.191 qpair failed and we were unable to recover it. 00:27:46.191 [2024-11-29 02:32:49.689578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.689692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.689717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.191 qpair failed and we were unable to recover it. 00:27:46.191 [2024-11-29 02:32:49.689838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.689921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.689946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.191 qpair failed and we were unable to recover it. 00:27:46.191 [2024-11-29 02:32:49.690039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.690121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.690147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.191 qpair failed and we were unable to recover it. 00:27:46.191 [2024-11-29 02:32:49.690264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.690382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.690415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.191 qpair failed and we were unable to recover it. 00:27:46.191 [2024-11-29 02:32:49.690508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.690595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.690622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.191 qpair failed and we were unable to recover it. 00:27:46.191 [2024-11-29 02:32:49.690771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.690913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.690938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.191 qpair failed and we were unable to recover it. 00:27:46.191 [2024-11-29 02:32:49.691036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.691148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.691173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.191 qpair failed and we were unable to recover it. 00:27:46.191 [2024-11-29 02:32:49.691313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.691407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.691433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.191 qpair failed and we were unable to recover it. 00:27:46.191 [2024-11-29 02:32:49.691593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.191 [2024-11-29 02:32:49.691691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.691719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.691816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.691935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.691961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.692108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.692246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.692272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.692399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.692485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.692511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.692608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.692721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.692746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.692857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.692945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.692970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.693084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.693203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.693230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.693314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.693422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.693447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.693564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.693657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.693684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.693803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.693949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.693975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.694128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.694242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.694268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.694358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.694511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.694538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.694668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.694781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.694807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.694923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.695074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.695100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.695244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.695388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.695420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.695566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.695700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.695726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.695820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.695961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.695987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.696105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.696220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.696246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.696336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.696461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.696506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.696623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.696741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.696768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.696868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.696987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.697014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.697162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.697254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.697279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.697404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.697529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.697556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.697642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.697760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.697785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.697909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.697989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.698015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.698104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.698246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.698272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.698365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.698488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.698515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.698665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.698782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.698808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.698930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.699040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.699066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.192 qpair failed and we were unable to recover it. 00:27:46.192 [2024-11-29 02:32:49.699211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.192 [2024-11-29 02:32:49.699295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.699320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.699467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.699594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.699620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.699740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.699855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.699880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.699997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.700085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.700112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.700226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.700397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.700424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.700550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.700633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.700659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.700772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.700865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.700891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.701016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.701100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.701126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.701207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.701299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.701325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.701445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.701547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.701573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.701719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.701852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.701878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.702002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.702092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.702119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.702218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.702358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.702385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.702517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.702601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.702627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.702752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.702874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.702901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.703027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.703116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.703142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.703261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.703379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.703415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.703505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.703617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.703643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.703733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.703881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.703907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.704029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.704124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.704150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.704295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.704417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.704444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.704533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.704624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.704650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.704739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.704860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.704887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.705040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.705156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.705182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.705306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.705422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.705449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.705568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.705683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.705710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.705795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.705887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.705913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.706045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.706169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.706195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.706289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.706407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.193 [2024-11-29 02:32:49.706441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.193 qpair failed and we were unable to recover it. 00:27:46.193 [2024-11-29 02:32:49.706585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.706740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.706767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.706858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.706949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.706975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.707100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.707212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.707243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.707360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.707489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.707516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.707639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.707750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.707776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.707921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.708040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.708066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.708189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.708333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.708359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.708467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.708555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.708581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.708667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.708788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.708815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.708928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.709037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.709063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.709186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.709306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.709333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.709470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.709624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.709673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.709768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.709880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.709911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.710054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.710177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.710204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.710330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.710448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.710474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.710565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.710650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.710676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.710794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.710913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.710940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.711057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.711139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.711167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.711256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.711347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.711373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.711523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.711674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.711700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.711821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.711935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.711961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.712104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.712218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.712244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.712401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.712548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.712580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.712696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.712815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.712841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.712952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.713043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.713069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.713155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.713273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.713300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.713452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.713595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.713621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.713708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.713829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.713855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.194 [2024-11-29 02:32:49.713986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.714104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.194 [2024-11-29 02:32:49.714130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.194 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.714252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.714370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.714404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.714534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.714652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.714678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.714792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.714936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.714962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.715053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.715153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.715183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.715276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.715422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.715449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.715553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.715662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.715688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.715774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.715894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.715920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.716039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.716154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.716180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.716324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.716440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.716466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.716589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.716672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.716698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.716780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.716902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.716927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.717038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.717159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.717186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.717305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.717402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.717429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.717515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.717656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.717682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.717806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.717897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.717923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.718073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.718154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.718180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.718301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.718446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.718474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.718595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.718710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.718736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.718822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.718940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.718965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.719047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.719134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.719159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.719306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.719418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.719445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.719596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.719710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.719736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.719866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.719984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.720011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.720104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.720222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.720249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.720374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.720492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.720519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.720609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.720721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.720747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.720864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.720954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.720981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.195 qpair failed and we were unable to recover it. 00:27:46.195 [2024-11-29 02:32:49.721125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.721249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.195 [2024-11-29 02:32:49.721276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.196 qpair failed and we were unable to recover it. 00:27:46.196 [2024-11-29 02:32:49.721365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.721502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.721529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.196 qpair failed and we were unable to recover it. 00:27:46.196 [2024-11-29 02:32:49.721654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.721737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.721764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.196 qpair failed and we were unable to recover it. 00:27:46.196 [2024-11-29 02:32:49.721883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.722031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.722057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.196 qpair failed and we were unable to recover it. 00:27:46.196 [2024-11-29 02:32:49.722205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.722300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.722327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.196 qpair failed and we were unable to recover it. 00:27:46.196 [2024-11-29 02:32:49.722463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.722590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.722616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.196 qpair failed and we were unable to recover it. 00:27:46.196 [2024-11-29 02:32:49.722768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.722879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.722905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.196 qpair failed and we were unable to recover it. 00:27:46.196 [2024-11-29 02:32:49.723029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.723121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.723149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.196 qpair failed and we were unable to recover it. 00:27:46.196 [2024-11-29 02:32:49.723232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.723355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.723381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.196 qpair failed and we were unable to recover it. 00:27:46.196 [2024-11-29 02:32:49.723508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.723600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.723627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.196 qpair failed and we were unable to recover it. 00:27:46.196 [2024-11-29 02:32:49.723747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.723897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.723923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.196 qpair failed and we were unable to recover it. 00:27:46.196 [2024-11-29 02:32:49.724008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.724099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.724125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.196 qpair failed and we were unable to recover it. 00:27:46.196 [2024-11-29 02:32:49.724266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.724412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.724439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.196 qpair failed and we were unable to recover it. 00:27:46.196 [2024-11-29 02:32:49.724557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.724655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.724680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.196 qpair failed and we were unable to recover it. 00:27:46.196 [2024-11-29 02:32:49.724829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.724943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.724969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.196 qpair failed and we were unable to recover it. 00:27:46.196 [2024-11-29 02:32:49.725116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.725210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.725235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.196 qpair failed and we were unable to recover it. 00:27:46.196 [2024-11-29 02:32:49.725349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.725468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.725495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.196 qpair failed and we were unable to recover it. 00:27:46.196 [2024-11-29 02:32:49.725618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.725727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.725753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.196 qpair failed and we were unable to recover it. 00:27:46.196 [2024-11-29 02:32:49.725847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.725959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.725985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.196 qpair failed and we were unable to recover it. 00:27:46.196 [2024-11-29 02:32:49.726133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.726251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.726277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.196 qpair failed and we were unable to recover it. 00:27:46.196 [2024-11-29 02:32:49.726405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.726513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.726541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.196 qpair failed and we were unable to recover it. 00:27:46.196 [2024-11-29 02:32:49.726684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.726835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.726883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.196 qpair failed and we were unable to recover it. 00:27:46.196 [2024-11-29 02:32:49.727003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.727120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.727146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.196 qpair failed and we were unable to recover it. 00:27:46.196 [2024-11-29 02:32:49.727284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.727429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.727456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.196 qpair failed and we were unable to recover it. 00:27:46.196 [2024-11-29 02:32:49.727576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.727663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.727689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.196 qpair failed and we were unable to recover it. 00:27:46.196 [2024-11-29 02:32:49.727832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.727949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.727976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.196 qpair failed and we were unable to recover it. 00:27:46.196 [2024-11-29 02:32:49.728128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.728250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.196 [2024-11-29 02:32:49.728276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.728404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.728521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.728547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.728664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.728783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.728809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.728955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.729094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.729120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.729239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.729322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.729349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.729484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.729606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.729632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.729752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.729842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.729868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.729954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.730039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.730065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.730186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.730296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.730322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.730421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.730546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.730573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.730716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.730830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.730856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.730976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.731066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.731092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.731240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.731318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.731344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.731446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.731591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.731620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.731781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.731924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.731950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.732064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.732183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.732210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.732366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.732514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.732559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.732697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.732858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.732884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.733004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.733090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.733116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.733210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.733325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.733351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.733507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.733625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.733652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.733747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.733836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.733862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.733975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.734091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.734118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.734238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.734320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.734346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.734444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.734561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.734588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.734710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.734809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.734835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.734980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.735097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.735124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.735241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.735362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.735389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.735521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.735662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.735688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.197 qpair failed and we were unable to recover it. 00:27:46.197 [2024-11-29 02:32:49.735831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.197 [2024-11-29 02:32:49.735918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.735944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.736030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.736125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.736151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.736285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.736419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.736449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.736551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.736666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.736691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.736840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.736939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.736968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.737077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.737183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.737210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.737316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.737422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.737448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.737544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.737654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.737694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.737824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.737923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.737951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.738076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.738200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.738227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.738405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.738521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.738546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.738688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.738823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.738850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.739009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.739144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.739172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.739298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.739385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.739434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.739523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.739634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.739659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.739836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.739964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.739991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.740140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.740276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.740304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.740448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.740603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.740627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.740714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.740793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.740817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.740942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.741031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.741055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.741181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.741285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.741312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.741414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.741546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.741570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.741662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.741775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.741804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.741968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.742104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.742145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.742303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.742446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.742472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.742587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.742716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.742743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.742845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.742966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.742991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.743165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.743282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.743308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.743418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.743577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.743602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.198 qpair failed and we were unable to recover it. 00:27:46.198 [2024-11-29 02:32:49.743759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.198 [2024-11-29 02:32:49.743915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.743941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.744108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.744259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.744286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.744417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.744578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.744603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.744739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.744830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.744857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.745021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.745143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.745170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.745298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.745442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.745467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.745587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.745725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.745751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.745875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.746004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.746031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.746156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.746321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.746346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.746462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.746577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.746601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.746715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.746866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.746894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.746990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.747120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.747148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.747250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.747403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.747446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.747555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.747670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.747695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.747840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.747963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.747990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.748124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.748217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.748244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.748367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.748509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.748535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.748625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.748721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.748745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.748832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.748991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.749018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.749142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.749243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.749270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.749372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.749515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.749540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.749681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.749769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.749810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.749973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.750103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.750130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.750237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.750321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.750363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.750492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.750582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.750606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.750724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.750813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.750837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.751001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.751100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.751128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.751310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.751427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.751453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.751568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.751661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.751686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.199 qpair failed and we were unable to recover it. 00:27:46.199 [2024-11-29 02:32:49.751854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.199 [2024-11-29 02:32:49.752013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.752040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.200 qpair failed and we were unable to recover it. 00:27:46.200 [2024-11-29 02:32:49.752147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.752247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.752275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.200 qpair failed and we were unable to recover it. 00:27:46.200 [2024-11-29 02:32:49.752407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.752534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.752558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.200 qpair failed and we were unable to recover it. 00:27:46.200 [2024-11-29 02:32:49.752648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.752741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.752765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.200 qpair failed and we were unable to recover it. 00:27:46.200 [2024-11-29 02:32:49.752899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.753039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.753067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.200 qpair failed and we were unable to recover it. 00:27:46.200 [2024-11-29 02:32:49.753168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.753284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.753315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.200 qpair failed and we were unable to recover it. 00:27:46.200 [2024-11-29 02:32:49.753468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.753588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.753613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.200 qpair failed and we were unable to recover it. 00:27:46.200 [2024-11-29 02:32:49.753743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.753849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.753877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.200 qpair failed and we were unable to recover it. 00:27:46.200 [2024-11-29 02:32:49.753995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.754107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.754132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.200 qpair failed and we were unable to recover it. 00:27:46.200 [2024-11-29 02:32:49.754317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.754439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.754465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.200 qpair failed and we were unable to recover it. 00:27:46.200 [2024-11-29 02:32:49.754604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.754728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.754756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.200 qpair failed and we were unable to recover it. 00:27:46.200 [2024-11-29 02:32:49.754885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.755007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.755034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.200 qpair failed and we were unable to recover it. 00:27:46.200 [2024-11-29 02:32:49.755173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.755264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.755288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.200 qpair failed and we were unable to recover it. 00:27:46.200 [2024-11-29 02:32:49.755372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.755490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.755516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.200 qpair failed and we were unable to recover it. 00:27:46.200 [2024-11-29 02:32:49.755611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.755713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.755740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.200 qpair failed and we were unable to recover it. 00:27:46.200 [2024-11-29 02:32:49.755908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.755991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.756019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.200 qpair failed and we were unable to recover it. 00:27:46.200 [2024-11-29 02:32:49.756133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.756252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.756277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.200 qpair failed and we were unable to recover it. 00:27:46.200 [2024-11-29 02:32:49.756420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.756585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.756610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.200 qpair failed and we were unable to recover it. 00:27:46.200 [2024-11-29 02:32:49.756735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.756862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.756889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.200 qpair failed and we were unable to recover it. 00:27:46.200 [2024-11-29 02:32:49.757022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.757144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.757172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.200 qpair failed and we were unable to recover it. 00:27:46.200 [2024-11-29 02:32:49.757311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.757429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.757454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.200 qpair failed and we were unable to recover it. 00:27:46.200 [2024-11-29 02:32:49.757631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.757770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.757795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.200 qpair failed and we were unable to recover it. 00:27:46.200 [2024-11-29 02:32:49.757920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.758016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.758043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.200 qpair failed and we were unable to recover it. 00:27:46.200 [2024-11-29 02:32:49.758164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.758318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.758345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.200 qpair failed and we were unable to recover it. 00:27:46.200 [2024-11-29 02:32:49.758470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.758588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.758613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.200 qpair failed and we were unable to recover it. 00:27:46.200 [2024-11-29 02:32:49.758790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.758897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.758923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.200 qpair failed and we were unable to recover it. 00:27:46.200 [2024-11-29 02:32:49.759087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.200 [2024-11-29 02:32:49.759204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.759229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.759391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.759532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.759560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.759695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.759779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.759805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.759972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.760097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.760124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.760276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.760371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.760407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.760531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.760629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.760656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.760824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.760899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.760923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.761030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.761155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.761183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.761286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.761379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.761433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.761567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.761696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.761724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.761876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.761992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.762016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.762159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.762273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.762302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.762468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.762590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.762618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.762745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.762854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.762883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.763047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.763189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.763214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.763388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.763525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.763552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.763695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.763804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.763829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.763916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.764085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.764112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.764287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.764405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.764431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.764538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.764635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.764664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.764825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.764970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.764994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.765130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.765259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.765287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.765429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.765542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.765568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.765691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.765802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.765827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.765915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.766030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.766055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.766153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.766284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.766311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.766446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.766587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.766612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.766746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.766899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.766927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.767080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.767182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.767209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.201 qpair failed and we were unable to recover it. 00:27:46.201 [2024-11-29 02:32:49.767333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.201 [2024-11-29 02:32:49.767431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.767473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.202 [2024-11-29 02:32:49.767593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.767739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.767768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.202 [2024-11-29 02:32:49.767926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.768048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.768075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.202 [2024-11-29 02:32:49.768176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.768295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.768322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.202 [2024-11-29 02:32:49.768520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.768651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.768680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.202 [2024-11-29 02:32:49.768848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.768945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.768970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.202 [2024-11-29 02:32:49.769116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.769250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.769277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.202 [2024-11-29 02:32:49.769412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.769546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.769571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.202 [2024-11-29 02:32:49.769733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.769885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.769912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.202 [2024-11-29 02:32:49.770063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.770178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.770203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.202 [2024-11-29 02:32:49.770288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.770406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.770434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.202 [2024-11-29 02:32:49.770579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.770696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.770720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.202 [2024-11-29 02:32:49.770879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.771028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.771056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.202 [2024-11-29 02:32:49.771222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.771333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.771357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.202 [2024-11-29 02:32:49.771519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.771639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.771665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.202 [2024-11-29 02:32:49.771782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.771941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.771968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.202 [2024-11-29 02:32:49.772125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.772217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.772244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.202 [2024-11-29 02:32:49.772379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.772490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.772516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.202 [2024-11-29 02:32:49.772645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.772804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.772832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.202 [2024-11-29 02:32:49.772956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.773054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.773081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.202 [2024-11-29 02:32:49.773209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.773334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.773361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.202 [2024-11-29 02:32:49.773499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.773639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.773663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.202 [2024-11-29 02:32:49.773803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.773921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.773948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.202 [2024-11-29 02:32:49.774078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.774191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.774218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.202 [2024-11-29 02:32:49.774322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.774453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.774482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.202 [2024-11-29 02:32:49.774623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.774739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.774764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.202 [2024-11-29 02:32:49.774882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.775049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.202 [2024-11-29 02:32:49.775074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.202 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.775183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.775312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.775341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.775488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.775610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.775638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.775780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.775872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.775897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.776011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.776179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.776207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.776342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.776483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.776512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.776643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.776745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.776773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.776905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.777040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.777065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.777153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.777288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.777316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.777419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.777550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.777577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.777703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.777803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.777831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.777942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.778059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.778084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.778174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.778281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.778309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.778460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.778606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.778632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.778767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.778938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.778963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.779075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.779193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.779218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.779350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.779477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.779503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.779620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.779796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.779821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.779933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.780086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.780110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.780254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.780337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.780362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.780519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.780635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.780661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.780777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.780928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.780956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.781092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.781218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.781246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.781384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.781542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.781568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.781713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.781868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.781896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.782019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.782178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.782205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.782299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.782464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.782494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.782636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.782747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.782772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.782908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.782998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.783028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.203 qpair failed and we were unable to recover it. 00:27:46.203 [2024-11-29 02:32:49.783151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.783321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.203 [2024-11-29 02:32:49.783346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.783425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.783540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.783565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.783710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.783787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.783812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.783957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.784058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.784088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.784222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.784377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.784424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.784545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.784629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.784672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.784817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.784907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.784932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.785068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.785197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.785226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.785361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.785501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.785527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.785637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.785744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.785785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.785892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.786005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.786031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.786171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.786290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.786318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.786421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.786554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.786582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.786736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.786861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.786890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.787019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.787159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.787184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.787353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.787486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.787516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.787659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.787782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.787811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.787974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.788068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.788096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.788248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.788356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.788382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.788498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.788629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.788657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.788796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.788931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.788956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.789088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.789213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.789241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.789425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.789504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.789529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.789698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.789780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.789807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.789935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.790091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.790118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.790272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.790355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.790383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.790527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.790672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.790698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.790842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.790973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.791002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.791098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.791246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.791272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.204 qpair failed and we were unable to recover it. 00:27:46.204 [2024-11-29 02:32:49.791419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.791583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.204 [2024-11-29 02:32:49.791611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.205 qpair failed and we were unable to recover it. 00:27:46.205 [2024-11-29 02:32:49.791730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.791840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.791866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.205 qpair failed and we were unable to recover it. 00:27:46.205 [2024-11-29 02:32:49.791959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.792069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.792094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.205 qpair failed and we were unable to recover it. 00:27:46.205 [2024-11-29 02:32:49.792178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.792262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.792302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.205 qpair failed and we were unable to recover it. 00:27:46.205 [2024-11-29 02:32:49.792437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.792533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.792561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.205 qpair failed and we were unable to recover it. 00:27:46.205 [2024-11-29 02:32:49.792704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.792815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.792841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.205 qpair failed and we were unable to recover it. 00:27:46.205 [2024-11-29 02:32:49.792950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.793109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.793137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.205 qpair failed and we were unable to recover it. 00:27:46.205 [2024-11-29 02:32:49.793238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.793339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.793367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.205 qpair failed and we were unable to recover it. 00:27:46.205 [2024-11-29 02:32:49.793490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.793605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.793630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.205 qpair failed and we were unable to recover it. 00:27:46.205 [2024-11-29 02:32:49.793743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.793825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.793854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.205 qpair failed and we were unable to recover it. 00:27:46.205 [2024-11-29 02:32:49.793995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.794114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.794143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.205 qpair failed and we were unable to recover it. 00:27:46.205 [2024-11-29 02:32:49.794255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.794408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.794436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.205 qpair failed and we were unable to recover it. 00:27:46.205 [2024-11-29 02:32:49.794540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.794675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.794703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.205 qpair failed and we were unable to recover it. 00:27:46.205 [2024-11-29 02:32:49.794840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.794957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.794983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.205 qpair failed and we were unable to recover it. 00:27:46.205 [2024-11-29 02:32:49.795150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.795302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.795330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.205 qpair failed and we were unable to recover it. 00:27:46.205 [2024-11-29 02:32:49.795458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.795631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.795656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.205 qpair failed and we were unable to recover it. 00:27:46.205 [2024-11-29 02:32:49.795764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.795883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.795926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.205 qpair failed and we were unable to recover it. 00:27:46.205 [2024-11-29 02:32:49.796060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.796172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.796198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.205 qpair failed and we were unable to recover it. 00:27:46.205 [2024-11-29 02:32:49.796293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.796446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.796476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.205 qpair failed and we were unable to recover it. 00:27:46.205 [2024-11-29 02:32:49.796571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.796701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.796734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.205 qpair failed and we were unable to recover it. 00:27:46.205 [2024-11-29 02:32:49.796856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.796973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.797001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.205 qpair failed and we were unable to recover it. 00:27:46.205 [2024-11-29 02:32:49.797108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.797225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.797250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.205 qpair failed and we were unable to recover it. 00:27:46.205 [2024-11-29 02:32:49.797349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.797435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.797462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.205 qpair failed and we were unable to recover it. 00:27:46.205 [2024-11-29 02:32:49.797610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.205 [2024-11-29 02:32:49.797780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.797806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.797925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.798003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.798043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.798146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.798266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.798291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.798433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.798598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.798627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.798747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.798846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.798874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.799003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.799121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.799150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.799296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.799412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.799439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.799583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.799745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.799773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.799915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.800028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.800053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.800219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.800347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.800374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.800544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.800658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.800682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.800825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.800969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.800993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.801114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.801248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.801277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.801424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.801552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.801580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.801749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.801840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.801864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.801995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.802114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.802141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.802270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.802370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.802404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.802558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.802701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.802727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.802815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.802892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.802918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.803010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.803120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.803145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.803271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.803409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.803438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.803537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.803691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.803719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.803859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.803936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.803961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.804092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.804192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.804220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.804320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.804449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.804478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.804580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.804722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.804749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.804857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.804975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.805001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.805139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.805270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.805298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.805467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.805584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.805609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.206 qpair failed and we were unable to recover it. 00:27:46.206 [2024-11-29 02:32:49.805773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.206 [2024-11-29 02:32:49.805897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.805925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.806046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.806167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.806192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.806282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.806401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.806427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.806526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.806658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.806686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.806812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.806967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.806994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.807157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.807273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.807298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.807439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.807534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.807562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.807694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.807776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.807801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.807917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.808046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.808079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.808216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.808357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.808382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.808527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.808620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.808648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.808769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.808892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.808920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.809018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.809113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.809140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.809273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.809351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.809377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.809518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.809675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.809703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.809805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.809903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.809930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.810065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.810158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.810185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.810306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.810389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.810422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.810560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.810679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.810706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.810808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.810929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.810956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.811086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.811210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.811250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.811365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.811489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.811515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.811636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.811725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.811750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.811878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.812002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.812032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.812157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.812285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.812313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.812419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.812536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.812560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.812670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.812804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.812834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.812956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.813075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.813102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.813197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.813319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.813348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.207 qpair failed and we were unable to recover it. 00:27:46.207 [2024-11-29 02:32:49.813515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.207 [2024-11-29 02:32:49.813632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.208 [2024-11-29 02:32:49.813657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.208 qpair failed and we were unable to recover it. 00:27:46.208 [2024-11-29 02:32:49.813795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.208 [2024-11-29 02:32:49.813941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.208 [2024-11-29 02:32:49.813966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.208 qpair failed and we were unable to recover it. 00:27:46.508 [2024-11-29 02:32:49.814084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.814197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.814222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.508 qpair failed and we were unable to recover it. 00:27:46.508 [2024-11-29 02:32:49.814316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.814413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.814439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.508 qpair failed and we were unable to recover it. 00:27:46.508 [2024-11-29 02:32:49.814548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.814687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.814712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.508 qpair failed and we were unable to recover it. 00:27:46.508 [2024-11-29 02:32:49.814823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.814982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.815010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.508 qpair failed and we were unable to recover it. 00:27:46.508 [2024-11-29 02:32:49.815144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.815304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.815333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.508 qpair failed and we were unable to recover it. 00:27:46.508 [2024-11-29 02:32:49.815442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.815570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.815597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.508 qpair failed and we were unable to recover it. 00:27:46.508 [2024-11-29 02:32:49.815739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.815822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.815847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.508 qpair failed and we were unable to recover it. 00:27:46.508 [2024-11-29 02:32:49.815994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.816126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.816154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.508 qpair failed and we were unable to recover it. 00:27:46.508 [2024-11-29 02:32:49.816289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.816417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.816448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.508 qpair failed and we were unable to recover it. 00:27:46.508 [2024-11-29 02:32:49.816600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.816695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.816724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.508 qpair failed and we were unable to recover it. 00:27:46.508 [2024-11-29 02:32:49.816874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.816986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.817012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.508 qpair failed and we were unable to recover it. 00:27:46.508 [2024-11-29 02:32:49.817162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.817275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.817300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.508 qpair failed and we were unable to recover it. 00:27:46.508 [2024-11-29 02:32:49.817390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.817566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.817592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.508 qpair failed and we were unable to recover it. 00:27:46.508 [2024-11-29 02:32:49.817678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.817764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.817789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.508 qpair failed and we were unable to recover it. 00:27:46.508 [2024-11-29 02:32:49.817884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.818026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.818050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.508 qpair failed and we were unable to recover it. 00:27:46.508 [2024-11-29 02:32:49.818177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.818273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.818301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.508 qpair failed and we were unable to recover it. 00:27:46.508 [2024-11-29 02:32:49.818425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.818523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.818552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.508 qpair failed and we were unable to recover it. 00:27:46.508 [2024-11-29 02:32:49.818650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.818768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.818797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.508 qpair failed and we were unable to recover it. 00:27:46.508 [2024-11-29 02:32:49.818899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.819048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.819074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.508 qpair failed and we were unable to recover it. 00:27:46.508 [2024-11-29 02:32:49.819181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.819308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.819350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.508 qpair failed and we were unable to recover it. 00:27:46.508 [2024-11-29 02:32:49.819473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.819607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.819635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.508 qpair failed and we were unable to recover it. 00:27:46.508 [2024-11-29 02:32:49.819733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.819819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.819847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.508 qpair failed and we were unable to recover it. 00:27:46.508 [2024-11-29 02:32:49.819983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.820093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.820118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.508 qpair failed and we were unable to recover it. 00:27:46.508 [2024-11-29 02:32:49.820207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.820346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.508 [2024-11-29 02:32:49.820375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.508 qpair failed and we were unable to recover it. 00:27:46.508 [2024-11-29 02:32:49.820532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.820615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.820639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.820720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.820820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.820848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.820968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.821053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.821079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.821196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.821329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.821357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.821486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.821606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.821639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.821736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.821863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.821891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.822034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.822120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.822145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.822227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.822319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.822345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.822425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.822501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.822526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.822701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.822831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.822859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.822996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.823150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.823175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.823312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.823431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.823460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.823579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.823680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.823708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.823840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.823934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.823962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.824095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.824239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.824264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.824376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.824512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.824547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.824678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.824800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.824828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.824956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.825049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.825077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.825181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.825289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.825315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.825448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.825591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.825616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.825713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.825824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.825849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.825991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.826115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.826144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.826312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.826468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.826497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.826660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.826746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.826773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.826874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.826992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.827020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.827157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.827313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.827341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.827443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.827527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.827552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.827667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.827798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.827828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.509 qpair failed and we were unable to recover it. 00:27:46.509 [2024-11-29 02:32:49.827949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.509 [2024-11-29 02:32:49.828050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.828076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.828161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.828268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.828292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.828381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.828475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.828502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.828650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.828784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.828812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.828902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.828989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.829033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.829112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.829197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.829221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.829367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.829450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.829475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.829574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.829698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.829727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.829889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.829974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.830002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.830129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.830281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.830310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.830450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.830539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.830564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.830694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.830845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.830873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.831004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.831100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.831128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.831258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.831344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.831372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.831527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.831609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.831634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.831768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.831868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.831896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.832054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.832147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.832174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.832270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.832369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.832407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.832511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.832603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.832628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.832776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.832904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.832932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.833051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.833170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.833199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.833297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.833421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.833449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.833616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.833742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.833768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.833919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.834088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.834114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.834238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.834408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.834434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.834548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.834719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.834747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.834880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.835022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.510 [2024-11-29 02:32:49.835047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.510 qpair failed and we were unable to recover it. 00:27:46.510 [2024-11-29 02:32:49.835188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.835337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.835369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.835524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.835618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.835643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.835725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.835838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.835863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.836015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.836094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.836119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.836257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.836379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.836414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.836544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.836644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.836672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.836769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.836923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.836950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.837118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.837233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.837257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.837361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.837531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.837557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.837713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.837878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.837906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.838033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.838187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.838214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.838368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.838495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.838520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.838617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.838743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.838770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.838899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.839020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.839048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.839204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.839370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.839401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.839523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.839644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.839669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.839810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.839906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.839934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.840058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.840186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.840215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.840371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.840513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.840538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.840630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.840740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.840765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.840898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.841029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.841056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.841203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.841295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.841320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.841477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.841605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.841634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.841769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.841911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.841937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.842036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.842186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.842214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.842372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.842527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.842553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.842671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.842791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.842815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.842934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.843048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.843072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.843217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.843310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.511 [2024-11-29 02:32:49.843338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.511 qpair failed and we were unable to recover it. 00:27:46.511 [2024-11-29 02:32:49.843465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.843587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.843614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.512 qpair failed and we were unable to recover it. 00:27:46.512 [2024-11-29 02:32:49.843724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.843850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.843877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.512 qpair failed and we were unable to recover it. 00:27:46.512 [2024-11-29 02:32:49.843999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.844145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.844170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.512 qpair failed and we were unable to recover it. 00:27:46.512 [2024-11-29 02:32:49.844309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.844406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.844435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.512 qpair failed and we were unable to recover it. 00:27:46.512 [2024-11-29 02:32:49.844530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.844620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.844647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.512 qpair failed and we were unable to recover it. 00:27:46.512 [2024-11-29 02:32:49.844767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.844917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.844944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.512 qpair failed and we were unable to recover it. 00:27:46.512 [2024-11-29 02:32:49.845090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.845199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.845223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.512 qpair failed and we were unable to recover it. 00:27:46.512 [2024-11-29 02:32:49.845345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.845467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.845495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.512 qpair failed and we were unable to recover it. 00:27:46.512 [2024-11-29 02:32:49.845597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.845698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.845726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.512 qpair failed and we were unable to recover it. 00:27:46.512 [2024-11-29 02:32:49.845849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.845938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.845967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.512 qpair failed and we were unable to recover it. 00:27:46.512 [2024-11-29 02:32:49.846131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.846274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.846300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.512 qpair failed and we were unable to recover it. 00:27:46.512 [2024-11-29 02:32:49.846453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.846577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.846602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.512 qpair failed and we were unable to recover it. 00:27:46.512 [2024-11-29 02:32:49.846737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.846884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.846915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.512 qpair failed and we were unable to recover it. 00:27:46.512 [2024-11-29 02:32:49.847057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.847220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.847247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.512 qpair failed and we were unable to recover it. 00:27:46.512 [2024-11-29 02:32:49.847388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.847512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.847536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.512 qpair failed and we were unable to recover it. 00:27:46.512 [2024-11-29 02:32:49.847676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.847799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.847827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.512 qpair failed and we were unable to recover it. 00:27:46.512 [2024-11-29 02:32:49.847999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.848099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.848127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.512 qpair failed and we were unable to recover it. 00:27:46.512 [2024-11-29 02:32:49.848252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.848355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.848384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.512 qpair failed and we were unable to recover it. 00:27:46.512 [2024-11-29 02:32:49.848557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.848672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.848697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.512 qpair failed and we were unable to recover it. 00:27:46.512 [2024-11-29 02:32:49.848865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.848963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.848991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.512 qpair failed and we were unable to recover it. 00:27:46.512 [2024-11-29 02:32:49.849111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.849232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.849259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.512 qpair failed and we were unable to recover it. 00:27:46.512 [2024-11-29 02:32:49.849379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.849546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.849574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.512 qpair failed and we were unable to recover it. 00:27:46.512 [2024-11-29 02:32:49.849684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.849825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.849849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.512 qpair failed and we were unable to recover it. 00:27:46.512 [2024-11-29 02:32:49.849947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.850061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.850103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.512 qpair failed and we were unable to recover it. 00:27:46.512 [2024-11-29 02:32:49.850259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.850380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.512 [2024-11-29 02:32:49.850415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.512 qpair failed and we were unable to recover it. 00:27:46.512 [2024-11-29 02:32:49.850573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.850722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.850750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.513 [2024-11-29 02:32:49.850854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.850944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.850968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.513 [2024-11-29 02:32:49.851090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.851242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.851270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.513 [2024-11-29 02:32:49.851360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.851513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.851540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.513 [2024-11-29 02:32:49.851662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.851793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.851821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.513 [2024-11-29 02:32:49.851954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.852094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.852119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.513 [2024-11-29 02:32:49.852292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.852469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.852494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.513 [2024-11-29 02:32:49.852591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.852748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.852776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.513 [2024-11-29 02:32:49.852889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.853012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.853040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.513 [2024-11-29 02:32:49.853142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.853228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.853255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.513 [2024-11-29 02:32:49.853374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.853486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.853515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.513 [2024-11-29 02:32:49.853670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.853789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.853817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.513 [2024-11-29 02:32:49.853980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.854119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.854144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.513 [2024-11-29 02:32:49.854263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.854375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.854406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.513 [2024-11-29 02:32:49.854539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.854690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.854718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.513 [2024-11-29 02:32:49.854817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.854914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.854941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.513 [2024-11-29 02:32:49.855068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.855162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.855190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.513 [2024-11-29 02:32:49.855325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.855415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.855441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.513 [2024-11-29 02:32:49.855567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.855681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.855723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.513 [2024-11-29 02:32:49.855854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.855982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.856007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.513 [2024-11-29 02:32:49.856097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.856196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.856225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.513 [2024-11-29 02:32:49.856328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.856441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.856467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.513 [2024-11-29 02:32:49.856596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.856721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.856749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.513 [2024-11-29 02:32:49.856898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.857028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.857056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.513 [2024-11-29 02:32:49.857212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.857301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.857329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.513 [2024-11-29 02:32:49.857439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.857559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.857584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.513 [2024-11-29 02:32:49.857719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.857869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.513 [2024-11-29 02:32:49.857897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.513 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.857986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.858091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.858119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.858270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.858405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.858436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.858570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.858687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.858712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.858862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.859024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.859052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.859174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.859312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.859337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.859452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.859568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.859595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.859708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.859851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.859876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.859995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.860080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.860105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.860217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.860358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.860387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.860546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.860620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.860645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.860743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.860883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.860908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.861080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.861208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.861242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.861334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.861464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.861494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.861616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.861766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.861795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.861953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.862093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.862118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.862269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.862403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.862433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.862561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.862685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.862714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.862808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.862929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.862957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.863072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.863160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.863184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.863307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.863411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.863439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.863535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.863687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.863714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.863842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.863968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.863996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.864120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.864230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.864256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.864387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.864542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.864570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.864725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.864849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.864877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.865009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.865099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.865124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.865238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.865378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.865411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.865534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.865614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.865640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.514 qpair failed and we were unable to recover it. 00:27:46.514 [2024-11-29 02:32:49.865752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.514 [2024-11-29 02:32:49.865898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.865926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.515 qpair failed and we were unable to recover it. 00:27:46.515 [2024-11-29 02:32:49.866048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.866182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.866207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.515 qpair failed and we were unable to recover it. 00:27:46.515 [2024-11-29 02:32:49.866325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.866469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.866495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.515 qpair failed and we were unable to recover it. 00:27:46.515 [2024-11-29 02:32:49.866653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.866805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.866830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.515 qpair failed and we were unable to recover it. 00:27:46.515 [2024-11-29 02:32:49.866940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.867094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.867122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.515 qpair failed and we were unable to recover it. 00:27:46.515 [2024-11-29 02:32:49.867216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.867338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.867378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.515 qpair failed and we were unable to recover it. 00:27:46.515 [2024-11-29 02:32:49.867472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.867614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.867639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.515 qpair failed and we were unable to recover it. 00:27:46.515 [2024-11-29 02:32:49.867752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.867906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.867934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.515 qpair failed and we were unable to recover it. 00:27:46.515 [2024-11-29 02:32:49.868036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.868156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.868183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.515 qpair failed and we were unable to recover it. 00:27:46.515 [2024-11-29 02:32:49.868308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.868459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.868487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.515 qpair failed and we were unable to recover it. 00:27:46.515 [2024-11-29 02:32:49.868651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.868764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.868789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.515 qpair failed and we were unable to recover it. 00:27:46.515 [2024-11-29 02:32:49.868957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.869088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.869116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.515 qpair failed and we were unable to recover it. 00:27:46.515 [2024-11-29 02:32:49.869239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.869367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.869400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.515 qpair failed and we were unable to recover it. 00:27:46.515 [2024-11-29 02:32:49.869532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.869653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.869678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.515 qpair failed and we were unable to recover it. 00:27:46.515 [2024-11-29 02:32:49.869768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.869886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.869911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.515 qpair failed and we were unable to recover it. 00:27:46.515 [2024-11-29 02:32:49.869999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.870109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.870134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.515 qpair failed and we were unable to recover it. 00:27:46.515 [2024-11-29 02:32:49.870277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.870360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.870410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.515 qpair failed and we were unable to recover it. 00:27:46.515 [2024-11-29 02:32:49.870550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.870677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.870702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.515 qpair failed and we were unable to recover it. 00:27:46.515 [2024-11-29 02:32:49.870843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.870986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.871011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.515 qpair failed and we were unable to recover it. 00:27:46.515 [2024-11-29 02:32:49.871135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.871253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.871278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.515 qpair failed and we were unable to recover it. 00:27:46.515 [2024-11-29 02:32:49.871406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.871527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.871552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.515 qpair failed and we were unable to recover it. 00:27:46.515 [2024-11-29 02:32:49.871639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.871779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.871804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.515 qpair failed and we were unable to recover it. 00:27:46.515 [2024-11-29 02:32:49.871927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.872010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.872036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.515 qpair failed and we were unable to recover it. 00:27:46.515 [2024-11-29 02:32:49.872181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.872303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.872328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.515 qpair failed and we were unable to recover it. 00:27:46.515 [2024-11-29 02:32:49.872417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.872509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.872542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.515 qpair failed and we were unable to recover it. 00:27:46.515 [2024-11-29 02:32:49.872697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.872789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.515 [2024-11-29 02:32:49.872814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.515 qpair failed and we were unable to recover it. 00:27:46.515 [2024-11-29 02:32:49.872937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.873082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.873107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.873253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.873340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.873365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.873492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.873605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.873630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.873781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.873900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.873925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.874072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.874181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.874206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.874292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.874411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.874436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.874526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.874603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.874627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.874734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.874880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.874905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.875021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.875139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.875168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.875281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.875414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.875440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.875554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.875667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.875692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.875773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.875887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.875911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.876028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.876110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.876136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.876254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.876406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.876432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.876558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.876638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.876662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.876770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.876893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.876917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.877062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.877172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.877196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.877314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.877402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.877427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.877543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.877657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.877681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.877832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.877944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.877969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.878055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.878135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.878159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.878272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.878389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.878418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.878532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.878649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.878673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.878764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.878914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.878939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.879029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.879145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.879170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.879290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.879410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.879436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.879514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.879591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.879615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.879757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.879875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.879900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.880017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.880099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.880124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.516 qpair failed and we were unable to recover it. 00:27:46.516 [2024-11-29 02:32:49.880245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.516 [2024-11-29 02:32:49.880356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.880382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.517 qpair failed and we were unable to recover it. 00:27:46.517 [2024-11-29 02:32:49.880531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.880627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.880652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.517 qpair failed and we were unable to recover it. 00:27:46.517 [2024-11-29 02:32:49.880765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.880860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.880885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.517 qpair failed and we were unable to recover it. 00:27:46.517 [2024-11-29 02:32:49.881008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.881128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.881153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.517 qpair failed and we were unable to recover it. 00:27:46.517 [2024-11-29 02:32:49.881268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.881354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.881379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.517 qpair failed and we were unable to recover it. 00:27:46.517 [2024-11-29 02:32:49.881483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.881620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.881645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.517 qpair failed and we were unable to recover it. 00:27:46.517 [2024-11-29 02:32:49.881763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.881855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.881879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.517 qpair failed and we were unable to recover it. 00:27:46.517 [2024-11-29 02:32:49.881961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.882069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.882094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.517 qpair failed and we were unable to recover it. 00:27:46.517 [2024-11-29 02:32:49.882206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.882314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.882339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.517 qpair failed and we were unable to recover it. 00:27:46.517 [2024-11-29 02:32:49.882484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.882629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.882654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.517 qpair failed and we were unable to recover it. 00:27:46.517 [2024-11-29 02:32:49.882736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.882821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.882846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.517 qpair failed and we were unable to recover it. 00:27:46.517 [2024-11-29 02:32:49.882969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.883085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.883112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.517 qpair failed and we were unable to recover it. 00:27:46.517 [2024-11-29 02:32:49.883237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.883317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.883341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.517 qpair failed and we were unable to recover it. 00:27:46.517 [2024-11-29 02:32:49.883436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.883546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.883571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.517 qpair failed and we were unable to recover it. 00:27:46.517 [2024-11-29 02:32:49.883688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.883796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.883822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.517 qpair failed and we were unable to recover it. 00:27:46.517 [2024-11-29 02:32:49.883912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.884021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.884046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.517 qpair failed and we were unable to recover it. 00:27:46.517 [2024-11-29 02:32:49.884201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.884292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.884317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.517 qpair failed and we were unable to recover it. 00:27:46.517 [2024-11-29 02:32:49.884412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.884553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.884579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.517 qpair failed and we were unable to recover it. 00:27:46.517 [2024-11-29 02:32:49.884663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.884782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.884807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.517 qpair failed and we were unable to recover it. 00:27:46.517 [2024-11-29 02:32:49.884926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.885036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.885061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.517 qpair failed and we were unable to recover it. 00:27:46.517 [2024-11-29 02:32:49.885216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.885297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.885327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.517 qpair failed and we were unable to recover it. 00:27:46.517 [2024-11-29 02:32:49.885440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.885558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.885584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.517 qpair failed and we were unable to recover it. 00:27:46.517 [2024-11-29 02:32:49.885694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.885768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.885793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.517 qpair failed and we were unable to recover it. 00:27:46.517 [2024-11-29 02:32:49.885942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.886061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.886086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.517 qpair failed and we were unable to recover it. 00:27:46.517 [2024-11-29 02:32:49.886218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.886360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.886385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.517 qpair failed and we were unable to recover it. 00:27:46.517 [2024-11-29 02:32:49.886513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.886655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.517 [2024-11-29 02:32:49.886681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.517 qpair failed and we were unable to recover it. 00:27:46.517 [2024-11-29 02:32:49.886795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.886904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.886930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.887052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.887159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.887184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.887293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.887380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.887419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.887502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.887623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.887648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.887746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.887862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.887887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.888038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.888119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.888145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.888264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.888374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.888407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.888502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.888584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.888609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.888695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.888812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.888837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.888950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.889040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.889066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.889184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.889294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.889320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.889422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.889511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.889537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.889631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.889746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.889771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.889888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.890029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.890055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.890140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.890222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.890248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.890361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.890450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.890476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.890565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.890651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.890676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.890790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.890882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.890907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.891026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.891141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.891167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.891283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.891365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.891391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.891511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.891623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.891648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.891769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.891922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.891948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.892037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.892152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.892178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.892268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.892377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.892408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.892489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.892582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.892607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.892727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.892832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.892858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.892943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.893061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.893087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.893175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.893294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.893319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.893430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.893521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.518 [2024-11-29 02:32:49.893546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.518 qpair failed and we were unable to recover it. 00:27:46.518 [2024-11-29 02:32:49.893632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.893720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.893745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.893863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.894014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.894039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.894122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.894205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.894230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.894349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.894518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.894544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.894690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.894816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.894843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.894997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.895073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.895098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.895182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.895300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.895325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.895424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.895503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.895527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.895648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.895758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.895782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.895860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.895998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.896024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.896135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.896217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.896242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.896333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.896475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.896501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.896595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.896683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.896708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.896818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.896896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.896920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.897005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.897115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.897140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.897223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.897332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.897357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.897484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.897591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.897620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.897706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.897823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.897849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.897996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.898107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.898133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.898213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.898289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.898314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.898436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.898518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.898542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.898630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.898755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.898781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.898864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.898946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.898970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.899052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.899146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.899172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.899319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.899403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.899428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.899519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.899626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.899651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.899769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.899859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.899883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.899982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.900068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.900093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.900208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.900285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.900310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.519 qpair failed and we were unable to recover it. 00:27:46.519 [2024-11-29 02:32:49.900456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.519 [2024-11-29 02:32:49.900550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.900576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.900693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.900811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.900836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.900932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.901073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.901098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.901251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.901397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.901422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.901568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.901655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.901679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.901824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.901939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.901963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.902111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.902235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.902259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.902382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.902530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.902555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.902643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.902727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.902751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.902862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.902982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.903007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.903148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.903291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.903316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.903433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.903551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.903575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.903691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.903802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.903826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.903935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.904029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.904054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.904181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.904277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.904301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.904391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.904486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.904510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.904647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.904760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.904785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.904872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.904978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.905003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.905117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.905211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.905236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.905357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.905473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.905498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.905585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.905677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.905702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.905788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.905875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.905899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.906018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.906105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.906131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.906248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.906329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.906353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.906498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.906588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.906612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.906696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.906812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.906837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.906954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.907070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.907095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.907212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.907293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.907317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.907435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.907548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.907577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.520 qpair failed and we were unable to recover it. 00:27:46.520 [2024-11-29 02:32:49.907724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.520 [2024-11-29 02:32:49.907810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.907834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.907978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.908095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.908120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.908213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.908304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.908329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.908445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.908564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.908589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.908674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.908767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.908792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.908933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.909074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.909099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.909248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.909336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.909360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.909507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.909596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.909622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.909717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.909860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.909886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.910028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.910126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.910157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.910275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.910355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.910379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.910524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.910644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.910671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.910817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.910922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.910947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.911069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.911185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.911210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.911365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.911488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.911512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.911644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.911733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.911757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.911858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.912001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.912026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.912144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.912257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.912281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.912454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.912576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.912601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.912747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.912837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.912861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.912984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.913088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.913113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.913256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.913350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.913374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.913528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.913609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.913633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.913745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.913884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.913908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.913994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.914082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.914107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.914197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.914283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.914307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.914423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.914532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.914556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.914678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.914766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.914791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.914879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.914994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.915020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.521 qpair failed and we were unable to recover it. 00:27:46.521 [2024-11-29 02:32:49.915138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.915250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.521 [2024-11-29 02:32:49.915274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.522 qpair failed and we were unable to recover it. 00:27:46.522 [2024-11-29 02:32:49.915376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.915477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.915507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.522 qpair failed and we were unable to recover it. 00:27:46.522 [2024-11-29 02:32:49.915659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.915781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.915807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.522 qpair failed and we were unable to recover it. 00:27:46.522 [2024-11-29 02:32:49.915955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.916095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.916140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.522 qpair failed and we were unable to recover it. 00:27:46.522 [2024-11-29 02:32:49.916265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.916359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.916386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.522 qpair failed and we were unable to recover it. 00:27:46.522 [2024-11-29 02:32:49.916519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.916664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.916691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.522 qpair failed and we were unable to recover it. 00:27:46.522 [2024-11-29 02:32:49.916814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.916932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.916959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.522 qpair failed and we were unable to recover it. 00:27:46.522 [2024-11-29 02:32:49.917086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.917205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.917231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.522 qpair failed and we were unable to recover it. 00:27:46.522 [2024-11-29 02:32:49.917349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.917466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.917493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.522 qpair failed and we were unable to recover it. 00:27:46.522 [2024-11-29 02:32:49.917609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.917720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.917746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.522 qpair failed and we were unable to recover it. 00:27:46.522 [2024-11-29 02:32:49.917868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.917983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.918009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.522 qpair failed and we were unable to recover it. 00:27:46.522 [2024-11-29 02:32:49.918109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.918229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.918256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.522 qpair failed and we were unable to recover it. 00:27:46.522 [2024-11-29 02:32:49.918377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.918529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.918556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.522 qpair failed and we were unable to recover it. 00:27:46.522 [2024-11-29 02:32:49.918676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.918765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.918793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.522 qpair failed and we were unable to recover it. 00:27:46.522 [2024-11-29 02:32:49.918917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.919005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.919031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.522 qpair failed and we were unable to recover it. 00:27:46.522 [2024-11-29 02:32:49.919150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.919261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.919287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.522 qpair failed and we were unable to recover it. 00:27:46.522 [2024-11-29 02:32:49.919415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.919529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.919555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.522 qpair failed and we were unable to recover it. 00:27:46.522 [2024-11-29 02:32:49.919675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.919797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.919823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.522 qpair failed and we were unable to recover it. 00:27:46.522 [2024-11-29 02:32:49.919913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.920030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.920056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.522 qpair failed and we were unable to recover it. 00:27:46.522 [2024-11-29 02:32:49.920153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.920265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.920291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.522 qpair failed and we were unable to recover it. 00:27:46.522 [2024-11-29 02:32:49.920387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.920523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.920549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.522 qpair failed and we were unable to recover it. 00:27:46.522 [2024-11-29 02:32:49.920634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.920753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.920779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.522 qpair failed and we were unable to recover it. 00:27:46.522 [2024-11-29 02:32:49.920879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.920996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.921022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.522 qpair failed and we were unable to recover it. 00:27:46.522 [2024-11-29 02:32:49.921114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.921224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.921250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.522 qpair failed and we were unable to recover it. 00:27:46.522 [2024-11-29 02:32:49.921371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.921491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.921517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.522 qpair failed and we were unable to recover it. 00:27:46.522 [2024-11-29 02:32:49.921659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.921802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.921827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.522 qpair failed and we were unable to recover it. 00:27:46.522 [2024-11-29 02:32:49.921952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.522 [2024-11-29 02:32:49.922070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.922097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.922194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.922314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.922340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.922434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.922549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.922575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.922698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.922814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.922840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.922957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.923068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.923094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.923219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.923344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.923372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.923478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.923570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.923598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.923711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.923854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.923880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.924001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.924119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.924146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.924238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.924324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.924350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.924445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.924529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.924556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.924699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.924782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.924808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.924931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.925044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.925070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.925182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.925337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.925363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.925451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.925567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.925593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.925684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.925830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.925857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.925978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.926091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.926117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.926205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.926349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.926375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.926475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.926620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.926646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.926803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.926923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.926949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.927044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.927162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.927188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.927272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.927388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.927433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.927583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.927696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.927722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.927805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.927952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.927979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.928102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.928219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.928245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.928371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.928519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.928551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.928646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.928767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.928793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.928916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.929037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.929063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.523 [2024-11-29 02:32:49.929207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.929326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.523 [2024-11-29 02:32:49.929352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.523 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.929483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.929603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.929629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.929730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.929817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.929844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.929962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.930042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.930068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.930215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.930292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.930318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.930424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.930546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.930572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.930671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.930793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.930819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.930932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.931070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.931101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.931258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.931342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.931368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.931492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.931612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.931638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.931752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.931869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.931896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.932015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.932124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.932150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.932271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.932389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.932420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.932540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.932625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.932652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.932773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.932856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.932883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.933006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.933095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.933121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.933221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.933329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.933355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.933505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.933650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.933680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.933823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.933942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.933968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.934084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.934203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.934229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.934343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.934504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.934534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.934679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.934836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.934880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.934997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.935118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.935145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.935263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.935412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.935439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.935575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.935722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.935751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.935889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.935983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.936010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.936156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.936239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.936265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.936381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.936498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.936550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.936672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.936820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.936846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.524 qpair failed and we were unable to recover it. 00:27:46.524 [2024-11-29 02:32:49.936965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.937059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.524 [2024-11-29 02:32:49.937085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.937200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.937312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.937337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.937458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.937584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.937611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.937700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.937822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.937848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.937968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.938057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.938085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.938195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.938337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.938363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.938537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.938688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.938730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.938897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.938998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.939025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.939142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.939263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.939289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.939456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.939590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.939616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.939704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.939826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.939852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.940001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.940117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.940143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.940288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.940378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.940410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.940531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.940673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.940699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.940789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.940906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.940931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.941053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.941163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.941189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.941270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.941356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.941382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.941510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.941627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.941654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.941739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.941856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.941883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.942039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.942129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.942155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.942279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.942400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.942427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.942561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.942640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.942667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.942813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.942927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.942952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.943051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.943130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.943156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.943279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.943425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.943452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.943616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.943770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.943814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.943931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.944042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.944068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.944156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.944300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.944326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.944464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.944603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.525 [2024-11-29 02:32:49.944629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.525 qpair failed and we were unable to recover it. 00:27:46.525 [2024-11-29 02:32:49.944775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.944916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.944942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.526 qpair failed and we were unable to recover it. 00:27:46.526 [2024-11-29 02:32:49.945061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.945147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.945173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.526 qpair failed and we were unable to recover it. 00:27:46.526 [2024-11-29 02:32:49.945267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.945376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.945408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.526 qpair failed and we were unable to recover it. 00:27:46.526 [2024-11-29 02:32:49.945555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.945697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.945741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.526 qpair failed and we were unable to recover it. 00:27:46.526 [2024-11-29 02:32:49.945884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.945995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.946022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.526 qpair failed and we were unable to recover it. 00:27:46.526 [2024-11-29 02:32:49.946115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.946231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.946257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.526 qpair failed and we were unable to recover it. 00:27:46.526 [2024-11-29 02:32:49.946345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.946438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.946464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.526 qpair failed and we were unable to recover it. 00:27:46.526 [2024-11-29 02:32:49.946590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.946704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.946730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.526 qpair failed and we were unable to recover it. 00:27:46.526 [2024-11-29 02:32:49.946880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.946969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.946995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.526 qpair failed and we were unable to recover it. 00:27:46.526 [2024-11-29 02:32:49.947105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.947248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.947274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.526 qpair failed and we were unable to recover it. 00:27:46.526 [2024-11-29 02:32:49.947423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.947536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.947563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.526 qpair failed and we were unable to recover it. 00:27:46.526 [2024-11-29 02:32:49.947653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.947735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.947761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.526 qpair failed and we were unable to recover it. 00:27:46.526 [2024-11-29 02:32:49.947841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.947935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.947962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.526 qpair failed and we were unable to recover it. 00:27:46.526 [2024-11-29 02:32:49.948081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.948169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.948194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.526 qpair failed and we were unable to recover it. 00:27:46.526 [2024-11-29 02:32:49.948344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.948461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.948488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.526 qpair failed and we were unable to recover it. 00:27:46.526 [2024-11-29 02:32:49.948590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.948701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.948727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.526 qpair failed and we were unable to recover it. 00:27:46.526 [2024-11-29 02:32:49.948875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.949008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.949034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.526 qpair failed and we were unable to recover it. 00:27:46.526 [2024-11-29 02:32:49.949157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.949240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.949266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.526 qpair failed and we were unable to recover it. 00:27:46.526 [2024-11-29 02:32:49.949398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.949517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.949543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.526 qpair failed and we were unable to recover it. 00:27:46.526 [2024-11-29 02:32:49.949638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.949779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.949804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.526 qpair failed and we were unable to recover it. 00:27:46.526 [2024-11-29 02:32:49.949926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.950073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.950099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.526 qpair failed and we were unable to recover it. 00:27:46.526 [2024-11-29 02:32:49.950212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.950320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.950345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.526 qpair failed and we were unable to recover it. 00:27:46.526 [2024-11-29 02:32:49.950511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.950599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.950625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.526 qpair failed and we were unable to recover it. 00:27:46.526 [2024-11-29 02:32:49.950748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.950863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.950890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.526 qpair failed and we were unable to recover it. 00:27:46.526 [2024-11-29 02:32:49.950986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.951066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.951092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.526 qpair failed and we were unable to recover it. 00:27:46.526 [2024-11-29 02:32:49.951183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.951290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.526 [2024-11-29 02:32:49.951316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.951473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.951587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.951614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.951762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.951880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.951906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.952052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.952169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.952195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.952318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.952468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.952494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.952598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.952686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.952712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.952813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.952923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.952949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.953069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.953191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.953216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.953349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.953445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.953472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.953594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.953706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.953732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.953851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.953968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.953994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.954076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.954188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.954214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.954330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.954444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.954470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.954594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.954694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.954721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.954866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.954981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.955008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.955110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.955189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.955215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.955329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.955474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.955500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.955626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.955771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.955797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.955944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.956059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.956085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.956183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.956325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.956352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.956497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.956627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.956653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.956771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.956911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.956937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.957030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.957174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.957199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.957310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.957424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.957451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.957566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.957684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.957710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.957830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.957940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.957966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.958089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.958179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.958205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.527 [2024-11-29 02:32:49.958352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.958451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.527 [2024-11-29 02:32:49.958478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.527 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.958596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.958686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.958712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.958872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.959012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.959038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.959159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.959274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.959301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.959424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.959512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.959539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.959627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.959741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.959768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.959888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.960032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.960058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.960186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.960307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.960334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.960495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.960652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.960695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.960871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.960983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.961009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.961101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.961225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.961253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.961404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.961496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.961522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.961638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.961730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.961756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.961901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.962014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.962040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.962189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.962311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.962337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.962485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.962615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.962643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.962778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.962917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.962944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.963098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.963245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.963271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.963398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.963541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.963585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.963703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.963795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.963821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.963922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.964041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.964067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.964160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.964273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.964299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.964424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.964511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.964537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.964631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.964780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.964805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.964896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.964982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.965008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.965148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.965232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.965258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.965404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.965490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.965516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.965668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.965757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.965784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.965907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.966026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.966052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.528 qpair failed and we were unable to recover it. 00:27:46.528 [2024-11-29 02:32:49.966200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.966342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.528 [2024-11-29 02:32:49.966367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.966532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.966721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.966767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.966904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.967019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.967044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.967191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.967269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.967294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.967413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.967547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.967591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.967726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.967844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.967871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.967981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.968121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.968147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.968229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.968320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.968346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.968447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.968569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.968595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.968687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.968808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.968834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.968950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.969038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.969064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.969161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.969252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.969279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.969362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.969512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.969539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.969670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.969751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.969778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.969922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.970041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.970068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.970190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.970284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.970310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.970452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.970570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.970596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.970744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.970831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.970857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.971007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.971123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.971149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.971267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.971386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.971441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.971562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.971712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.971738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.971892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.971976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.972001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.972101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.972211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.972237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.972385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.972537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.972563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.972671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.972844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.972888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.973055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.973187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.973213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.973309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.973400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.973427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.973542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.973715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.973758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.529 [2024-11-29 02:32:49.973895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.974058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.529 [2024-11-29 02:32:49.974085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.529 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.974205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.974326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.974358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.974513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.974599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.974624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.974741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.974860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.974886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.975031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.975143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.975169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.975259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.975371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.975404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.975536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.975684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.975729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.975846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.975955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.975981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.976100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.976181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.976207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.976329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.976488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.976533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.976674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.976823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.976867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.977008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.977155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.977187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.977307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.977407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.977434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.977567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.977747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.977791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.977881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.977975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.978002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.978112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.978194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.978220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.978379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.978526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.978553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.978658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.978782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.978812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.978951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.979065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.979091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.979206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.979298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.979324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.979419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.979566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.979592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.979716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.979878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.979925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.980045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.980188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.980215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.980370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.980512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.980556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.980647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.980728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.980753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.980894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.981023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.981049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.981143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.981257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.981284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.981413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.981532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.981558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.981681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.981806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.981833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.530 qpair failed and we were unable to recover it. 00:27:46.530 [2024-11-29 02:32:49.981922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.982030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.530 [2024-11-29 02:32:49.982056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.531 qpair failed and we were unable to recover it. 00:27:46.531 [2024-11-29 02:32:49.982175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.982259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.982285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.531 qpair failed and we were unable to recover it. 00:27:46.531 [2024-11-29 02:32:49.982410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.982553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.982581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.531 qpair failed and we were unable to recover it. 00:27:46.531 [2024-11-29 02:32:49.982751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.982867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.982894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.531 qpair failed and we were unable to recover it. 00:27:46.531 [2024-11-29 02:32:49.982990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.983071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.983097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.531 qpair failed and we were unable to recover it. 00:27:46.531 [2024-11-29 02:32:49.983240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.983388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.983431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.531 qpair failed and we were unable to recover it. 00:27:46.531 [2024-11-29 02:32:49.983567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.983703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.983733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.531 qpair failed and we were unable to recover it. 00:27:46.531 [2024-11-29 02:32:49.983883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.984019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.984045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.531 qpair failed and we were unable to recover it. 00:27:46.531 [2024-11-29 02:32:49.984168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.984261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.984287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.531 qpair failed and we were unable to recover it. 00:27:46.531 [2024-11-29 02:32:49.984371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.984473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.984499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.531 qpair failed and we were unable to recover it. 00:27:46.531 [2024-11-29 02:32:49.984590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.984701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.984727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.531 qpair failed and we were unable to recover it. 00:27:46.531 [2024-11-29 02:32:49.984846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.984965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.984991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.531 qpair failed and we were unable to recover it. 00:27:46.531 [2024-11-29 02:32:49.985073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.985218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.985243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.531 qpair failed and we were unable to recover it. 00:27:46.531 [2024-11-29 02:32:49.985362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.985481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.985508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.531 qpair failed and we were unable to recover it. 00:27:46.531 [2024-11-29 02:32:49.985631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.985744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.985771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.531 qpair failed and we were unable to recover it. 00:27:46.531 [2024-11-29 02:32:49.985860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.986013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.986039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.531 qpair failed and we were unable to recover it. 00:27:46.531 [2024-11-29 02:32:49.986160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.986242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.986268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.531 qpair failed and we were unable to recover it. 00:27:46.531 [2024-11-29 02:32:49.986382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.986522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.986566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.531 qpair failed and we were unable to recover it. 00:27:46.531 [2024-11-29 02:32:49.986702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.986839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.986865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.531 qpair failed and we were unable to recover it. 00:27:46.531 [2024-11-29 02:32:49.986956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.987102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.987128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.531 qpair failed and we were unable to recover it. 00:27:46.531 [2024-11-29 02:32:49.987253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.987370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.987417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.531 qpair failed and we were unable to recover it. 00:27:46.531 [2024-11-29 02:32:49.987579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.987698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.987723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.531 qpair failed and we were unable to recover it. 00:27:46.531 [2024-11-29 02:32:49.987827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.987943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.987969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.531 qpair failed and we were unable to recover it. 00:27:46.531 [2024-11-29 02:32:49.988095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.988240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.988265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.531 qpair failed and we were unable to recover it. 00:27:46.531 [2024-11-29 02:32:49.988385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.988518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.988543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.531 qpair failed and we were unable to recover it. 00:27:46.531 [2024-11-29 02:32:49.988661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.988757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.988782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.531 qpair failed and we were unable to recover it. 00:27:46.531 [2024-11-29 02:32:49.988874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.531 [2024-11-29 02:32:49.989016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.989042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.989157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.989275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.989302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.989405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.989493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.989518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.989613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.989730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.989756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.989873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.989986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.990012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.990107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.990218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.990244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.990390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.990492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.990518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.990641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.990786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.990811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.990897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.991043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.991068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.991189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.991330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.991357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.991518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.991602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.991628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.991769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.991901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.991927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.992047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.992165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.992191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.992304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.992418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.992446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.992595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.992728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.992772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.992891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.993043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.993069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.993194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.993337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.993362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.993533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.993692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.993735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.993826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.993940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.993966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.994060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.994178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.994204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.994295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.994418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.994445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.994595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.994734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.994760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.994887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.994976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.995002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.995125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.995214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.995240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.995351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.995501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.995548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.995679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.995810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.995854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.996009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.996119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.996145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.996234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.996315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.996342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.532 qpair failed and we were unable to recover it. 00:27:46.532 [2024-11-29 02:32:49.996443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.532 [2024-11-29 02:32:49.996578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:49.996604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:49.996721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:49.996869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:49.996894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:49.997007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:49.997151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:49.997176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:49.997296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:49.997420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:49.997447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:49.997562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:49.997681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:49.997707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:49.997854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:49.997967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:49.997992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:49.998081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:49.998165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:49.998191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:49.998279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:49.998403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:49.998430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:49.998554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:49.998671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:49.998698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:49.998854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:49.998952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:49.998980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:49.999102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:49.999183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:49.999208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:49.999329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:49.999491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:49.999520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:49.999613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:49.999695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:49.999724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:49.999906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.000048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.000076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:50.000184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.000287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.000312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:50.000413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.000528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.000553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:50.000694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.000821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.000859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:50.001004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.001164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.001207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:50.001338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.001519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.001555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:50.001730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.001867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.001896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:50.002054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.002158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.002188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:50.002295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.002440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.002467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:50.002588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.002726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.002755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:50.002856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.002959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.002988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:50.003148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.003243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.003271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:50.003372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.003511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.003537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:50.003700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.003801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.003844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:50.003953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.004074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.004103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.533 [2024-11-29 02:32:50.004237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.004327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.533 [2024-11-29 02:32:50.004355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.533 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.004466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.004551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.004580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.004735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.004900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.004945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.005097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.005236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.005271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.005421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.005555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.005590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.005739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.005891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.005951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.006360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.006500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.006535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.006639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.006744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.006772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.006862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.006988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.007016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.007143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.007226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.007254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.007385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.007505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.007531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.007636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.007728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.007756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.007884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.008010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.008038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.008133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.008237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.008267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.008408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.008538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.008563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.008668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.008763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.008804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.008950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.009085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.009114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.009271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.009423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.009467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.009563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.009735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.009763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.009889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.010012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.010040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.010165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.010286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.010314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.010451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.010592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.010618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.010741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.010893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.010921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.011115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.011208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.011236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.011371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.011520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.011545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.011638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.011781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.011809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.011898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.012024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.012051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.012243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.012380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.012432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.012551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.012630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.012655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.534 [2024-11-29 02:32:50.012794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.012953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.534 [2024-11-29 02:32:50.012982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.534 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.013087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.013183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.013212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.535 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.013358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.013482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.013507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.535 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.013633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.013718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.013765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.535 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.013935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.014087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.014115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.535 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.014274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.014447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.014473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.535 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.014617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.014698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.014723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.535 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.014859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.014985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.015012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.535 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.015144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.015269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.015298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.535 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.015455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.015576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.015602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.535 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.015751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.015833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.015857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.535 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.015951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.016102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.016128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.535 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.016269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.016362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.016390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.535 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.016517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.016648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.016678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.535 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.016827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.016942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.016968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.535 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.017062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.017167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.017195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.535 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.017293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.017467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.017493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.535 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.017617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.017780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.017809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.535 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.017952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.018093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.018118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.535 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.018234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.018361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.018389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.535 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.018527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.018623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.018651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.535 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.018747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.018903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.018931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.535 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.019072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.019193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.019218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.535 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.019314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.019443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.019478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.535 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.019611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.019733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.019761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.535 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.019920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.020072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.020101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.535 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.020239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.020333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.535 [2024-11-29 02:32:50.020359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.535 qpair failed and we were unable to recover it. 00:27:46.535 [2024-11-29 02:32:50.020455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.020574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.020599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.020706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.020796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.020824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.020955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.021044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.021072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.021193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.021307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.021333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.021464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.021592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.021621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.021746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.021866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.021907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.022033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.022160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.022188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.022337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.022428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.022454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.022577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.022672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.022700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.022794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.022962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.022987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.023091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.023232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.023257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.023373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.023497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.023523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.023640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.023768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.023796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.023925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.024080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.024108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.024271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.024422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.024460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.024589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.024731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.024760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.024908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.025095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.025124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.025257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.025448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.025477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.025604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.025722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.025749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.025899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.026019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.026046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.026168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.026309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.026339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.026495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.026628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.026656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.026828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.026958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.026987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.027095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.027185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.027213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.027328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.027423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.027450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.027591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.027754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.027781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.027914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.028076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.028106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.028234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.028409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.028454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.536 [2024-11-29 02:32:50.028553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.028688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.536 [2024-11-29 02:32:50.028717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.536 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.028875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.028998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.029026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.029147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.029264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.029294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.029432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.029553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.029579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.029729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.029888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.029918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.030063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.030195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.030227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.030399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.030515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.030541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.030662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.030777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.030804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.030962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.031100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.031129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.031298] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfc1600 is same with the state(5) to be set 00:27:46.537 [2024-11-29 02:32:50.031473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.031582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.031610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.031742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.031836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.031862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.032004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.032100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.032128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.032231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.032334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.032363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.032489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.032580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.032605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.032703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.032825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.032851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.032949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.033055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.033092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.033216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.033341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.033386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.033529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.033634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.033666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.033778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.033944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.033976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.034154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.034252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.034278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.034442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.034569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.034596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.034717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.034858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.034887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.035007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.035106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.035133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.035219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.035362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.035388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.035517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.035610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.035637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.035802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.035919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.035945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.036083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.036219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.036249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.036407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.036515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.036542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.036639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.036723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.036749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.537 qpair failed and we were unable to recover it. 00:27:46.537 [2024-11-29 02:32:50.036868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.537 [2024-11-29 02:32:50.036971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.037000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.037102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.037216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.037247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.037463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.037584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.037610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.037705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.037797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.037823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.037963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.038122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.038152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.038302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.038471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.038499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.038613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.038716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.038745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.038877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.039001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.039030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.039164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.039281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.039307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.039431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.039519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.039546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.039687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.039813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.039842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.039961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.040108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.040135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.040245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.040411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.040463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.040587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.040724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.040753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.040922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.041013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.041039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.041205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.041298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.041326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.041467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.041578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.041604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.041694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.041780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.041806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.041951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.042092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.042121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.042216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.042344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.042373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.042502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.042599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.042626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.042725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.042830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.042859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.042997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.043099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.043128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.043256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.043387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.043442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.043541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.043667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.043695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.043831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.043917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.043945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.044068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.044180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.044207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.044326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.044454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.044481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.044602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.044725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.044751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.538 qpair failed and we were unable to recover it. 00:27:46.538 [2024-11-29 02:32:50.044913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.538 [2024-11-29 02:32:50.045037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.045066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.045200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.045328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.045357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.045477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.045559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.045585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.045679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.045777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.045805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.045926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.046015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.046059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.046198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.046293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.046322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.046455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.046543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.046569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.046733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.046838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.046869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.047003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.047130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.047160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.047279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.047364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.047390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.047532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.047620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.047649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.047806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.047942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.047972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.048126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.048243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.048268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.048375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.048485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.048514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.048620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.048752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.048781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.048893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.048992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.049019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.049108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.049271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.049300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.049453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.049566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.049592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.049717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.049810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.049837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.049921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.050009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.050036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.050232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.050405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.050450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.050569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.050664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.050690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.050806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.050932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.050961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.051061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.051190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.051226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.051364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.051512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.051539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.051630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.051750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.051777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.051862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.052002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.052031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.539 qpair failed and we were unable to recover it. 00:27:46.539 [2024-11-29 02:32:50.052159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.539 [2024-11-29 02:32:50.052284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.052313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.540 qpair failed and we were unable to recover it. 00:27:46.540 [2024-11-29 02:32:50.052435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.052546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.052574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.540 qpair failed and we were unable to recover it. 00:27:46.540 [2024-11-29 02:32:50.052668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.052757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.052786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.540 qpair failed and we were unable to recover it. 00:27:46.540 [2024-11-29 02:32:50.052928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.053016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.053042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.540 qpair failed and we were unable to recover it. 00:27:46.540 [2024-11-29 02:32:50.053178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.053286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.053315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.540 qpair failed and we were unable to recover it. 00:27:46.540 [2024-11-29 02:32:50.053457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.053585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.053615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.540 qpair failed and we were unable to recover it. 00:27:46.540 [2024-11-29 02:32:50.053758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.053900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.053927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.540 qpair failed and we were unable to recover it. 00:27:46.540 [2024-11-29 02:32:50.054079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.054211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.054240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.540 qpair failed and we were unable to recover it. 00:27:46.540 [2024-11-29 02:32:50.054340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.054456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.054484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.540 qpair failed and we were unable to recover it. 00:27:46.540 [2024-11-29 02:32:50.054574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.054720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.054746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.540 qpair failed and we were unable to recover it. 00:27:46.540 [2024-11-29 02:32:50.054912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.055040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.055069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.540 qpair failed and we were unable to recover it. 00:27:46.540 [2024-11-29 02:32:50.055198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.055330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.055356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.540 qpair failed and we were unable to recover it. 00:27:46.540 [2024-11-29 02:32:50.055484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.055612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.055639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.540 qpair failed and we were unable to recover it. 00:27:46.540 [2024-11-29 02:32:50.055789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.055885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.055914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.540 qpair failed and we were unable to recover it. 00:27:46.540 [2024-11-29 02:32:50.056069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.056181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.056211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.540 qpair failed and we were unable to recover it. 00:27:46.540 [2024-11-29 02:32:50.056326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.056448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.056475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.540 qpair failed and we were unable to recover it. 00:27:46.540 [2024-11-29 02:32:50.056582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.056725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.056752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.540 qpair failed and we were unable to recover it. 00:27:46.540 [2024-11-29 02:32:50.056877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.057015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.057044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.540 qpair failed and we were unable to recover it. 00:27:46.540 [2024-11-29 02:32:50.057182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.057264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.057291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.540 qpair failed and we were unable to recover it. 00:27:46.540 [2024-11-29 02:32:50.057382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.057529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.057559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.540 qpair failed and we were unable to recover it. 00:27:46.540 [2024-11-29 02:32:50.057682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.057843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.057874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.540 qpair failed and we were unable to recover it. 00:27:46.540 [2024-11-29 02:32:50.057991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.058115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.058142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.540 qpair failed and we were unable to recover it. 00:27:46.540 [2024-11-29 02:32:50.058274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.058380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.058420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.540 qpair failed and we were unable to recover it. 00:27:46.540 [2024-11-29 02:32:50.058523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.058648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.058679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.540 qpair failed and we were unable to recover it. 00:27:46.540 [2024-11-29 02:32:50.058822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.058946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.058977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.540 qpair failed and we were unable to recover it. 00:27:46.540 [2024-11-29 02:32:50.059091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.059247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.059276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.540 qpair failed and we were unable to recover it. 00:27:46.540 [2024-11-29 02:32:50.059407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.540 [2024-11-29 02:32:50.059531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.059560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.059703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.059848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.059875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.059975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.060105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.060136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.060265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.060389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.060424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.060534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.060613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.060639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.060728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.060870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.060898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.060985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.061131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.061160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.061299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.061419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.061447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.061591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.061687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.061723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.061821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.061953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.061984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.062130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.062275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.062301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.062464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.062553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.062579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.062684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.062796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.062822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.062938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.063088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.063116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.063285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.063423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.063451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.063579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.063711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.063740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.063864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.064007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.064033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.064168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.064259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.064289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.064432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.064526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.064557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.064673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.064759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.064785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.064920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.065067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.065093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.065181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.065277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.065303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.065425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.065548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.065574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.065723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.065822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.065851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.065947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.066050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.066080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.066249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.066400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.066446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.066610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.066707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.066736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.066858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.066979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.067007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.067174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.067295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.541 [2024-11-29 02:32:50.067353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.541 qpair failed and we were unable to recover it. 00:27:46.541 [2024-11-29 02:32:50.067498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.067630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.067659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.067763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.067883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.067912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.068046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.068163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.068189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.068332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.068482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.068515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.068618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.068745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.068776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.068942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.069091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.069118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.069231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.069363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.069399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.069518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.069649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.069678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.069826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.069942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.069968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.070053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.070145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.070171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.070276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.070387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.070421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.070534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.070657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.070685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.070855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.071015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.071045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.071184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.071339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.071368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.071539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.071631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.071659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.071801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.071966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.071996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.072122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.072248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.072277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.072387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.072539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.072566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.072706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.072872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.072903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.073025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.073155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.073184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.073363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.073462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.073490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.073575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.073697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.073742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.073879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.073969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.073998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.074115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.074236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.074262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.074449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.074537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.074563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.074682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.074846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.074874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.074993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.075132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.075159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.075269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.075373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.075405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.542 [2024-11-29 02:32:50.075520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.075658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.542 [2024-11-29 02:32:50.075687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.542 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.075796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.075880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.075907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.076079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.076211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.076242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.076369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.076542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.076569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.076688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.076773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.076801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.076938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.077058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.077087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.077186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.077321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.077350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.077468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.077558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.077585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.077673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.077839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.077868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.078002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.078130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.078161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.078279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.078390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.078426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.078581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.078708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.078737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.078840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.078968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.078997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.079116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.079200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.079227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.079349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.079532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.079562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.079710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.079855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.079881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.080001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.080151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.080177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.080307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.080432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.080468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.080643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.080761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.080787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.080910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.081005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.081032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.081168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.081311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.081338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.081483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.081593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.081624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.081765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.081877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.081904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.082007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.082127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.082155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.082314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.082442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.082473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.082642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.082767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.082794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.082913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.083078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.083107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.083194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.083314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.083343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.543 qpair failed and we were unable to recover it. 00:27:46.543 [2024-11-29 02:32:50.083499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.543 [2024-11-29 02:32:50.083593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.083620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.544 qpair failed and we were unable to recover it. 00:27:46.544 [2024-11-29 02:32:50.083760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.083920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.083951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.544 qpair failed and we were unable to recover it. 00:27:46.544 [2024-11-29 02:32:50.084110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.084213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.084242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.544 qpair failed and we were unable to recover it. 00:27:46.544 [2024-11-29 02:32:50.084340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.084421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.084449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.544 qpair failed and we were unable to recover it. 00:27:46.544 [2024-11-29 02:32:50.084597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.084731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.084760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.544 qpair failed and we were unable to recover it. 00:27:46.544 [2024-11-29 02:32:50.084919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.085041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.085068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.544 qpair failed and we were unable to recover it. 00:27:46.544 [2024-11-29 02:32:50.085163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.085280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.085308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.544 qpair failed and we were unable to recover it. 00:27:46.544 [2024-11-29 02:32:50.085403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.085579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.085608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.544 qpair failed and we were unable to recover it. 00:27:46.544 [2024-11-29 02:32:50.085766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.085889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.085927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.544 qpair failed and we were unable to recover it. 00:27:46.544 [2024-11-29 02:32:50.086072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.086194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.086220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.544 qpair failed and we were unable to recover it. 00:27:46.544 [2024-11-29 02:32:50.086335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.086453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.086498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.544 qpair failed and we were unable to recover it. 00:27:46.544 [2024-11-29 02:32:50.086655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.086816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.086844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.544 qpair failed and we were unable to recover it. 00:27:46.544 [2024-11-29 02:32:50.086980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.087134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.087179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.544 qpair failed and we were unable to recover it. 00:27:46.544 [2024-11-29 02:32:50.087302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.087434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.087466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.544 qpair failed and we were unable to recover it. 00:27:46.544 [2024-11-29 02:32:50.087573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.087701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.087731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.544 qpair failed and we were unable to recover it. 00:27:46.544 [2024-11-29 02:32:50.087888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.088030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.088058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.544 qpair failed and we were unable to recover it. 00:27:46.544 [2024-11-29 02:32:50.088188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.088309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.088338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.544 qpair failed and we were unable to recover it. 00:27:46.544 [2024-11-29 02:32:50.088466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.088598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.088642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.544 qpair failed and we were unable to recover it. 00:27:46.544 [2024-11-29 02:32:50.088731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.088876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.088903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.544 qpair failed and we were unable to recover it. 00:27:46.544 [2024-11-29 02:32:50.089040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.089159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.089199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.544 qpair failed and we were unable to recover it. 00:27:46.544 [2024-11-29 02:32:50.089367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.089514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.089542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.544 qpair failed and we were unable to recover it. 00:27:46.544 [2024-11-29 02:32:50.089663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.089756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.089783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.544 qpair failed and we were unable to recover it. 00:27:46.544 [2024-11-29 02:32:50.089914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.090061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.090088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.544 qpair failed and we were unable to recover it. 00:27:46.544 [2024-11-29 02:32:50.090208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.090298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.090343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.544 qpair failed and we were unable to recover it. 00:27:46.544 [2024-11-29 02:32:50.090492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.090606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.090632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.544 qpair failed and we were unable to recover it. 00:27:46.544 [2024-11-29 02:32:50.090753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.090918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.544 [2024-11-29 02:32:50.090947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.091036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.091159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.091189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.091307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.091460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.091490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.091584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.091714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.091743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.091877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.092024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.092051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.092142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.092251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.092278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.092370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.092499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.092528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.092648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.092804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.092833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.092976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.093085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.093111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.093231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.093346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.093376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.093513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.093654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.093685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.093846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.093957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.093984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.094147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.094282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.094311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.094437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.094575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.094613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.094763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.094910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.094953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.095110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.095271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.095300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.095403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.095514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.095543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.095651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.095753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.095781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.095884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.096019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.096048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.096176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.096313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.096343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.096530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.096649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.096676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.096866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.096966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.097012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.097111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.097251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.097282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.097422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.097536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.097562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.097663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.097796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.097826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.097963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.098086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.098116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.098258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.098408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.098437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.545 qpair failed and we were unable to recover it. 00:27:46.545 [2024-11-29 02:32:50.098539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.098664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.545 [2024-11-29 02:32:50.098694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.098792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.098920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.098958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.099105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.099231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.099257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.099376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.099522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.099552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.099650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.099780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.099809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.099954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.100071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.100099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.100212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.100358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.100388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.100536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.100655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.100699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.100845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.101014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.101043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.101207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.101365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.101401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.101553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.101671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.101698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.101815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.101899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.101925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.102029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.102152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.102189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.102317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.102419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.102450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.102567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.102680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.102706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.102843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.102969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.102997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.103151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.103279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.103319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.103478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.103577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.103603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.103692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.103859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.103888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.104010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.104143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.104172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.104337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.104468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.104496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.104646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.104735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.104761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.104850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.104939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.104969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.105103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.105195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.105221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.105309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.105471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.105500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.105640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.105731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.105761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.105910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.106064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.106091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.106220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.106309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.106335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.106482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.106622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.106651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.546 qpair failed and we were unable to recover it. 00:27:46.546 [2024-11-29 02:32:50.106820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.546 [2024-11-29 02:32:50.106963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.107005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.107159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.107288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.107317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.107480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.107579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.107610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.107751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.107868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.107899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.108044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.108169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.108198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.108330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.108464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.108494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.108661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.108824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.108854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.108980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.109105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.109134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.109266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.109414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.109441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.109586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.109695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.109728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.109862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.110026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.110055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.110189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.110314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.110343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.110497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.110620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.110647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.110769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.110901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.110933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.111073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.111171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.111200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.111346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.111437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.111465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.111607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.111760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.111789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.111899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.112035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.112065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.112207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.112304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.112332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.112480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.112558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.112602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.112701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.112795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.112824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.112985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.113076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.113103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.113229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.113334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.113360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.113513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.113680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.113710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.113859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.113971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.113997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.114129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.114229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.114258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.114417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.114562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.114588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.114699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.114820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.114846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.114989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.115109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.115135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.547 qpair failed and we were unable to recover it. 00:27:46.547 [2024-11-29 02:32:50.115312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.547 [2024-11-29 02:32:50.115407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.115434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.115526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.115645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.115671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.115853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.115968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.115996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.116097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.116297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.116325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.116480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.116575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.116603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.116746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.116903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.116932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.117064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.117155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.117185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.117290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.117422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.117451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.117567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.117676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.117702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.117791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.117866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.117908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.118014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.118167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.118193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.118335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.118471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.118503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.118636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.118795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.118824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.118959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.119075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.119102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.119274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.119422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.119449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.119578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.119700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.119729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.119842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.119957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.119985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.120105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.120255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.120284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.120417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.120553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.120582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.120716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.120810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.120836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.120945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.121065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.121110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.121270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.121369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.121427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.121569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.121703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.121731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.121853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.122027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.122054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.122168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.122310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.122339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.122485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.122597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.122623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.122752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.122856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.122901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.122994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.123154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.123183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.123346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.123462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.548 [2024-11-29 02:32:50.123489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.548 qpair failed and we were unable to recover it. 00:27:46.548 [2024-11-29 02:32:50.123632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.123752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.123781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.549 qpair failed and we were unable to recover it. 00:27:46.549 [2024-11-29 02:32:50.123893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.123994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.124025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.549 qpair failed and we were unable to recover it. 00:27:46.549 [2024-11-29 02:32:50.124143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.124236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.124263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.549 qpair failed and we were unable to recover it. 00:27:46.549 [2024-11-29 02:32:50.124426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.124555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.124584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.549 qpair failed and we were unable to recover it. 00:27:46.549 [2024-11-29 02:32:50.124722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.124861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.124890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.549 qpair failed and we were unable to recover it. 00:27:46.549 [2024-11-29 02:32:50.125038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.125124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.125150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.549 qpair failed and we were unable to recover it. 00:27:46.549 [2024-11-29 02:32:50.125285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.125445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.125475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.549 qpair failed and we were unable to recover it. 00:27:46.549 [2024-11-29 02:32:50.125632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.125796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.125825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.549 qpair failed and we were unable to recover it. 00:27:46.549 [2024-11-29 02:32:50.125965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.126079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.126108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.549 qpair failed and we were unable to recover it. 00:27:46.549 [2024-11-29 02:32:50.126247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.126339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.126368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.549 qpair failed and we were unable to recover it. 00:27:46.549 [2024-11-29 02:32:50.126507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.126634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.126663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.549 qpair failed and we were unable to recover it. 00:27:46.549 [2024-11-29 02:32:50.126773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.126855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.126881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.549 qpair failed and we were unable to recover it. 00:27:46.549 [2024-11-29 02:32:50.126995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.127182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.127210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.549 qpair failed and we were unable to recover it. 00:27:46.549 [2024-11-29 02:32:50.127324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.127490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.127519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.549 qpair failed and we were unable to recover it. 00:27:46.549 [2024-11-29 02:32:50.127629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.127749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.127775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.549 qpair failed and we were unable to recover it. 00:27:46.549 [2024-11-29 02:32:50.127910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.128036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.128065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.549 qpair failed and we were unable to recover it. 00:27:46.549 [2024-11-29 02:32:50.128241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.128343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.128370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.549 qpair failed and we were unable to recover it. 00:27:46.549 [2024-11-29 02:32:50.128502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.128578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.128605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.549 qpair failed and we were unable to recover it. 00:27:46.549 [2024-11-29 02:32:50.128734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.128855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.128884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.549 qpair failed and we were unable to recover it. 00:27:46.549 [2024-11-29 02:32:50.129024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.129108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.129137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.549 qpair failed and we were unable to recover it. 00:27:46.549 [2024-11-29 02:32:50.129314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.129478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.129509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.549 qpair failed and we were unable to recover it. 00:27:46.549 [2024-11-29 02:32:50.129620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.129714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.129743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.549 qpair failed and we were unable to recover it. 00:27:46.549 [2024-11-29 02:32:50.129899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.130007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.130037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.549 qpair failed and we were unable to recover it. 00:27:46.549 [2024-11-29 02:32:50.130177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.130322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.130348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.549 qpair failed and we were unable to recover it. 00:27:46.549 [2024-11-29 02:32:50.130494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.130610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.130636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.549 qpair failed and we were unable to recover it. 00:27:46.549 [2024-11-29 02:32:50.130764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.130862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.549 [2024-11-29 02:32:50.130891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.131001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.131122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.131148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.131272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.131434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.131467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.131579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.131700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.131730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.131842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.131986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.132012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.132163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.132257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.132286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.132425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.132581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.132609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.132736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.132827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.132853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.132935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.133075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.133104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.133198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.133327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.133356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.133506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.133650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.133678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.133795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.133929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.133960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.134049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.134178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.134207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.134323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.134440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.134467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.134608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.134715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.134751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.134863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.134963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.134992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.135132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.135229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.135256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.135351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.135504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.135532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.135666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.135759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.135793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.135938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.136049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.136075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.136227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.136360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.136389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.136533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.136633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.136664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.136815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.136911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.136945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.137091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.137222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.137251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.137426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.137557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.137586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.137754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.137841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.137868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.137979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.138104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.138134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.138259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.138428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.138456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.138584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.138661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.550 [2024-11-29 02:32:50.138687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.550 qpair failed and we were unable to recover it. 00:27:46.550 [2024-11-29 02:32:50.138819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.138922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.138949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.139059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.139175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.139206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.139341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.139445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.139473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.139592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.139673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.139700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.139821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.139957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.139985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.140130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.140252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.140281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.140432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.140587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.140616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.140746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.140876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.140905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.141039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.141127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.141153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.141315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.141452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.141482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.141642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.141768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.141797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.141915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.142061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.142088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.142260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.142438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.142469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.142592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.142728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.142756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.142902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.142998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.143025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.143115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.143232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.143259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.143376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.143474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.143521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.143669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.143746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.143772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.143927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.144025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.144056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.144188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.144294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.144320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.144446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.144571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.144600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.144697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.144784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.144810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.144951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.145054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.145083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.145227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.145343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.145369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.145467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.145590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.145625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.145744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.145843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.145873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.146048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.146160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.146186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.146304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.146431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.146461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.146585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.146693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.146727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.146846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.146966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.146993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.551 qpair failed and we were unable to recover it. 00:27:46.551 [2024-11-29 02:32:50.147146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.551 [2024-11-29 02:32:50.147242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.147271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.147369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.147469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.147499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.147668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.147788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.147821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.147960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.148056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.148085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.148216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.148335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.148364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.148513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.148629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.148655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.148748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.148887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.148918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.149028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.149156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.149187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.149361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.149515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.149561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.149683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.149806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.149835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.149931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.150065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.150095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.150230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.150316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.150342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.150525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.150639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.150669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.150803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.150896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.150925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.151101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.151218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.151245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.151366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.151471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.151498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.151614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.151739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.151769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.151906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.152029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.152055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.152203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.152290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.152318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.152435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.152554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.152580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.152675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.152787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.152813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.152947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.153077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.153105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.153262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.153364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.153408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.153542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.153640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.153668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.153839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.153969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.153998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.154128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.154225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.154256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.154409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.154507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.154535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.154620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.154733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.154762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.154898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.155024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.155053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.155195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.155318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.552 [2024-11-29 02:32:50.155344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.552 qpair failed and we were unable to recover it. 00:27:46.552 [2024-11-29 02:32:50.155511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.553 [2024-11-29 02:32:50.155666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.553 [2024-11-29 02:32:50.155709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.553 qpair failed and we were unable to recover it. 00:27:46.553 [2024-11-29 02:32:50.155840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.553 [2024-11-29 02:32:50.155927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.553 [2024-11-29 02:32:50.155958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.553 qpair failed and we were unable to recover it. 00:27:46.553 [2024-11-29 02:32:50.156059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.553 [2024-11-29 02:32:50.156171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.553 [2024-11-29 02:32:50.156206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.553 qpair failed and we were unable to recover it. 00:27:46.553 [2024-11-29 02:32:50.156322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.553 [2024-11-29 02:32:50.156442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.553 [2024-11-29 02:32:50.156470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.553 qpair failed and we were unable to recover it. 00:27:46.553 [2024-11-29 02:32:50.156614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.553 [2024-11-29 02:32:50.156745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.553 [2024-11-29 02:32:50.156773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.553 qpair failed and we were unable to recover it. 00:27:46.553 [2024-11-29 02:32:50.156885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.553 [2024-11-29 02:32:50.156973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.553 [2024-11-29 02:32:50.157001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.553 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 02:32:50.157115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.157229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.157254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 02:32:50.157353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.157506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.157537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 02:32:50.157724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.157806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.157832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 02:32:50.157943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.158026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.158055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 02:32:50.158194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.158321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.158350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 02:32:50.158480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.158560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.158586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 02:32:50.158686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.158804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.158831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 02:32:50.158933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.159065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.159094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 02:32:50.159236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.159348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.159374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 02:32:50.159493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.159622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.159666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 02:32:50.159747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.159869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.159895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 02:32:50.159983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.160100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.160126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 02:32:50.160273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.160414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.160445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 02:32:50.160571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.160697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.160726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 02:32:50.160857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.160988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.161015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 02:32:50.161157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.161274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.161303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 02:32:50.161433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.161589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.161617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 02:32:50.161756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.161879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.161915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 02:32:50.162095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.162247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.162276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 02:32:50.162411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.162541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 02:32:50.162571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.162675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.162793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.162821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.162954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.163075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.163107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.163266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.163426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.163457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.163599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.163728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.163756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.163893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.164027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.164058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.164237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.164409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.164440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.164548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.164671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.164698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.164842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.164949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.164977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.165100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.165257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.165288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.165458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.165560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.165586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.165756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.165886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.165915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.166042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.166140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.166167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.166284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.166404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.166431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.166553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.166693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.166722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.166877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.166993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.167022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.167166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.167279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.167305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.167454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.167594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.167623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.167748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.167834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.167862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.167980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.168102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.168129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.168276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.168406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.168446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.168562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.168666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.168710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.168801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.168926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.168952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.169103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.169244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.169273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.169410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.169521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.169556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.169667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.169808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.169834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.169962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.170061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.170090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.170233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.170338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.170365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.170510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.170623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.170651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 02:32:50.170795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 02:32:50.170926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.170955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.171091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.171215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.171244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.171348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.171508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.171535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.171657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.171798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.171828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.171964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.172105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.172133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.172258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.172351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.172376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.172500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.172594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.172623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.172748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.172912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.172942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.173047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.173230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.173272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.173429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.173538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.173581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.173684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.173809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.173840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.173943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.174064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.174090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.174204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.174341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.174367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.174530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.174666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.174700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.174852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.174954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.174981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.175089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.175219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.175249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.175384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.175532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.175559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.175667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.175793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.175820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.175938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.176071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.176097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.176190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.176278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.176304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.176421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.176538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.176569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.176689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.176832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.176858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.177011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.177151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.177180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.177284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.177460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.177486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.177578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.177666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.177692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.177830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.177985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.178014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.178144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.178272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.178302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.178430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.178520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.178546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 02:32:50.178640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.178748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 02:32:50.178779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.178917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.179023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.179054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.179174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.179316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.179345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.179440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.179529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.179556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.179654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.179816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.179845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.179951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.180069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.180096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.180257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.180358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.180402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.180507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.180631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.180659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.180794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.180918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.180943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.181059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.181169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.181197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.181368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.181511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.181540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.181633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.181753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.181791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.181955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.182083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.182112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.182237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.182347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.182375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.182521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.182644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.182670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.182810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.182909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.182937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.183070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.183172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.183200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.183320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.183443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.183470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.183558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.183661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.183688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.183829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.183959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.183987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.184103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.184214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.184244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.184340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.184497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.184523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.184624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.184742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.184770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.184861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.184953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.184979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.185078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.185214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.185242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.186094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.186245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.186275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.186403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.186550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.186575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.186690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.186788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.186816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.186913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.187047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.187076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 02:32:50.187187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 02:32:50.187275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.187302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 02:32:50.187413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.187641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.187683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 02:32:50.187848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.187954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.187987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 02:32:50.188118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.188237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.188263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 02:32:50.188400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.188510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.188535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 02:32:50.188666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.188769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.188794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 02:32:50.188939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.189028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.189055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 02:32:50.189187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.189311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.189338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 02:32:50.189455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.189543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.189568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 02:32:50.189650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.189748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.189776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 02:32:50.189861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.189978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.190019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 02:32:50.190129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.190232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.190262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 02:32:50.190377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.190486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.190513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 02:32:50.190635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.190763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.190788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 02:32:50.190889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.190986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.191011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 02:32:50.191138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.191262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.191293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 02:32:50.191446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.191542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.191569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 02:32:50.191686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.191771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.191797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 02:32:50.191920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.192047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.192072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 02:32:50.192167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.192302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.192333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 02:32:50.192467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.192555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.192581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 02:32:50.192679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.192808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.192833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 02:32:50.192923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.193087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.193120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 02:32:50.193252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.193360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 02:32:50.193387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 02:32:50.193509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.193601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.193626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 02:32:50.193760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.193859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.193889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 02:32:50.194021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.194174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.194198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 02:32:50.194284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.194403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.194429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 02:32:50.194514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.194605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.194630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 02:32:50.194753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.194922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.194950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 02:32:50.195090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.195241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.195283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 02:32:50.195459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.195549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.195577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 02:32:50.195698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.195819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.195856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 02:32:50.195995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.196114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.196139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 02:32:50.196260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.196399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.196442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 02:32:50.196543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.196632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.196665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 02:32:50.196798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.196947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.196972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 02:32:50.197062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.197177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.197202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 02:32:50.197320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.197450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.197476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 02:32:50.197591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.197720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.197746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 02:32:50.197884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.198024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.198049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 02:32:50.198156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.198284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.198312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 02:32:50.198462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.198586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.198616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 02:32:50.198747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.198865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.198891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 02:32:50.198974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.199104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.199147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 02:32:50.199257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.199351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.199376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 02:32:50.199481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.199564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.199589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 02:32:50.199687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.199782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.199808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 02:32:50.199925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.200050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.200076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 02:32:50.200198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.200337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 02:32:50.200362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.200467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.200564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.200589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.200714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.200837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.200862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.200969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.201075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.201111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.201211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.201382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.201422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.201536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.201626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.201652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.201785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.201873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.201916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.202078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.202251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.202280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.202407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.202491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.202517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.202602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.202731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.202756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.202844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.202954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.202980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.203058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.203151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.203176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.203313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.203451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.203478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.203576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.203661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.203686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.203824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.203923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.203948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.204067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.204195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.204224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.204320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.204475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.204502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.204615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.204721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.204747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.204864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.205015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.205042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.205168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.205320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.205347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.205441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.205535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.205561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.205649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.205762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.205806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.205915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.206055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.206081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.206200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.206314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.206359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.206527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.206638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.206667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.206841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.206943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.206971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.207078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.207223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.207248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.207332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.207483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.207510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.207607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.207688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.207714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 02:32:50.207813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 02:32:50.207921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.207945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.208058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.208152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.208194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.208281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.208390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.208425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.208515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.208626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.208651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.208785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.208877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.208902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.209000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.209082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.209107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.209228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.209312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.209337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.209443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.209527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.209553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.209641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.209740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.209764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.209867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.209959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.209985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.210119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.210269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.210306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.210474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.210562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.210588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.210682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.210763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.210788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.210910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.211039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.211067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.211194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.211328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.211356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.211504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.211585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.211610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.211702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.211831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.211857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.211977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.212104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.212138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.212252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.212328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.212353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.212461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.212578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.212603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.212732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.212850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.212876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.212968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.213058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.213082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.213224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.213327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.213355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.213490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.213604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.213629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.213724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.213808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.213834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.213942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.214065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.214095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.214208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.214348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.214376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.214490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.214577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.214604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.214784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.214884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.214912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 02:32:50.215002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 02:32:50.215129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.215155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.215271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.215363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.215388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.215484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.215582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.215607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.215715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.215846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.215871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.215991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.216112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.216137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.216226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.216311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.216336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.216447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.216538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.216567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.216682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.216772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.216798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.216971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.217105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.217132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.217229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.217356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.217383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.217509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.217623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.217648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.217791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.217884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.217912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.218052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.218167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.218192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.218310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.218433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.218459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.218584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.218662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.218688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.218812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.218901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.218926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.219021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.219140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.219167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.219289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.219411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.219437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.219522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.219636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.219661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.219777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.219859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.219884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.219983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.220167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.220192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.220303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.220446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.220474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.220587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.220671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.220709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.220873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.220989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.221015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.221105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.221243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.221268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.221386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.221474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.221500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.221586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.221673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.221697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.221816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.221905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.221930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.222040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.222123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.222148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 02:32:50.222231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 02:32:50.222313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.222339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 02:32:50.222462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.222554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.222579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 02:32:50.222669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.222770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.222795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 02:32:50.222883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.223025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.223050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 02:32:50.223139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.223257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.223282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 02:32:50.223402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.223482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.223507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 02:32:50.223597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.223733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.223758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 02:32:50.223861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.223978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.224003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 02:32:50.224115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.224246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.224271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 02:32:50.224363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.224484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.224511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 02:32:50.224595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.224720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.224745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 02:32:50.224836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.224984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.225009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 02:32:50.225129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.225220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.225245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 02:32:50.225332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.225454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.225481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 02:32:50.225583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.225700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.225734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 02:32:50.225849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.225967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.225992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 02:32:50.226107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.226187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.226213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 02:32:50.226337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.226486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.226512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 02:32:50.226632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.226720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.226750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 02:32:50.226835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.226951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.226980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 02:32:50.227097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.227219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.227244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 02:32:50.227352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.227447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.227473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 02:32:50.227569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 02:32:50.227689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.227725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.227871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.227970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.227995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.228111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.228229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.228254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.228346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.228448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.228473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.228560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.228641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.228666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.228769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.228889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.228913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.228997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.229090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.229115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.229203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.229322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.229347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.229480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.229575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.229602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.229722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.229819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.229845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.229975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.230094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.230121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.230222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.230336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.230361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.230488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.230587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.230612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.230707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.230827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.230852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.230979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.231129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.231153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.231238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.231371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.231403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.231490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.231572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.231597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.231687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.231801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.231826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.231944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.232061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.232087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.232218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.232304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.232329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.232455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.232546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.232572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.232668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.232758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.232783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.232868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.232957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.232982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.233109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.233203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.233228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.233341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.233488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.233517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.233615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.233704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.233729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.233848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.233961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.233986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.234082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.234190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.234215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.234332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.234432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.234458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 02:32:50.234549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 02:32:50.234634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.234659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.234776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.234896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.234921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.235042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.235126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.235151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.235235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.235368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.235408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.235556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.235673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.235700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.235827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.235918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.235943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.236040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.236134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.236160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.236277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.236362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.236404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.236493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.236609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.236634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.236742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.236848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.236873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.236993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.237077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.237102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.237201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.237290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.237315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.237426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.237546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.237572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.237683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.237774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.237799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.237907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.238029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.238054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.238185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.238273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.238298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.238419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.238507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.238532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.238649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.238739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.238764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.238902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.239056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.239088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.239233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.239313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.239339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.239427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.239513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.239539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.239656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.239843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.239868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.239963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.240078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.240106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.240238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.240343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.240369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.240485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.240575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.240600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.240724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.240809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.240834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.240952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.241069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.241095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.241228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.241361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.241389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.241518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.241635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 02:32:50.241661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 02:32:50.241747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.241842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.241869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.241991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.242128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.242156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.242253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.242340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.242368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.242506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.242627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.242652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.242777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.242923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.242948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.243093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.243249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.243277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.243429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.243510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.243536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.243653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.243755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.243783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.243923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.244048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.244077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.244241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.244375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.244405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.244552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.244636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.244662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.244796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.244922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.244950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.245087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.245204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.245229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.245343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.245534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.245561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.245646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.245797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.245825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.245991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.246112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.246137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.246252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.246367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.246399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.246493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.246583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.246608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.246724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.246814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.246840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.246938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.247025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.247050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.247149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.247237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.247262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.247388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.247497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.247522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.247612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.247763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.247789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.247905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.247992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.248035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.248141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.248296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.248322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.248442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.248535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.248561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.248650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.248757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.248785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.248924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.249038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.249066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 02:32:50.249187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 02:32:50.249271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.249299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.249437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.249538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.249562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.249658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.249751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.249781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.249884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.249980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.250008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.250099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.250185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.250214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.250338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.250465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.250491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.250609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.250690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.250722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.250833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.250945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.250970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.251062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.251189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.251214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.251304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.251427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.251453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.251535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.251633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.251658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.251741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.251839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.251889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.251977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.252140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.252173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.252286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.252376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.252408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.252533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.252616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.252641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.252774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.252894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.252932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.253041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.253140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.253168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.253358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.253533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.253559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.253710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.253848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.253876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.254039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.254166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.254194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.254296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.254405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.254448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.254539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.254625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.254650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.254797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.254886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.254915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.255052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.255178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.255206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.255335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.255461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.255486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.255571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.255692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.255735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.255879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.255963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.255989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.256084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.256280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.256309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.256457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.256548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.256574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 02:32:50.256662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 02:32:50.256787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.256812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 02:32:50.256922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.257052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.257078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 02:32:50.257196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.257315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.257342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 02:32:50.257490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.257568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.257593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 02:32:50.257732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.257884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.257910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 02:32:50.258043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.258229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.258254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 02:32:50.258411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.258504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.258529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 02:32:50.258648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.258764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.258804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 02:32:50.258891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.259012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.259038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 02:32:50.259182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.259303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.259331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 02:32:50.259457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.259563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.259589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 02:32:50.259695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.259815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.259842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 02:32:50.259988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.260107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.260138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 02:32:50.260239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.260341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.260369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 02:32:50.260496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.260590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.260616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 02:32:50.260735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.260897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.260924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 02:32:50.261044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.261185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.261211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 02:32:50.261429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.261588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.261614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 02:32:50.261732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.261846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.261871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 02:32:50.262046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.262154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.262181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 02:32:50.262325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.262422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.262464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 02:32:50.262561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.262649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.262674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 02:32:50.262812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.262955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.262982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 02:32:50.263115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.263247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.263274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 02:32:50.263420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.263535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.263565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 02:32:50.263698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.263824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 02:32:50.263851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.264005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.264152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.264179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.264291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.264433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.264460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.264582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.264720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.264745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.264842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.264947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.264972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.265143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.265318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.265346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.265482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.265634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.265661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.265806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.265919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.265944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.266094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.266177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.266204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.266328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.266497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.266524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.266624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.266755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.266782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.266904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.266983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.267008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.267150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.267290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.267320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.267470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.267557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.267600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.267790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.267925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.267971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.268171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.268293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.268321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.268454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.268539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.268564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.268703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.268855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.268881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.269013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.269181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.269224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.269349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.269483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.269510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.269612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.269742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.269766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.269932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.270068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.270095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.270245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.270367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.270402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.270509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.270616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.270641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.270789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.270938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.270966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.271078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.271206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.271233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.271364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.271483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.271509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.271611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.271708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.271732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.271830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.271911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 02:32:50.271952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 02:32:50.272082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.272207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.272235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.272433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.272565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.272590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.272696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.272821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.272849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.273031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.273149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.273174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.273357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.273482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.273507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.273598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.273728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.273756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.273883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.273966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.273992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.274121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.274206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.274232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.274335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.274486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.274511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.274607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.274731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.274756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.274843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.274985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.275015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.275138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.275263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.275291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.275423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.275565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.275590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.275708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.275797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.275837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.275940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.276069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.276097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.276240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.276323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.276351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.276497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.276602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.276646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.276746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.276866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.276908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.277120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.277246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.277276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.277429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.277541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.277566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.277658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.277848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.277876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.278027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.278155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.278184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.278264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.278348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.278373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.278496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.278596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.278624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.278782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.278900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.278925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.279051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.279177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.279204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.279324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.279473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.279517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.279630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.279743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.279768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.279911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.280033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 02:32:50.280057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 02:32:50.280157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.280273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.280300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.280406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.280536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.280564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.280744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.280826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.280854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.280990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.281103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.281128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.281258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.281353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.281382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.281504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.281636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.281664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.281842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.281957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.281984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.282122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.282215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.282255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.282345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.282496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.282522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.282615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.282727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.282755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.282922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.283053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.283078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.283207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.283284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.283309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.283450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.283539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.283564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.283695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.283826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.283852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.283943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.284044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.284072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.284212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.284307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.284331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.284432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.284538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.284563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.284696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.284876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.284904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.285043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.285137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.285163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.285277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.285364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.285389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.285482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.285588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.285616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.285750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.285839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.285879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.286014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.286111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.286136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.286255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.286354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.286380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.286526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.286636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.286661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.286861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.287093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.287121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.287286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.287406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.287433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.287525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.287642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.287667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.287829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.287972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.287997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 02:32:50.288106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 02:32:50.288255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.288281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 02:32:50.288378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.288479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.288505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 02:32:50.288620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.288775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.288800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 02:32:50.288961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.289106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.289133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 02:32:50.289229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.289377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.289434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 02:32:50.289549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.289664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.289689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 02:32:50.289791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.289867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.289909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 02:32:50.290032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.290125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.290152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 02:32:50.290380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.290512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.290538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 02:32:50.290633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.290742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.290766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 02:32:50.290888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.290987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.291013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 02:32:50.291151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.291233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.291257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 02:32:50.291366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.291486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.291513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 02:32:50.291613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.291735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.291761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 02:32:50.291886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.292000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.292030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 02:32:50.292166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.292266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.292292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 02:32:50.292414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.292499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.292541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 02:32:50.292648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.292740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.292765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 02:32:50.292884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.293000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.293024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 02:32:50.293163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.293308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.293334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 02:32:50.293496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.293615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.293641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 02:32:50.293792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.293901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.293926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 02:32:50.294023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.294104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 02:32:50.294129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.294273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.294388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.294419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.294540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.294628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.294653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.294778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.294892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.294917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.295039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.295124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.295149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.295230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.295314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.295339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.295480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.295600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.295625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.295752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.295844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.295870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.295959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.296104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.296129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.296211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.296300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.296325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.296424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.296546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.296572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.296692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.296781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.296806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.296889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.296973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.296998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.297115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.297208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.297233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.297326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.297447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.297472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.297582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.297662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.297686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.297800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.297892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.297917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.298060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.298147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.298172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.298249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.298364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.298389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.298518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.298626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.298651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.298770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.298923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.298948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.299042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.299135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.299160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.299237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.299320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.299345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.299446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.299548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.299574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.299686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.299779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.299803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.299883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.299971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.299996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.300086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.300179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.300206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.300324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.300417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 02:32:50.300443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 02:32:50.300533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.300623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.300648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.300807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.300921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.300946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.301036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.301147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.301172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.301310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.301425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.301452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.301540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.301659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.301684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.301797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.301910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.301940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.302058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.302138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.302163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.302281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.302403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.302429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.302550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.302636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.302661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.302748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.302897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.302922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.303065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.303211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.303236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.303337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.303435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.303460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.303572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.303657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.303682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.303801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.303919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.303944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.304058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.304174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.304199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.304281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.304365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.304391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.304482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.304567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.304592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.304693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.304787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.304812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.304910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.305018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.305043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.305159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.305268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.305293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.305388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.305484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.305508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.305651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.305747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.305773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.305900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.306016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.306043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.306159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.306268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.306292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.306442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.306582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.306607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.306761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.306868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.306894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.307014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.307101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.307126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.307218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.307304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.307328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 02:32:50.307454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.307566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 02:32:50.307591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.307682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.307789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.307814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.307927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.308019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.308044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.308159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.308270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.308295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.308396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.308511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.308536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.308615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.308707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.308732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.308841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.308951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.308975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.309095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.309211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.309236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.309385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.309559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.309588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.309715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.309800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.309827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.309945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.310055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.310085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.310209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.310333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.310359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.310515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.310644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.310673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.310764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.310887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.310913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.311003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.311119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.311145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.311275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.311362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.311389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.311520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.311607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.311633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.311757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.311872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.311902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.312027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.312161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.312189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.312328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.312450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.312476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.312611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.312754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.312784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.312946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.313052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.313077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.313190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.313334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.313359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.313486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.313572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.313598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.313729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.313911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.313939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.314092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.314238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.314264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.314351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.314447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.314473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.314593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.314724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.314750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 02:32:50.314855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.315012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 02:32:50.315040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.315176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.315261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.315288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.315420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.315535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.315560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.315672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.315757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.315801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.315959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.316094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.316119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.316237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.316326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.316351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.316485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.316601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.316628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.316787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.316871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.316896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.317037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.317187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.317212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.317301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.317401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.317427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.317518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.317641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.317668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.317783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.317870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.317895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.318006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.318097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.318138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.318254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.318405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.318449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.318558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.318696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.318724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.318836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.318926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.318952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.319070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.319183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.319209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.319326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.319424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.319450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.319567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.319653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.319678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.319757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.319869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.319895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.320015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.320132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.320157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.320271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.320396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.320422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.320518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.320600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.320625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.320744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.320858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.320883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.321010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.321129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.321154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.321273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.321418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.321444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.321589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.321681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.321706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.321819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.321933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.321958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 02:32:50.322072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 02:32:50.322165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.322191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 02:32:50.322334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.322433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.322459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 02:32:50.322581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.322668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.322697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 02:32:50.322845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.322988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.323013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 02:32:50.323128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.323231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.323256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 02:32:50.323372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.323469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.323496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 02:32:50.323641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.323786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.323812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 02:32:50.323927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.324010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.324035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 02:32:50.324133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.324224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.324250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 02:32:50.324364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.324467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.324493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 02:32:50.324637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.324753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.324779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 02:32:50.324921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.325042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.325067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 02:32:50.325159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.325252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.325283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 02:32:50.325425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.325515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.325540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 02:32:50.325686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.325800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.325825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 02:32:50.325943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.326025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.326050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 02:32:50.326164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.326312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.326337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 02:32:50.326418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.326502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.326527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 02:32:50.326657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.326811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.326839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 02:32:50.326971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.327083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.327108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 02:32:50.327224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.327349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.327400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 02:32:50.327517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.327640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.327681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 02:32:50.327822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.327979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.328025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 02:32:50.328154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.328244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.328271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 02:32:50.328410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 02:32:50.328522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.328547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.328689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.328806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.328832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.328912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.329068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.329096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.329269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.329399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.329444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.329549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.329661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.329686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.329805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.329888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.329914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.330001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.330119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.330161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.330295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.330413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.330439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.330557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.330674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.330704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.330830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.330990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.331017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.331137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.331256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.331282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.331391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.331521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.331564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.331655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.331740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.331766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.331882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.332002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.332027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.332137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.332257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.332286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.332382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.332529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.332555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.332701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.332819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.332844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.332975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.333057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.333082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.333197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.333315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.333359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.333524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.333639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.333665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.333793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.333928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.333956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.334111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.334239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.334267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.334373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.334523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.334549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.334668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.334774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.334802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.334933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.335034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.335061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.335164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.335304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.335329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.335480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.335586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.335613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.335722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.335874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.335902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.336041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.336153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 02:32:50.336178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 02:32:50.336273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.336419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.336445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.336561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.336642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.336669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.336809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.336901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.336926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.337098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.337257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.337282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.337403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.337566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.337593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.337680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.337841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.337866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.338031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.338136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.338163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.338297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.338415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.338441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.338527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.338614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.338639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.338759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.338867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.338895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.339057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.339184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.339212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.339337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.339448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.339474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.339569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.339682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.339707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.339798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.339971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.340012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.340128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.340241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.340267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.340431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.340579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.340606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.340701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.340842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.340871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.340984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.341127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.341152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.341278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.341419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.341447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.341584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.341730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.341757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.341929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.342044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.342070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.342227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.342341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.342366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.342508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.342635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.342661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.342818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.342958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.342983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.343092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.343230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.343258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.343389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.343518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.343547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.343662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.343774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.343800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.343933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.344014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.344056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 02:32:50.344183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 02:32:50.344300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.344328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 02:32:50.344467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.344559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.344585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 02:32:50.344729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.344818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.344843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 02:32:50.344966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.345076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.345104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 02:32:50.345240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.345349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.345374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 02:32:50.345512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.345596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.345624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 02:32:50.345716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.345807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.345835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 02:32:50.345966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.346081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.346106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 02:32:50.346247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.346330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.346357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 02:32:50.346514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.346625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.346651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 02:32:50.346729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.346834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.346860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 02:32:50.346949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.347127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.347156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 02:32:50.347288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.347460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.347488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 02:32:50.347601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.347713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.347738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 02:32:50.347859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.347955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.347980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 02:32:50.348095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.348258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.348286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 02:32:50.348446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.348595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.348637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 02:32:50.348748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.348848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.348892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 02:32:50.349035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.349127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.349152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 02:32:50.349276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.349420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.349464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 02:32:50.349563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.349723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.349749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 02:32:50.349832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.349973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.350000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 02:32:50.350136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.350230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.350255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 02:32:50.350364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.350464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.350507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 02:32:50.350624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.350743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.350770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 02:32:50.350916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.350993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.351019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 02:32:50.351140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 02:32:50.351273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.351300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.351460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.351549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.351578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.351695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.351773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.351798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.351921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.352006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.352046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.352214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.352306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.352331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.352475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.352568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.352593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.352719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.352809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.352837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.352926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.353083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.353112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.353220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.353308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.353334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.353458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.353545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.353587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.353684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.353859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.353884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.354002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.354114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.354139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.354265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.354379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.354410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.354511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.354595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.354620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.354705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.354814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.354839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.354939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.355093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.355121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.355219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.355391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.355427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.355562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.355655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.355680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.355792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.355906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.355950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.356082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.356212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.356240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.356356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.356467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.356495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.356642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.356784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.356811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.356972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.357092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.357119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.357229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.357346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.357373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.357534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.357689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.357718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.357829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.357925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.357951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.358070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.358193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.358219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.358331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.358421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.358467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 02:32:50.358564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 02:32:50.358666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.358710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 02:32:50.358814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.358932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.358958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 02:32:50.359052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.359166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.359194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 02:32:50.359342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.359436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.359461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 02:32:50.359554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.359683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.359710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 02:32:50.359834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.359945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.359989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 02:32:50.360117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.360243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.360273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 02:32:50.360411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.360580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.360609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 02:32:50.360796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.360922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.360948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 02:32:50.361036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.361209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.361238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 02:32:50.361353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.361468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.361496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 02:32:50.361593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.361718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.361763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 02:32:50.361883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.362002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.362027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 02:32:50.362123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.362216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.362242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 02:32:50.362415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.362539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.362568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 02:32:50.362697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.362788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.362817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 02:32:50.362962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.363123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.363149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 02:32:50.363241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.363422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.363452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 02:32:50.363564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.363677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.363707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 02:32:50.363853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.363943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.363970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 02:32:50.364100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.364241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.364266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 02:32:50.364413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 02:32:50.364509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.364537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.364696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.364783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.364808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.364945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.365101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.365133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.365240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.365364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.365434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.365586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.365700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.365726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.365882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.366002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.366027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.366164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.366289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.366316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.366441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.366523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.366553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.366673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.366812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.366840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.366999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.367095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.367123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.367262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.367401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.367448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.367570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.367663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.367706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.367847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.367938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.367965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.368072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.368198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.368223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.368365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.368491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.368517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.368608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.368752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.368781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.368894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.369054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.369083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.369247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.369339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.369372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.369521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.369635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.369661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.369756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.369865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.369891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.370030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.370134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.370162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.370253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.370381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.370434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.370536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.370626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.370653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.370765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.370880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.370922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.371073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.371213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.371241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.371370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.371500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.371526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.371613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.371775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 02:32:50.371803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 02:32:50.371931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.372103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.372133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 02:32:50.372250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.372375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.372409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 02:32:50.372579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.372680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.372727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 02:32:50.372855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.372969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.373011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 02:32:50.373159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.373270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.373296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 02:32:50.373436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.373583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.373610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 02:32:50.373733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.373888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.373915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 02:32:50.374034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.374122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.374148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 02:32:50.374263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.374374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.374405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 02:32:50.374508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.374647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.374674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 02:32:50.374829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.374955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.374982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 02:32:50.375069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.375243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.375272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 02:32:50.375399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.375553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.375581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 02:32:50.375802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.375933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.375973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 02:32:50.376090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.376246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.376274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 02:32:50.376419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.376581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.376607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 02:32:50.376786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.376958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.376986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 02:32:50.377122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.377239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.377264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 02:32:50.377377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.377528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.377557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 02:32:50.377668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.377788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.377813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 02:32:50.377900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.378009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.378035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 02:32:50.378170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.378261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.378286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 02:32:50.378407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.378524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.378549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 02:32:50.378672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.378782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.378809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 02:32:50.378897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.379025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.379052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 02:32:50.379189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.379298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.379324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 02:32:50.379421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 02:32:50.379512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.379537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.379628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.379720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.379745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.379836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.379948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.379973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.380066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.380153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.380178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.380295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.380460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.380490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.380630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.380747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.380772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.380944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.381042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.381071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.381201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.381377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.381422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.381554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.381700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.381742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.381879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.381995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.382021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.382133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.382237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.382265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.382434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.382544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.382570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.382704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.382826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.382853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.382938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.383079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.383108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.383273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.383403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.383447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.383573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.383694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.383721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.383851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.383970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.383996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.384103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.384208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.384235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.384335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.384484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.384510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.384633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.384776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.384802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.384941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.385054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.385079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.385212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.385381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.385412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.385557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.385708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.385735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.385860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.385979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.386003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.386117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.386234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.386275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.386434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.386569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.386597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.386700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.386847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.386873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.386986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.387154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.387179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.387292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.387410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.387440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 02:32:50.387544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 02:32:50.387652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.387678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.387834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.387951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.387976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.388071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.388186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.388214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.388327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.388459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.388486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.388619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.388723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.388751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.388889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.389003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.389030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.389161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.389253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.389278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.389425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.389513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.389539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.389667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.389789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.389817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.389959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.390091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.390118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.390215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.390317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.390346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.390496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.390619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.390644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.390778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.390908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.390937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.391028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.391143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.391169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.391274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.391364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.391399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.391509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.391680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.391708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.391811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.391938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.391966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.392075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.392208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.392234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.392363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.392490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.392516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.392651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.392813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.392840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.392943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.393042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.393070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.393208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.393360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.393389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.393520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.393608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.393633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.393754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.393886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.393914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.394035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.394171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.394199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.394294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.394457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.394483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.394572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.394660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.394704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.394897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.395049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.395077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 02:32:50.395211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.395377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 02:32:50.395432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.869 [2024-11-29 02:32:50.395559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.395679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.395704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.869 qpair failed and we were unable to recover it. 00:27:46.869 [2024-11-29 02:32:50.395853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.395935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.395960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.869 qpair failed and we were unable to recover it. 00:27:46.869 [2024-11-29 02:32:50.396090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.396206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.396235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.869 qpair failed and we were unable to recover it. 00:27:46.869 [2024-11-29 02:32:50.396347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.396508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.396537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.869 qpair failed and we were unable to recover it. 00:27:46.869 [2024-11-29 02:32:50.396677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.396767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.396793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.869 qpair failed and we were unable to recover it. 00:27:46.869 [2024-11-29 02:32:50.396881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.397024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.397068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.869 qpair failed and we were unable to recover it. 00:27:46.869 [2024-11-29 02:32:50.397206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.397329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.397356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.869 qpair failed and we were unable to recover it. 00:27:46.869 [2024-11-29 02:32:50.397544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.397636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.397662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.869 qpair failed and we were unable to recover it. 00:27:46.869 [2024-11-29 02:32:50.397773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.397929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.397957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.869 qpair failed and we were unable to recover it. 00:27:46.869 [2024-11-29 02:32:50.398085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.398210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.398239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.869 qpair failed and we were unable to recover it. 00:27:46.869 [2024-11-29 02:32:50.398347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.398485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.398512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.869 qpair failed and we were unable to recover it. 00:27:46.869 [2024-11-29 02:32:50.398636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.398732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.398758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.869 qpair failed and we were unable to recover it. 00:27:46.869 [2024-11-29 02:32:50.398838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.398981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.399008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.869 qpair failed and we were unable to recover it. 00:27:46.869 [2024-11-29 02:32:50.399135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.399243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.399268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.869 qpair failed and we were unable to recover it. 00:27:46.869 [2024-11-29 02:32:50.399386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.399596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.399624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.869 qpair failed and we were unable to recover it. 00:27:46.869 [2024-11-29 02:32:50.399735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.399880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.399905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.869 qpair failed and we were unable to recover it. 00:27:46.869 [2024-11-29 02:32:50.400000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.400140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.400166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.869 qpair failed and we were unable to recover it. 00:27:46.869 [2024-11-29 02:32:50.400276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.400438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.400466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.869 qpair failed and we were unable to recover it. 00:27:46.869 [2024-11-29 02:32:50.400553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.400674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.400701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.869 qpair failed and we were unable to recover it. 00:27:46.869 [2024-11-29 02:32:50.400804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.400890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.400917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.869 qpair failed and we were unable to recover it. 00:27:46.869 [2024-11-29 02:32:50.401037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.401130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.401155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.869 qpair failed and we were unable to recover it. 00:27:46.869 [2024-11-29 02:32:50.401321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.401473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.401502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.869 qpair failed and we were unable to recover it. 00:27:46.869 [2024-11-29 02:32:50.401639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.401755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.401780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.869 qpair failed and we were unable to recover it. 00:27:46.869 [2024-11-29 02:32:50.401919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.402005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.402036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.869 qpair failed and we were unable to recover it. 00:27:46.869 [2024-11-29 02:32:50.402164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.402271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.869 [2024-11-29 02:32:50.402298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.869 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.402433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.402556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.402581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.402675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.402787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.402827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.403002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.403098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.403124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.403234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.403310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.403336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.403498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.403637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.403664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.403791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.403872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.403899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.404011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.404122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.404149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.404247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.404381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.404415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.404543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.404633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.404659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.404800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.404967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.404996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.405177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.405286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.405312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.405432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.405559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.405587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.405727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.405851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.405877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.405964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.406078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.406103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.406290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.406430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.406455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.406603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.406746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.406787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.406934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.407105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.407130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.407269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.407439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.407469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.407579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.407693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.407718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.407802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.407918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.407945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.408037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.408211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.408239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.408380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.408506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.408533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.408629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.408810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.408843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.408938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.409058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.409086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.409247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.409411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.409454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.409597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.409731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.409759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.409871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.409955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.409983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.410120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.410283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.870 [2024-11-29 02:32:50.410311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.870 qpair failed and we were unable to recover it. 00:27:46.870 [2024-11-29 02:32:50.410451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.410568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.410593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.410683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.410790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.410818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.410959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.411040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.411065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.411155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.411267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.411295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.411447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.411570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.411601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.411714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.411801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.411826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.411926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.412015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.412043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.412169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.412310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.412339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.412463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.412604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.412630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.412732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.412895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.412922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.413056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.413167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.413195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.413371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.413505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.413538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.413689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.413823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.413852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.414003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.414107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.414135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.414302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.414388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.414429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.414599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.414749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.414774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.414868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.414992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.415021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.415195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.415333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.415375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.415574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.415684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.415719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.415819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.415964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.416005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.416176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.416272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.416299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.416424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.416564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.416592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.416762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.416892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.416918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.417005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.417096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.417122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.417214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.417391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.417432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.417583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.417698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.417723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.417840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.417967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.417993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.418076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.418159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.418184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.871 [2024-11-29 02:32:50.418294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.418398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.871 [2024-11-29 02:32:50.418443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.871 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.418542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.418661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.418688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.418779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.418897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.418927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.419073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.419188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.419213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.419345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.419429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.419455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.419538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.419672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.419699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.419831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.419982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.420012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.420138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.420226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.420252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.420343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.420454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.420482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.420571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.420711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.420739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.420879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.420961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.420987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.421090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.421239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.421267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.421383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.421552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.421581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.421699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.421782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.421809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.421924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.422063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.422091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.422230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.422372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.422408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.422530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.422645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.422671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.422760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.422839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.422864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.422983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.423113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.423141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.423245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.423345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.423390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.423502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.423618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.423644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.423764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.423881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.423906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.424003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.424131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.424159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.424284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.424367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.424409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.424566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.424679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.424705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.424858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.424980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.425006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.425109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.425275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.425303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.425466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.425556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.425582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.425670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.425811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.425837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.872 qpair failed and we were unable to recover it. 00:27:46.872 [2024-11-29 02:32:50.426017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.426165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.872 [2024-11-29 02:32:50.426192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.873 qpair failed and we were unable to recover it. 00:27:46.873 [2024-11-29 02:32:50.426367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.426469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.426494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.873 qpair failed and we were unable to recover it. 00:27:46.873 [2024-11-29 02:32:50.426586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.426689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.426715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.873 qpair failed and we were unable to recover it. 00:27:46.873 [2024-11-29 02:32:50.426810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.426983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.427009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.873 qpair failed and we were unable to recover it. 00:27:46.873 [2024-11-29 02:32:50.427121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.427230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.427258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.873 qpair failed and we were unable to recover it. 00:27:46.873 [2024-11-29 02:32:50.427423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.427565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.427591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.873 qpair failed and we were unable to recover it. 00:27:46.873 [2024-11-29 02:32:50.427753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.427900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.427926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.873 qpair failed and we were unable to recover it. 00:27:46.873 [2024-11-29 02:32:50.428051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.428173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.428201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.873 qpair failed and we were unable to recover it. 00:27:46.873 [2024-11-29 02:32:50.428373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.428494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.428536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.873 qpair failed and we were unable to recover it. 00:27:46.873 [2024-11-29 02:32:50.428669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.428792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.428820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.873 qpair failed and we were unable to recover it. 00:27:46.873 [2024-11-29 02:32:50.428958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.429045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.429070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.873 qpair failed and we were unable to recover it. 00:27:46.873 [2024-11-29 02:32:50.429187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.429271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.429301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.873 qpair failed and we were unable to recover it. 00:27:46.873 [2024-11-29 02:32:50.429390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.429530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.429555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.873 qpair failed and we were unable to recover it. 00:27:46.873 [2024-11-29 02:32:50.429689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.429780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.429809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.873 qpair failed and we were unable to recover it. 00:27:46.873 [2024-11-29 02:32:50.429915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.430058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.430083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.873 qpair failed and we were unable to recover it. 00:27:46.873 [2024-11-29 02:32:50.430247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.430349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.430377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.873 qpair failed and we were unable to recover it. 00:27:46.873 [2024-11-29 02:32:50.430479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.430598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.430626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.873 qpair failed and we were unable to recover it. 00:27:46.873 [2024-11-29 02:32:50.430734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.430874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.430900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.873 qpair failed and we were unable to recover it. 00:27:46.873 [2024-11-29 02:32:50.431038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.431140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.431169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.873 qpair failed and we were unable to recover it. 00:27:46.873 [2024-11-29 02:32:50.431331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.431461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.431490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.873 qpair failed and we were unable to recover it. 00:27:46.873 [2024-11-29 02:32:50.431636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.431743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.431768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.873 qpair failed and we were unable to recover it. 00:27:46.873 [2024-11-29 02:32:50.431932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.432061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.432089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.873 qpair failed and we were unable to recover it. 00:27:46.873 [2024-11-29 02:32:50.432198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.432320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.432348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.873 qpair failed and we were unable to recover it. 00:27:46.873 [2024-11-29 02:32:50.432490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.432607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.432632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.873 qpair failed and we were unable to recover it. 00:27:46.873 [2024-11-29 02:32:50.432730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.432861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.432885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.873 qpair failed and we were unable to recover it. 00:27:46.873 [2024-11-29 02:32:50.432975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.433120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.433148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.873 qpair failed and we were unable to recover it. 00:27:46.873 [2024-11-29 02:32:50.433290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.873 [2024-11-29 02:32:50.433405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.433431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.874 [2024-11-29 02:32:50.433557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.433642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.433670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.874 [2024-11-29 02:32:50.433806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.433969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.433996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.874 [2024-11-29 02:32:50.434132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.434240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.434266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.874 [2024-11-29 02:32:50.434388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.434511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.434537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.874 [2024-11-29 02:32:50.434651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.434788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.434813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.874 [2024-11-29 02:32:50.434920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.435019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.435044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.874 [2024-11-29 02:32:50.435178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.435329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.435357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.874 [2024-11-29 02:32:50.435511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.435629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.435655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.874 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 238886 Killed "${NVMF_APP[@]}" "$@" 00:27:46.874 [2024-11-29 02:32:50.435766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.435873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.435898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.874 [2024-11-29 02:32:50.436034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 02:32:50 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:27:46.874 [2024-11-29 02:32:50.436177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.436202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.874 02:32:50 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:46.874 [2024-11-29 02:32:50.436285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 02:32:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:46.874 [2024-11-29 02:32:50.436377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.436410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.874 02:32:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:46.874 [2024-11-29 02:32:50.436503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 02:32:50 -- common/autotest_common.sh@10 -- # set +x 00:27:46.874 [2024-11-29 02:32:50.436623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.436649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.874 [2024-11-29 02:32:50.436780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.436904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.436931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.874 [2024-11-29 02:32:50.437065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.437191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.437219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.874 [2024-11-29 02:32:50.437352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.437461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.437488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.874 [2024-11-29 02:32:50.437606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.437705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.437748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.874 [2024-11-29 02:32:50.437843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.437994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.438022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.874 [2024-11-29 02:32:50.438165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.438246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.438271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.874 [2024-11-29 02:32:50.438358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.438469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.438495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.874 [2024-11-29 02:32:50.438652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.438783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.438812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.874 [2024-11-29 02:32:50.438927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.439011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.439037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.874 [2024-11-29 02:32:50.439119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.439260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.439288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.874 [2024-11-29 02:32:50.439382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.439514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.439543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.874 [2024-11-29 02:32:50.439656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.439748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.439773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.874 [2024-11-29 02:32:50.439873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 02:32:50 -- nvmf/common.sh@469 -- # nvmfpid=239590 00:27:46.874 02:32:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:46.874 02:32:50 -- nvmf/common.sh@470 -- # waitforlisten 239590 00:27:46.874 [2024-11-29 02:32:50.440043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.440071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.874 [2024-11-29 02:32:50.440198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 02:32:50 -- common/autotest_common.sh@829 -- # '[' -z 239590 ']' 00:27:46.874 [2024-11-29 02:32:50.440335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.874 [2024-11-29 02:32:50.440362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.874 02:32:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:46.874 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.440476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 02:32:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:46.875 [2024-11-29 02:32:50.440569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.440595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 02:32:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:46.875 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:46.875 [2024-11-29 02:32:50.440683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 02:32:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:46.875 [2024-11-29 02:32:50.440837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.440865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 02:32:50 -- common/autotest_common.sh@10 -- # set +x 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.441009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.441141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.441169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.441307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.441387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.441420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.441527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.441625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.441668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.441758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.441856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.441883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.441980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.442060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.442085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.442169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.442282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.442308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.442472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.442601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.442629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.442781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.442869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.442894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.442989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.443104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.443132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.443229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.443352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.443401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.443515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.443603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.443629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.443735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.443877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.443902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.444018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.444116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.444145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.444288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.444410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.444436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.444562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.444668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.444706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.444834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.444931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.444959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.445075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.445169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.445195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.445338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.445437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.445463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.445584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.445681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.445725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.445891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.446035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.446060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.446208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.446333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.446362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.446583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.446744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.446772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.446915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.447034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.447059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.447202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.447341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.447385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.447497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.447651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.447677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.875 qpair failed and we were unable to recover it. 00:27:46.875 [2024-11-29 02:32:50.447799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.875 [2024-11-29 02:32:50.447914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.447940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.448054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.448166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.448191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.448300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.448450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.448479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.448660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.448773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.448799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.448909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.449054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.449082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.449194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.449313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.449339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.449476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.449561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.449586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.449687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.449781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.449808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.449932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.450021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.450047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.450156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.450269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.450294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.450398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.450512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.450538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.450651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.450754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.450782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.450955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.451069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.451095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.451200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.451345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.451373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.451504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.451621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.451646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.451764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.451890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.451916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.452026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.452169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.452196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.452318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.452437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.452479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.452578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.452690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.452714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.452835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.452972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.453001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.453103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.453270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.453297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.453468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.453577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.453620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.453725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.453819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.453844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.453957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.454056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.454083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.454248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.454333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.454359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.454491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.454615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.454643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.454777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.454909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.454937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.455053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.455166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.455191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.455311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.455415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.455443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.455590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.455702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.455729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.455845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.455990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.456016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.876 qpair failed and we were unable to recover it. 00:27:46.876 [2024-11-29 02:32:50.456159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.456298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.876 [2024-11-29 02:32:50.456326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.456434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.456566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.456608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.456724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.456839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.456864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.456986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.457115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.457152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.457281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.457453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.457494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.457607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.457777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.457803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.457940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.458031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.458056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.458185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.458275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.458302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.458425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.458549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.458574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.458695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.458781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.458824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.458916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.459047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.459072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.459196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.459342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.459368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.459492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.459597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.459625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.459745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.459862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.459889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.460021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.460165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.460195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.460372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.460476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.460502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.460606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.460726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.460753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.460867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.461007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.461033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.461167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.461248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.461274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.461364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.461476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.461502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.461596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.461736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.461762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.461876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.461993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.462019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.462136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.462231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.462256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.462378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.462482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.462509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.462654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.462744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.462773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.462863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.462976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.463002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.463111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.463258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.463283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.877 qpair failed and we were unable to recover it. 00:27:46.877 [2024-11-29 02:32:50.463377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.463524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.877 [2024-11-29 02:32:50.463552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.878 qpair failed and we were unable to recover it. 00:27:46.878 [2024-11-29 02:32:50.463646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.463789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.463814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.878 qpair failed and we were unable to recover it. 00:27:46.878 [2024-11-29 02:32:50.463939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.464056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.464082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.878 qpair failed and we were unable to recover it. 00:27:46.878 [2024-11-29 02:32:50.464169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.464279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.464304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.878 qpair failed and we were unable to recover it. 00:27:46.878 [2024-11-29 02:32:50.464415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.464506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.464531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.878 qpair failed and we were unable to recover it. 00:27:46.878 [2024-11-29 02:32:50.464632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.464747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.464773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.878 qpair failed and we were unable to recover it. 00:27:46.878 [2024-11-29 02:32:50.464890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.464983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.465009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.878 qpair failed and we were unable to recover it. 00:27:46.878 [2024-11-29 02:32:50.465091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.465202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.465232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.878 qpair failed and we were unable to recover it. 00:27:46.878 [2024-11-29 02:32:50.465362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.465472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.465498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.878 qpair failed and we were unable to recover it. 00:27:46.878 [2024-11-29 02:32:50.465596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.465688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.465714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.878 qpair failed and we were unable to recover it. 00:27:46.878 [2024-11-29 02:32:50.465807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.465892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.465918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.878 qpair failed and we were unable to recover it. 00:27:46.878 [2024-11-29 02:32:50.466036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.466153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.466180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.878 qpair failed and we were unable to recover it. 00:27:46.878 [2024-11-29 02:32:50.466299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.466435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.466472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.878 qpair failed and we were unable to recover it. 00:27:46.878 [2024-11-29 02:32:50.466587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.466703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.466728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.878 qpair failed and we were unable to recover it. 00:27:46.878 [2024-11-29 02:32:50.466845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.466941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.466967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.878 qpair failed and we were unable to recover it. 00:27:46.878 [2024-11-29 02:32:50.467064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.467173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.467198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.878 qpair failed and we were unable to recover it. 00:27:46.878 [2024-11-29 02:32:50.467316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.467428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.467454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.878 qpair failed and we were unable to recover it. 00:27:46.878 [2024-11-29 02:32:50.467571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.467689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.467719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.878 qpair failed and we were unable to recover it. 00:27:46.878 [2024-11-29 02:32:50.467809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.467926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.467952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.878 qpair failed and we were unable to recover it. 00:27:46.878 [2024-11-29 02:32:50.468071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.468191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.468216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.878 qpair failed and we were unable to recover it. 00:27:46.878 [2024-11-29 02:32:50.468363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.468485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.468511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.878 qpair failed and we were unable to recover it. 00:27:46.878 [2024-11-29 02:32:50.468623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.468748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.468775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.878 qpair failed and we were unable to recover it. 00:27:46.878 [2024-11-29 02:32:50.468869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.468980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.469006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.878 qpair failed and we were unable to recover it. 00:27:46.878 [2024-11-29 02:32:50.469124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.469238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.469263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.878 qpair failed and we were unable to recover it. 00:27:46.878 [2024-11-29 02:32:50.469363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.469485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.878 [2024-11-29 02:32:50.469511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.878 qpair failed and we were unable to recover it. 00:27:46.878 [2024-11-29 02:32:50.469637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.469752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.469778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.469870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.469963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.469988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.470105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.470220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.470245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.470366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.470467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.470493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.470636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.470758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.470784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.470878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.470970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.470996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.471115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.471233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.471259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.471367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.471495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.471520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.471613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.471729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.471755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.471841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.471928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.471954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.472046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.472131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.472157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.472273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.472400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.472426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.472539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.472653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.472677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.472776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.472895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.472920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.473010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.473093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.473118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.473198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.473321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.473347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.473464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.473572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.473598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.473716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.473829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.473854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.473950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.474042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.474068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.474185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.474280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.474306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.474425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.474513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.474538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.474685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.474817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.474842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.474982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.475063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.475088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.475241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.475337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.475362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.475488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.475587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.475612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.475741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.475851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.475876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.475972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.476084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.476109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.476230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.476318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.476343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.476466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.476558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.879 [2024-11-29 02:32:50.476584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.879 qpair failed and we were unable to recover it. 00:27:46.879 [2024-11-29 02:32:50.476668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.476760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.476785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.476885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.477005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.477030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.477148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.477261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.477286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.477410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.477527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.477552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.477699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.477813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.477838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.477960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.478107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.478133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.478227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.478331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.478357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.478465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.478569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.478594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.478721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.478838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.478863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.478978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.479121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.479146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.479232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.479349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.479375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.479477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.479557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.479582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.479698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.479784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.479809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.479952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.480069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.480095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.480241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.480359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.480384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.480517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.480630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.480655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.480782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.480898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.480923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.481049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.481164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.481190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.481279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.481365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.481391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.481514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.481600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.481626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.481742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.481851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.481877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.482005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.482148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.482174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.482286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.482433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.482459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.482552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.482632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.482657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.482784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.482872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.482897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.483012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.483130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.483156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.483243] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:46.880 [2024-11-29 02:32:50.483272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.483300] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:46.880 [2024-11-29 02:32:50.483386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.483415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.483508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.483591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.483616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.880 qpair failed and we were unable to recover it. 00:27:46.880 [2024-11-29 02:32:50.483713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.880 [2024-11-29 02:32:50.483809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.483835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.483951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.484068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.484095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.484185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.484278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.484303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.484449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.484542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.484567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.484683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.484813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.484839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.484922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.485049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.485075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.485172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.485287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.485313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.485429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.485522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.485549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.485697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.485782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.485808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.485900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.486016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.486042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.486145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.486235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.486261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.486378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.486473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.486499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.486592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.486706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.486730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.486823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.486909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.486934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.487074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.487159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.487184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.487293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.487457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.487484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.487581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.487666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.487692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.487777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.487870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.487896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.488010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.488128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.488154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.488310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.488425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.488451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.488546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.488639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.488664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.488795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.488912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.488938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.489026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.489113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.489138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.489243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.489386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.489416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.489504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.489595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.489620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.489705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.489806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.489831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.489923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.490039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.490064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.490154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.490235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.490260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.490374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.490526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.490551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.490644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.490762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.490787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.490902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.491015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.491040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.491137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.491224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.491250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:46.881 [2024-11-29 02:32:50.491339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.491437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.881 [2024-11-29 02:32:50.491464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:46.881 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 02:32:50.491586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 02:32:50.491675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 02:32:50.491701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 02:32:50.491820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 02:32:50.491902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 02:32:50.491927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 02:32:50.492011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 02:32:50.492124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 02:32:50.492154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 02:32:50.492245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 02:32:50.492335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 02:32:50.492361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 02:32:50.492482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 02:32:50.492558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.492583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.492671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.492791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.492816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.492900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.492980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.493005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.493125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.493205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.493231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.493333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.493422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.493448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.493543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.493633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.493658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.493755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.493882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.493907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.494024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.494117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.494142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.494253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.494382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.494418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.494541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.494637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.494662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.494758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.494876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.494901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.495017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.495131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.495156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.495244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.495341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.495366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.495488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.495579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.495604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.495702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.495793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.495819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.495917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.496031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.496057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.496195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.496279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.496304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.496412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.496496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.496521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.496643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.496721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.496750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.496849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.496967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.496993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.497106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.497245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.497270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.497359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.497458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.497484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.497603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.497713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.497739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.497856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.497975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.498000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.498115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.498227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.498252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.498338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.498449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.498475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.498594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.498708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.498735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.498856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.498975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.499000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 02:32:50.499120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.499204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 02:32:50.499236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.499327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.499470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.499496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.499614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.499704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.499729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.499843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.499951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.499976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.500095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.500185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.500210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.500298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.500430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.500457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.500550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.500670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.500696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.500810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.500898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.500923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.501011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.501158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.501184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.501298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.501419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.501444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.501561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.501639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.501664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.501783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.501879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.501903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.502018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.502134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.502159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.502250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.502337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.502363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.502487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.502608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.502634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.502782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.502871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.502897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.502998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.503134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.503160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.503298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.503425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.503451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.503566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.503654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.503680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.503771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.503852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.503877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.503993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.504105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.504130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.504223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.504341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.504366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.504497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.504590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.504615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.504703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.504820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.504846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.504970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.505057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.505083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.505171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.505263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.505288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.505390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.505515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.505541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.505658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.505742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.505768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.505915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.506029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 02:32:50.506054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 02:32:50.506171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.506265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.506290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.506422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.506538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.506564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.506721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.506873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.506898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.506989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.507066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.507091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.507181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.507319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.507344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.507464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.507575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.507601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.507717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.507843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.507868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.508002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.508145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.508170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.508255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.508364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.508389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.508512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.508626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.508652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.508771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.508865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.508890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.508984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.509071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.509097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.509218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.509304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.509329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.509413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.509489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.509514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.509607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.509701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.509727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.509846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.509937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.509963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.510079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.510200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.510225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.510341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.510444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.510470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.510589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.510713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.510739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.510829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.510919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.510945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.511064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.511177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.511202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.511293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.511386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.511427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.511528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.511656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.511681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.511801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.511915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.511940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.512087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.512174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.512199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.512295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.512418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.512445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.512534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.512650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.512676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.512793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.512904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.512930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 02:32:50.513078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 02:32:50.513161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.513188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.513334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.513423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.513449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.513543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.513687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.513712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.513804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.513919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.513944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.514104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.514199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.514224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.514347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.514439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.514464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.514579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.514702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.514727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.514811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.514896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.514921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.515039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.515159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.515184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.515308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.515418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.515444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.515567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.515651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.515676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.515763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.515916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.515941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.516035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.516118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.516143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.516238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.516351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.516376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.516526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.516665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.516694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.516787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.516930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.516956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.517049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.517159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.517185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.517306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.517404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.517431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.517525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.517668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.517695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.517813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.517903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.517930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.518046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.518161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.518187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.518308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.518435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.518463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.518606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.518688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.518714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.518859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.518981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.519007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.519135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.519257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.519283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.519382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.519509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.519535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.519654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.519773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.519799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.519920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.520038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.520063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 02:32:50.520215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 02:32:50.520327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.520353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 02:32:50.520483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.520595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.520621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 02:32:50.520737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.520855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.520882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 02:32:50.520975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.521097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.521123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 02:32:50.521213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.521326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.521352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 02:32:50.521484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.521605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.521631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 02:32:50.521777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.521869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.521895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 02:32:50.522018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 EAL: No free 2048 kB hugepages reported on node 1 00:27:47.172 [2024-11-29 02:32:50.522133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.522159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 02:32:50.522242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.522331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.522356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 02:32:50.522479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.522596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.522622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 02:32:50.522751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.522842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.522868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 02:32:50.522959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.523044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.523070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 02:32:50.523185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.523301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.523327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 02:32:50.523445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.523542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.523569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 02:32:50.523686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.523832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.523858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 02:32:50.523978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.524133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.524159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 02:32:50.524248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.524341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.524367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 02:32:50.524487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.524589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.524616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 02:32:50.524701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.524810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.524836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 02:32:50.524922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.525015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.525041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 02:32:50.525135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.525250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.525276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 02:32:50.525365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.525459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.525487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 02:32:50.525590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.525705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.525733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 02:32:50.525936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.526035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 02:32:50.526061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 02:32:50.526144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.526235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.526260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.526409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.526520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.526548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.526640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.526769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.526797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.526890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.527038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.527065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.527183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.527293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.527319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.527412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.527527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.527554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.527644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.527756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.527783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.527872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.527983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.528009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.528129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.528243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.528269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.528350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.528435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.528462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.528572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.528658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.528684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.528774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.528864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.528892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.529004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.529099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.529128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.529223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.529317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.529343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.529488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.529570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.529596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.529679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.529796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.529821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.529938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.530056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.530083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.530180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.530271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.530297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.530428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.530541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.530567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.530723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.530849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.530876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.531022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.531137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.531164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.531248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.531357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.531383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.531523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.531648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.531674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.531774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.531886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.531912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.532056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.532176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.532202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.532320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.532419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.532448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.532571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.532665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.532691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.532780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.532893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.532919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 02:32:50.533013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.533106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 02:32:50.533132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.533226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.533304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.533330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.533474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.533611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.533641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.533768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.533858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.533885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.533975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.534087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.534121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.534239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.534357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.534382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.534482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.534572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.534597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.534692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.534805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.534830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.534972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.535051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.535076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.535160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.535275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.535300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.535426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.535516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.535541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.535634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.535756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.535781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.535893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.535980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.536005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.536101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.536191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.536217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.536300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.536465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.536497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.536589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.536675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.536700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.536808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.536925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.536951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.537064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.537162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.537187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.537267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.537384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.537417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.537497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.537589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.537614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.537707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.537790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.537816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.537931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.538048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.538074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.538157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.538245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.538270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.538373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.538517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.538550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.538672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.538759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.538785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.538884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.539004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.539030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.539153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.539267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.539293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.539381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.539503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.539530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.539616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.539730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.539756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.539850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.539993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 02:32:50.540018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 02:32:50.540149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.540268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.540293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.540413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.540529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.540554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.540639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.540755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.540780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.540923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.541014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.541041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.541134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.541251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.541276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.541404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.541518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.541544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.541661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.541807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.541832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.541950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.542039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.542064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.542164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.542252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.542277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.542371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.542469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.542495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.542591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.542675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.542700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.542814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.542903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.542928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.543006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.543128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.543153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.543278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.543361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.543386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.543472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.543558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.543583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.543672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.543808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.543834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.543920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.544005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.544030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.544128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.544239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.544264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.544359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.544445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.544472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.544568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.544683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.544708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.544827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.544909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.544934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.545019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.545136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.545161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.545254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.545371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.545413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.545530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.545618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.545642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.545754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.545839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.545864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.545980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.546070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.546096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.546212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.546296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.546322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.546405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.546498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.546524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.546636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.546727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 02:32:50.546752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 02:32:50.546871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.546991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.547016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.547165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.547255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.547281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.547368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.547461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.547487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.547573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.547691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.547720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.547806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.547921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.547947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.548057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.548148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.548173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.548259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.548345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.548375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.548505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.548639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.548664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.548776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.548891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.548916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.549000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.549109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.549134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.549216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.549352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.549377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.549476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.549582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.549607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.549695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.549804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.549829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.549943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.550058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.550083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.550243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.550323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.550348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.550457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.550580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.550605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.550690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.550778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.550804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.550903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.551021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.551047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.551136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.551217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.551242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.551350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.551443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.551468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.551555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.551641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.551666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.551776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.551859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.551886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.552004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.552114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.552139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.552263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.552374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.552405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.552530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.552616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.552640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.552759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.552841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.552865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.552959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.553081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 02:32:50.553106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 02:32:50.553197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.553287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.553312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 02:32:50.553405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.553507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.553532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 02:32:50.553619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.553730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.553756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 02:32:50.553868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.553959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.553984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 02:32:50.554070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.554185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.554210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 02:32:50.554309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.554399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.554424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 02:32:50.554511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.554600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.554624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 02:32:50.554731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.554826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.554850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 02:32:50.554946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.555031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.555056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 02:32:50.555153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.555237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.555261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 02:32:50.555351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.555444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.555470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 02:32:50.555554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.555560] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:47.177 [2024-11-29 02:32:50.555674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.555699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 02:32:50.555785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.555860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.555885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 02:32:50.556005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.556117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.556142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 02:32:50.556255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.556375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.556417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 02:32:50.556531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.556641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.556667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 02:32:50.556744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.556884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.556910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 02:32:50.557008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.557087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.557111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 02:32:50.557219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.557342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.557367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 02:32:50.557462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.557558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.557584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 02:32:50.557670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.557761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.557786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 02:32:50.557872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.557983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.558008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 02:32:50.558115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.558198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.558223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 02:32:50.558355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.558452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.558478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 02:32:50.558565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.558676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.558701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 02:32:50.558793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.558936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 02:32:50.558961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.559083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.559196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.559220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.559305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.559389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.559421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.559510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.559634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.559660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.559759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.559860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.559885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.560001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.560129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.560158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.560281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.560398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.560425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.560513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.560626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.560651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.560769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.560913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.560938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.561021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.561123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.561148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.561234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.561349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.561374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.561502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.561616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.561642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.561734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.561826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.561852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.561942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.562063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.562088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.562182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.562297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.562322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.562411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.562539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.562565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.562667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.562782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.562807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.562922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.563010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.563035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.563129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.563244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.563270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.563366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.563464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.563490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.563580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.563664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.563690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.563795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.563882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.563908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.564041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.564130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.564155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.564269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.564423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.564450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.564571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.564699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.564725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.564829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.564946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.564973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.565121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.565236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.565262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.565381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.565509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.565535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.565626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.565710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.565735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 02:32:50.565846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 02:32:50.565940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.565966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.566161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.566292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.566317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.566432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.566639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.566664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.566781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.566925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.566951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.567065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.567150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.567175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.567262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.567377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.567412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.567502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.567617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.567642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.567830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.567943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.567972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.568072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.568161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.568187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.568305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.568434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.568462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.568609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.568738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.568768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.568894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.568981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.569007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.569125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.569237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.569263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.569385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.569481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.569508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.569602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.569731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.569756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.569866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.569955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.569980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.570075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.570188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.570214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.570333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.570429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.570456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.570549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.570693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.570719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.570836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.570923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.570949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.571047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.571127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.571152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.571264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.571352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.571379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.571492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.571605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.571631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.571751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.571842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.571868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.571954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.572081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.572107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.572189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.572305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.572331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.572453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.572551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.572578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.572663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.572760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.572785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.572876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.573018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.573043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 02:32:50.573160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 02:32:50.573274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.573300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.573386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.573481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.573507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.573620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.573714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.573741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.573859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.573973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.573999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.574092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.574235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.574261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.574385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.574477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.574503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.574588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.574678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.574703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.574849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.574926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.574951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.575074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.575167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.575193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.575309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.575420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.575447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.575537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.575629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.575656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.575748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.575888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.575913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.575997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.576114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.576139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.576266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.576360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.576385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.576496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.576578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.576604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.576724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.576816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.576841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.576964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.577076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.577102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.577196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.577316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.577341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.577458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.577552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.577579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.577666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.577808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.577835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.577975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.578057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.578082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.578171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.578282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.578308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.578404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.578519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.578545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.578702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.578789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.578815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.578910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.579025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.579051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.579137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.579278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.579304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.579404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.579524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.579549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.579649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.579763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.579789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.579899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.580022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 02:32:50.580052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 02:32:50.580136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.580210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.580236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 02:32:50.580385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.580509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.580535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 02:32:50.580660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.580780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.580805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 02:32:50.580897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.581040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.581066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 02:32:50.581158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.581240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.581265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 02:32:50.581354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.581484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.581511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 02:32:50.581634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.581717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.581743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 02:32:50.581857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.581973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.582000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 02:32:50.582104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.582216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.582242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 02:32:50.582325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.582420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.582452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 02:32:50.582573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.582665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.582691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 02:32:50.582776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.582913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.582939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 02:32:50.583082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.583195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.583221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 02:32:50.583302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.583425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.583451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 02:32:50.583543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.583627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.583653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 02:32:50.583780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.583863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.583889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 02:32:50.584015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.584132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.584159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 02:32:50.584307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.584412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.584439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 02:32:50.584528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.584650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.584676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 02:32:50.584770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.584884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.584915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 02:32:50.585017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.585167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.585192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 02:32:50.585276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.585425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.585452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 02:32:50.585550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.585668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.585694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 02:32:50.585816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.585930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.585955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 02:32:50.586073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.586154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.586179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 02:32:50.586272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 02:32:50.586384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.586418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.586528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.586628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.586654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.586771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.586884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.586909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.586999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.587116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.587143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.587257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.587372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.587420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.587524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.587610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.587635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.587737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.587823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.587850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.587970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.588060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.588087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.588210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.588297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.588324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.588425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.588515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.588540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.588636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.588731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.588756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.588869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.588961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.588986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.589071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.589154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.589178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.589321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.589422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.589449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.589566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.589648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.589674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.589781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.589890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.589916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.590008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.590095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.590122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.590203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.590322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.590347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.590445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.590537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.590563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.590655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.590742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.590768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.590885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.591011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.591038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.591161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.591246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.591271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.591390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.591482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.591508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.591599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.591717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.591742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.591862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.592005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.592031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.592150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.592266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.592292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.592372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.592510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.592538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.592642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.592743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.592768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.592886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.592967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.592996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 02:32:50.593089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 02:32:50.593206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.593230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.593327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.593423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.593451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.593547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.593637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.593662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.593759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.593873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.593899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.594016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.594097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.594123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.594216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.594332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.594357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.594463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.594579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.594606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.594696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.594787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.594812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.594900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.595016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.595043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.595160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.595255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.595282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.595365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.595455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.595481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.595565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.595679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.595705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.595809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.595890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.595916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.596030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.596149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.596175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.596296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.596378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.596415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.596513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.596597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.596623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.596741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.596822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.596847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.596943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.597029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.597055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.597169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.597313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.597338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.597434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.597516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.597541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.597643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.597759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.597786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.597900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.598043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.598068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.598178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.598293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.598318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.598406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.598507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.598533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.598649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.598766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.598791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.598938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.599021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.599047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.599136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.599280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.599306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.599402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.599489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.599515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.599667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.599752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 02:32:50.599778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 02:32:50.599871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.599980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.600006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.600128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.600215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.600240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.600359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.600457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.600482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.600576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.600687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.600712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.600802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.600891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.600917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.601030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.601145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.601171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.601287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.601403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.601430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.601519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.601594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.601620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.601718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.601801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.601827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.601909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.602027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.602053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.602165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.602274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.602300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.602404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.602517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.602542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.602687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.602775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.602800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.602945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.603036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.603062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.603179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.603256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.603281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.603411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.603522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.603548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.603640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.603730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.603768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.603891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.603985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.604012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.604105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.604222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.604249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.604365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.604473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.604500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.604594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.604679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.604704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.604789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.604900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.604925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.605036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.605127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.605154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.605277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.605390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.605422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.605503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.605598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.605625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.605744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.605831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.605856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.605970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.606110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.606135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.606256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.606406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.606433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 02:32:50.606526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.606610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 02:32:50.606637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.606755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.606866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.606892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.607011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.607105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.607131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.607225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.607325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.607350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.607444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.607561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.607587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.607685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.607777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.607803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.607948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.608060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.608086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.608173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.608316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.608341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.608456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.608536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.608561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.608677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.608794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.608820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.608940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.609085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.609110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.609203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.609292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.609318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.609408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.609528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.609553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.609635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.609717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.609743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.609889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.610010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.610035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.610130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.610210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.610236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.610378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.610470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.610496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.610590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.610674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.610700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.610788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.610904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.610930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.611018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.611139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.611165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.611263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.611349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.611375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.611500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.611605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.611631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.611758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.611876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.611901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.611987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.612107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.612134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.612282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.612369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.612403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.612492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.612615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.612642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.612785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.612900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.612925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.613043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.613133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.613158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.613303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.613450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.613478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 02:32:50.613574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.613688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 02:32:50.613715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 02:32:50.613841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.613970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.613995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 02:32:50.614107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.614235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.614260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 02:32:50.614346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.614494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.614519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 02:32:50.614651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.614771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.614798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 02:32:50.614885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.615003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.615029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 02:32:50.615143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.615255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.615280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 02:32:50.615410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.615540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.615566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 02:32:50.615683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.615780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.615806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 02:32:50.615903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.616024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.616050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 02:32:50.616141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.616256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.616282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 02:32:50.616391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.616545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.616572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 02:32:50.616703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.616854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.616880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 02:32:50.616968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.617110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.617136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 02:32:50.617226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.617337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.617362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 02:32:50.617486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.617578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.617603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 02:32:50.617723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.617836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.617862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 02:32:50.617990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.618073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.618100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 02:32:50.618214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.618311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.618337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 02:32:50.618455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.618569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.618595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 02:32:50.618684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.618770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.618801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 02:32:50.618892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.619015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.619041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 02:32:50.619131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.619255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.619281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 02:32:50.619370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.619514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.619540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 02:32:50.619623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.619728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.619758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 02:32:50.619877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.619990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 02:32:50.620015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.620104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.620222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.620249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.620334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.620461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.620489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.620571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.620702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.620727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.620866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.620946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.620972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.621095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.621176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.621205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.621329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.621460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.621486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.621603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.621740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.621765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.621854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.621936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.621961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.622050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.622148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.622174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.622285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.622412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.622438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.622538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.622659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.622685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.622776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.622921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.622946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.623036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.623158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.623183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.623268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.623399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.623426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.623526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.623647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.623678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.623808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.623918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.623943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.624034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.624146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.624172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.624287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.624379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.624437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.624558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.624653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.624686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.624795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.624912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.624942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.625078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.625171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.625197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.625281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.625414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.625441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.625551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.625644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.625669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.625757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.625843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.625869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.625978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.626069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.626099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.626217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.626358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.626383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.626480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.626568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.626593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.626682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.626807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.626832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 02:32:50.626927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 02:32:50.627018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.627045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.627141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.627231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.627258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.627375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.627488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.627514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.627599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.627688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.627713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.627801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.627892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.627918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.628040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.628120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.628145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.628260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.628339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.628364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.628501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.628646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.628672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.628790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.628881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.628908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.629006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.629094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.629119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.629206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.629317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.629343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.629432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.629528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.629554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.629669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.629766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.629792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.629883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.629999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.630025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.630145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.630259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.630284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.630377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.630527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.630553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.630639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.630789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.630814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.630935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.631028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.631054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.631147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.631266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.631293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.631417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.631506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.631532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.631624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.631740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.631765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.631884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.632005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.632030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.632174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.632263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.632289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.632419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.632538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.632563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.632710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.632795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.632821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.632966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.633049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.633075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.633152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.633300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.633326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.633450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.633571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.633596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.633714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.633831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.633858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 02:32:50.633947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 02:32:50.634058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.634083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.634199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.634318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.634343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.634443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.634554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.634579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.634672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.634753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.634778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.634890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.634984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.635009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.635132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.635218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.635244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.635352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.635470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.635495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.635586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.635682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.635707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.635829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.635942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.635967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.636085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.636230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.636255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.636347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.636457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.636483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.636566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.636709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.636734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.636816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.636898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.636923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.637010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.637123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.637149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.637231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.637323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.637348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.637450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.637536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.637562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.637653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.637770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.637796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.637884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.637997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.638023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.638173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.638257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.638282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.638370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.638521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.638547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.638635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.638753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.638778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.638865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.638949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.638974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.639068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.639180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.639206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.639321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.639409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.639435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.639554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.639650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.639675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.639764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.639860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.639887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.640004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.640123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.640149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.640232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.640314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.640340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.640478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.640594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.640620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 02:32:50.640714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 02:32:50.640812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.640839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 02:32:50.640926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.641020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.641045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 02:32:50.641141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.641251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.641277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 02:32:50.641399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.641518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.641543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 02:32:50.641630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.641742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.641767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 02:32:50.641850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.641932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.641958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 02:32:50.642042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.642133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.642159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 02:32:50.642270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.642398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.642425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 02:32:50.642509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.642628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.642654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 02:32:50.642743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.642822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.642847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 02:32:50.642936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.643026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.643053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 02:32:50.643170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.643262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.643287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 02:32:50.643377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.643486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.643511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 02:32:50.643628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.643708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.643734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 02:32:50.643844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.643953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.643978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 02:32:50.644065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.644147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.644172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 02:32:50.644291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.644372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.644416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 02:32:50.644509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.644588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.644613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 02:32:50.644712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.644828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.644855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 02:32:50.644975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.645090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.645116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 02:32:50.645198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.645278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.645303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 02:32:50.645417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.645500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.645526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 02:32:50.645620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.645741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.645767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 02:32:50.645883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.645970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.645995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 02:32:50.646108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.646219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.646245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 02:32:50.646330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.646452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 02:32:50.646477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.646569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.646683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.646708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.646829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.646944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.646970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.647083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.647177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.647203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.647286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.647412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.647438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.647537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.647654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.647680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.647787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.647936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.647961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.648047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.648154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.648179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.648277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.648370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.648415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.648517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.648635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.648661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.648744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.648859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.648885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.648977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.649093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.649119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.649232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.649354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.649380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.649475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.649563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.649589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.649734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.649868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.649894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.649979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.650095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.650122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.650238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.650377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.650411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.650527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.650613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.650640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.650731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.650846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.650871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.650985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.651104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.651129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.651219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.651335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.651361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.651485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.651577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.651603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.651723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.651810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.651837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.651977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.652095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.652120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.652208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.652358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.652384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.652513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.652599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.652626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.652719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.652831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.652856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.652946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.653063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.653088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 02:32:50.653171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.653256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 02:32:50.653282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.653382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.653473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.653498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.653589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.653673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.653698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.653783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.653873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.653898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.653994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.654137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.654163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.654254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.654364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.654389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.654517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.654645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.654670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.654786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.654907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.654933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.655048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.655159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.655185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.655304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.655403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.655429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.655517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.655630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.655656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.655775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.655861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.655887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.655970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.656089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.656115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.656211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.656333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.656359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.656485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.656581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.656607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.656695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.656783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.656810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.656893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.657011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.657041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.657160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.657244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.657270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.657359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.657455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.657481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.657573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.657696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.657722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.657837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.657961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.657986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.658068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.658175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.658201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.658293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.658419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.658445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.658541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.658653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.658679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.658795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.658886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.658912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.659032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.659128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.659153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.659274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.659419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.659450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.659550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.659667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.659693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.659814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.659904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.659930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 02:32:50.660018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 02:32:50.660131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.660157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.660277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.660384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.660416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.660536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.660654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.660679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.660763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.660878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.660903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.660985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.661103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.661130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.661223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.661318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.661344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.661462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.661579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.661604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.661694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.661806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.661838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.661928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.662044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.662070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.662155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.662265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.662290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.662418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.662529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.662555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.662643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.662725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.662751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.662849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.662965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.662991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.663109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.663250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.663276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.663363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.663483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.663510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.663602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.663722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.663747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.663832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.663912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.663937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.664052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.664138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.664164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.664314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.664391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.664433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.664520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.664600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.664625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.664722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.664834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.664859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.664947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.665062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.665087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.665178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.665294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.665321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.665471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.665557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.665582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.665672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.665787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.665812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.665923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.666039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.666065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.666172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.666286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.666312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.666441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.666553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.666579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 02:32:50.666708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.666833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 02:32:50.666859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 02:32:50.667007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.667100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.667127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 02:32:50.667242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.667333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.667359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 02:32:50.667475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.667565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.667591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 02:32:50.667676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.667796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.667822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 02:32:50.667915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.667998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.668024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 02:32:50.668118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.668230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.668255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 02:32:50.668346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.668428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.668453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 02:32:50.668552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.668642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.668667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 02:32:50.668753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.668848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.668874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 02:32:50.668973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.669055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.669079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 02:32:50.669154] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:47.194 [2024-11-29 02:32:50.669172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.669252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.669273] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:47.194 [2024-11-29 02:32:50.669278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.194 [2024-11-29 02:32:50.669291] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of eventsqpair failed and we were unable to recover it. 00:27:47.194 at runtime. 00:27:47.194 [2024-11-29 02:32:50.669307] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:47.194 [2024-11-29 02:32:50.669387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.669356] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:47.194 [2024-11-29 02:32:50.669381] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:47.194 [2024-11-29 02:32:50.669520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.669515] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:47.194 [2024-11-29 02:32:50.669550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.194 [2024-11-29 02:32:50.669521] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 02:32:50.669653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.669744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.669771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 02:32:50.669874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.669987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.670013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 02:32:50.670106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.670220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.670246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 02:32:50.670349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.670473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.670500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 02:32:50.670618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.670738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.670764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 02:32:50.670862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.670942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.670967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 02:32:50.671050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.671175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.671201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 02:32:50.671292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.671376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.671409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 02:32:50.671498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.671589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.671614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 02:32:50.671709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.671796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.671822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 02:32:50.671938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.672030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.672055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 02:32:50.672143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.672227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.672252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 02:32:50.672343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.672426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.672451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 02:32:50.672539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.672627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.672653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 02:32:50.672777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 02:32:50.672861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.672886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 02:32:50.672974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.673054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.673079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 02:32:50.673169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.673252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.673277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc068000b90 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 02:32:50.673399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.673512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.673541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 02:32:50.673637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.673768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.673795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 02:32:50.673919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.674008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.674034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 02:32:50.674120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.674252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.674279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 02:32:50.674402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.674488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.674514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 02:32:50.674602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.674696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.674723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 02:32:50.674857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.674943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.674970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 02:32:50.675091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.675172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.675198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 02:32:50.675289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.675401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.675429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 02:32:50.675514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.675598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.675624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 02:32:50.675708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.675809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.675835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 02:32:50.675950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.676038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.676065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 02:32:50.676182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.676299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.676326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 02:32:50.676422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.676541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.676567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 02:32:50.676654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.676743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.676770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 02:32:50.676888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.676981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.677007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 02:32:50.677122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.677203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.677229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 02:32:50.677314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.677413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.677439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 02:32:50.677548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.677669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.677695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 02:32:50.677778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.677896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.677922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 02:32:50.678006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.678119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.678145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 02:32:50.678237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.678316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.678342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 02:32:50.678431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.678522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 02:32:50.678549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.678670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.678783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.678809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.678927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.679021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.679047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.679137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.679224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.679251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.679374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.679504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.679530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.679638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.679736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.679763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.679913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.679990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.680016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.680106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.680192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.680219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.680302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.680401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.680430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.680512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.680607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.680633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.680728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.680810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.680836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.680931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.681017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.681043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.681132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.681252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.681278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.681361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.681459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.681486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.681571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.681660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.681687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.681808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.681901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.681927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.682031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.682115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.682142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.682242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.682327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.682352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.682457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.682575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.682602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.682695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.682816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.682842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.682928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.683073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.683099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.683185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.683266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.683292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.683382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.683511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.683538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.683625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.683739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.683765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.683850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.683962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.683987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.684084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.684169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.684195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.684318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.684406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.684442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.684528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.684614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.684640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.684753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.684838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.684866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 02:32:50.684958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 02:32:50.685056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.685082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.685167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.685256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.685284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.685371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.685472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.685499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.685586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.685681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.685709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.685828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.685913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.685940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.686029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.686117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.686143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.686224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.686334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.686360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.686520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.686637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.686667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.686774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.686873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.686899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.686991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.687076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.687101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.687188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.687278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.687304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.687403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.687496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.687521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.687604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.687687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.687713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.687859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.687943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.687968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.688101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.688186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.688211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.688294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.688404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.688430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.688525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.688637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.688663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.688757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.688858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.688883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.688973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.689058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.689084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.689173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.689261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.689288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.689406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.689510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.689536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.689629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.689748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.689773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.689855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.689935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.689960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.690041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.690118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.690143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.690228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.690326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.690351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.690491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.690584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.690609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.690704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.690818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.690844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.690968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.691093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.691128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.691215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.691301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.691328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 02:32:50.691448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 02:32:50.691539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.691564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.691660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.691775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.691800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.691921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.692018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.692044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.692155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.692237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.692263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.692355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.692451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.692477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.692577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.692659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.692683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.692793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.692906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.692931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.693038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.693150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.693175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.693266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.693376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.693408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.693542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.693628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.693654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.693750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.693827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.693852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.693947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.694055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.694081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.694173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.694291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.694316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.694422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.694511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.694536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.694622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.694716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.694741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.694822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.694907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.694932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.695026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.695149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.695174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.695258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.695340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.695365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.695454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.695533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.695558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.695663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.695761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.695786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.695866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.695973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.695998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.696095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.696181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.696206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.696288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.696373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.696405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.696529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.696632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.696662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.696788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.696881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.696908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.697012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.697108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.697135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.697223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.697367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.697416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.697539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.697617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.697644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.697775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.697864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.697892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 02:32:50.697983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 02:32:50.698080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.698106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 02:32:50.698305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.698427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.698453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 02:32:50.698540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.698667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.698692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 02:32:50.698780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.698866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.698893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 02:32:50.699010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.699131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.699156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 02:32:50.699252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.699341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.699367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 02:32:50.699492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.699585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.699610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 02:32:50.699705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.699816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.699841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 02:32:50.699935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.700047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.700072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 02:32:50.700189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.700268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.700293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 02:32:50.700411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.700530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.700555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 02:32:50.700666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.700756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.700783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 02:32:50.700900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.701018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.701043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 02:32:50.701134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.701251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.701277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 02:32:50.701403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.701510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.701536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 02:32:50.701628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.701711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.701736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 02:32:50.701823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.701939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.701965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 02:32:50.702051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.702169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.702194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 02:32:50.702293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.702386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.702418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 02:32:50.702504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.702590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.702615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 02:32:50.702717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.702827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.702856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 02:32:50.702974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.703060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.703084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 02:32:50.703218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.703299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.703324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 02:32:50.703431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.703512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.703537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 02:32:50.703629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.703719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.703744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 02:32:50.703874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.704015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.704040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 02:32:50.704153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 02:32:50.704241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.704267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.704380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.704521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.704547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.704646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.704742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.704768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.704898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.704983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.705008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.705105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.705234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.705259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.705400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.705489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.705515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.705597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.705695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.705719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.705813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.705907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.705932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.706049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.706130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.706156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.706255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.706338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.706364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.706518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.706615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.706642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.706729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.706860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.706885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.707002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.707116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.707142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.707228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.707370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.707402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.707503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.707582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.707607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.707731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.707815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.707840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.707935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.708048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.708074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.708220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.708302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.708328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.708429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.708515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.708541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.708625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.708718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.708743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.708838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.708951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.708976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.709108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.709220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.709245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.709358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.709447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.709472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.709555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.709679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.709704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.709791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.709897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.709922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.710039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.710159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.710185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.710275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.710355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.710380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.710484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.710599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.710624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.710713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.710830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.710855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 02:32:50.710940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 02:32:50.711039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.711064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.711152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.711235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.711260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.711373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.711467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.711492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.711602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.711720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.711744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.711861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.711952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.711977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.712067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.712153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.712178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.712295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.712414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.712445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.712540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.712630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.712657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.712741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.712850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.712875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.712988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.713077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.713102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.713190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.713282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.713307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.713427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.713516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.713541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.713661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.713778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.713803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.713895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.713973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.713998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.714116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.714201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.714226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.714313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.714429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.714456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.714584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.714695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.714724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.714841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.714922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.714947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.715052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.715134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.715161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.715275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.715385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.715415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.715500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.715587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.715612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.715727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.715809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.715834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.715947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.716031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.716056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.716151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.716263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.716288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.716374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.716469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.716495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.716587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.716679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.716703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.716795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.716936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.716962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.717055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.717144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.717169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.717262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.717418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.717444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 02:32:50.717549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 02:32:50.717635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.717663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.717752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.717893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.717918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.718045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.718169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.718195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.718282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.718401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.718427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.718518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.718638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.718663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.718757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.718841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.718867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.718959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.719047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.719072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.719172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.719287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.719314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.719440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.719564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.719589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.719683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.719797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.719822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.719910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.720019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.720044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.720191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.720304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.720329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.720444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.720528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.720554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.720674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.720782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.720808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.720893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.720976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.721001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.721119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.721209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.721234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.721320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.721464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.721490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.721604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.721693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.721719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.721808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.721927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.721952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.722042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.722156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.722181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.722296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.722438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.722464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.722555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.722645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.722671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.722756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.722868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.722893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.722994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.723109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.723135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.723217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.723328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.723353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.723541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.723657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.723682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.723793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.723884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.723908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.723999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.724085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.724111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.724195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.724305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.724334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 02:32:50.724431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.724518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 02:32:50.724543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.724626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.724704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.724730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.724853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.724952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.724977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.725093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.725183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.725208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.725296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.725379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.725411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.725557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.725648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.725673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.725755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.725845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.725870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.725956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.726048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.726073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.726160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.726254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.726279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.726390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.726511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.726537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.726630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.726716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.726742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.726853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.726966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.726991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.727078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.727157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.727182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.727330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.727442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.727468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.727558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.727642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.727667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.727747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.727827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.727852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.727965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.728079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.728104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.728190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.728308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.728333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.728434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.728530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.728556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.728644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.728725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.728751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.728854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.728935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.728961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.729080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.729159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.729185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.729273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.729353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.729378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.729482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.729572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.729598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.729686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.729805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.729830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.729950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.730033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.730058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.730142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.730231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.730256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.730355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.730443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.730469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.730557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.730642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.730668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 02:32:50.730784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.730915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 02:32:50.730940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.204 qpair failed and we were unable to recover it. 00:27:47.204 [2024-11-29 02:32:50.731064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.731211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.731236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.204 qpair failed and we were unable to recover it. 00:27:47.204 [2024-11-29 02:32:50.731319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.731405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.731431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.204 qpair failed and we were unable to recover it. 00:27:47.204 [2024-11-29 02:32:50.731518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.731625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.731651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.204 qpair failed and we were unable to recover it. 00:27:47.204 [2024-11-29 02:32:50.731797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.731882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.731907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.204 qpair failed and we were unable to recover it. 00:27:47.204 [2024-11-29 02:32:50.731996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.732096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.732120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.204 qpair failed and we were unable to recover it. 00:27:47.204 [2024-11-29 02:32:50.732235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.732320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.732346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.204 qpair failed and we were unable to recover it. 00:27:47.204 [2024-11-29 02:32:50.732452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.732541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.732567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.204 qpair failed and we were unable to recover it. 00:27:47.204 [2024-11-29 02:32:50.732681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.732796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.732821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.204 qpair failed and we were unable to recover it. 00:27:47.204 [2024-11-29 02:32:50.732909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.732996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.733023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.204 qpair failed and we were unable to recover it. 00:27:47.204 [2024-11-29 02:32:50.733145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.733258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.733283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.204 qpair failed and we were unable to recover it. 00:27:47.204 [2024-11-29 02:32:50.733369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.733471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.733504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.204 qpair failed and we were unable to recover it. 00:27:47.204 [2024-11-29 02:32:50.733642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.733734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.733765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.204 qpair failed and we were unable to recover it. 00:27:47.204 [2024-11-29 02:32:50.733894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.733977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.734003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.204 qpair failed and we were unable to recover it. 00:27:47.204 [2024-11-29 02:32:50.734084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.734200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.734227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.204 qpair failed and we were unable to recover it. 00:27:47.204 [2024-11-29 02:32:50.734325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.734419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.734446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.204 qpair failed and we were unable to recover it. 00:27:47.204 [2024-11-29 02:32:50.734541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.734622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.734647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.204 qpair failed and we were unable to recover it. 00:27:47.204 [2024-11-29 02:32:50.734745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.734827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.734853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.204 qpair failed and we were unable to recover it. 00:27:47.204 [2024-11-29 02:32:50.734940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.735020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.735045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.204 qpair failed and we were unable to recover it. 00:27:47.204 [2024-11-29 02:32:50.735176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.735257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.735283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.204 qpair failed and we were unable to recover it. 00:27:47.204 [2024-11-29 02:32:50.735366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.735465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.735491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.204 qpair failed and we were unable to recover it. 00:27:47.204 [2024-11-29 02:32:50.735580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.735690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.735720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.204 qpair failed and we were unable to recover it. 00:27:47.204 [2024-11-29 02:32:50.735812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.735930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.735955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.204 qpair failed and we were unable to recover it. 00:27:47.204 [2024-11-29 02:32:50.736043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.736140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.736165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.204 qpair failed and we were unable to recover it. 00:27:47.204 [2024-11-29 02:32:50.736250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.736343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.736370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.204 qpair failed and we were unable to recover it. 00:27:47.204 [2024-11-29 02:32:50.736471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.736556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.736581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.204 qpair failed and we were unable to recover it. 00:27:47.204 [2024-11-29 02:32:50.736699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.204 [2024-11-29 02:32:50.736778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.736803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.736927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.737016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.737042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.737128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.737247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.737273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.737386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.737477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.737502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.737588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.737674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.737700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.737795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.737936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.737961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.738048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.738160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.738186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.738273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.738389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.738422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.738512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.738651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.738676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.738762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.738866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.738891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.738972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.739082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.739108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.739224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.739298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.739324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.739436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.739521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.739546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.739650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.739760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.739786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.739875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.739993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.740018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.740104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.740222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.740247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.740348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.740451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.740478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.740621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.740737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.740762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.740850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.740954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.740979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.741068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.741159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.741184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.741307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.741390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.741421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.741510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.741593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.741618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.741706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.741787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.741813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.741934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.742045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.742070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.742160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.742270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.742295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.742383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.742485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.742510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.742594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.742692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.742717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.742810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.742896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.742921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.743003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.743106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.205 [2024-11-29 02:32:50.743131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.205 qpair failed and we were unable to recover it. 00:27:47.205 [2024-11-29 02:32:50.743244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.743332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.743356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.743452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.743535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.743560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.743641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.743725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.743751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.743846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.743925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.743950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.744038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.744125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.744150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.744244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.744358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.744383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.744521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.744638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.744664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.744748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.744868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.744898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.744985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.745067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.745092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.745204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.745327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.745352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.745479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.745575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.745600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.745684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.745791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.745816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.745900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.745976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.746001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.746098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.746208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.746233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.746319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.746408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.746434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.746517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.746610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.746635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.746724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.746811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.746836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.746919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.747058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.747087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.747200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.747340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.747365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.747461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.747585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.747611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.747696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.747783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.747809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.747931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.748023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.748048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.748168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.748266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.748291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.748375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.748476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.748502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.748588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.748671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.748696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.748813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.748902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.748927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.749046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.749123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.749148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.749232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.749323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.749348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.749463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.749564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.749589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.206 qpair failed and we were unable to recover it. 00:27:47.206 [2024-11-29 02:32:50.749674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.206 [2024-11-29 02:32:50.749772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.749796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.749884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.750004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.750031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.750147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.750255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.750281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.750372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.750495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.750521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.750607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.750718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.750743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.750834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.750923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.750948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.751029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.751122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.751149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.751236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.751323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.751350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.751444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.751536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.751561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.751654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.751766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.751792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.751913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.752031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.752056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.752149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.752316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.752342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.752430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.752519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.752545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.752643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.752727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.752752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.752850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.752962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.752987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.753071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.753184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.753210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.753301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.753377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.753408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.753495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.753608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.753633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.753718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.753832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.753857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.753950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.754035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.754061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.754143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.754239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.754264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.754374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.754467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.754492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.754619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.754696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.754721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.754805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.754884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.754910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.755056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.755177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.755202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.755292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.755404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.755430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.755520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.755609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.755634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.755750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.755895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.755920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.756004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.756088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.756115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.207 qpair failed and we were unable to recover it. 00:27:47.207 [2024-11-29 02:32:50.756282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.207 [2024-11-29 02:32:50.756373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.756409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.756509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.756629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.756654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.756748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.756830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.756854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.756947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.757031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.757057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.757179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.757271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.757296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.757380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.757515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.757540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.757621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.757705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.757731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.757843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.757959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.757985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.758080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.758165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.758195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.758283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.758439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.758465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.758557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.758644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.758668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.758761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.758871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.758896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.759024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.759111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.759137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.759228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.759325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.759351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.759438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.759521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.759546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.759634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.759714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.759740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.759850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.759965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.759990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.760088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.760203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.760229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.760314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.760405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.760448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.760538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.760623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.760648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.760739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.760855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.760880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.761000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.761109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.761134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.761227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.761340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.761365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.761521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.761612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.761637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.761749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.761829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.761854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.761940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.762077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.762102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.762246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.762401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.762427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.762513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.762603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.208 [2024-11-29 02:32:50.762628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.208 qpair failed and we were unable to recover it. 00:27:47.208 [2024-11-29 02:32:50.762708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.762845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.762869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.762958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.763066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.763090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.763207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.763295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.763321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.763418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.763498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.763523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.763638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.763713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.763738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.763854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.763931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.763956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.764069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.764178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.764204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.764349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.764466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.764492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.764586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.764670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.764696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.764820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.764899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.764924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.765012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.765128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.765153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.765297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.765376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.765408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.765503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.765591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.765616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.765702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.765786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.765811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.765905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.766016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.766040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.766127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.766242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.766268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.766382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.766478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.766503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.766630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.766707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.766732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.766849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.766937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.766962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.767083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.767225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.767250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.767336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.767428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.767455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.767554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.767640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.767665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.767775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.767854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.767879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.767970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.768087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.768117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.768250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.768338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.768363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.768521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.768608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.768634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.768721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.768861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.768886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.768974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.769090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.769115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.769228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.769342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.769368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.769461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.769578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.769605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.769690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.769775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.769800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.209 qpair failed and we were unable to recover it. 00:27:47.209 [2024-11-29 02:32:50.769882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.769973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.209 [2024-11-29 02:32:50.769998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.770112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.770227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.770252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.770374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.770495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.770521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.770614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.770723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.770749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.770861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.770947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.770972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.771060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.771174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.771198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.771347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.771465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.771491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.771576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.771698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.771723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.771810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.771923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.771947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.772031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.772147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.772171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.772254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.772340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.772366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.772460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.772604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.772629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.772710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.772788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.772814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.772903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.773044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.773069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.773213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.773296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.773321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.773442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.773557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.773583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.773673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.773815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.773840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.773919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.774000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.774025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.774120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.774235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.774260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.774374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.774471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.774497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.774582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.774697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.774722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.774815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.774934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.774959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.775045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.775155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.775180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.775298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.775391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.775425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.775512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.775620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.775645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.775770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.775889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.775914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.775994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.776109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.776133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.776209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.776325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.776350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.776454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.776539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.776564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.776648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.776757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.776782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.776871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.776980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.777004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.210 [2024-11-29 02:32:50.777121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.777231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.210 [2024-11-29 02:32:50.777256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.210 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.777405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.777493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.777518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.777606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.777695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.777726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.777813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.777907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.777934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.778022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.778135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.778160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.778269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.778352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.778379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.778484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.778568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.778595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.778678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.778760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.778785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.778899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.778981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.779005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.779123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.779205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.779230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.779341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.779424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.779450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.779596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.779718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.779744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.779857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.779974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.780005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.780089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.780169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.780194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.780282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.780399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.780424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.780540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.780656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.780682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.780794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.780879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.780903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.780988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.781076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.781101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.781186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.781293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.781318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.781408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.781537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.781562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.781676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.781790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.781815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.781911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.782025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.782050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.782132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.782214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.782239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.782353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.782459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.782485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.782603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.782683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.782707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.782819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.782904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.782930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.783027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.783106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.783131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.783214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.783327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.783351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.783448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.783567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.783592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.783679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.783790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.783815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.783896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.784011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.784036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.784149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.784261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.784287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.784371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.784486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.784512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.784630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.784710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.784735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.211 qpair failed and we were unable to recover it. 00:27:47.211 [2024-11-29 02:32:50.784848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.211 [2024-11-29 02:32:50.784929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.784954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.785034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.785113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.785139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.785229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.785315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.785340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.785434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.785521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.785546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.785659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.785775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.785800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.785911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.785995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.786020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.786101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.786187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.786212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.786306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.786389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.786419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.786507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.786589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.786615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.786731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.786826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.786851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.786942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.787026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.787052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.787170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.787258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.787285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.787406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.787518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.787543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.787635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.787728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.787753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.787832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.787942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.787967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.788052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.788193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.788218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.788301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.788400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.788427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.788539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.788657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.788683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.788771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.788885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.788910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.788993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.789101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.789131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.789255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.789367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.789412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.789505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.789589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.789614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.789697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.789779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.789804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.789915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.790029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.790054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.790146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.790232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.790256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.790376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.790496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.790521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.790607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.790699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.790724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.790837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.790950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.790975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.791066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.791145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.791170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.791285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.791366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.791390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.212 [2024-11-29 02:32:50.791520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.791605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.212 [2024-11-29 02:32:50.791630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.212 qpair failed and we were unable to recover it. 00:27:47.213 [2024-11-29 02:32:50.791711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.791806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.791834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.213 qpair failed and we were unable to recover it. 00:27:47.213 [2024-11-29 02:32:50.791919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.792030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.792055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.213 qpair failed and we were unable to recover it. 00:27:47.213 [2024-11-29 02:32:50.792145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.792238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.792263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.213 qpair failed and we were unable to recover it. 00:27:47.213 [2024-11-29 02:32:50.792376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.792697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.792724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.213 qpair failed and we were unable to recover it. 00:27:47.213 [2024-11-29 02:32:50.792820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.792900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.792925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.213 qpair failed and we were unable to recover it. 00:27:47.213 [2024-11-29 02:32:50.793017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.793104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.793131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.213 qpair failed and we were unable to recover it. 00:27:47.213 [2024-11-29 02:32:50.793223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.793368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.793401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.213 qpair failed and we were unable to recover it. 00:27:47.213 [2024-11-29 02:32:50.793547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.793626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.793651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.213 qpair failed and we were unable to recover it. 00:27:47.213 [2024-11-29 02:32:50.793735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.793824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.793849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.213 qpair failed and we were unable to recover it. 00:27:47.213 [2024-11-29 02:32:50.793970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.794084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.794108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.213 qpair failed and we were unable to recover it. 00:27:47.213 [2024-11-29 02:32:50.794255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.794337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.794361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.213 qpair failed and we were unable to recover it. 00:27:47.213 [2024-11-29 02:32:50.794465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.794581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.794606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.213 qpair failed and we were unable to recover it. 00:27:47.213 [2024-11-29 02:32:50.794698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.794781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.794806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.213 qpair failed and we were unable to recover it. 00:27:47.213 [2024-11-29 02:32:50.794895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.795007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.795033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.213 qpair failed and we were unable to recover it. 00:27:47.213 [2024-11-29 02:32:50.795121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.795228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.795253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.213 qpair failed and we were unable to recover it. 00:27:47.213 [2024-11-29 02:32:50.795340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.795426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.795452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.213 qpair failed and we were unable to recover it. 00:27:47.213 [2024-11-29 02:32:50.795569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.795686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.795711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.213 qpair failed and we were unable to recover it. 00:27:47.213 [2024-11-29 02:32:50.795791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.795887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.795911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.213 qpair failed and we were unable to recover it. 00:27:47.213 [2024-11-29 02:32:50.796028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.796112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.796136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.213 qpair failed and we were unable to recover it. 00:27:47.213 [2024-11-29 02:32:50.796224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.796306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.796331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.213 qpair failed and we were unable to recover it. 00:27:47.213 [2024-11-29 02:32:50.796445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.796554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.796578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.213 qpair failed and we were unable to recover it. 00:27:47.213 [2024-11-29 02:32:50.796666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.213 [2024-11-29 02:32:50.796760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.796784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.214 qpair failed and we were unable to recover it. 00:27:47.214 [2024-11-29 02:32:50.796893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.797004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.797028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.214 qpair failed and we were unable to recover it. 00:27:47.214 [2024-11-29 02:32:50.797114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.797194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.797218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.214 qpair failed and we were unable to recover it. 00:27:47.214 [2024-11-29 02:32:50.797299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.797419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.797445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.214 qpair failed and we were unable to recover it. 00:27:47.214 [2024-11-29 02:32:50.797563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.797655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.797680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.214 qpair failed and we were unable to recover it. 00:27:47.214 [2024-11-29 02:32:50.797790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.797866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.797891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.214 qpair failed and we were unable to recover it. 00:27:47.214 [2024-11-29 02:32:50.798010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.798100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.798124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.214 qpair failed and we were unable to recover it. 00:27:47.214 [2024-11-29 02:32:50.798239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.798350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.798374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.214 qpair failed and we were unable to recover it. 00:27:47.214 [2024-11-29 02:32:50.798463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.798554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.798579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.214 qpair failed and we were unable to recover it. 00:27:47.214 [2024-11-29 02:32:50.798688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.798770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.798795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.214 qpair failed and we were unable to recover it. 00:27:47.214 [2024-11-29 02:32:50.798884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.798992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.799018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.214 qpair failed and we were unable to recover it. 00:27:47.214 [2024-11-29 02:32:50.799106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.799217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.799241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.214 qpair failed and we were unable to recover it. 00:27:47.214 [2024-11-29 02:32:50.799324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.799407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.799433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.214 qpair failed and we were unable to recover it. 00:27:47.214 [2024-11-29 02:32:50.799520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.799608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.799633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.214 qpair failed and we were unable to recover it. 00:27:47.214 [2024-11-29 02:32:50.799730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.799845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.799870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.214 qpair failed and we were unable to recover it. 00:27:47.214 [2024-11-29 02:32:50.799956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.800033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.800057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.214 qpair failed and we were unable to recover it. 00:27:47.214 [2024-11-29 02:32:50.800170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.800280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.800305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.214 qpair failed and we were unable to recover it. 00:27:47.214 [2024-11-29 02:32:50.800390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.800484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.800511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.214 qpair failed and we were unable to recover it. 00:27:47.214 [2024-11-29 02:32:50.800623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.800716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.800746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.214 qpair failed and we were unable to recover it. 00:27:47.214 [2024-11-29 02:32:50.800845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.800925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.800950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.214 qpair failed and we were unable to recover it. 00:27:47.214 [2024-11-29 02:32:50.801041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.801148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.801172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.214 qpair failed and we were unable to recover it. 00:27:47.214 [2024-11-29 02:32:50.801263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.801407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.801432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.214 qpair failed and we were unable to recover it. 00:27:47.214 [2024-11-29 02:32:50.801520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.801603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.214 [2024-11-29 02:32:50.801628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.214 qpair failed and we were unable to recover it. 00:27:47.215 [2024-11-29 02:32:50.801741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.801831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.801856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.215 qpair failed and we were unable to recover it. 00:27:47.215 [2024-11-29 02:32:50.801935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.802019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.802043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.215 qpair failed and we were unable to recover it. 00:27:47.215 [2024-11-29 02:32:50.802122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.802199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.802223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.215 qpair failed and we were unable to recover it. 00:27:47.215 [2024-11-29 02:32:50.802333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.802416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.802442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.215 qpair failed and we were unable to recover it. 00:27:47.215 [2024-11-29 02:32:50.802560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.802649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.802676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.215 qpair failed and we were unable to recover it. 00:27:47.215 [2024-11-29 02:32:50.802792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.802878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.802903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.215 qpair failed and we were unable to recover it. 00:27:47.215 [2024-11-29 02:32:50.803019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.803096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.803121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.215 qpair failed and we were unable to recover it. 00:27:47.215 [2024-11-29 02:32:50.803213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.803297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.803321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.215 qpair failed and we were unable to recover it. 00:27:47.215 [2024-11-29 02:32:50.803434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.803513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.803537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.215 qpair failed and we were unable to recover it. 00:27:47.215 [2024-11-29 02:32:50.803623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.803746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.803771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.215 qpair failed and we were unable to recover it. 00:27:47.215 [2024-11-29 02:32:50.803913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.804003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.804027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.215 qpair failed and we were unable to recover it. 00:27:47.215 [2024-11-29 02:32:50.804119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.804199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.804225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.215 qpair failed and we were unable to recover it. 00:27:47.215 [2024-11-29 02:32:50.804370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.804456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.804482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.215 qpair failed and we were unable to recover it. 00:27:47.215 [2024-11-29 02:32:50.804597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.804704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.804730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.215 qpair failed and we were unable to recover it. 00:27:47.215 [2024-11-29 02:32:50.804847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.804959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.804983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.215 qpair failed and we were unable to recover it. 00:27:47.215 [2024-11-29 02:32:50.805077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.805152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.805176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.215 qpair failed and we were unable to recover it. 00:27:47.215 [2024-11-29 02:32:50.805299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.805419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.805444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.215 qpair failed and we were unable to recover it. 00:27:47.215 [2024-11-29 02:32:50.805531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.805644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.805668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.215 qpair failed and we were unable to recover it. 00:27:47.215 [2024-11-29 02:32:50.805762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.805877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.805901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.215 qpair failed and we were unable to recover it. 00:27:47.215 [2024-11-29 02:32:50.805990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.806071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.806095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.215 qpair failed and we were unable to recover it. 00:27:47.215 [2024-11-29 02:32:50.806187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.806263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.806288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.215 qpair failed and we were unable to recover it. 00:27:47.215 [2024-11-29 02:32:50.806372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.806463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.215 [2024-11-29 02:32:50.806489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.215 qpair failed and we were unable to recover it. 00:27:47.216 [2024-11-29 02:32:50.806574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.806692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.806718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.216 qpair failed and we were unable to recover it. 00:27:47.216 [2024-11-29 02:32:50.806803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.806916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.806941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.216 qpair failed and we were unable to recover it. 00:27:47.216 [2024-11-29 02:32:50.807061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.807152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.807177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.216 qpair failed and we were unable to recover it. 00:27:47.216 [2024-11-29 02:32:50.807292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.807406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.807431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.216 qpair failed and we were unable to recover it. 00:27:47.216 [2024-11-29 02:32:50.807519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.807604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.807629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.216 qpair failed and we were unable to recover it. 00:27:47.216 [2024-11-29 02:32:50.807776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.807860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.807884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.216 qpair failed and we were unable to recover it. 00:27:47.216 [2024-11-29 02:32:50.807976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.808090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.808116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.216 qpair failed and we were unable to recover it. 00:27:47.216 [2024-11-29 02:32:50.808199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.808282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.808307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.216 qpair failed and we were unable to recover it. 00:27:47.216 [2024-11-29 02:32:50.808391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.808484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.808508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.216 qpair failed and we were unable to recover it. 00:27:47.216 [2024-11-29 02:32:50.808599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.808711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.808736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.216 qpair failed and we were unable to recover it. 00:27:47.216 [2024-11-29 02:32:50.808850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.808929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.808953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.216 qpair failed and we were unable to recover it. 00:27:47.216 [2024-11-29 02:32:50.809063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.809146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.809172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.216 qpair failed and we were unable to recover it. 00:27:47.216 [2024-11-29 02:32:50.809257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.809337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.809361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.216 qpair failed and we were unable to recover it. 00:27:47.216 [2024-11-29 02:32:50.809447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.809528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.809552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.216 qpair failed and we were unable to recover it. 00:27:47.216 [2024-11-29 02:32:50.809664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.809781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.809810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.216 qpair failed and we were unable to recover it. 00:27:47.216 [2024-11-29 02:32:50.809923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.810002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.810027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.216 qpair failed and we were unable to recover it. 00:27:47.216 [2024-11-29 02:32:50.810137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.810223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.810249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.216 qpair failed and we were unable to recover it. 00:27:47.216 [2024-11-29 02:32:50.810330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.810440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.810466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.216 qpair failed and we were unable to recover it. 00:27:47.216 [2024-11-29 02:32:50.810585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.810699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.810723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.216 qpair failed and we were unable to recover it. 00:27:47.216 [2024-11-29 02:32:50.810809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.810887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.810911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.216 qpair failed and we were unable to recover it. 00:27:47.216 [2024-11-29 02:32:50.811007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.811092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.811116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.216 qpair failed and we were unable to recover it. 00:27:47.216 [2024-11-29 02:32:50.811203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.811281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.216 [2024-11-29 02:32:50.811307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.216 qpair failed and we were unable to recover it. 00:27:47.216 [2024-11-29 02:32:50.811425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.811514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.811540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.217 qpair failed and we were unable to recover it. 00:27:47.217 [2024-11-29 02:32:50.811649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.811731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.811755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.217 qpair failed and we were unable to recover it. 00:27:47.217 [2024-11-29 02:32:50.811842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.811954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.811984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.217 qpair failed and we were unable to recover it. 00:27:47.217 [2024-11-29 02:32:50.812108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.812190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.812215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.217 qpair failed and we were unable to recover it. 00:27:47.217 [2024-11-29 02:32:50.812306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.812422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.812448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.217 qpair failed and we were unable to recover it. 00:27:47.217 [2024-11-29 02:32:50.812565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.812705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.812730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.217 qpair failed and we were unable to recover it. 00:27:47.217 [2024-11-29 02:32:50.812818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.812925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.812949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.217 qpair failed and we were unable to recover it. 00:27:47.217 [2024-11-29 02:32:50.813043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.813128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.813153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.217 qpair failed and we were unable to recover it. 00:27:47.217 [2024-11-29 02:32:50.813250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.813364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.813389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.217 qpair failed and we were unable to recover it. 00:27:47.217 [2024-11-29 02:32:50.813516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.813603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.813628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.217 qpair failed and we were unable to recover it. 00:27:47.217 [2024-11-29 02:32:50.813711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.813798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.813823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.217 qpair failed and we were unable to recover it. 00:27:47.217 [2024-11-29 02:32:50.813914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.814005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.814030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.217 qpair failed and we were unable to recover it. 00:27:47.217 [2024-11-29 02:32:50.814111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.814221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.814246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.217 qpair failed and we were unable to recover it. 00:27:47.217 [2024-11-29 02:32:50.814371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.814460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.814484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.217 qpair failed and we were unable to recover it. 00:27:47.217 [2024-11-29 02:32:50.814627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.814711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.814735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.217 qpair failed and we were unable to recover it. 00:27:47.217 [2024-11-29 02:32:50.814818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.814896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.814920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.217 qpair failed and we were unable to recover it. 00:27:47.217 [2024-11-29 02:32:50.815009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.815093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.815117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.217 qpair failed and we were unable to recover it. 00:27:47.217 [2024-11-29 02:32:50.815210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.815299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.815324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.217 qpair failed and we were unable to recover it. 00:27:47.217 [2024-11-29 02:32:50.815413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.815532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.815559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.217 qpair failed and we were unable to recover it. 00:27:47.217 [2024-11-29 02:32:50.815645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.815737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.815762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.217 qpair failed and we were unable to recover it. 00:27:47.217 [2024-11-29 02:32:50.815846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.815959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.815983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.217 qpair failed and we were unable to recover it. 00:27:47.217 [2024-11-29 02:32:50.816067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.816187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.816214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.217 qpair failed and we were unable to recover it. 00:27:47.217 [2024-11-29 02:32:50.816331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.217 [2024-11-29 02:32:50.816424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.816450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.218 qpair failed and we were unable to recover it. 00:27:47.218 [2024-11-29 02:32:50.816587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.816674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.816698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.218 qpair failed and we were unable to recover it. 00:27:47.218 [2024-11-29 02:32:50.816789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.816879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.816904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.218 qpair failed and we were unable to recover it. 00:27:47.218 [2024-11-29 02:32:50.816981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.817060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.817085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.218 qpair failed and we were unable to recover it. 00:27:47.218 [2024-11-29 02:32:50.817201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.817284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.817310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.218 qpair failed and we were unable to recover it. 00:27:47.218 [2024-11-29 02:32:50.817404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.817490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.817514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.218 qpair failed and we were unable to recover it. 00:27:47.218 [2024-11-29 02:32:50.817596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.817676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.817700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.218 qpair failed and we were unable to recover it. 00:27:47.218 [2024-11-29 02:32:50.817797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.817912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.817937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.218 qpair failed and we were unable to recover it. 00:27:47.218 [2024-11-29 02:32:50.818027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.818116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.818141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.218 qpair failed and we were unable to recover it. 00:27:47.218 [2024-11-29 02:32:50.818222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.818305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.818329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.218 qpair failed and we were unable to recover it. 00:27:47.218 [2024-11-29 02:32:50.818415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.818527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.818552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.218 qpair failed and we were unable to recover it. 00:27:47.218 [2024-11-29 02:32:50.818650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.818742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.818766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.218 qpair failed and we were unable to recover it. 00:27:47.218 [2024-11-29 02:32:50.818854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.818937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.818962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.218 qpair failed and we were unable to recover it. 00:27:47.218 [2024-11-29 02:32:50.819072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.819182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.819206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.218 qpair failed and we were unable to recover it. 00:27:47.218 [2024-11-29 02:32:50.819288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.819405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.819430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.218 qpair failed and we were unable to recover it. 00:27:47.218 [2024-11-29 02:32:50.819512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.819589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.819613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.218 qpair failed and we were unable to recover it. 00:27:47.218 [2024-11-29 02:32:50.819725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.819842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.218 [2024-11-29 02:32:50.819866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.218 qpair failed and we were unable to recover it. 00:27:47.218 [2024-11-29 02:32:50.819952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.219 [2024-11-29 02:32:50.820062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.219 [2024-11-29 02:32:50.820086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.219 qpair failed and we were unable to recover it. 00:27:47.219 [2024-11-29 02:32:50.820186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.219 [2024-11-29 02:32:50.820267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.219 [2024-11-29 02:32:50.820291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.219 qpair failed and we were unable to recover it. 00:27:47.219 [2024-11-29 02:32:50.820384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.820495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.820520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 02:32:50.820639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.820734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.820759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 02:32:50.820849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.820967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.820996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 02:32:50.821080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.821181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.821207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 02:32:50.821289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.821378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.821410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 02:32:50.821498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.821582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.821606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 02:32:50.821687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.821773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.821798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 02:32:50.821893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.822012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.822037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 02:32:50.822127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.822204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.822230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 02:32:50.822316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.822427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.822452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 02:32:50.822542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.822632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.822657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 02:32:50.822751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.822841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.822866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 02:32:50.822957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.823046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.823070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 02:32:50.823165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.823249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.823275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 02:32:50.823360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.823484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.823510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 02:32:50.823604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.823687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.823712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 02:32:50.823810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.823890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.823915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 02:32:50.824008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.824092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 02:32:50.824116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 02:32:50.824236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.824349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.824373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 02:32:50.824471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.824555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.824580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 02:32:50.824675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.824764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.824789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 02:32:50.824874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.824987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.825012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 02:32:50.825102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.825182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.825207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 02:32:50.825330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.825445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.825472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 02:32:50.825564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.825677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.825702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 02:32:50.825843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.825932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.825957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 02:32:50.826049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.826137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.826163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 02:32:50.826251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.826334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.826359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 02:32:50.826453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.826539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.826565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 02:32:50.826650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.826760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.826785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 02:32:50.826868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.826948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.826972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 02:32:50.827061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.827177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.827203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 02:32:50.827313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.827424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.827450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 02:32:50.827572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.827652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.827677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 02:32:50.827799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.827888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.827913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 02:32:50.828028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.828137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.828162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 02:32:50.828255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.828367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.828391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 02:32:50.828524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.828612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.828637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 02:32:50.828720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.828800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.828824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 02:32:50.828911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.829052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 02:32:50.829077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 02:32:50.829164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.829279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.829304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 02:32:50.829388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.829486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.829512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 02:32:50.829607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.829690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.829714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 02:32:50.829800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.829917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.829942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 02:32:50.830052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.830160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.830184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 02:32:50.830275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.830384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.830415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 02:32:50.830528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.830609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.830634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 02:32:50.830712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.830793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.830819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 02:32:50.830935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.831014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.831039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 02:32:50.831150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.831233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.831258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 02:32:50.831339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.831452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.831477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 02:32:50.831589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.831677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.831703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 02:32:50.831787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.831908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.831933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 02:32:50.832021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.832107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.832137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 02:32:50.832250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.832389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.832428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 02:32:50.832548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.832629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.832653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 02:32:50.832764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.832851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.832876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 02:32:50.832993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.833099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.833123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 02:32:50.833246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.833335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.833360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 02:32:50.833446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.833531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.833555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 02:32:50.833667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.833777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 02:32:50.833802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 02:32:50.833915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.834030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.834054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 02:32:50.834168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.834256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.834282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 02:32:50.834402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.834484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.834509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 02:32:50.834596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.834708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.834732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 02:32:50.834818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.834939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.834963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 02:32:50.835049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.835157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.835181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 02:32:50.835267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.835422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.835447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 02:32:50.835572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.835660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.835685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 02:32:50.835796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.835939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.835963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 02:32:50.836085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.836167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.836192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 02:32:50.836306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.836422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.836447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 02:32:50.836532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.836669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.836694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 02:32:50.836774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.836859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.836885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 02:32:50.836977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.837119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.837143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 02:32:50.837225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.837304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.837328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 02:32:50.837423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.837535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.837560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 02:32:50.837648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.837764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.837789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 02:32:50.837870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.837958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.837983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 02:32:50.838072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.838150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.838174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 02:32:50.838288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.838378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.838407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 02:32:50.838523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.838636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 02:32:50.838660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 02:32:50.838771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.838850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.838874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 02:32:50.838986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.839079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.839105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 02:32:50.839192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.839284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.839309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 02:32:50.839422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.839530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.839555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 02:32:50.839642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.839721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.839746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 02:32:50.839829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.839941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.839965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 02:32:50.840054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.840144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.840169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 02:32:50.840283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.840372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.840402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 02:32:50.840517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.840606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.840630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 02:32:50.840717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.840835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.840860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 02:32:50.840943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.841058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.841083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 02:32:50.841192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.841286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.841313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 02:32:50.841414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.841509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.841538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 02:32:50.841658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.841770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.841795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 02:32:50.841880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.841960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.841984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 02:32:50.842079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.842163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.842189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 02:32:50.842274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.842355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.842380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 02:32:50.842527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.842606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.842631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 02:32:50.842713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.842805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.842831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 02:32:50.842921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.843030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.843055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 02:32:50.843141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.843250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.843275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 02:32:50.843384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 02:32:50.843506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.843530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 02:32:50.843615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.843697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.843727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 02:32:50.843815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.843965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.843990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 02:32:50.844072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.844152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.844177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 02:32:50.844299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.844411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.844436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 02:32:50.844523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.844636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.844661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 02:32:50.844754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.844844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.844870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 02:32:50.844988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.845068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.845092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 02:32:50.845184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.845292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.845316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 02:32:50.845403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.845497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.845521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 02:32:50.845604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.845719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.845743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 02:32:50.845838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.845924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.845948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 02:32:50.846066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.846176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.846201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 02:32:50.846320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.846404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.846430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 02:32:50.846512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.846653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.846678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 02:32:50.846794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.846874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.846898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 02:32:50.847007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.847098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.847122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 02:32:50.847214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.847299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.847324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 02:32:50.847412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.847523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.847547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 02:32:50.847638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.847724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.847750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 02:32:50.847841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.847917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.847941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 02:32:50.848039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.848155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.848179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 02:32:50.848296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.848416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 02:32:50.848441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 02:32:50.848535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.848641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.848667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 02:32:50.848756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.848841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.848866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 02:32:50.848955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.849051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.849076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 02:32:50.849197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.849276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.849300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 02:32:50.849396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.849479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.849503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 02:32:50.849596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.849684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.849708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 02:32:50.849824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.849911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.849938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 02:32:50.850050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.850170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.850195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 02:32:50.850287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.850378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.850408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 02:32:50.850519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.850611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.850636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 02:32:50.850737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.850826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.850850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 02:32:50.850936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.851019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.851043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 02:32:50.851124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.851231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.851255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 02:32:50.851337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.851417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.851442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 02:32:50.851525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.851612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.851636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 02:32:50.851779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.851860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.851885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 02:32:50.851967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.852077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 02:32:50.852101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 02:32:50.852187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.852308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.852333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 02:32:50.852423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.852504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.852528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 02:32:50.852648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.852731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.852761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 02:32:50.852844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.852929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.852953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 02:32:50.853047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.853140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.853165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 02:32:50.853282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.853363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.853387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 02:32:50.853488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.853580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.853605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 02:32:50.853717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.853799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.853824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 02:32:50.853901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.853980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.854004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 02:32:50.854099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.854210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.854234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 02:32:50.854320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.854403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.854428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 02:32:50.854549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.854690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.854714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 02:32:50.854830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.854911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.854935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 02:32:50.855057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.855138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.855163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 02:32:50.855247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.855356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.855381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 02:32:50.855508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.855602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.855629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 02:32:50.855719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.855832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.855856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 02:32:50.855971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.856080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.856104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 02:32:50.856183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.856298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.856323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 02:32:50.856440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.856524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.856548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 02:32:50.856649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.856765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 02:32:50.856789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 02:32:50.856869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.856983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.857007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 02:32:50.857095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.857207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.857232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 02:32:50.857319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.857440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.857466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 02:32:50.857549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.857636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.857660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 02:32:50.857774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.857855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.857879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 02:32:50.857963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.858046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.858071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 02:32:50.858198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.858277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.858301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 02:32:50.858411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.858491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.858517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 02:32:50.858609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.858696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.858720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 02:32:50.858861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.858970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.858995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 02:32:50.859091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.859171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.859195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 02:32:50.859342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.859435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.859460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 02:32:50.859554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.859643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.859668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 02:32:50.859756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.859865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.859890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 02:32:50.859972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.860080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.860105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 02:32:50.860195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.860309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.860334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 02:32:50.860423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.860534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.860560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 02:32:50.860648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.860760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.860784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 02:32:50.860900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.861040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.861066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 02:32:50.861149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.861262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.861286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 02:32:50.861403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.861523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.861548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 02:32:50.861634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.861746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 02:32:50.861770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 02:32:50.861857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.861940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.861965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 02:32:50.862066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.862185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.862210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 02:32:50.862324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.862404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.862430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 02:32:50.862519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.862608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.862632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 02:32:50.862751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.862863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.862888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 02:32:50.862970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.863081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.863105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 02:32:50.863216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.863332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.863358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 02:32:50.863460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.863543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.863568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 02:32:50.863664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.863747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.863772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 02:32:50.863883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.863962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.863986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 02:32:50.864070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.864176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.864206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 02:32:50.864322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.864405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.864440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 02:32:50.864558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.864674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.864699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 02:32:50.864789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.864900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.864925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 02:32:50.865016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.865104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.865128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 02:32:50.865244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.865362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.865386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 02:32:50.865475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.865557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.865581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 02:32:50.865695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.865809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.865834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 02:32:50.865920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.866008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.866033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 02:32:50.866114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.866251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.866276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 02:32:50.866395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.866491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.866516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 02:32:50.866639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.866724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.866749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 02:32:50.866845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.866927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 02:32:50.866951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 02:32:50.867031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.867116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.867141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 02:32:50.867225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.867335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.867359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 02:32:50.867457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.867576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.867600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 02:32:50.867689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.867770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.867795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 02:32:50.867880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.867969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.867994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 02:32:50.868077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.868192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.868216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 02:32:50.868306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.868386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.868442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 02:32:50.868564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.868645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.868669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 02:32:50.868761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.868845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.868869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 02:32:50.868980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.869093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.869118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 02:32:50.869201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.869278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.869304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 02:32:50.869388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.869482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.869506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 02:32:50.869592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.869709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.869733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 02:32:50.869860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.869943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.869968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 02:32:50.870087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.870177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.870201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 02:32:50.870314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.870400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.870425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 02:32:50.870545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.870625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.870649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 02:32:50.870731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.870880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.870905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 02:32:50.870991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.871076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.871100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 02:32:50.871218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.871323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.871348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 02:32:50.871493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.871575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.871599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 02:32:50.871685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.871828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.871852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 02:32:50.871933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.872024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 02:32:50.872048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 02:32:50.872168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.872248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.872273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 02:32:50.872356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.872456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.872482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 02:32:50.872563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.872641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.872666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 02:32:50.872776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.872857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.872881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 02:32:50.872964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.873077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.873101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 02:32:50.873211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.873297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.873325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 02:32:50.873417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.873501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.873525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 02:32:50.873610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.873697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.873721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 02:32:50.873812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.873891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.873915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 02:32:50.874059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.874136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.874162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 02:32:50.874239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.874324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.874348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 02:32:50.874450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.874559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.874583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 02:32:50.874704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.874813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.874838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 02:32:50.874932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.875010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.875035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 02:32:50.875120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.875200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.875224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 02:32:50.875367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.875484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.875513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 02:32:50.875598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.875709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.875735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 02:32:50.875822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.875912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.875937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 02:32:50.876046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.876159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.876184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 02:32:50.876276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.876357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.876382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 02:32:50.876500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.876580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.876604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 02:32:50.876717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.876831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.876855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 02:32:50.876939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 02:32:50.877054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.877079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 02:32:50.877195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.877286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.877311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 02:32:50.877405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.877502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.877527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 02:32:50.877611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.877725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.877750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 02:32:50.877833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.877910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.877934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 02:32:50.878051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.878167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.878191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 02:32:50.878274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.878383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.878415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 02:32:50.878529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.878605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.878629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 02:32:50.878713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.878792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.878816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 02:32:50.878901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.878984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.879009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 02:32:50.879122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.879206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.879230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 02:32:50.879349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.879432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.879457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 02:32:50.879570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.879685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.879709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 02:32:50.879824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.879945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.879970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 02:32:50.880090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.880175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.880200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 02:32:50.880320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.880419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.880445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 02:32:50.880554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.880696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.880721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 02:32:50.880801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.880879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.880903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 02:32:50.881015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 02:32:50.881123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.881147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 02:32:50.881230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.881322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.881347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 02:32:50.881461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.881554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.881578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 02:32:50.881657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.881741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.881767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 02:32:50.881852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.881937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.881961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 02:32:50.882054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.882175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.882200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 02:32:50.882312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.882436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.882461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 02:32:50.882554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.882639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.882665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 02:32:50.882782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.882866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.882890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 02:32:50.883002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.883082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.883106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 02:32:50.883187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.883307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.883332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 02:32:50.883424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.883511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.883537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 02:32:50.883620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.883733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.883758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 02:32:50.883873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.883955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.883979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 02:32:50.884065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.884147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.884172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 02:32:50.884254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.884344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.884368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 02:32:50.884472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.884554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.884583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 02:32:50.884669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.884811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.884835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 02:32:50.884925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.885040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.885066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 02:32:50.885153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.885230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.885255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 02:32:50.885367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.885455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.885480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 02:32:50.885604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.885685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.885709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 02:32:50.885786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.885891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 02:32:50.885915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 02:32:50.886028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.886138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.886163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 02:32:50.886277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.886360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.886384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 02:32:50.886507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.886585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.886610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 02:32:50.886727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.886839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.886864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 02:32:50.886981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.887067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.887092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 02:32:50.887183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.887297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.887322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 02:32:50.887436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.887525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.887550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 02:32:50.887636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.887726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.887750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 02:32:50.887833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.887923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.887948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 02:32:50.888033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.888117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.888142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 02:32:50.888226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.888310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.888336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 02:32:50.888453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.888562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.888588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 02:32:50.888674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.888758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.888782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 02:32:50.888862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.888971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.888996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 02:32:50.889090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.889197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.889223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 02:32:50.889309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.889421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.889446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 02:32:50.889565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.889648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.889674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 02:32:50.889756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.889863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.889888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 02:32:50.889978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.890089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.890113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 02:32:50.890200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.890340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.890365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 02:32:50.890455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.890550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.890575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 02:32:50.890655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.890740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 02:32:50.890766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 02:32:50.890855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.890933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.890957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 02:32:50.891040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.891129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.891154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 02:32:50.891235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.891375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.891406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 02:32:50.891498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.891587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.891611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 02:32:50.891696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.891810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.891835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 02:32:50.891952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.892055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.892080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 02:32:50.892165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.892249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.892274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 02:32:50.892360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.892488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.892513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 02:32:50.892599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.892713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.892737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 02:32:50.892878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.892958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.892982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 02:32:50.893125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.893237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.893261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 02:32:50.893350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.893437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.893462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 02:32:50.893556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.893655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.893680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 02:32:50.893790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.893869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.893894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 02:32:50.893982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.894071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.894095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 02:32:50.894188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.894275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.894299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 02:32:50.894382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.894499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.894523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 02:32:50.894614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.894691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.894716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 02:32:50.894803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.894919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.894945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 02:32:50.895034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.895125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.895149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 02:32:50.895271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.895381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.895412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 02:32:50.895494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.895586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 02:32:50.895611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 02:32:50.895696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.895778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.895807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 02:32:50.895889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.896035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.896060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 02:32:50.896144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.896233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.896257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 02:32:50.896374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.896470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.896496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 02:32:50.896611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.896694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.896718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 02:32:50.896833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.896944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.896968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 02:32:50.897055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.897166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.897190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 02:32:50.897299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.897385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.897416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 02:32:50.897500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.897614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.897639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 02:32:50.897724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.897807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.897832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 02:32:50.897918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.898005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.898030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 02:32:50.898134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.898242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.898266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 02:32:50.898351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.898441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.898466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 02:32:50.898606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.898690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.898714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 02:32:50.898854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.898937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.898961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 02:32:50.899110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.899199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.899224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 02:32:50.899306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.899389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.899421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 02:32:50.899511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.899593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.899618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 02:32:50.899730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.899851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.899876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 02:32:50.899967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.900054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.900078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 02:32:50.900161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.900246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.900271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 02:32:50.900360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.900455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 02:32:50.900480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 02:32:50.900561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.900652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.900677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 02:32:50.900759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.900849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.900873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 02:32:50.900964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.901074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.901099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 02:32:50.901202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.901283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.901307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 02:32:50.901403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.901524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.901548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 02:32:50.901633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.901747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.901771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 02:32:50.901885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.901995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.902019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 02:32:50.902098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.902179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.902204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 02:32:50.902291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.902407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.902432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 02:32:50.902575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.902661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.902686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 02:32:50.902770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.902852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.902877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 02:32:50.902991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.903074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.903099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 02:32:50.903209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.903299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.903323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 02:32:50.903405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.903489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.903514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 02:32:50.903631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.903709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.903733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 02:32:50.903831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.903917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.903941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 02:32:50.904026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.904109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.904133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 02:32:50.904247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.904327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.904352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 02:32:50.904479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.904565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.904591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 02:32:50.904700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.904794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.904823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 02:32:50.904944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.905025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.905050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 02:32:50.905160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.905240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 02:32:50.905264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 02:32:50.905344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.905433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.905458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 02:32:50.905574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.905671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.905696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 02:32:50.905814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.905893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.905917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 02:32:50.906000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.906085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.906111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 02:32:50.906225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.906309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.906334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 02:32:50.906445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.906560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.906584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 02:32:50.906668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.906753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.906777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 02:32:50.906861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.906950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.906980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 02:32:50.907072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.907185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.907210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 02:32:50.907326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.907437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.907462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 02:32:50.907580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.907693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.907718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 02:32:50.907830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.907909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.907934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 02:32:50.908029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.908142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.908168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 02:32:50.908285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.908361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.908385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 02:32:50.908500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.908586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.908611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 02:32:50.908726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.908806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.908831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 02:32:50.908945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.909056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.909081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 02:32:50.909197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.909308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 02:32:50.909333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 02:32:50.909455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.909536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.909560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 02:32:50.909641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.909758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.909782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 02:32:50.909871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.909946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.909970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 02:32:50.910054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.910139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.910165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 02:32:50.910276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.910355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.910380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 02:32:50.910473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.910585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.910609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 02:32:50.910721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.910803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.910827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 02:32:50.910917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.911005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.911031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 02:32:50.911148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.911269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.911293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 02:32:50.911382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.911477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.911503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 02:32:50.911621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.911728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.911753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 02:32:50.911835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.911923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.911948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 02:32:50.912037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.912156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.912182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 02:32:50.912268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.912378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.912409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 02:32:50.912533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.912620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.912644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 02:32:50.912757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.912836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.912860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 02:32:50.912986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.913106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.913130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 02:32:50.913216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.913324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.913348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 02:32:50.913442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.913533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.913558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 02:32:50.913669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.913782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.913806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 02:32:50.913921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.914009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.914034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 02:32:50.914122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.914203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 02:32:50.914227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 02:32:50.914305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.914420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.914445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 02:32:50.914556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.914645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.914669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 02:32:50.914759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.914843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.914867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 02:32:50.914949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.915030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.915055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 02:32:50.915179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.915260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.915285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 02:32:50.915402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.915485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.915510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 02:32:50.915600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.915739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.915763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 02:32:50.915881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.915997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.916021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 02:32:50.916113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.916224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.916253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 02:32:50.916373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.916475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.916500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 02:32:50.916615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.916693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.916717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 02:32:50.916808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.916888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.916913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 02:32:50.917001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.917083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.917107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 02:32:50.917192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.917274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.917299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 02:32:50.917416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.917503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.917528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 02:32:50.917615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.917705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.917729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 02:32:50.917813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.917919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.917944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 02:32:50.918035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.918144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.918169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 02:32:50.918281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.918398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.918423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 02:32:50.918512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.918622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.918647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 02:32:50.918736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.918824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.918848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 02:32:50.918932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.919073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 02:32:50.919098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 02:32:50.919186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.919265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.919289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 02:32:50.919406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.919520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.919544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 02:32:50.919658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.919750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.919774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 02:32:50.919869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.919982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.920007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 02:32:50.920093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.920172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.920197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 02:32:50.920316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.920405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.920430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 02:32:50.920513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.920631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.920656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 02:32:50.920744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.920824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.920850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 02:32:50.920937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.921048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.921073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 02:32:50.921165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.921252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.921277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 02:32:50.921387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.921502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.921527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 02:32:50.921645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.921758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.921782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 02:32:50.921874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.921958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.921982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 02:32:50.922070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.922159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.922184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 02:32:50.922327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.922409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.922434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 02:32:50.922519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.922639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.922663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 02:32:50.922755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.922870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.922894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 02:32:50.922987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.923094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.923119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 02:32:50.923230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.923311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.923336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 02:32:50.923427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.923537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.923563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 02:32:50.923678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.923759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.923784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 02:32:50.923870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 02:32:50.923980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.924006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 02:32:50.924092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.924203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.924227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 02:32:50.924371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.924473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.924498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 02:32:50.924595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.924675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.924699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 02:32:50.924791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.924908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.924932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 02:32:50.925053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.925142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.925169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 02:32:50.925281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.925365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.925389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 02:32:50.925518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.925612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.925636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 02:32:50.925728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.925811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.925836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 02:32:50.925920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.926004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.926029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 02:32:50.926111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.926223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.926247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 02:32:50.926337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.926447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.926472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 02:32:50.926582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.926665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.926689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 02:32:50.926807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.926915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.926939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 02:32:50.927035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.927147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.927171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 02:32:50.927255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.927339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.927363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 02:32:50.927453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.927546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.927576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 02:32:50.927687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.927778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.927803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 02:32:50.927887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.928030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.928055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 02:32:50.928137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.928214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.928238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 02:32:50.928322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.928425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.928451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 02:32:50.928537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.928631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.928657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 02:32:50.928748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 02:32:50.928862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.928887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 02:32:50.928965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.929083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.929107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 02:32:50.929221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.929307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.929331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 02:32:50.929417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.929497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.929521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 02:32:50.929609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.929694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.929721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 02:32:50.929814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.929900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.929926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 02:32:50.930013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.930127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.930152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 02:32:50.930238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.930312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.930336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 02:32:50.930428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.930509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.930534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 02:32:50.930645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.930734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.930760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 02:32:50.930848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.930960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.930986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 02:32:50.931067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.931161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.931186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 02:32:50.931273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.931354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.931379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 02:32:50.931503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.931615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.931639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 02:32:50.931755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.931842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.931866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 02:32:50.931988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.932069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.932094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 02:32:50.932178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.932260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.932285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 02:32:50.932370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.932483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.932508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 02:32:50.932628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.932716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.932742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 02:32:50.932889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.932976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.932999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 02:32:50.933112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.933223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.933248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 02:32:50.933326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.933437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.933463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 02:32:50.933587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.933677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 02:32:50.933702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 02:32:50.933827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.933937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.933962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 02:32:50.934054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.934134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.934158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 02:32:50.934267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.934385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.934414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 02:32:50.934535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.934615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.934639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 02:32:50.934756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.934835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.934860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 02:32:50.934954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.935039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.935063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 02:32:50.935149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.935224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.935249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 02:32:50.935365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.935455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.935481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 02:32:50.935600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.935684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.935708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 02:32:50.935799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.935920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.935945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 02:32:50.936029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.936111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.936136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 02:32:50.936227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.936339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.936364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 02:32:50.936507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.936594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.936624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 02:32:50.936722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.936804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.936829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 02:32:50.936911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.937027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.937052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 02:32:50.937136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.937227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.937251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 02:32:50.937336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.937456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.937481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 02:32:50.937564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.937703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.937727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 02:32:50.937812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 02:32:50.937893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.937917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 02:32:50.938001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.938088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.938113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 02:32:50.938200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.938290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.938314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 02:32:50.938399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.938482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.938507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 02:32:50.938628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.938770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.938799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 02:32:50.938885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.938965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.938989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 02:32:50.939102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.939190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.939215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 02:32:50.939303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.939410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.939436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 02:32:50.939518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.939601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.939625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 02:32:50.939720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.939837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.939861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 02:32:50.939944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.940060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.940083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 02:32:50.940195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.940280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.940304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 02:32:50.940420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.940535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.940559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 02:32:50.940651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.940734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.940760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 02:32:50.940869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.940958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.940983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 02:32:50.941080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.941191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.941215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 02:32:50.941328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.941413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.941439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 02:32:50.941530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.941637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.941662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 02:32:50.941755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.941866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.941890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 02:32:50.941973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.942060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.942085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 02:32:50.942205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.942287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.942311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 02:32:50.942398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.942506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.942532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 02:32:50.942616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.942703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 02:32:50.942727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 02:32:50.942839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.942931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.942955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 02:32:50.943070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.943148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.943172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 02:32:50.943299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.943377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.943407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 02:32:50.943520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.943636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.943660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 02:32:50.943775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.943886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.943910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 02:32:50.944036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.944117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.944141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 02:32:50.944264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.944425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.944452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 02:32:50.944542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.944654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.944678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 02:32:50.944769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.944879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.944904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 02:32:50.944998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.945076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.945101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 02:32:50.945182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.945263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.945287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 02:32:50.945382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.945481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.945505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 02:32:50.945601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.945687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.945711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 02:32:50.945803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.945912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.945937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 02:32:50.946026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.946146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.946170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 02:32:50.946256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.946339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.946363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 02:32:50.946458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.946576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.946602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 02:32:50.946683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.946773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.946798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 02:32:50.946891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.946976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.947002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 02:32:50.947084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.947195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.947219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 02:32:50.947298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.947411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.947437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 02:32:50.947526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.947635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.947660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 02:32:50.947747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 02:32:50.947834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.947864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 02:32:50.948006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.948119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.948143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 02:32:50.948231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.948312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.948336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 02:32:50.948449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.948540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.948564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 02:32:50.948648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.948757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.948781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 02:32:50.948902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.948980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.949005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 02:32:50.949096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.949178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.949203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 02:32:50.949322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.949415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.949440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 02:32:50.949530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.949650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.949674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 02:32:50.949763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.949873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.949897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 02:32:50.950012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.950125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.950149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 02:32:50.950265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.950344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.950368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 02:32:50.950461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.950542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.950566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 02:32:50.950651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.950762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.950787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 02:32:50.950884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.950995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.951021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 02:32:50.951104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.951191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.951215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 02:32:50.951325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.951421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.951446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 02:32:50.951567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.951653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.951677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 02:32:50.951794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.951884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.951909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 02:32:50.951999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.952093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.952118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 02:32:50.952201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.952315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.952341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 02:32:50.952479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.952557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.952582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 02:32:50.952665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.952759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 02:32:50.952783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 02:32:50.952872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.952981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.953006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 02:32:50.953097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.953209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.953235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 02:32:50.953320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.953410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.953436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 02:32:50.953557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.953644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.953670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 02:32:50.953791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.953879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.953904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 02:32:50.954015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.954127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.954152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 02:32:50.954267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.954379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.954409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 02:32:50.954504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.954586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.954611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 02:32:50.954698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.954809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.954834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 02:32:50.954912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.955025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.955050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 02:32:50.955130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.955242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.955269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 02:32:50.955357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.955447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.955472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 02:32:50.955593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.955678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.955704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 02:32:50.955797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.955876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.955901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 02:32:50.955993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.956107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.956132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 02:32:50.956246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.956330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.956354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 02:32:50.956491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.956576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.956601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 02:32:50.956721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.956804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.956829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 02:32:50.956943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.957027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.957053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 02:32:50.957139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.957284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.957310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 02:32:50.957405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.957489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.957514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 02:32:50.957629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 02:32:50.957717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.957742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 02:32:50.957857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.957971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.957996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 02:32:50.958111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.958202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.958227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 02:32:50.958312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.958399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.958423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 02:32:50.958539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.958632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.958658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 02:32:50.958741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.958824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.958849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 02:32:50.958960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.959076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.959101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 02:32:50.959216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.959324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.959353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 02:32:50.959440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.959549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.959574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 02:32:50.959670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.959786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.959812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 02:32:50.959925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.960008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.960033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 02:32:50.960118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.960228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.960252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 02:32:50.960338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.960453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.960478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 02:32:50.960566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.960651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.960676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 02:32:50.960790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.960905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.960931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 02:32:50.961048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.961128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.961153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 02:32:50.961240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.961351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.961376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 02:32:50.961470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.961579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.961604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 02:32:50.961720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.961806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.961831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 02:32:50.961913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.961999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.962024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 02:32:50.962142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.962281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.962306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 02:32:50.962402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.962479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.962504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 02:32:50.962619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.962702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.962726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 02:32:50.962838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 02:32:50.962925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.962951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 02:32:50.963036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.963122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.963147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 02:32:50.963263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.963357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.963382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 02:32:50.963505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.963584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.963609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 02:32:50.963705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.963784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.963808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 02:32:50.963903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.964041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.964067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 02:32:50.964178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.964257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.964282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 02:32:50.964410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.964498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.964524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 02:32:50.964641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.964750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.964775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 02:32:50.964861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.964974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.964999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 02:32:50.965086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.965200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.965224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 02:32:50.965308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.965399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.965424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 02:32:50.965543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.965634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.965658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 02:32:50.965773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.965853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.965878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 02:32:50.966017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.966131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.966155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 02:32:50.966238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.966325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.966350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 02:32:50.966442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.966530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.966555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 02:32:50.966671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.966782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 02:32:50.966807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 02:32:50.966894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.966975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.966999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 02:32:50.967081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.967162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.967187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 02:32:50.967273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.967360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.967384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 02:32:50.967473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.967556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.967580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 02:32:50.967670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.967784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.967809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 02:32:50.967898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.967978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.968003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 02:32:50.968097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.968182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.968207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 02:32:50.968320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.968402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.968443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 02:32:50.968539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.968621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.968645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 02:32:50.968766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.968855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.968879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 02:32:50.968966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.969045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.969071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 02:32:50.969158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.969278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.969303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 02:32:50.969404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.969495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.969520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 02:32:50.969604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.969685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.969710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 02:32:50.969820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.969934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.969960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 02:32:50.970049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.970190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.970216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 02:32:50.970295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.970378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.970409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 02:32:50.970491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.970574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.970605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 02:32:50.970690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.970766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.970791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 02:32:50.970899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.971007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.971032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 02:32:50.971112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.971194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.971219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 02:32:50.971309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.971388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.971418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 02:32:50.971532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 02:32:50.971622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.971647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 02:32:50.971724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.971834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.971858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 02:32:50.971945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.972063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.972087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 02:32:50.972165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.972325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.972350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 02:32:50.972475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.972591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.972616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 02:32:50.972719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.972805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.972830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 02:32:50.972920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.973030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.973054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 02:32:50.973138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.973255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.973281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 02:32:50.973379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.973473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.973499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 02:32:50.973581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.973662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.973686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 02:32:50.973777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.973887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.973913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 02:32:50.974000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.974108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.974133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 02:32:50.974217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.974308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.974335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 02:32:50.974453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.974532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.974558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 02:32:50.974641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.974754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.974779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 02:32:50.974867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.974960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.974984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 02:32:50.975070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.975192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.975217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 02:32:50.975327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.975410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.975436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 02:32:50.975520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.975606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.975631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 02:32:50.975748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.975828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.975853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 02:32:50.975969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.976050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.976075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 02:32:50.976224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.976301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 02:32:50.976326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 02:32:50.976414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.976492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.976518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 02:32:50.976603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.976689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.976714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 02:32:50.976856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.976968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.976993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 02:32:50.977080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.977162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.977186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 02:32:50.977274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.977389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.977419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 02:32:50.977506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.977588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.977613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 02:32:50.977693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.977786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.977813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 02:32:50.977896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.977988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.978013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 02:32:50.978096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.978208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.978232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 02:32:50.978315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.978398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.978424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 02:32:50.978514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.978601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.978626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 02:32:50.978705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.978789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.978815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 02:32:50.978928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.979045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.979072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 02:32:50.979188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.979283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.979308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 02:32:50.979422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.979537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.979567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 02:32:50.979660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.979740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.979765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 02:32:50.979876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.979993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.980019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 02:32:50.980112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.980230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.980256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 02:32:50.980373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.980486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.980512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 02:32:50.980602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.980718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.980743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 02:32:50.980831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.980917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.980941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 02:32:50.981069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.981150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.981176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 02:32:50.981257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 02:32:50.981371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.981405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 02:32:50.981524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.981607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.981632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 02:32:50.981716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.981831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.981856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 02:32:50.981976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.982065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.982091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 02:32:50.982176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.982319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.982345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 02:32:50.982435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.982549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.982574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 02:32:50.982672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.982787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.982812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 02:32:50.982898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.982988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.983013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 02:32:50.983124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.983264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.983289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 02:32:50.983369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.983488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.983514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 02:32:50.983602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.983692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.983717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 02:32:50.983830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.983913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.983938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 02:32:50.984058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.984139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.984164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 02:32:50.984301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.984389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.984442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 02:32:50.984531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.984622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.984648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 02:32:50.984765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.984872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.984896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 02:32:50.985014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.985101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.985126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 02:32:50.985213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.985349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.985374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 02:32:50.985501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.985587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.985612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 02:32:50.985707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.985851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.985876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 02:32:50.985963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.986043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.986068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 02:32:50.986151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.986231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.986255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 02:32:50.986335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.986455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 02:32:50.986480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 02:32:50.986569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.986650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.986675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 02:32:50.986767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.986850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.986875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 02:32:50.986962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.987063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.987088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 02:32:50.987174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.987284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.987310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 02:32:50.987434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.987515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.987539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 02:32:50.987624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.987771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.987797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 02:32:50.987908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.988019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.988045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 02:32:50.988142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.988256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.988282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 02:32:50.988415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.988532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.988559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 02:32:50.988654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.988735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.988760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 02:32:50.988839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.988988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.989014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 02:32:50.989099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.989184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.989210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 02:32:50.989311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.989396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.989422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 02:32:50.989509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.989632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.989657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 02:32:50.989736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.989817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.989842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 02:32:50.989933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.990016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.990040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 02:32:50.990183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.990262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.990286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 02:32:50.990380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.990464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.990488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 02:32:50.990568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.990646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.990671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 02:32:50.990787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.990900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.990925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 02:32:50.991043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.991129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.991158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 02:32:50.991303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 02:32:50.991402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.991428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 02:32:50.991558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.991646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.991670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 02:32:50.991786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.991902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.991927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 02:32:50.992049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.992130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.992156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 02:32:50.992244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.992388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.992442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 02:32:50.992528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.992616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.992642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 02:32:50.992770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.992890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.992915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 02:32:50.993030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.993113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.993137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 02:32:50.993247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.993361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.993386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 02:32:50.993503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.993615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.993639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 02:32:50.993755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.993844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.993868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 02:32:50.993958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.994039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.994064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 02:32:50.994177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.994284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.994310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 02:32:50.994419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.994503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.994528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 02:32:50.994619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.994729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.994754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 02:32:50.994878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.994995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.995019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 02:32:50.995100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.995208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.995232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 02:32:50.995324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.995411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.995437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 02:32:50.995577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.995667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 02:32:50.995691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 02:32:50.995811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.995894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.995918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.540 [2024-11-29 02:32:50.996051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.996133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.996157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.540 [2024-11-29 02:32:50.996271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.996413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.996439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.540 [2024-11-29 02:32:50.996525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.996639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.996664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.540 [2024-11-29 02:32:50.996779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.996864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.996891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.540 [2024-11-29 02:32:50.996974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.997056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.997081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.540 [2024-11-29 02:32:50.997191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.997276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.997300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.540 [2024-11-29 02:32:50.997391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.997481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.997506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.540 [2024-11-29 02:32:50.997624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.997717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.997742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.540 [2024-11-29 02:32:50.997830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.997911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.997935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.540 [2024-11-29 02:32:50.998018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.998132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.998157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.540 [2024-11-29 02:32:50.998242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.998389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.998421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.540 [2024-11-29 02:32:50.998508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.998597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.998623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.540 [2024-11-29 02:32:50.998735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.998811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.998836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.540 [2024-11-29 02:32:50.998917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.999000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.999024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.540 [2024-11-29 02:32:50.999143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.999228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.999252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.540 [2024-11-29 02:32:50.999367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.999455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.999480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.540 [2024-11-29 02:32:50.999592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.999680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.999706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.540 [2024-11-29 02:32:50.999821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.999903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:50.999928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.540 [2024-11-29 02:32:51.000020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:51.000135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:51.000159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.540 [2024-11-29 02:32:51.000242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:51.000352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:51.000378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.540 [2024-11-29 02:32:51.000485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:51.000576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 02:32:51.000605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.541 qpair failed and we were unable to recover it. 00:27:47.541 [2024-11-29 02:32:51.000719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.000803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.000828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.541 qpair failed and we were unable to recover it. 00:27:47.541 [2024-11-29 02:32:51.000915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.001053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.001078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.541 qpair failed and we were unable to recover it. 00:27:47.541 [2024-11-29 02:32:51.001220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.001331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.001356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.541 qpair failed and we were unable to recover it. 00:27:47.541 [2024-11-29 02:32:51.001448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.001536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.001562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.541 qpair failed and we were unable to recover it. 00:27:47.541 [2024-11-29 02:32:51.001643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.001757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.001782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.541 qpair failed and we were unable to recover it. 00:27:47.541 [2024-11-29 02:32:51.001877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.001961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.001986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.541 qpair failed and we were unable to recover it. 00:27:47.541 [2024-11-29 02:32:51.002130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.002214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.002239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.541 qpair failed and we were unable to recover it. 00:27:47.541 [2024-11-29 02:32:51.002322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.002408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.002434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.541 qpair failed and we were unable to recover it. 00:27:47.541 [2024-11-29 02:32:51.002529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.002678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.002704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.541 qpair failed and we were unable to recover it. 00:27:47.541 [2024-11-29 02:32:51.002836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.002921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.002953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.541 qpair failed and we were unable to recover it. 00:27:47.541 [2024-11-29 02:32:51.003043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.003151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.003176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.541 qpair failed and we were unable to recover it. 00:27:47.541 [2024-11-29 02:32:51.003267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.003350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.003375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.541 qpair failed and we were unable to recover it. 00:27:47.541 [2024-11-29 02:32:51.003499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.003584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.003610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.541 qpair failed and we were unable to recover it. 00:27:47.541 [2024-11-29 02:32:51.003705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.003791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.003818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.541 qpair failed and we were unable to recover it. 00:27:47.541 [2024-11-29 02:32:51.003902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.003997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.004023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.541 qpair failed and we were unable to recover it. 00:27:47.541 [2024-11-29 02:32:51.004117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.004206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.004232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.541 qpair failed and we were unable to recover it. 00:27:47.541 [2024-11-29 02:32:51.004317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.004400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.004426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.541 qpair failed and we were unable to recover it. 00:27:47.541 [2024-11-29 02:32:51.004543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.004657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.004682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.541 qpair failed and we were unable to recover it. 00:27:47.541 [2024-11-29 02:32:51.004770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.004884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.004909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.541 qpair failed and we were unable to recover it. 00:27:47.541 [2024-11-29 02:32:51.005023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.005118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.005144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.541 qpair failed and we were unable to recover it. 00:27:47.541 [2024-11-29 02:32:51.005234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.005339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.541 [2024-11-29 02:32:51.005365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.541 qpair failed and we were unable to recover it. 00:27:47.541 [2024-11-29 02:32:51.005468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.005557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.005583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.542 qpair failed and we were unable to recover it. 00:27:47.542 [2024-11-29 02:32:51.005693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.005779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.005805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.542 qpair failed and we were unable to recover it. 00:27:47.542 [2024-11-29 02:32:51.005889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.006010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.006035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.542 qpair failed and we were unable to recover it. 00:27:47.542 [2024-11-29 02:32:51.006130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.006245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.006269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.542 qpair failed and we were unable to recover it. 00:27:47.542 [2024-11-29 02:32:51.006350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.006477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.006503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.542 qpair failed and we were unable to recover it. 00:27:47.542 [2024-11-29 02:32:51.006589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.006675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.006701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.542 qpair failed and we were unable to recover it. 00:27:47.542 [2024-11-29 02:32:51.006796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.006882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.006907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.542 qpair failed and we were unable to recover it. 00:27:47.542 [2024-11-29 02:32:51.006986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.007096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.007121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.542 qpair failed and we were unable to recover it. 00:27:47.542 [2024-11-29 02:32:51.007231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.007309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.007335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.542 qpair failed and we were unable to recover it. 00:27:47.542 [2024-11-29 02:32:51.007426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.007543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.007568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.542 qpair failed and we were unable to recover it. 00:27:47.542 [2024-11-29 02:32:51.007686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.007803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.007829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.542 qpair failed and we were unable to recover it. 00:27:47.542 [2024-11-29 02:32:51.007942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.008031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.008056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.542 qpair failed and we were unable to recover it. 00:27:47.542 [2024-11-29 02:32:51.008169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.008265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.008290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.542 qpair failed and we were unable to recover it. 00:27:47.542 [2024-11-29 02:32:51.008371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.008497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.008522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.542 qpair failed and we were unable to recover it. 00:27:47.542 [2024-11-29 02:32:51.008607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.008690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.008714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.542 qpair failed and we were unable to recover it. 00:27:47.542 [2024-11-29 02:32:51.008826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.008941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.008965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.542 qpair failed and we were unable to recover it. 00:27:47.542 [2024-11-29 02:32:51.009050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.009132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.009158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.542 qpair failed and we were unable to recover it. 00:27:47.542 [2024-11-29 02:32:51.009244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.009324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.009348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.542 qpair failed and we were unable to recover it. 00:27:47.542 [2024-11-29 02:32:51.009470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.009561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.009586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.542 qpair failed and we were unable to recover it. 00:27:47.542 [2024-11-29 02:32:51.009677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.009764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.009790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.542 qpair failed and we were unable to recover it. 00:27:47.542 [2024-11-29 02:32:51.009913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.010022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.010047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.542 qpair failed and we were unable to recover it. 00:27:47.542 [2024-11-29 02:32:51.010133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.010225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.542 [2024-11-29 02:32:51.010249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.542 qpair failed and we were unable to recover it. 00:27:47.543 [2024-11-29 02:32:51.010337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.010424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.010448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.543 qpair failed and we were unable to recover it. 00:27:47.543 [2024-11-29 02:32:51.010537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.010648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.010673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.543 qpair failed and we were unable to recover it. 00:27:47.543 [2024-11-29 02:32:51.010786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.010867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.010892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.543 qpair failed and we were unable to recover it. 00:27:47.543 [2024-11-29 02:32:51.011044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.011156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.011181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.543 qpair failed and we were unable to recover it. 00:27:47.543 [2024-11-29 02:32:51.011277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.011366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.011391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.543 qpair failed and we were unable to recover it. 00:27:47.543 [2024-11-29 02:32:51.011479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.011561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.011585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.543 qpair failed and we were unable to recover it. 00:27:47.543 [2024-11-29 02:32:51.011681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.011800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.011826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.543 qpair failed and we were unable to recover it. 00:27:47.543 [2024-11-29 02:32:51.011938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.012022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.012051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.543 qpair failed and we were unable to recover it. 00:27:47.543 [2024-11-29 02:32:51.012163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.012246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.012272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.543 qpair failed and we were unable to recover it. 00:27:47.543 [2024-11-29 02:32:51.012385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.012509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.012534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.543 qpair failed and we were unable to recover it. 00:27:47.543 [2024-11-29 02:32:51.012614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.012695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.012719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.543 qpair failed and we were unable to recover it. 00:27:47.543 [2024-11-29 02:32:51.012832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.012912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.012937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.543 qpair failed and we were unable to recover it. 00:27:47.543 [2024-11-29 02:32:51.013052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.013164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.013188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.543 qpair failed and we were unable to recover it. 00:27:47.543 [2024-11-29 02:32:51.013288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.013381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.013412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.543 qpair failed and we were unable to recover it. 00:27:47.543 [2024-11-29 02:32:51.013498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.013579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.013604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.543 qpair failed and we were unable to recover it. 00:27:47.543 [2024-11-29 02:32:51.013700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.013810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.013836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.543 qpair failed and we were unable to recover it. 00:27:47.543 [2024-11-29 02:32:51.013917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.014001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.014027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.543 qpair failed and we were unable to recover it. 00:27:47.543 [2024-11-29 02:32:51.014105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.014188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.014213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.543 qpair failed and we were unable to recover it. 00:27:47.543 [2024-11-29 02:32:51.014302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.014418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.014444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.543 qpair failed and we were unable to recover it. 00:27:47.543 [2024-11-29 02:32:51.014533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.014614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.014639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.543 qpair failed and we were unable to recover it. 00:27:47.543 [2024-11-29 02:32:51.014724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.014807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.014834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.543 qpair failed and we were unable to recover it. 00:27:47.543 [2024-11-29 02:32:51.014947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.543 [2024-11-29 02:32:51.015039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.015063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.544 qpair failed and we were unable to recover it. 00:27:47.544 [2024-11-29 02:32:51.015144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.015222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.015246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.544 qpair failed and we were unable to recover it. 00:27:47.544 [2024-11-29 02:32:51.015360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.015446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.015471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.544 qpair failed and we were unable to recover it. 00:27:47.544 [2024-11-29 02:32:51.015560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.015647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.015673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.544 qpair failed and we were unable to recover it. 00:27:47.544 [2024-11-29 02:32:51.015766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.015845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.015870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.544 qpair failed and we were unable to recover it. 00:27:47.544 [2024-11-29 02:32:51.015958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.016074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.016100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.544 qpair failed and we were unable to recover it. 00:27:47.544 [2024-11-29 02:32:51.016218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.016330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.016355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.544 qpair failed and we were unable to recover it. 00:27:47.544 [2024-11-29 02:32:51.016472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.016555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.016579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.544 qpair failed and we were unable to recover it. 00:27:47.544 [2024-11-29 02:32:51.016661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.016743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.016768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.544 qpair failed and we were unable to recover it. 00:27:47.544 [2024-11-29 02:32:51.016863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.016948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.016973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.544 qpair failed and we were unable to recover it. 00:27:47.544 [2024-11-29 02:32:51.017094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.017171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.017197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.544 qpair failed and we were unable to recover it. 00:27:47.544 [2024-11-29 02:32:51.017305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.017427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.017453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.544 qpair failed and we were unable to recover it. 00:27:47.544 [2024-11-29 02:32:51.017541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.017654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.017679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.544 qpair failed and we were unable to recover it. 00:27:47.544 [2024-11-29 02:32:51.017758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.017874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.017899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.544 qpair failed and we were unable to recover it. 00:27:47.544 [2024-11-29 02:32:51.017989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.018069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.018094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.544 qpair failed and we were unable to recover it. 00:27:47.544 [2024-11-29 02:32:51.018207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.018299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.018325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.544 qpair failed and we were unable to recover it. 00:27:47.544 [2024-11-29 02:32:51.018425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.018511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.018535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.544 qpair failed and we were unable to recover it. 00:27:47.544 [2024-11-29 02:32:51.018658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.018773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.018798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.544 qpair failed and we were unable to recover it. 00:27:47.544 [2024-11-29 02:32:51.018883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.018969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.018993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.544 qpair failed and we were unable to recover it. 00:27:47.544 [2024-11-29 02:32:51.019089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.019168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.019193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.544 qpair failed and we were unable to recover it. 00:27:47.544 [2024-11-29 02:32:51.019305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.019420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.019444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.544 qpair failed and we were unable to recover it. 00:27:47.544 [2024-11-29 02:32:51.019541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.019626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.019651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.544 qpair failed and we were unable to recover it. 00:27:47.544 [2024-11-29 02:32:51.019738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.019825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.544 [2024-11-29 02:32:51.019852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.544 qpair failed and we were unable to recover it. 00:27:47.544 [2024-11-29 02:32:51.019939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.020059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.020085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.545 qpair failed and we were unable to recover it. 00:27:47.545 [2024-11-29 02:32:51.020195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.020287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.020312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.545 qpair failed and we were unable to recover it. 00:27:47.545 [2024-11-29 02:32:51.020427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.020542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.020567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.545 qpair failed and we were unable to recover it. 00:27:47.545 [2024-11-29 02:32:51.020655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.020764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.020789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.545 qpair failed and we were unable to recover it. 00:27:47.545 [2024-11-29 02:32:51.020902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.021017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.021042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.545 qpair failed and we were unable to recover it. 00:27:47.545 [2024-11-29 02:32:51.021132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.021220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.021247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.545 qpair failed and we were unable to recover it. 00:27:47.545 [2024-11-29 02:32:51.021342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.021458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.021485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.545 qpair failed and we were unable to recover it. 00:27:47.545 [2024-11-29 02:32:51.021599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.021679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.021704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.545 qpair failed and we were unable to recover it. 00:27:47.545 [2024-11-29 02:32:51.021789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.021906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.021931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.545 qpair failed and we were unable to recover it. 00:27:47.545 [2024-11-29 02:32:51.022053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.022139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.022164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.545 qpair failed and we were unable to recover it. 00:27:47.545 [2024-11-29 02:32:51.022285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.022370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.022401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.545 qpair failed and we were unable to recover it. 00:27:47.545 [2024-11-29 02:32:51.022493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.022586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.022611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.545 qpair failed and we were unable to recover it. 00:27:47.545 [2024-11-29 02:32:51.022703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.022872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.022897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.545 qpair failed and we were unable to recover it. 00:27:47.545 [2024-11-29 02:32:51.022986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.023064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.023089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.545 qpair failed and we were unable to recover it. 00:27:47.545 [2024-11-29 02:32:51.023172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.023262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.023290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.545 qpair failed and we were unable to recover it. 00:27:47.545 [2024-11-29 02:32:51.023373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.023466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.023491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.545 qpair failed and we were unable to recover it. 00:27:47.545 [2024-11-29 02:32:51.023607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.023690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.023714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.545 qpair failed and we were unable to recover it. 00:27:47.545 [2024-11-29 02:32:51.023801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.023913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.023938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.545 qpair failed and we were unable to recover it. 00:27:47.545 [2024-11-29 02:32:51.024034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.024121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.545 [2024-11-29 02:32:51.024146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.545 qpair failed and we were unable to recover it. 00:27:47.546 [2024-11-29 02:32:51.024255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.024346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.024371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.546 qpair failed and we were unable to recover it. 00:27:47.546 [2024-11-29 02:32:51.024464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.024550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.024574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.546 qpair failed and we were unable to recover it. 00:27:47.546 [2024-11-29 02:32:51.024656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.024769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.024793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.546 qpair failed and we were unable to recover it. 00:27:47.546 [2024-11-29 02:32:51.024914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.025031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.025056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.546 qpair failed and we were unable to recover it. 00:27:47.546 [2024-11-29 02:32:51.025173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.025259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.025284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.546 qpair failed and we were unable to recover it. 00:27:47.546 [2024-11-29 02:32:51.025372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.025496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.025521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.546 qpair failed and we were unable to recover it. 00:27:47.546 [2024-11-29 02:32:51.025618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.025728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.025752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.546 qpair failed and we were unable to recover it. 00:27:47.546 [2024-11-29 02:32:51.025872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.025953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.025977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.546 qpair failed and we were unable to recover it. 00:27:47.546 [2024-11-29 02:32:51.026061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.026146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.026172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.546 qpair failed and we were unable to recover it. 00:27:47.546 [2024-11-29 02:32:51.026289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.026373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.026404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.546 qpair failed and we were unable to recover it. 00:27:47.546 [2024-11-29 02:32:51.026494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.026603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.026627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.546 qpair failed and we were unable to recover it. 00:27:47.546 [2024-11-29 02:32:51.026711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.026803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.026827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.546 qpair failed and we were unable to recover it. 00:27:47.546 [2024-11-29 02:32:51.026909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.026996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.027020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.546 qpair failed and we were unable to recover it. 00:27:47.546 [2024-11-29 02:32:51.027164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.027244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.027268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.546 qpair failed and we were unable to recover it. 00:27:47.546 [2024-11-29 02:32:51.027383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.027470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.027495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.546 qpair failed and we were unable to recover it. 00:27:47.546 [2024-11-29 02:32:51.027588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.027677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.027701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.546 qpair failed and we were unable to recover it. 00:27:47.546 [2024-11-29 02:32:51.027799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.027887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.027912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.546 qpair failed and we were unable to recover it. 00:27:47.546 [2024-11-29 02:32:51.027993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.028084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.028108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.546 qpair failed and we were unable to recover it. 00:27:47.546 [2024-11-29 02:32:51.028219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.028303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.028329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.546 qpair failed and we were unable to recover it. 00:27:47.546 [2024-11-29 02:32:51.028429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.028517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.028542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.546 qpair failed and we were unable to recover it. 00:27:47.546 [2024-11-29 02:32:51.028628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.028742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.028768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.546 qpair failed and we were unable to recover it. 00:27:47.546 [2024-11-29 02:32:51.028852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.028938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.028962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.546 qpair failed and we were unable to recover it. 00:27:47.546 [2024-11-29 02:32:51.029047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.029189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.029213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.546 qpair failed and we were unable to recover it. 00:27:47.546 [2024-11-29 02:32:51.029305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.546 [2024-11-29 02:32:51.029386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.029417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.547 qpair failed and we were unable to recover it. 00:27:47.547 [2024-11-29 02:32:51.029504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.029618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.029643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.547 qpair failed and we were unable to recover it. 00:27:47.547 [2024-11-29 02:32:51.029789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.029903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.029928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.547 qpair failed and we were unable to recover it. 00:27:47.547 [2024-11-29 02:32:51.030009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.030093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.030118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.547 qpair failed and we were unable to recover it. 00:27:47.547 [2024-11-29 02:32:51.030232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.030324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.030348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.547 qpair failed and we were unable to recover it. 00:27:47.547 [2024-11-29 02:32:51.030472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.030582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.030607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.547 qpair failed and we were unable to recover it. 00:27:47.547 [2024-11-29 02:32:51.030705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.030816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.030840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.547 qpair failed and we were unable to recover it. 00:27:47.547 [2024-11-29 02:32:51.030954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.031058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.031083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.547 qpair failed and we were unable to recover it. 00:27:47.547 [2024-11-29 02:32:51.031169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.031253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.031279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.547 qpair failed and we were unable to recover it. 00:27:47.547 [2024-11-29 02:32:51.031359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.031489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.031514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.547 qpair failed and we were unable to recover it. 00:27:47.547 [2024-11-29 02:32:51.031634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.031724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.031749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.547 qpair failed and we were unable to recover it. 00:27:47.547 [2024-11-29 02:32:51.031835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.031951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.031977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.547 qpair failed and we were unable to recover it. 00:27:47.547 [2024-11-29 02:32:51.032056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.032139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.032164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.547 qpair failed and we were unable to recover it. 00:27:47.547 [2024-11-29 02:32:51.032263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.032350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.032379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.547 qpair failed and we were unable to recover it. 00:27:47.547 [2024-11-29 02:32:51.032512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.032596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.032621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.547 qpair failed and we were unable to recover it. 00:27:47.547 [2024-11-29 02:32:51.032744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.032829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.032854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.547 qpair failed and we were unable to recover it. 00:27:47.547 [2024-11-29 02:32:51.032947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.033027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.033052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.547 qpair failed and we were unable to recover it. 00:27:47.547 [2024-11-29 02:32:51.033137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.033245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.033270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.547 qpair failed and we were unable to recover it. 00:27:47.547 [2024-11-29 02:32:51.033354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.033444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.033469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.547 qpair failed and we were unable to recover it. 00:27:47.547 [2024-11-29 02:32:51.033555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.033641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.033667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.547 qpair failed and we were unable to recover it. 00:27:47.547 [2024-11-29 02:32:51.033765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.033875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.033899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.547 qpair failed and we were unable to recover it. 00:27:47.547 [2024-11-29 02:32:51.033986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.034097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.034121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.547 qpair failed and we were unable to recover it. 00:27:47.547 [2024-11-29 02:32:51.034208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.034320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.034344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.547 qpair failed and we were unable to recover it. 00:27:47.547 [2024-11-29 02:32:51.034453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.034536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.034560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.547 qpair failed and we were unable to recover it. 00:27:47.547 [2024-11-29 02:32:51.034696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.034788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.547 [2024-11-29 02:32:51.034813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.547 qpair failed and we were unable to recover it. 00:27:47.548 [2024-11-29 02:32:51.034903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.035020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.035046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.548 qpair failed and we were unable to recover it. 00:27:47.548 [2024-11-29 02:32:51.035192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.035275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.035300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.548 qpair failed and we were unable to recover it. 00:27:47.548 [2024-11-29 02:32:51.035383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.035499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.035526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.548 qpair failed and we were unable to recover it. 00:27:47.548 [2024-11-29 02:32:51.035617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.035730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.035756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.548 qpair failed and we were unable to recover it. 00:27:47.548 [2024-11-29 02:32:51.035841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.035950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.035975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.548 qpair failed and we were unable to recover it. 00:27:47.548 [2024-11-29 02:32:51.036057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.036163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.036188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.548 qpair failed and we were unable to recover it. 00:27:47.548 [2024-11-29 02:32:51.036274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.036378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.036409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.548 qpair failed and we were unable to recover it. 00:27:47.548 [2024-11-29 02:32:51.036552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.036672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.036697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.548 qpair failed and we were unable to recover it. 00:27:47.548 [2024-11-29 02:32:51.036785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.036897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.036922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.548 qpair failed and we were unable to recover it. 00:27:47.548 [2024-11-29 02:32:51.037015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.037135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.037160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.548 qpair failed and we were unable to recover it. 00:27:47.548 [2024-11-29 02:32:51.037276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.037358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.037384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.548 qpair failed and we were unable to recover it. 00:27:47.548 [2024-11-29 02:32:51.037471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.037562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.037586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.548 qpair failed and we were unable to recover it. 00:27:47.548 [2024-11-29 02:32:51.037670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.037755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.037779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.548 qpair failed and we were unable to recover it. 00:27:47.548 [2024-11-29 02:32:51.037866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.037978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.038002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.548 qpair failed and we were unable to recover it. 00:27:47.548 [2024-11-29 02:32:51.038086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.038178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.038203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.548 qpair failed and we were unable to recover it. 00:27:47.548 [2024-11-29 02:32:51.038284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.038398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.038424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.548 qpair failed and we were unable to recover it. 00:27:47.548 [2024-11-29 02:32:51.038518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.038656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.038681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.548 qpair failed and we were unable to recover it. 00:27:47.548 [2024-11-29 02:32:51.038769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.038845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.038870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.548 qpair failed and we were unable to recover it. 00:27:47.548 [2024-11-29 02:32:51.038959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.039043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.039068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.548 qpair failed and we were unable to recover it. 00:27:47.548 [2024-11-29 02:32:51.039158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.039242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.039267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.548 qpair failed and we were unable to recover it. 00:27:47.548 [2024-11-29 02:32:51.039381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.039481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.039506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.548 qpair failed and we were unable to recover it. 00:27:47.548 [2024-11-29 02:32:51.039588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.039674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.039702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.548 qpair failed and we were unable to recover it. 00:27:47.548 [2024-11-29 02:32:51.039792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.039883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.039908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.548 qpair failed and we were unable to recover it. 00:27:47.548 [2024-11-29 02:32:51.039994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.040077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.548 [2024-11-29 02:32:51.040101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.548 qpair failed and we were unable to recover it. 00:27:47.549 [2024-11-29 02:32:51.040188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.040300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.040325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.549 qpair failed and we were unable to recover it. 00:27:47.549 [2024-11-29 02:32:51.040422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.040508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.040533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.549 qpair failed and we were unable to recover it. 00:27:47.549 [2024-11-29 02:32:51.040629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.040714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.040738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.549 qpair failed and we were unable to recover it. 00:27:47.549 [2024-11-29 02:32:51.040830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.040948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.040973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.549 qpair failed and we were unable to recover it. 00:27:47.549 [2024-11-29 02:32:51.041058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.041175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.041200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.549 qpair failed and we were unable to recover it. 00:27:47.549 [2024-11-29 02:32:51.041322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.041413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.041438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.549 qpair failed and we were unable to recover it. 00:27:47.549 [2024-11-29 02:32:51.041527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.041615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.041640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.549 qpair failed and we were unable to recover it. 00:27:47.549 [2024-11-29 02:32:51.041731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.041839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.041865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.549 qpair failed and we were unable to recover it. 00:27:47.549 [2024-11-29 02:32:51.041982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.042068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.042093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.549 qpair failed and we were unable to recover it. 00:27:47.549 [2024-11-29 02:32:51.042185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.042275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.042299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.549 qpair failed and we were unable to recover it. 00:27:47.549 [2024-11-29 02:32:51.042376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.042471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.042495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.549 qpair failed and we were unable to recover it. 00:27:47.549 [2024-11-29 02:32:51.042589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.042677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.042701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.549 qpair failed and we were unable to recover it. 00:27:47.549 [2024-11-29 02:32:51.042793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.042947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.042972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.549 qpair failed and we were unable to recover it. 00:27:47.549 [2024-11-29 02:32:51.043066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.043177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.043201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.549 qpair failed and we were unable to recover it. 00:27:47.549 [2024-11-29 02:32:51.043289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.043368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.043397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.549 qpair failed and we were unable to recover it. 00:27:47.549 [2024-11-29 02:32:51.043482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.043572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.043602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.549 qpair failed and we were unable to recover it. 00:27:47.549 [2024-11-29 02:32:51.043722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.043798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.043823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.549 qpair failed and we were unable to recover it. 00:27:47.549 [2024-11-29 02:32:51.043911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.043992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.044016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.549 qpair failed and we were unable to recover it. 00:27:47.549 [2024-11-29 02:32:51.044132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.044242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.044267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.549 qpair failed and we were unable to recover it. 00:27:47.549 [2024-11-29 02:32:51.044377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.044471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.044497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.549 qpair failed and we were unable to recover it. 00:27:47.549 [2024-11-29 02:32:51.044623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.044736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.044760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.549 qpair failed and we were unable to recover it. 00:27:47.549 [2024-11-29 02:32:51.044846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.044927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.044951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.549 qpair failed and we were unable to recover it. 00:27:47.549 [2024-11-29 02:32:51.045070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.045161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.045188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.549 qpair failed and we were unable to recover it. 00:27:47.549 [2024-11-29 02:32:51.045269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.549 [2024-11-29 02:32:51.045377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.045410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.550 qpair failed and we were unable to recover it. 00:27:47.550 [2024-11-29 02:32:51.045498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.045584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.045609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.550 qpair failed and we were unable to recover it. 00:27:47.550 [2024-11-29 02:32:51.045692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.045777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.045801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.550 qpair failed and we were unable to recover it. 00:27:47.550 [2024-11-29 02:32:51.045927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.046044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.046069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.550 qpair failed and we were unable to recover it. 00:27:47.550 [2024-11-29 02:32:51.046163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.046243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.046267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.550 qpair failed and we were unable to recover it. 00:27:47.550 [2024-11-29 02:32:51.046349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.046441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.046467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.550 qpair failed and we were unable to recover it. 00:27:47.550 [2024-11-29 02:32:51.046590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.046673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.046698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.550 qpair failed and we were unable to recover it. 00:27:47.550 [2024-11-29 02:32:51.046779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.046894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.046920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.550 qpair failed and we were unable to recover it. 00:27:47.550 [2024-11-29 02:32:51.047008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.047146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.047170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.550 qpair failed and we were unable to recover it. 00:27:47.550 [2024-11-29 02:32:51.047280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.047362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.047387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.550 qpair failed and we were unable to recover it. 00:27:47.550 [2024-11-29 02:32:51.047481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.047568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.047594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.550 qpair failed and we were unable to recover it. 00:27:47.550 [2024-11-29 02:32:51.047689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.047806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.047831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.550 qpair failed and we were unable to recover it. 00:27:47.550 [2024-11-29 02:32:51.047981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.048100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.048125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.550 qpair failed and we were unable to recover it. 00:27:47.550 [2024-11-29 02:32:51.048246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.048388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.048422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.550 qpair failed and we were unable to recover it. 00:27:47.550 [2024-11-29 02:32:51.048511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.048599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.048625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.550 qpair failed and we were unable to recover it. 00:27:47.550 [2024-11-29 02:32:51.048721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.048808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.048834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.550 qpair failed and we were unable to recover it. 00:27:47.550 [2024-11-29 02:32:51.048923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.049064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.049090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.550 qpair failed and we were unable to recover it. 00:27:47.550 [2024-11-29 02:32:51.049176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.049288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.049314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.550 qpair failed and we were unable to recover it. 00:27:47.550 [2024-11-29 02:32:51.049401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.049488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.049512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.550 qpair failed and we were unable to recover it. 00:27:47.550 [2024-11-29 02:32:51.049592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.049704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.049730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.550 qpair failed and we were unable to recover it. 00:27:47.550 [2024-11-29 02:32:51.049821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.049911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.049938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.550 qpair failed and we were unable to recover it. 00:27:47.550 [2024-11-29 02:32:51.050024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.550 [2024-11-29 02:32:51.050114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.050138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.551 qpair failed and we were unable to recover it. 00:27:47.551 [2024-11-29 02:32:51.050260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.050347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.050372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.551 qpair failed and we were unable to recover it. 00:27:47.551 [2024-11-29 02:32:51.050472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.050563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.050590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.551 qpair failed and we were unable to recover it. 00:27:47.551 [2024-11-29 02:32:51.050709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.050819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.050844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.551 qpair failed and we were unable to recover it. 00:27:47.551 [2024-11-29 02:32:51.050939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.051050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.051076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.551 qpair failed and we were unable to recover it. 00:27:47.551 [2024-11-29 02:32:51.051166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.051274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.051298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.551 qpair failed and we were unable to recover it. 00:27:47.551 [2024-11-29 02:32:51.051398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.051480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.051505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.551 qpair failed and we were unable to recover it. 00:27:47.551 [2024-11-29 02:32:51.051626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.051711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.051738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.551 qpair failed and we were unable to recover it. 00:27:47.551 [2024-11-29 02:32:51.051825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.051912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.051936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.551 qpair failed and we were unable to recover it. 00:27:47.551 [2024-11-29 02:32:51.052026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.052139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.052163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.551 qpair failed and we were unable to recover it. 00:27:47.551 [2024-11-29 02:32:51.052246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.052323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.052348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.551 qpair failed and we were unable to recover it. 00:27:47.551 [2024-11-29 02:32:51.052442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.052564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.052589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.551 qpair failed and we were unable to recover it. 00:27:47.551 [2024-11-29 02:32:51.052702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.052788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.052813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.551 qpair failed and we were unable to recover it. 00:27:47.551 [2024-11-29 02:32:51.052929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.053015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.053040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.551 qpair failed and we were unable to recover it. 00:27:47.551 [2024-11-29 02:32:51.053152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.053231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.053255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.551 qpair failed and we were unable to recover it. 00:27:47.551 [2024-11-29 02:32:51.053335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.053450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.053477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.551 qpair failed and we were unable to recover it. 00:27:47.551 [2024-11-29 02:32:51.053565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.053653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.053678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.551 qpair failed and we were unable to recover it. 00:27:47.551 [2024-11-29 02:32:51.053774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.053885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.053909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.551 qpair failed and we were unable to recover it. 00:27:47.551 [2024-11-29 02:32:51.054021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.054133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.054158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.551 qpair failed and we were unable to recover it. 00:27:47.551 [2024-11-29 02:32:51.054237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.054322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.054349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.551 qpair failed and we were unable to recover it. 00:27:47.551 [2024-11-29 02:32:51.054452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.054541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.054567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.551 qpair failed and we were unable to recover it. 00:27:47.551 [2024-11-29 02:32:51.054677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.054758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.054782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.551 qpair failed and we were unable to recover it. 00:27:47.551 [2024-11-29 02:32:51.054873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.055015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.055045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.551 qpair failed and we were unable to recover it. 00:27:47.551 [2024-11-29 02:32:51.055136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.055222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.055246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.551 qpair failed and we were unable to recover it. 00:27:47.551 [2024-11-29 02:32:51.055355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.055445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.055471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.551 qpair failed and we were unable to recover it. 00:27:47.551 [2024-11-29 02:32:51.055557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.055650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.055675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.551 qpair failed and we were unable to recover it. 00:27:47.551 [2024-11-29 02:32:51.055762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.055848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.551 [2024-11-29 02:32:51.055872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.552 [2024-11-29 02:32:51.055958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.056072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.056098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.552 [2024-11-29 02:32:51.056250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.056330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.056355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.552 [2024-11-29 02:32:51.056463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.056547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.056571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.552 [2024-11-29 02:32:51.056713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.056794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.056819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.552 [2024-11-29 02:32:51.056929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.057014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.057038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.552 [2024-11-29 02:32:51.057119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.057204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.057230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.552 [2024-11-29 02:32:51.057317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.057408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.057434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.552 [2024-11-29 02:32:51.057520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.057666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.057692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.552 [2024-11-29 02:32:51.057805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.057920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.057945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.552 [2024-11-29 02:32:51.058033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.058121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.058145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.552 [2024-11-29 02:32:51.058238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.058319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.058343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.552 [2024-11-29 02:32:51.058461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.058543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.058568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.552 [2024-11-29 02:32:51.058680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.058762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.058786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.552 [2024-11-29 02:32:51.058872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.058959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.058984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.552 [2024-11-29 02:32:51.059066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.059146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.059170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.552 [2024-11-29 02:32:51.059288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.059370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.059399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.552 [2024-11-29 02:32:51.059527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.059641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.059665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.552 [2024-11-29 02:32:51.059754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.059874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.059899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.552 [2024-11-29 02:32:51.059988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.060065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.060090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.552 [2024-11-29 02:32:51.060175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.060284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.060308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.552 [2024-11-29 02:32:51.060398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.060482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.060506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.552 [2024-11-29 02:32:51.060625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.060739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.060763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.552 [2024-11-29 02:32:51.060882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.060992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.061017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.552 [2024-11-29 02:32:51.061106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.061188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.061212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.552 [2024-11-29 02:32:51.061299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.061425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.061452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.552 [2024-11-29 02:32:51.061569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.061657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.552 [2024-11-29 02:32:51.061683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.552 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.061803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.061895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.061921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.062013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.062101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.062125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.062203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.062291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.062315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.062398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.062481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.062506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.062607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.062721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.062746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.062829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.062937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.062963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.063046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.063156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.063181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.063266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.063352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.063378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.063468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.063554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.063580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.063693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.063804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.063828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.063915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.064031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.064059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.064183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.064271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.064296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.064412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.064490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.064515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.064598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.064684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.064710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.064792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.064905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.064930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.065017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.065138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.065162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.065248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.065361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.065385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.065487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.065564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.065589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.065675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.065754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.065778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.065894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.065999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.066024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.066109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.066225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.066251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.066346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.066460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.066486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.066571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.066653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.066676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.066763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.066857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.066882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.066994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.067079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.067103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.067185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.067282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.067307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.067387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.067508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.067533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.553 qpair failed and we were unable to recover it. 00:27:47.553 [2024-11-29 02:32:51.067616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.067724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.553 [2024-11-29 02:32:51.067748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.067837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.067945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.067969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.068058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.068174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.068199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.068319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.068422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.068448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.068541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.068650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.068675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.068802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.068918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.068943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.069022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.069135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.069159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.069247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.069336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.069361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.069485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.069572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.069598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.069686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.069771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.069796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.069886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.069996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.070021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.070104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.070200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.070226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.070314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.070391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.070422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.070508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.070614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.070641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.070740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.070826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.070851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.070945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.071099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.071125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.071223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.071302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.071328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.071455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.071545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.071570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.071657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.071741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.071766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.071861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.071944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.071970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.072056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.072197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.072223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.072344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.072443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.072470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.072566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.072674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.072699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.072790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.072876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.072901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.073014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.073100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.073125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.073257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.073346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.073370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.073493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.073605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.073629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.073710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.073851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.073876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.073958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.074039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.074064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.074150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.074247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.074272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.554 qpair failed and we were unable to recover it. 00:27:47.554 [2024-11-29 02:32:51.074388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.074510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.554 [2024-11-29 02:32:51.074537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.555 qpair failed and we were unable to recover it. 00:27:47.555 [2024-11-29 02:32:51.074617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.074701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.074726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.555 qpair failed and we were unable to recover it. 00:27:47.555 [2024-11-29 02:32:51.074820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.074933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.074957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.555 qpair failed and we were unable to recover it. 00:27:47.555 [2024-11-29 02:32:51.075041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.075126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.075151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.555 qpair failed and we were unable to recover it. 00:27:47.555 [2024-11-29 02:32:51.075245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.075338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.075368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.555 qpair failed and we were unable to recover it. 00:27:47.555 [2024-11-29 02:32:51.075471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.075580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.075604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.555 qpair failed and we were unable to recover it. 00:27:47.555 [2024-11-29 02:32:51.075693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.075813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.075838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.555 qpair failed and we were unable to recover it. 00:27:47.555 [2024-11-29 02:32:51.075920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.076028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.076053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.555 qpair failed and we were unable to recover it. 00:27:47.555 [2024-11-29 02:32:51.076137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.076224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.076249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.555 qpair failed and we were unable to recover it. 00:27:47.555 [2024-11-29 02:32:51.076328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.076425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.076452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.555 qpair failed and we were unable to recover it. 00:27:47.555 [2024-11-29 02:32:51.076546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.076658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.076684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.555 qpair failed and we were unable to recover it. 00:27:47.555 [2024-11-29 02:32:51.076793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.076882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.076907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.555 qpair failed and we were unable to recover it. 00:27:47.555 [2024-11-29 02:32:51.076995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.077103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.077128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.555 qpair failed and we were unable to recover it. 00:27:47.555 [2024-11-29 02:32:51.077213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.077331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.077355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.555 qpair failed and we were unable to recover it. 00:27:47.555 [2024-11-29 02:32:51.077476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.077592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.077617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.555 qpair failed and we were unable to recover it. 00:27:47.555 [2024-11-29 02:32:51.077702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.077787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.077811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.555 qpair failed and we were unable to recover it. 00:27:47.555 [2024-11-29 02:32:51.077927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.078009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.078034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.555 qpair failed and we were unable to recover it. 00:27:47.555 [2024-11-29 02:32:51.078125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.078233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.078258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.555 qpair failed and we were unable to recover it. 00:27:47.555 [2024-11-29 02:32:51.078351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.078439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.078464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.555 qpair failed and we were unable to recover it. 00:27:47.555 [2024-11-29 02:32:51.078572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.078686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.078710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.555 qpair failed and we were unable to recover it. 00:27:47.555 [2024-11-29 02:32:51.078801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.078912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.078937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.555 qpair failed and we were unable to recover it. 00:27:47.555 [2024-11-29 02:32:51.079057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.079166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.079191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.555 qpair failed and we were unable to recover it. 00:27:47.555 [2024-11-29 02:32:51.079276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.079396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.079422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.555 qpair failed and we were unable to recover it. 00:27:47.555 [2024-11-29 02:32:51.079536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.079621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.079645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.555 qpair failed and we were unable to recover it. 00:27:47.555 [2024-11-29 02:32:51.079757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.079878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.555 [2024-11-29 02:32:51.079902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.555 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.080027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.080144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.080170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.080261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.080347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.080372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.080511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.080625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.080650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.080737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.080822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.080849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.080934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.081045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.081072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.081160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.081276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.081300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.081452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.081541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.081567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.081656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.081767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.081792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.081881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.081961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.081986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.082066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.082207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.082232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.082330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.082418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.082444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.082530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.082641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.082665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.082751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.082840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.082864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.082981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.083075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.083100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.083191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.083278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.083303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.083429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.083539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.083564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.083652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.083738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.083764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.083884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.084002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.084028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.084161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.084243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.084267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.084359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.084471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.084497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.084615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.084703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.084727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.084845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.084928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.084954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.085050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.085139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.085164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.085278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.085387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.085419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.085519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.085631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.085656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.085800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.085911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.085935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.086021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.086104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.086128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.086210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.086323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.556 [2024-11-29 02:32:51.086348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.556 qpair failed and we were unable to recover it. 00:27:47.556 [2024-11-29 02:32:51.086451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.086530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.086556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.086707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.086793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.086820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.086905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.086987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.087017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.087161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.087305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.087330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.087446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.087532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.087556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.087647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.087769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.087794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.087919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.088008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.088033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.088121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.088207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.088231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.088317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.088404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.088432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.088514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.088623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.088647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.088741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.088828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.088853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.088930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.089028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.089054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.089199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.089312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.089337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.089429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.089541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.089567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.089656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.089744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.089769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.089883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.089970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.089995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.090100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.090185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.090209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.090325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.090407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.090431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.090517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.090661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.090686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.090768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.090850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.090875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.090956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.091042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.091065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.091154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.091268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.091294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.091377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.091495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.091520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.091649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.091735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.091761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.091907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.092023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.092048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.092136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.092221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.092246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.092347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.092459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.092486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.092600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.092687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.092712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.092836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.092929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.557 [2024-11-29 02:32:51.092955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.557 qpair failed and we were unable to recover it. 00:27:47.557 [2024-11-29 02:32:51.093039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.093116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.093140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.093226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.093309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.093335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.093445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.093560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.093585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.093703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.093791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.093816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.093907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.094022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.094047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.094126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.094270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.094295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.094410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.094500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.094527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.094644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.094733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.094759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.094840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.094922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.094946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.095057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.095138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.095163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.095245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.095360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.095385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.095475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.095555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.095580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.095695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.095774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.095799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.095884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.095959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.095984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.096075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.096191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.096220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.096307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.096417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.096443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.096532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.096623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.096647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.096766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.096848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.096872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.096982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.097066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.097092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.097179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.097268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.097293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.097379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.097474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.097498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.097594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.097710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.097735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.097824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.097963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.097987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.098078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.098159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.098184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.098302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.098381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.098411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.098511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.098601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.098625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.098714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.098799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.098824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.098919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.099034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.099060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.099142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.099223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.099248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.558 [2024-11-29 02:32:51.099336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.099459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.558 [2024-11-29 02:32:51.099484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.558 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.099566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.099651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.099676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.099787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.099897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.099921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.100065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.100157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.100181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.100264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.100343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.100367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.100486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.100572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.100596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.100683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.100767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.100791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.100917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.100997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.101021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.101133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.101214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.101238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.101333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.101414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.101439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.101552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.101635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.101659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.101756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.101841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.101865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.101961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.102044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.102070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.102156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.102246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.102270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.102391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.102481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.102506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.102631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.102709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.102733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.102819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.102903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.102928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.103050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.103159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.103184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.103265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.103379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.103409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.103493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.103574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.103599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.103688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.103769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.103793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.103878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.103990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.104014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.104135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.104248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.104273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.104364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.104458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.104484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.104569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.104682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.104706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.104788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.104874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.104898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.104989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.105084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.105109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.105201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.105280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.105305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.105423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.105501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.105526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.105609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.105683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.105708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.559 qpair failed and we were unable to recover it. 00:27:47.559 [2024-11-29 02:32:51.105791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.105905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.559 [2024-11-29 02:32:51.105930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.560 qpair failed and we were unable to recover it. 00:27:47.560 [2024-11-29 02:32:51.106029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.106110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.106134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.560 qpair failed and we were unable to recover it. 00:27:47.560 [2024-11-29 02:32:51.106217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.106294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.106318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.560 qpair failed and we were unable to recover it. 00:27:47.560 [2024-11-29 02:32:51.106439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.106533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.106559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.560 qpair failed and we were unable to recover it. 00:27:47.560 [2024-11-29 02:32:51.106642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.106726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.106750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.560 qpair failed and we were unable to recover it. 00:27:47.560 [2024-11-29 02:32:51.106895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.107002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.107027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.560 qpair failed and we were unable to recover it. 00:27:47.560 [2024-11-29 02:32:51.107105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.107219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.107247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.560 qpair failed and we were unable to recover it. 00:27:47.560 [2024-11-29 02:32:51.107358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.107478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.107503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.560 qpair failed and we were unable to recover it. 00:27:47.560 [2024-11-29 02:32:51.107620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.107735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.107759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.560 qpair failed and we were unable to recover it. 00:27:47.560 [2024-11-29 02:32:51.107851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.107930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.107954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.560 qpair failed and we were unable to recover it. 00:27:47.560 [2024-11-29 02:32:51.108048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.108138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.108162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.560 qpair failed and we were unable to recover it. 00:27:47.560 [2024-11-29 02:32:51.108274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.108355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.108379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.560 qpair failed and we were unable to recover it. 00:27:47.560 [2024-11-29 02:32:51.108471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.108583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.108607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.560 qpair failed and we were unable to recover it. 00:27:47.560 [2024-11-29 02:32:51.108688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.108802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.108826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.560 qpair failed and we were unable to recover it. 00:27:47.560 [2024-11-29 02:32:51.108910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.108991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.109015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.560 qpair failed and we were unable to recover it. 00:27:47.560 [2024-11-29 02:32:51.109110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.109198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.109223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.560 qpair failed and we were unable to recover it. 00:27:47.560 [2024-11-29 02:32:51.109313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.109426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.109453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.560 qpair failed and we were unable to recover it. 00:27:47.560 [2024-11-29 02:32:51.109572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.109656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.109681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.560 qpair failed and we were unable to recover it. 00:27:47.560 [2024-11-29 02:32:51.109766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.109858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.109883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.560 qpair failed and we were unable to recover it. 00:27:47.560 [2024-11-29 02:32:51.109996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.110108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.110132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.560 qpair failed and we were unable to recover it. 00:27:47.560 [2024-11-29 02:32:51.110244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.110386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.110415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.560 qpair failed and we were unable to recover it. 00:27:47.560 [2024-11-29 02:32:51.110501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.110582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.110607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.560 qpair failed and we were unable to recover it. 00:27:47.560 [2024-11-29 02:32:51.110701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.110784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.110808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.560 qpair failed and we were unable to recover it. 00:27:47.560 [2024-11-29 02:32:51.110922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.111013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.111039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.560 qpair failed and we were unable to recover it. 00:27:47.560 [2024-11-29 02:32:51.111131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.560 [2024-11-29 02:32:51.111217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.111241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.561 qpair failed and we were unable to recover it. 00:27:47.561 [2024-11-29 02:32:51.111337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.111445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.111470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.561 qpair failed and we were unable to recover it. 00:27:47.561 [2024-11-29 02:32:51.111572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.111661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.111685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.561 qpair failed and we were unable to recover it. 00:27:47.561 [2024-11-29 02:32:51.111783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.111862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.111886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.561 qpair failed and we were unable to recover it. 00:27:47.561 [2024-11-29 02:32:51.111964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.112104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.112128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.561 qpair failed and we were unable to recover it. 00:27:47.561 [2024-11-29 02:32:51.112217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.112297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.112322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.561 qpair failed and we were unable to recover it. 00:27:47.561 [2024-11-29 02:32:51.112422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.112500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.112525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.561 qpair failed and we were unable to recover it. 00:27:47.561 [2024-11-29 02:32:51.112610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.112731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.112756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.561 qpair failed and we were unable to recover it. 00:27:47.561 [2024-11-29 02:32:51.112866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.112944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.112968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.561 qpair failed and we were unable to recover it. 00:27:47.561 [2024-11-29 02:32:51.113049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.113129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.113155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.561 qpair failed and we were unable to recover it. 00:27:47.561 [2024-11-29 02:32:51.113237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.113325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.113349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.561 qpair failed and we were unable to recover it. 00:27:47.561 [2024-11-29 02:32:51.113436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.113523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.113549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.561 qpair failed and we were unable to recover it. 00:27:47.561 [2024-11-29 02:32:51.113637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.113713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.113738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.561 qpair failed and we were unable to recover it. 00:27:47.561 [2024-11-29 02:32:51.113835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.113921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.113945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.561 qpair failed and we were unable to recover it. 00:27:47.561 [2024-11-29 02:32:51.114039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.114151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.114176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.561 qpair failed and we were unable to recover it. 00:27:47.561 [2024-11-29 02:32:51.114256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.114365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.114389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.561 qpair failed and we were unable to recover it. 00:27:47.561 [2024-11-29 02:32:51.114487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.114605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.114631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.561 qpair failed and we were unable to recover it. 00:27:47.561 [2024-11-29 02:32:51.114715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.114795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.114820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.561 qpair failed and we were unable to recover it. 00:27:47.561 [2024-11-29 02:32:51.114935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.115049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.115074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.561 qpair failed and we were unable to recover it. 00:27:47.561 [2024-11-29 02:32:51.115168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.115257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.115283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.561 qpair failed and we were unable to recover it. 00:27:47.561 [2024-11-29 02:32:51.115365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.115452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.115477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.561 qpair failed and we were unable to recover it. 00:27:47.561 [2024-11-29 02:32:51.115561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.115645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.115669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.561 qpair failed and we were unable to recover it. 00:27:47.561 [2024-11-29 02:32:51.115749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.115837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.115862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.561 qpair failed and we were unable to recover it. 00:27:47.561 [2024-11-29 02:32:51.115945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.116035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.561 [2024-11-29 02:32:51.116059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.116151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.116227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.116252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.116337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.116413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.116439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.116532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.116616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.116640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.116724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.116813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.116838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.116925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.117011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.117036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.117131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.117212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.117238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.117329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.117438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.117464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.117552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.117662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.117685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.117773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.117858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.117883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.117971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.118059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.118087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.118177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.118256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.118281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.118375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.118460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.118487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.118566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.118649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.118673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.118790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.118872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.118896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.119010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.119095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.119120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.119210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.119321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.119345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.119439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.119553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.119577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.119666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.119745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.119770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.119887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.119973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.119997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.120085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.120167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.120192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.120285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.120427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.120452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.120546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.120630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.120654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.120743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.120860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.120884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.120974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.121053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.121077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.121172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.121277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.121301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.121423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.121505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.121529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.121620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.121701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.121726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.121845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.121928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.121952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.562 qpair failed and we were unable to recover it. 00:27:47.562 [2024-11-29 02:32:51.122041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.562 [2024-11-29 02:32:51.122162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.122186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.122298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.122380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.122410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.122526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.122618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.122643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.122764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.122846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.122870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.122953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.123071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.123096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.123184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.123323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.123347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.123446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.123531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.123556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.123643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.123725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.123749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.123845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.123958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.123983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.124078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.124188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.124213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.124303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.124384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.124424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.124519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.124607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.124632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.124712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.124824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.124848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.124960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.125033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.125057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.125146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.125254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.125278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.125366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.125466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.125491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.125575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.125662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.125687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.125798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.125878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.125904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.125981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.126077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.126101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.126179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.126262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.126288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.126409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.126489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.126513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.126597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.126738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.126763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.126854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.126935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.126964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.127050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.127140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.127164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.127259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.127341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.127366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.127460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.127543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.127567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.127647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.127730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.127754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.127854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.127937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.127961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.128045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.128124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.128150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.563 qpair failed and we were unable to recover it. 00:27:47.563 [2024-11-29 02:32:51.128244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.563 [2024-11-29 02:32:51.128353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.128378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.128469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.128548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.128572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.128690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.128774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.128798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.128908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.128988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.129013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.129101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.129181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.129206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.129318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.129434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.129460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.129544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.129635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.129659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.129746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.129857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.129882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.129971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.130057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.130082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.130194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.130279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.130304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.130398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.130488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.130513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.130626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.130741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.130766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.130850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.130936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.130961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.131044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.131130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.131154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.131238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.131313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.131339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.131419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.131506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.131531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.131621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.131707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.131732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.131853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.131932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.131958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.132041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.132151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.132176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.132290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.132427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.132454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.132546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.132632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.132656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.132740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.132825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.132850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.132971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.133079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.133104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.133188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.133297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.133321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.133415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.133496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.133521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.133605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.133742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.133767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.133865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.133949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.133974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.564 qpair failed and we were unable to recover it. 00:27:47.564 [2024-11-29 02:32:51.134059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.134139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.564 [2024-11-29 02:32:51.134163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.565 qpair failed and we were unable to recover it. 00:27:47.565 [2024-11-29 02:32:51.134247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.134329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.134353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.565 qpair failed and we were unable to recover it. 00:27:47.565 [2024-11-29 02:32:51.134446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.134530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.134554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.565 qpair failed and we were unable to recover it. 00:27:47.565 [2024-11-29 02:32:51.134643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.134731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.134757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.565 qpair failed and we were unable to recover it. 00:27:47.565 [2024-11-29 02:32:51.134845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.134931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.134955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.565 qpair failed and we were unable to recover it. 00:27:47.565 [2024-11-29 02:32:51.135036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.135155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.135180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.565 qpair failed and we were unable to recover it. 00:27:47.565 [2024-11-29 02:32:51.135261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.135337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.135361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.565 qpair failed and we were unable to recover it. 00:27:47.565 [2024-11-29 02:32:51.135459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.135544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.135569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.565 qpair failed and we were unable to recover it. 00:27:47.565 [2024-11-29 02:32:51.135656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.135748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.135772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.565 qpair failed and we were unable to recover it. 00:27:47.565 [2024-11-29 02:32:51.135890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.135968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.135993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.565 qpair failed and we were unable to recover it. 00:27:47.565 [2024-11-29 02:32:51.136078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.136165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.136189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.565 qpair failed and we were unable to recover it. 00:27:47.565 [2024-11-29 02:32:51.136281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.136358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.136383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.565 qpair failed and we were unable to recover it. 00:27:47.565 [2024-11-29 02:32:51.136503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.136619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.136643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.565 qpair failed and we were unable to recover it. 00:27:47.565 [2024-11-29 02:32:51.136729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.136810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.136835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.565 qpair failed and we were unable to recover it. 00:27:47.565 [2024-11-29 02:32:51.136920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.137047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.137072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.565 qpair failed and we were unable to recover it. 00:27:47.565 [2024-11-29 02:32:51.137163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.137241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.137266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.565 qpair failed and we were unable to recover it. 00:27:47.565 [2024-11-29 02:32:51.137357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.137453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.137478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.565 qpair failed and we were unable to recover it. 00:27:47.565 [2024-11-29 02:32:51.137593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.137671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.137702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.565 qpair failed and we were unable to recover it. 00:27:47.565 [2024-11-29 02:32:51.137794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.137880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.137906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.565 qpair failed and we were unable to recover it. 00:27:47.565 [2024-11-29 02:32:51.138000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.138116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.138140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.565 qpair failed and we were unable to recover it. 00:27:47.565 [2024-11-29 02:32:51.138226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.138340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.138365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.565 qpair failed and we were unable to recover it. 00:27:47.565 [2024-11-29 02:32:51.138461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.138552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.138577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.565 qpair failed and we were unable to recover it. 00:27:47.565 [2024-11-29 02:32:51.138661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.138747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.138771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.565 qpair failed and we were unable to recover it. 00:27:47.565 [2024-11-29 02:32:51.138886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.138993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.139017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.565 qpair failed and we were unable to recover it. 00:27:47.565 [2024-11-29 02:32:51.139132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.139211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.139235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.565 qpair failed and we were unable to recover it. 00:27:47.565 [2024-11-29 02:32:51.139312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.139426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.139450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.565 qpair failed and we were unable to recover it. 00:27:47.565 [2024-11-29 02:32:51.139539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.139619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.565 [2024-11-29 02:32:51.139644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.139756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.139866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.139891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.140014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.140091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.140116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.140200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.140284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.140308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.140415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.140496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.140521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.140599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.140678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.140702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.140813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.140904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.140929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.141017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.141129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.141154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.141300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.141413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.141438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.141526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.141617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.141643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.141768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.141857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.141881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.141970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.142078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.142102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.142220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.142301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.142325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.142417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.142509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.142534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.142648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.142729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.142753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.142832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.142980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.143005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.143116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.143202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.143227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.143343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.143455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.143480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.143564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.143705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.143730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.143819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.143894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.143918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.144039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.144124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.144148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.144234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.144353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.144377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.144491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.144611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.144636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.144723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.144805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.144829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.144920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.145000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.145025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.145118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.145207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.145232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.145326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.145418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.145443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.145530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.145644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.145669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.145758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.145839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.145864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.566 qpair failed and we were unable to recover it. 00:27:47.566 [2024-11-29 02:32:51.145945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.146035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.566 [2024-11-29 02:32:51.146060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.146154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.146237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.146261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.146381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.146468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.146492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.146607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.146698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.146723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.146804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.146881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.146905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.147003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.147114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.147138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.147221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.147353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.147378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.147475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.147553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.147578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.147691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.147804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.147828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.147917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.148030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.148054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.148139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.148219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.148243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.148356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.148449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.148474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.148552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.148663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.148687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.148783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.148865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.148894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.148977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.149090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.149115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.149207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.149318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.149342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.149431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.149523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.149548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.149633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.149745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.149770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.149851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.149944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.149969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.150055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.150145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.150169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.150258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.150334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.150358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.150452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.150532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.150556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.150669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.150779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.150803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.150898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.150983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.151010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.151100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.151239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.151263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.151388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.151469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.151494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.151613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.151727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.151752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.151870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.151982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.152006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.152090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.152177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.152201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.567 qpair failed and we were unable to recover it. 00:27:47.567 [2024-11-29 02:32:51.152288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.152423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.567 [2024-11-29 02:32:51.152450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.568 qpair failed and we were unable to recover it. 00:27:47.568 [2024-11-29 02:32:51.152575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.152658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.152681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.568 qpair failed and we were unable to recover it. 00:27:47.568 [2024-11-29 02:32:51.152770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.152852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.152879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.568 qpair failed and we were unable to recover it. 00:27:47.568 [2024-11-29 02:32:51.152976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.153075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.153099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.568 qpair failed and we were unable to recover it. 00:27:47.568 [2024-11-29 02:32:51.153188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.153284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.153308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.568 qpair failed and we were unable to recover it. 00:27:47.568 [2024-11-29 02:32:51.153427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.153513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.153538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.568 qpair failed and we were unable to recover it. 00:27:47.568 [2024-11-29 02:32:51.153628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.153745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.153769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.568 qpair failed and we were unable to recover it. 00:27:47.568 [2024-11-29 02:32:51.153878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.153991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.154015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.568 qpair failed and we were unable to recover it. 00:27:47.568 [2024-11-29 02:32:51.154103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.154215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.154240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.568 qpair failed and we were unable to recover it. 00:27:47.568 [2024-11-29 02:32:51.154327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.154410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.154435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.568 qpair failed and we were unable to recover it. 00:27:47.568 [2024-11-29 02:32:51.154526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.154608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.154632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.568 qpair failed and we were unable to recover it. 00:27:47.568 [2024-11-29 02:32:51.154721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.154841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.154866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.568 qpair failed and we were unable to recover it. 00:27:47.568 [2024-11-29 02:32:51.154954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.155052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.155076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.568 qpair failed and we were unable to recover it. 00:27:47.568 [2024-11-29 02:32:51.155168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.155251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.155276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.568 qpair failed and we were unable to recover it. 00:27:47.568 [2024-11-29 02:32:51.155397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.155486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.155511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.568 qpair failed and we were unable to recover it. 00:27:47.568 [2024-11-29 02:32:51.155596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.155693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.155717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.568 qpair failed and we were unable to recover it. 00:27:47.568 [2024-11-29 02:32:51.155831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.155949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.155973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.568 qpair failed and we were unable to recover it. 00:27:47.568 [2024-11-29 02:32:51.156058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.156144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.156170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.568 qpair failed and we were unable to recover it. 00:27:47.568 [2024-11-29 02:32:51.156287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.156376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.156408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.568 qpair failed and we were unable to recover it. 00:27:47.568 [2024-11-29 02:32:51.156498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.156582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.156607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.568 qpair failed and we were unable to recover it. 00:27:47.568 [2024-11-29 02:32:51.156699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.156786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.568 [2024-11-29 02:32:51.156810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.568 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 02:32:51.156903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 02:32:51.157029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 02:32:51.157053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 02:32:51.157167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 02:32:51.157253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 02:32:51.157279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 02:32:51.157362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 02:32:51.157466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 02:32:51.157491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 02:32:51.157580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 02:32:51.157657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 02:32:51.157682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 02:32:51.157793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 02:32:51.157872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 02:32:51.157902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 02:32:51.157986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 02:32:51.158074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 02:32:51.158099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 02:32:51.158212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 02:32:51.158325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 02:32:51.158350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 02:32:51.158441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 02:32:51.158516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 02:32:51.158540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 02:32:51.158652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 02:32:51.158763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 02:32:51.158787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 02:32:51.158871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 02:32:51.158960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 02:32:51.158985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 02:32:51.159073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 02:32:51.159187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 02:32:51.159213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.159330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.159414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.159442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.159529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.159617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.159641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.159760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.159853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.159878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.159958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.160068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.160092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.160190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.160305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.160329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.160449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.160541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.160566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.160680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.160786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.160810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.160923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.161015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.161040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.161123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.161212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.161236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.161315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.161402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.161427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.161517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.161603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.161629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.161712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.161827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.161851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.161942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.162051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.162076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.162164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.162248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.162272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.162398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.162484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.162508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.162590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.162705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.162731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.162818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.162960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.162986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.163097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.163180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.163205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.163290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.163431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.163458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.163555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.163667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.163691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.163786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.163894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.163918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.164035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.164119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.164143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.164238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.164318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.164342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.164422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.164499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.164525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.164646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.164757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.164782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.164866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.164983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.165009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.165098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.165192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.165217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.165299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.165412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.165437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 02:32:51.165522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.165638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 02:32:51.165662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.165781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.165862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.165887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.165972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.166054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.166079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.166196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.166307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.166333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.166423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.166546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.166570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.166658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.166743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.166768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.166867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.166960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.166985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.167076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.167191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.167215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.167329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.167440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.167466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.167559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.167676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.167701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.167816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.167896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.167921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.168000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.168109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.168133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.168275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.168355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.168379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.168474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.168565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.168590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.168733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.168847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.168872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.168997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.169115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.169140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.169226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.169310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.169339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.169440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.169563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.169588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.169710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.169794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.169818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.169900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.169988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.170013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.170095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.170179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.170204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.170294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.170373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.170403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.170502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.170579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.170603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.170718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.170830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.170854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.170942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.171028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.171053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.171140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.171224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.171248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.171361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.171452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.171477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.171569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.171661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.171686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.171780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.171896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.171921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 02:32:51.172033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 02:32:51.172121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.172145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.172261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.172382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.172413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.172506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.172590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.172615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.172708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.172816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.172841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.172924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.173006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.173030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.173147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.173235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.173259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.173374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.173462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.173488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.173605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.173695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.173720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.173806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.173952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.173977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.174098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.174186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.174211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.174325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.174417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.174443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.174525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.174632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.174657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.174741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.174857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.174882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.174998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.175103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.175129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.175218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.175312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.175337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.175429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.175511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.175535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.175620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.175764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.175789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.175876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.176022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.176047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.176131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.176222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.176247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.176332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.176484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.176509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.176626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.176716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.176740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.176825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.176968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.176992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.177079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.177191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.177215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.177307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.177443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.177469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.177553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.177639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.177664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.177776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.177859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.177884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.177974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.178093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.178117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.178199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.178284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.178308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.178431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.178552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.178577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 02:32:51.178667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 02:32:51.178776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.178801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.178916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.178996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.179021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.179107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.179196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.179221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.179304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.179397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.179423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.179534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.179622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.179647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.179732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.179842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.179866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.179981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.180070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.180094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.180183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.180304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.180329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.180441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.180525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.180551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.180661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.180747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.180776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.180857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.180945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.180969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.181055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.181163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.181188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.181270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.181386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.181415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.181502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.181579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.181602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.181688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.181772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.181796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.181881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.181988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.182012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.182100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.182212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.182238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.182349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.182467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.182494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.182612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.182722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.182747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.182861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.182943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.182967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.183086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.183164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.183190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.183304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.183415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.183441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.183554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.183635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.183660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.183748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.183836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.183861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.183956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.184063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.184087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.184197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.184276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.184301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.184419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.184499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.184523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.184636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.184750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.184775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.184891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.184980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.185004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 02:32:51.185083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 02:32:51.185158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.185183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 02:32:51.185304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.185422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.185448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 02:32:51.185537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.185619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.185643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 02:32:51.185721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.185802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.185826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 02:32:51.185948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.186065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.186089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 02:32:51.186208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.186293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.186317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 02:32:51.186406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.186485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.186511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 02:32:51.186606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.186695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.186719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 02:32:51.186812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.186896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.186921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 02:32:51.187007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.187126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.187150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 02:32:51.187231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.187323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.187347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 02:32:51.187433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.187519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.187545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 02:32:51.187636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.187775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.187800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 02:32:51.187887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.187977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.188001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 02:32:51.188094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.188203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.188227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 02:32:51.188309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.188429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.188454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 02:32:51.188544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.188637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.188661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 02:32:51.188743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.188857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.188883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 02:32:51.189019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.189104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.189129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 02:32:51.189217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.189297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.189324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 02:32:51.189416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.189557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.189582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 02:32:51.189664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.189747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.189776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 02:32:51.189871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.189953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.189977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 02:32:51.190063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.190177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.190201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 02:32:51.190292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.190407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 02:32:51.190433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 02:32:51.190525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.190611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.190635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.190747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.190837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.190863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.190950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.191034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.191060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.191172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.191258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.191282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.191365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.191457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.191483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.191604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.191717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.191742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.191861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.191980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.192006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.192098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.192184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.192209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.192298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.192378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.192436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.192556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.192674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.192700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.192825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.192911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.192937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.193021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.193110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.193135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.193249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.193336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.193361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.193464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.193549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.193573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.193659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.193742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.193767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.193878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.193958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.193983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.194076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.194164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.194189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.194305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.194388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.194419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.194511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.194591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.194615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.194695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.194787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.194812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.194894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.194979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.195003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.195083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.195164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.195189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.195286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.195365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.195389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.195486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.195603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.195627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.195747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.195840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.195865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.195979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.196067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.196093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.196214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.196295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.196320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.196409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.196508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.196533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.196630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.196713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 02:32:51.196738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 02:32:51.196831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.196947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.196972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.197058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.197196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.197221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.197321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.197412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.197439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.197557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.197668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.197693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.197776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.197857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.197882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.198000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.198093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.198117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.198203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.198293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.198320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.198439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.198580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.198605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.198719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.198812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.198836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.198925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.199013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.199040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.199136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.199220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.199244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.199328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.199420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.199446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.199589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.199709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.199733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.199847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.199932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.199957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.200077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.200155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.200180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.200268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.200355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.200381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.200510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.200600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.200625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.200714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.200799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.200824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.200913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.200995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.201024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.201111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.201194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.201219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.201344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.201457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.201484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.201598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.201676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.201701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.201815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.201928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.201953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.202075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.202159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.202183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.202329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.202412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.202438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.202549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.202635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.202659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.202751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.202830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.202855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.202980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.203058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.203083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.203180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.203262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.203287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 02:32:51.203373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 02:32:51.203490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.203514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.203599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.203677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.203701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.203785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.203902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.203927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.204038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.204123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.204147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.204229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.204304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.204330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.204422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.204521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.204545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.204629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.204710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.204735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.204879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.204993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.205017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.205130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.205237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.205261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.205373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.205488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.205514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.205637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.205744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.205769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.205851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.205939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.205964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.206054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.206135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.206160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.206249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.206331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.206355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.206445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.206553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.206577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.206668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.206752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.206777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.206865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.206974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.206998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.207092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.207203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.207229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.207312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.207423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.207449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.207537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.207625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.207650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.207740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.207842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.207866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.207947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.208027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.208052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.208131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.208214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.208240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.208329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.208470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.208496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.208586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.208670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.208696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.208784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.208906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.208930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.209053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.209132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.209156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.209267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.209358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.209383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.209474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.209585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.209610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 02:32:51.209753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 02:32:51.209864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.209889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 02:32:51.210007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.210121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.210146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 02:32:51.210257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.210340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.210364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 02:32:51.210457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.210536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.210560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 02:32:51.210681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.210795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.210819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 02:32:51.210921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.211031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.211056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 02:32:51.211144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.211225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.211251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 02:32:51.211333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.211448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.211474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 02:32:51.211589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.211670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.211695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 02:32:51.211782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.211875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.211901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 02:32:51.211992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.212072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.212097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 02:32:51.212196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.212313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.212342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 02:32:51.212498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.212587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.212612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 02:32:51.212697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.212774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.212799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 02:32:51.212914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.212994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.213019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 02:32:51.213102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.213208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.213234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 02:32:51.213325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.213416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.213441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 02:32:51.213556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.213644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.213669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 02:32:51.213784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.213866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.213891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 02:32:51.213984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.214062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 02:32:51.214087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 02:32:51.214209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.214297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.214321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.214411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.214500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.214526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.214641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.214722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.214747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.214835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.214974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.214999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.215081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.215165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.215190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.215330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.215412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.215438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.215523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.215634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.215659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.215744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.215830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.215854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.215965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.216079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.216103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.216186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.216271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.216298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.216418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.216540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.216566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.216653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.216799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.216824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.216914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.217001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.217025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.217111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.217225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.217249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.217336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.217425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.217451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.217531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.217643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.217668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.217747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.217827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.217853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.217950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.218030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.218054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.218155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.218279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.218304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.218416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.218505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.218529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.218631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.218719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.218744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.218857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.218972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.218996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.219080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.219170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.219196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.219308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.219386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.219417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.219502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.219582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.219606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.219687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.219803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.219827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.219914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.219998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.220023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.220168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.220242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.220267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.220352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.220442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.865 [2024-11-29 02:32:51.220468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.865 qpair failed and we were unable to recover it. 00:27:47.865 [2024-11-29 02:32:51.220554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.220694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.220719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.220806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.220913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.220938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.221027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.221113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.221137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.221224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.221306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.221334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.221478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.221569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.221596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.221686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.221797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.221821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.221933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.222022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.222046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.222141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.222228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.222253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.222335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.222425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.222451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.222542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.222659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.222684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.222775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.222860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.222884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.222965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.223047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.223071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.223155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.223240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.223266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.223381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.223476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.223502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.223591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.223681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.223705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.223846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.223927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.223951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.224033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.224174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.224199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.224285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.224361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.224386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.224507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.224588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.224613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.224731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.224846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.224870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.224981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.225064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.225088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.225202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.225284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.225309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.225401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.225512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.225537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.225657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.225740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.225765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.225893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.225978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.226003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.226084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.226160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.226186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.226268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.226352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.226376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.226480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.226571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.226598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.226680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.226794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.866 [2024-11-29 02:32:51.226820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.866 qpair failed and we were unable to recover it. 00:27:47.866 [2024-11-29 02:32:51.226905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.227020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.227045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.227135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.227246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.227270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.227354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.227490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.227515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.227597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.227706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.227731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.227814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.227928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.227952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.228042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.228155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.228180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.228301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.228412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.228438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.228561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.228705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.228729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.228809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.228892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.228916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.229007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.229086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.229112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.229196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.229277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.229302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.229419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.229499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.229524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.229610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.229727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.229752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.229852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.229934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.229958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.230073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.230191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.230216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.230303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.230391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.230432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.230548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.230633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.230657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.230773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.230858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.230882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.230968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.231057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.231082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.231194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.231277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.231301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.231386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.231501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.231526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.231625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.231708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.231732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.231850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.231931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.231956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.232038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.232117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.232142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.232220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.232304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.232329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.232445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.232588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.232617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.232699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.232810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.232835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.232921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.233006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.233030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.233147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.233234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.233258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.867 qpair failed and we were unable to recover it. 00:27:47.867 [2024-11-29 02:32:51.233342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.867 [2024-11-29 02:32:51.233425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.233450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.233544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.233660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.233685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.233769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.233887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.233912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.233995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.234113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.234137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.234220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.234302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.234327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.234437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.234550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.234576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.234716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.234825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.234851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.234945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.235025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.235050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.235143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.235223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.235248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.235331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.235448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.235473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.235586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.235671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.235695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.235809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.235926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.235950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.236032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.236110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.236134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.236227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.236336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.236361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.236451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.236560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.236585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.236671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.236765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.236790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.236912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.236998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.237022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.237109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.237220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.237244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.237328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.237439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.237465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.237553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.237644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.237668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.237751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.237833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.237858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.237970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.238048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.238072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.238183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.238266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.238290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.238388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.238520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.238546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.238637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.238721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.238745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.238864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.238973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.238997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.239112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.239220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.239244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.239367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.239491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.239515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.239627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.239736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.239761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.868 qpair failed and we were unable to recover it. 00:27:47.868 [2024-11-29 02:32:51.239849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.868 [2024-11-29 02:32:51.239964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.239989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.869 qpair failed and we were unable to recover it. 00:27:47.869 [2024-11-29 02:32:51.240105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.240183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.240207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.869 qpair failed and we were unable to recover it. 00:27:47.869 [2024-11-29 02:32:51.240285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.240402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.240427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.869 qpair failed and we were unable to recover it. 00:27:47.869 [2024-11-29 02:32:51.240508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.240588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.240612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.869 qpair failed and we were unable to recover it. 00:27:47.869 [2024-11-29 02:32:51.240698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.240812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.240837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.869 qpair failed and we were unable to recover it. 00:27:47.869 [2024-11-29 02:32:51.240956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.241038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.241063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.869 qpair failed and we were unable to recover it. 00:27:47.869 [2024-11-29 02:32:51.241142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.241223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.241248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.869 qpair failed and we were unable to recover it. 00:27:47.869 [2024-11-29 02:32:51.241331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.241418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.241443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.869 qpair failed and we were unable to recover it. 00:27:47.869 [2024-11-29 02:32:51.241555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.241675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.241700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.869 qpair failed and we were unable to recover it. 00:27:47.869 [2024-11-29 02:32:51.241788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.241866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.241890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.869 qpair failed and we were unable to recover it. 00:27:47.869 [2024-11-29 02:32:51.241977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.242061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.242085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.869 qpair failed and we were unable to recover it. 00:27:47.869 [2024-11-29 02:32:51.242183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.242295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.242319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.869 qpair failed and we were unable to recover it. 00:27:47.869 [2024-11-29 02:32:51.242438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.242527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.242552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.869 qpair failed and we were unable to recover it. 00:27:47.869 [2024-11-29 02:32:51.242633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.242786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.869 [2024-11-29 02:32:51.242811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.869 qpair failed and we were unable to recover it. 00:27:47.869 [2024-11-29 02:32:51.242903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.242982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.243008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.243158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.243239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.243265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.243353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.243474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.243499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.243587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.243664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.243689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.243774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.243854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.243882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.243976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.244060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.244085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.244196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.244285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.244311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.244390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.244506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.244532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.244622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.244711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.244735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.244822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.244933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.244957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.245050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.245128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.245152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.245263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.245371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.245402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.245495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.245587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.245613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.245726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.245807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.245832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.245919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.246003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.246028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.246118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.246226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.246251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.246364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.246463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.246490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.246634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.246774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.246798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.246881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.246962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.246987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.247085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.247199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.247224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.247312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.247419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.247445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.247559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.247670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.247695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.247783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.247892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.247916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.248007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.248083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.248108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.248189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.248267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.248291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.248411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.248490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.248516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.248602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.248693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.248718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.248864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.248948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.248972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.249093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.249204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.870 [2024-11-29 02:32:51.249228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.870 qpair failed and we were unable to recover it. 00:27:47.870 [2024-11-29 02:32:51.249304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.249422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.249449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.249567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.249657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.249682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.249773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.249858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.249882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.249971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.250062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.250087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.250204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.250289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.250314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.250404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.250494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.250518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.250601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.250721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.250746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.250839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.250927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.250953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.251042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.251121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.251146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.251231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.251340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.251365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.251487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.251573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.251598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.251683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.251766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.251790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.251905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.251984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.252009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.252092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.252206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.252231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.252341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.252426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.252451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.252544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.252623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.252648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.252728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.252805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.252834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.252927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.253007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.253033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.253114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.253227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.253251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.253366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.253475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.253502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.253622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.253700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.253724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.253806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.253895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.253920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.254031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.254113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.254138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.254252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.254362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.254387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.254476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.254568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.254592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.254686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.254765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.254791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.254905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.255020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.255045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.255138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.255213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.255238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.871 qpair failed and we were unable to recover it. 00:27:47.871 [2024-11-29 02:32:51.255350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.255476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.871 [2024-11-29 02:32:51.255501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.255614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.255697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.255722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.255819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.255901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.255926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.256010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.256099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.256123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.256216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.256295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.256321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.256447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.256537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.256562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.256678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.256758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.256783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.256868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.256957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.256983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.257094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.257183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.257207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.257301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.257383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.257439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.257525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.257613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.257637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.257724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.257817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.257842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.257919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.257997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.258021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.258113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.258195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.258219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.258302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.258423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.258447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.258534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.258615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.258640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.258753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.258831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.258857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.258947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.259060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.259085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.259166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.259277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.259301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.259415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.259501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.259527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.259626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.259715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.259739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.259828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.259911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.259936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.260020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.260098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.260123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.260205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.260281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.260306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.260398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.260521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.260546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.260635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.260719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.260744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.260830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.260939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.260964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.261049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.261132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.261156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.261239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.261350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.261375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.872 qpair failed and we were unable to recover it. 00:27:47.872 [2024-11-29 02:32:51.261499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.261593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.872 [2024-11-29 02:32:51.261618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.261706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.261819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.261844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.261958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.262043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.262068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.262154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.262239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.262264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.262349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.262463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.262488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.262572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.262649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.262674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.262768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.262850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.262875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.262956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.263034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.263059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.263156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.263268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.263292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.263380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.263496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.263521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.263645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.263734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.263763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.263847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.263954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.263979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.264094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.264202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.264226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.264312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.264399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.264424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.264517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.264606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.264630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.264711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.264801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.264826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.264939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.265016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.265041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.265137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.265231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.265257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.265370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.265496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.265521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.265609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.265746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.265770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.265887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.265967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.265992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.266075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.266188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.266212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.266302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.266389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.266420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.266537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.266616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.266641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.266727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.266836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.266860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.266948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.267057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.267081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.267169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.267311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.267335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.267423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.267513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.267537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.267618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.267698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.267723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.873 [2024-11-29 02:32:51.267836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.267917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.873 [2024-11-29 02:32:51.267942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.873 qpair failed and we were unable to recover it. 00:27:47.874 [2024-11-29 02:32:51.268033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.268148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.268174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.874 qpair failed and we were unable to recover it. 00:27:47.874 [2024-11-29 02:32:51.268274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.268389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.268421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.874 qpair failed and we were unable to recover it. 00:27:47.874 [2024-11-29 02:32:51.268511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.268593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.268620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.874 qpair failed and we were unable to recover it. 00:27:47.874 [2024-11-29 02:32:51.268764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.268876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.268901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.874 qpair failed and we were unable to recover it. 00:27:47.874 [2024-11-29 02:32:51.268994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.269074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.269098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.874 qpair failed and we were unable to recover it. 00:27:47.874 [2024-11-29 02:32:51.269243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.269331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.269357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.874 qpair failed and we were unable to recover it. 00:27:47.874 [2024-11-29 02:32:51.269465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.269548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.269572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.874 qpair failed and we were unable to recover it. 00:27:47.874 [2024-11-29 02:32:51.269657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.269739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.269764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.874 qpair failed and we were unable to recover it. 00:27:47.874 [2024-11-29 02:32:51.269878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.269954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.269980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.874 qpair failed and we were unable to recover it. 00:27:47.874 [2024-11-29 02:32:51.270080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.270153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.270178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.874 qpair failed and we were unable to recover it. 00:27:47.874 [2024-11-29 02:32:51.270290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.270403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.270428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.874 qpair failed and we were unable to recover it. 00:27:47.874 [2024-11-29 02:32:51.270545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.270667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.270692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.874 qpair failed and we were unable to recover it. 00:27:47.874 [2024-11-29 02:32:51.270779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.270861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.270886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.874 qpair failed and we were unable to recover it. 00:27:47.874 [2024-11-29 02:32:51.270971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.271058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.271082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.874 qpair failed and we were unable to recover it. 00:27:47.874 [2024-11-29 02:32:51.271178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.271292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.271317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.874 qpair failed and we were unable to recover it. 00:27:47.874 [2024-11-29 02:32:51.271405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.271489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.271515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.874 qpair failed and we were unable to recover it. 00:27:47.874 [2024-11-29 02:32:51.271602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.271712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.271737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.874 qpair failed and we were unable to recover it. 00:27:47.874 [2024-11-29 02:32:51.271824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.271934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.271958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.874 qpair failed and we were unable to recover it. 00:27:47.874 [2024-11-29 02:32:51.272077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.272164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.272189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.874 qpair failed and we were unable to recover it. 00:27:47.874 [2024-11-29 02:32:51.272270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.272350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.272375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.874 qpair failed and we were unable to recover it. 00:27:47.874 [2024-11-29 02:32:51.272467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.272546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.272570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.874 qpair failed and we were unable to recover it. 00:27:47.874 [2024-11-29 02:32:51.272685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.272774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.272800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.874 qpair failed and we were unable to recover it. 00:27:47.874 [2024-11-29 02:32:51.272893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.272968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.272992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.874 qpair failed and we were unable to recover it. 00:27:47.874 [2024-11-29 02:32:51.273085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.273202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.273226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.874 qpair failed and we were unable to recover it. 00:27:47.874 [2024-11-29 02:32:51.273338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.273431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.273457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.874 qpair failed and we were unable to recover it. 00:27:47.874 [2024-11-29 02:32:51.273571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.874 [2024-11-29 02:32:51.273682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.273706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.273824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.273912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.273936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.274029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.274113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.274137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.274217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.274331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.274357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.274465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.274542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.274568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.274660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.274745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.274769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.274877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.274956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.274985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.275138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.275218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.275243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.275324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.275441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.275466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.275560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.275644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.275669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.275752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.275835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.275861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.275980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.276098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.276124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.276211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.276288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.276312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.276412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.276501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.276525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.276609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.276719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.276743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.276853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.276934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.276960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.277080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.277165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.277190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.277276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.277360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.277385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.277507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.277655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.277679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.277762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.277877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.277902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.277995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.278085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.278111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.278230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.278337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.278362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.278463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.278546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.278570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.278662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.278781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.278806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.278888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.278976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.279001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.279115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.279200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.279226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.279313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.279418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.279445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.279550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.279627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.279652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.279763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.279874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.279898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.875 qpair failed and we were unable to recover it. 00:27:47.875 [2024-11-29 02:32:51.279988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.875 [2024-11-29 02:32:51.280077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.280102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.280212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.280324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.280350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.280453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.280541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.280566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.280656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.280733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.280757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.280878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.280990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.281014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.281103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.281182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.281207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.281292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.281405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.281430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.281520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.281602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.281626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.281710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.281828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.281852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.281931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.282015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.282043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.282129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.282276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.282301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.282401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.282480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.282508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.282634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.282716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.282740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.282860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.282947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.282972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.283090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.283170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.283196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.283274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.283362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.283387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.283499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.283583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.283607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.283725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.283804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.283828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.283914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.283992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.284023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.284117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.284233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.284258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.284336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.284441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.284466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.284580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.284668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.284694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.284786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.284898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.284923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.285033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.285175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.285200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.285310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.285423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.285448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.285530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.285643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.285667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.285750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.285843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.285868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.285958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.286040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.286065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.286144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.286231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.286255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.876 qpair failed and we were unable to recover it. 00:27:47.876 [2024-11-29 02:32:51.286344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.876 [2024-11-29 02:32:51.286437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.286463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.286550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.286630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.286655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.286736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.286817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.286841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.286958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.287094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.287120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.287210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.287354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.287379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.287471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.287550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.287576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.287662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.287743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.287768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.287867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.287948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.287973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.288066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.288147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.288171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.288252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.288366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.288390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.288527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.288609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.288634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.288747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.288830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.288854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.288966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.289081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.289105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.289217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.289297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.289323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.289419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.289531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.289556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.289652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.289770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.289797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.289883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.289969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.289993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.290118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.290198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.290222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.290305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.290397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.290423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.290518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.290632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.290657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.290753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.290837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.290862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.290988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.291070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.291095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.291189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.291276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.291300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.291391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.291495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.291520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.291604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.291716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.291741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.291870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.291954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.291978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.292063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.292204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.292228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.292315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.292454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.292480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.292596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.292682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.292706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.877 qpair failed and we were unable to recover it. 00:27:47.877 [2024-11-29 02:32:51.292800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.877 [2024-11-29 02:32:51.292908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.292933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.293046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.293201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.293227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.293318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.293428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.293454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.293565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.293654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.293679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.293766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.293853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.293877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.293997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.294073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.294097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.294189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.294273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.294297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.294381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.294476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.294502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.294615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.294700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.294725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.294838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.294951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.294976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.295068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.295155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.295179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.295270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.295343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.295372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.295481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.295599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.295624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.295746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.295836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.295860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.295947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.296030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.296056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.296154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.296265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.296290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.296387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.296472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.296496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.296577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.296662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.296686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.296802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.296912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.296936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.297026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.297140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.297165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.297247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.297324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.297348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.297442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.297560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.297586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.297677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.297786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.297812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.297922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.298014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.298038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.298136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.298249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.298274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.298361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.298481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.298506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.298595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.298711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.298736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.878 qpair failed and we were unable to recover it. 00:27:47.878 [2024-11-29 02:32:51.298848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.878 [2024-11-29 02:32:51.298927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.298951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.299041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.299123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.299148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.299232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.299319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.299345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.299432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.299547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.299572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.299689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.299770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.299796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.299886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.299998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.300022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.300104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.300213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.300238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.300319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.300423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.300449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.300537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.300652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.300677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.300764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.300843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.300867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.300948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.301055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.301080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.301162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.301243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.301267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.301351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.301472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.301499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.301585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.301698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.301723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.301813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.301891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.301915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.302004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.302087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.302112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.302226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.302335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.302360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.302489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.302601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.302627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.302715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.302799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.302824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.302913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.302997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.303021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.303101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.303184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.303209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.303300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.303380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.303411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.303529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.303611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.303636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.303723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.303835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.303859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.303942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.304033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.304058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.304172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.304260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.304286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.304375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.304493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.304518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.304603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.304681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.879 [2024-11-29 02:32:51.304708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.879 qpair failed and we were unable to recover it. 00:27:47.879 [2024-11-29 02:32:51.304837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.304920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.304945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.305026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.305140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.305165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.305262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.305377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.305409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.305524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.305605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.305629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.305740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.305831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.305855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.305950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.306028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.306052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.306164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.306243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.306268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.306385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.306501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.306534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.306627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.306708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.306733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.306822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.306961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.306986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.307104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.307186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.307211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.307326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.307421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.307447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.307527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.307637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.307663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.307782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.307860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.307884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.307979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.308066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.308092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.308212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.308309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.308333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.308419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.308501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.308525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.308637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.308715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.308740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.308859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.308943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.308969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.309093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.309181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.309207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.309303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.309405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.309431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.309516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.309601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.309628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.309740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.309819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.309844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.309958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.310049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.310074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.310157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.310240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.310264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.310377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.310465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.310490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.310602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.310694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.310718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.310815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.310901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.310925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.311010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.311092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.880 [2024-11-29 02:32:51.311116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.880 qpair failed and we were unable to recover it. 00:27:47.880 [2024-11-29 02:32:51.311215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.311299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.311326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.311417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.311501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.311526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.311612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.311724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.311750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.311829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.311939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.311964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.312079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.312172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.312196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.312287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.312368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.312399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.312490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.312566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.312591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.312676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.312759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.312783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.312905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.313015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.313040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.313123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.313210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.313234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.313377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.313470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.313495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.313580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.313671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.313696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.313807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.313893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.313918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.314001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.314077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.314101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.314197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.314280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.314305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.314404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.314513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.314538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.314630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.314737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.314762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.314849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.314930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.314955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.315079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.315163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.315187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.315303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.315414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.315443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.315536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.315617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.315642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.315724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.315814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.315838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.315946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.316022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.316047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.316141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.316220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.316249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.316333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.316414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.316439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.316557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.316645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.316670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.316748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.316837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.316862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.316981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.317070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.317095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.317176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.317251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.317276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.881 qpair failed and we were unable to recover it. 00:27:47.881 [2024-11-29 02:32:51.317368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.881 [2024-11-29 02:32:51.317468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.317493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.317586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.317691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.317715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.317815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.317895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.317919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.318032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.318146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.318171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.318281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.318404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.318430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.318518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.318604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.318629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.318776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.318864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.318888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.318985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.319062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.319088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.319175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.319265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.319291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.319389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.319476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.319501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.319621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.319705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.319730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.319815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.319931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.319957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.320072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.320152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.320176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.320261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.320348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.320373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.320499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.320585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.320610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.320696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.320786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.320810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.320902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.320985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.321009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.321092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.321178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.321202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.321288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.321427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.321453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.321535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.321624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.321650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.321747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.321886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.321911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.322028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.322114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.322138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.322224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.322312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.322337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.322460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.322542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.322567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.322650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.322729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.322754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.322874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.322953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.322979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.323094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.323184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.323209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.323293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.323380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.323412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.323518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.323602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.323626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.882 qpair failed and we were unable to recover it. 00:27:47.882 [2024-11-29 02:32:51.323711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.882 [2024-11-29 02:32:51.323789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.323814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.883 qpair failed and we were unable to recover it. 00:27:47.883 [2024-11-29 02:32:51.323912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.324026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.324052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.883 qpair failed and we were unable to recover it. 00:27:47.883 [2024-11-29 02:32:51.324137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.324255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.324280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.883 qpair failed and we were unable to recover it. 00:27:47.883 [2024-11-29 02:32:51.324357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.324446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.324471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.883 qpair failed and we were unable to recover it. 00:27:47.883 [2024-11-29 02:32:51.324588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.324681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.324706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.883 qpair failed and we were unable to recover it. 00:27:47.883 [2024-11-29 02:32:51.324790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.324907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.324932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.883 qpair failed and we were unable to recover it. 00:27:47.883 [2024-11-29 02:32:51.325022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.325106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.325133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.883 qpair failed and we were unable to recover it. 00:27:47.883 [2024-11-29 02:32:51.325247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.325325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.325350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.883 qpair failed and we were unable to recover it. 00:27:47.883 [2024-11-29 02:32:51.325448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.325536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.325560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.883 qpair failed and we were unable to recover it. 00:27:47.883 [2024-11-29 02:32:51.325643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.325760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.325785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.883 qpair failed and we were unable to recover it. 00:27:47.883 [2024-11-29 02:32:51.325876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.325961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.325985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.883 qpair failed and we were unable to recover it. 00:27:47.883 [2024-11-29 02:32:51.326102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.326215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.326239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.883 qpair failed and we were unable to recover it. 00:27:47.883 [2024-11-29 02:32:51.326349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.326435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.326465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.883 qpair failed and we were unable to recover it. 00:27:47.883 [2024-11-29 02:32:51.326550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.326629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.326653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.883 qpair failed and we were unable to recover it. 00:27:47.883 [2024-11-29 02:32:51.326745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.326825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.326849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.883 qpair failed and we were unable to recover it. 00:27:47.883 [2024-11-29 02:32:51.326957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.327070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.327095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.883 qpair failed and we were unable to recover it. 00:27:47.883 [2024-11-29 02:32:51.327203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.327278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.327302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.883 qpair failed and we were unable to recover it. 00:27:47.883 [2024-11-29 02:32:51.327389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.327503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.327529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.883 qpair failed and we were unable to recover it. 00:27:47.883 [2024-11-29 02:32:51.327617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.327732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.327757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.883 qpair failed and we were unable to recover it. 00:27:47.883 [2024-11-29 02:32:51.327850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.327935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.327959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.883 qpair failed and we were unable to recover it. 00:27:47.883 [2024-11-29 02:32:51.328051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.328157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.328181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.883 qpair failed and we were unable to recover it. 00:27:47.883 [2024-11-29 02:32:51.328296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.328439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.328465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.883 qpair failed and we were unable to recover it. 00:27:47.883 [2024-11-29 02:32:51.328553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.328658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.328683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.883 qpair failed and we were unable to recover it. 00:27:47.883 [2024-11-29 02:32:51.328778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.328887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.328912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.883 qpair failed and we were unable to recover it. 00:27:47.883 [2024-11-29 02:32:51.329021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.329133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.329158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.883 qpair failed and we were unable to recover it. 00:27:47.883 [2024-11-29 02:32:51.329238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.329323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.883 [2024-11-29 02:32:51.329347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.883 qpair failed and we were unable to recover it. 00:27:47.883 [2024-11-29 02:32:51.329442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.329556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.329581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.329666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.329742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.329767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.329864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.329981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.330005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.330093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.330204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.330229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.330312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.330423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.330448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.330529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.330641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.330666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.330750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.330832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.330857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.330955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.331066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.331090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.331177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.331287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.331311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.331431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.331510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.331534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.331620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.331734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.331759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.331847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.331932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.331956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.332076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.332157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.332181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.332265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.332347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.332372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.332492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.332609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.332635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.332750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.332832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.332856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.332967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.333104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.333128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.333227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.333314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.333338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.333423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.333511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.333535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.333654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.333763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.333788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.333902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.333984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.334008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.334108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.334197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.334223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.334336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.334418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.334444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.334558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.334638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.334664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.334790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.334903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.334927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.335016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.335099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.335125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.335221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.335300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.335325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.335411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.335533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.335559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.335648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.335728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.335754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.884 qpair failed and we were unable to recover it. 00:27:47.884 [2024-11-29 02:32:51.335868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.884 [2024-11-29 02:32:51.335982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.336007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.336133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.336239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.336265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.336381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.336497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.336523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.336641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.336726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.336751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.336839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.336955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.336980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.337062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.337155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.337181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.337294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.337374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.337413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.337510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.337588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.337613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.337702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.337788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.337818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.337941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.338022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.338047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.338130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.338214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.338240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.338364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.338452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.338477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.338560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.338677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.338701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.338788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.338868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.338892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.339008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.339103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.339129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.339240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.339321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.339346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.339429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.339512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.339537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.339629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.339747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.339772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.339865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.339951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.339976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.340072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.340153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.340178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.340290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.340401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.340427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.340515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.340595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.340622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.340739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.340850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.340876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.340963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.341073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.341099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.341196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.341279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.341303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.341447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.341524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.341549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.341633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.341750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.341777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.341863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.341974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.341999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.342110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.342193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.885 [2024-11-29 02:32:51.342218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.885 qpair failed and we were unable to recover it. 00:27:47.885 [2024-11-29 02:32:51.342334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.342425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.342451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.342536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.342618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.342643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.342727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.342806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.342831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.342929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.343010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.343034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.343115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.343226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.343252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.343332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.343416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.343441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.343533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.343622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.343647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.343746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.343834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.343857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.343940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.344016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.344040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.344123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.344201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.344226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.344311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.344397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.344422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.344506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.344596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.344620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.344700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.344792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.344818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.344905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.344997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.345023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.345109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.345220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.345245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.345360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.345451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.345476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.345567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.345656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.345681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.345769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.345878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.345902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.345988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.346104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.346130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.346215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.346301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.346327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.346432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.346543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.346573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.346657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.346773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.346799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.346883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.346963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.346988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.347104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.347186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.347211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.347293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.347373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.347404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.347517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.347604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.347630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.347713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.347802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.347826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.347909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.347995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.348020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.348134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.348224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.886 [2024-11-29 02:32:51.348249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.886 qpair failed and we were unable to recover it. 00:27:47.886 [2024-11-29 02:32:51.348333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.348432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.348457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.348546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.348632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.348657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.348744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.348855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.348880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.348996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.349106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.349131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.349214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.349304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.349329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.349418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.349496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.349521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.349603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.349686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.349710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.349809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.349890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.349915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.350008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.350091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.350115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.350198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.350281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.350306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.350383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.350474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.350499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.350587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.350676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.350701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.350788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.350897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.350921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.351004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.351092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.351118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.351199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.351282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.351306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.351390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.351482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.351509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.351591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.351678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.351702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.351794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.351870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.351896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.351977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.352059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.352084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.352169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.352275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.352301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.352423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.352515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.352539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.352620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.352731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.352756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.352853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.352960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.352986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.353133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.353219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.353243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.353322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.353403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.353430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.353529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.353616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.353641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.353742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.353825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.353850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.353963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.354045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.354070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.354153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.354267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.354293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.887 qpair failed and we were unable to recover it. 00:27:47.887 [2024-11-29 02:32:51.354389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.887 [2024-11-29 02:32:51.354523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.354551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.888 qpair failed and we were unable to recover it. 00:27:47.888 [2024-11-29 02:32:51.354666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.354775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.354801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.888 qpair failed and we were unable to recover it. 00:27:47.888 [2024-11-29 02:32:51.354890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.354980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.355004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.888 qpair failed and we were unable to recover it. 00:27:47.888 [2024-11-29 02:32:51.355114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.355203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.355228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.888 qpair failed and we were unable to recover it. 00:27:47.888 [2024-11-29 02:32:51.355315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.355404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.355430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.888 qpair failed and we were unable to recover it. 00:27:47.888 [2024-11-29 02:32:51.355526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.355605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.355630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.888 qpair failed and we were unable to recover it. 00:27:47.888 [2024-11-29 02:32:51.355712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.355795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.355820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.888 qpair failed and we were unable to recover it. 00:27:47.888 [2024-11-29 02:32:51.355900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.356009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.356033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.888 qpair failed and we were unable to recover it. 00:27:47.888 [2024-11-29 02:32:51.356126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.356236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.356262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.888 qpair failed and we were unable to recover it. 00:27:47.888 [2024-11-29 02:32:51.356358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.356445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.356472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.888 qpair failed and we were unable to recover it. 00:27:47.888 [2024-11-29 02:32:51.356566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.356656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.356680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.888 qpair failed and we were unable to recover it. 00:27:47.888 [2024-11-29 02:32:51.356769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.356849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.356874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.888 qpair failed and we were unable to recover it. 00:27:47.888 [2024-11-29 02:32:51.356959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.357098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.357123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.888 qpair failed and we were unable to recover it. 00:27:47.888 [2024-11-29 02:32:51.357237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.357348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.357377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.888 qpair failed and we were unable to recover it. 00:27:47.888 [2024-11-29 02:32:51.357472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.357553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.357578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.888 qpair failed and we were unable to recover it. 00:27:47.888 [2024-11-29 02:32:51.357697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.357780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.357805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.888 qpair failed and we were unable to recover it. 00:27:47.888 [2024-11-29 02:32:51.357952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.358028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.358054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.888 qpair failed and we were unable to recover it. 00:27:47.888 [2024-11-29 02:32:51.358147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.358227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.358251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.888 qpair failed and we were unable to recover it. 00:27:47.888 [2024-11-29 02:32:51.358331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.358415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.358441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.888 qpair failed and we were unable to recover it. 00:27:47.888 [2024-11-29 02:32:51.358527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.358647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.358671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.888 qpair failed and we were unable to recover it. 00:27:47.888 [2024-11-29 02:32:51.358756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.358846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.358871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.888 qpair failed and we were unable to recover it. 00:27:47.888 [2024-11-29 02:32:51.358984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.359096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.359120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.888 qpair failed and we were unable to recover it. 00:27:47.888 [2024-11-29 02:32:51.359203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.359294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.359319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.888 qpair failed and we were unable to recover it. 00:27:47.888 [2024-11-29 02:32:51.359403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.359483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.359508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.888 qpair failed and we were unable to recover it. 00:27:47.888 [2024-11-29 02:32:51.359597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.359686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.359711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.888 qpair failed and we were unable to recover it. 00:27:47.888 [2024-11-29 02:32:51.359825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.359905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.888 [2024-11-29 02:32:51.359929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.888 qpair failed and we were unable to recover it. 00:27:47.888 [2024-11-29 02:32:51.360047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.360155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.360180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.360304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.360383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.360413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.360526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.360606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.360631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.360740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.360823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.360849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.360958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.361069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.361094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.361211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.361322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.361348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.361470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.361557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.361582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.361666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.361752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.361777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.361871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.361955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.361981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.362073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.362153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.362178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.362261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.362340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.362365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.362478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.362570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.362596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.362678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.362756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.362780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.362896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.363008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.363033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.363132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.363229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.363254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.363339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.363421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.363445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.363525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.363610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.363636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.363752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.363864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.363890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.363976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.364091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.364117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.364210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.364325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.364350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.364437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.364517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.364542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.364630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.364742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.364768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.364848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.364934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.364960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.365072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.365154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.365179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.365259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.365345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.365370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.365478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.365591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.365616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.365703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.365783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.365808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.365893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.365983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.366008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.366095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.366184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.889 [2024-11-29 02:32:51.366209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.889 qpair failed and we were unable to recover it. 00:27:47.889 [2024-11-29 02:32:51.366308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.366427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.366453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.366540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.366621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.366647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.366761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.366844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.366869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.366949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.367058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.367083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.367188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.367272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.367296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.367379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.367493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.367518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.367599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.367726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.367762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.367862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.367945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.367970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.368051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.368200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.368224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.368325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.368437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.368468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.368553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.368642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.368666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.368760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.368847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.368874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.368967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.369054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.369080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.369228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.369324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.369349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.369492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.369582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.369607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.369693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.369791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.369815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.369912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.369993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.370018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.370129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.370210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.370234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.370317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.370426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.370454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.370600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.370710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.370735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.370840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.370949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.370974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.371066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.371177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.371203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.371290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.371400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.371426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.371514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.371598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.371623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.371743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.371832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.371857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.371939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.372063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.372088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.372177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.372259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.372284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.372384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.372483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.372509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.372599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.372684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.372709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.890 qpair failed and we were unable to recover it. 00:27:47.890 [2024-11-29 02:32:51.372807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.890 [2024-11-29 02:32:51.372884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.372909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.373027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.373115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.373140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.373234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.373318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.373343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.373437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.373546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.373571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.373667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.373805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.373830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.373909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.374020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.374046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.374138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.374252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.374277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.374363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.374455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.374481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.374570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.374657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.374682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.374764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.374871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.374896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.374987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.375068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.375092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.375175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.375263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.375288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.375377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.375483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.375509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.375588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.375679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.375714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.375832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.375924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.375948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.376058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.376139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.376164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.376252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.376373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.376406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.376491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.376579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.376604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.376708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.376795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.376820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.376944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.377058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.377094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.377181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.377297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.377322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.377416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.377505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.377534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.377618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.377693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.377723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.377823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.377938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.377973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.378094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.378179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.378205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.378291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.378374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.378416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.378503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.378597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.378622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.378704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.378797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.378822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.378913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.379002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.891 [2024-11-29 02:32:51.379027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.891 qpair failed and we were unable to recover it. 00:27:47.891 [2024-11-29 02:32:51.379107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.379189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.379215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.892 qpair failed and we were unable to recover it. 00:27:47.892 [2024-11-29 02:32:51.379310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.379409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.379434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.892 qpair failed and we were unable to recover it. 00:27:47.892 [2024-11-29 02:32:51.379550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.379630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.379654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.892 qpair failed and we were unable to recover it. 00:27:47.892 [2024-11-29 02:32:51.379771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.379867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.379892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.892 qpair failed and we were unable to recover it. 00:27:47.892 [2024-11-29 02:32:51.379975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.380062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.380086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.892 qpair failed and we were unable to recover it. 00:27:47.892 [2024-11-29 02:32:51.380243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.380325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.380350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.892 qpair failed and we were unable to recover it. 00:27:47.892 [2024-11-29 02:32:51.380469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.380585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.380610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.892 qpair failed and we were unable to recover it. 00:27:47.892 [2024-11-29 02:32:51.380733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.380862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.380888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.892 qpair failed and we were unable to recover it. 00:27:47.892 [2024-11-29 02:32:51.380970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.381060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.381084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.892 qpair failed and we were unable to recover it. 00:27:47.892 [2024-11-29 02:32:51.381176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.381268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.381293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.892 qpair failed and we were unable to recover it. 00:27:47.892 [2024-11-29 02:32:51.381383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.381506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.381531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.892 qpair failed and we were unable to recover it. 00:27:47.892 [2024-11-29 02:32:51.381618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.381716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.381740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.892 qpair failed and we were unable to recover it. 00:27:47.892 [2024-11-29 02:32:51.381884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.381970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.381995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.892 qpair failed and we were unable to recover it. 00:27:47.892 [2024-11-29 02:32:51.382096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.382222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.382246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.892 qpair failed and we were unable to recover it. 00:27:47.892 [2024-11-29 02:32:51.382337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.382437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.382462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.892 qpair failed and we were unable to recover it. 00:27:47.892 [2024-11-29 02:32:51.382580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.382664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.382688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.892 qpair failed and we were unable to recover it. 00:27:47.892 [2024-11-29 02:32:51.382788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.382878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.382902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.892 qpair failed and we were unable to recover it. 00:27:47.892 [2024-11-29 02:32:51.382991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.383076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.383101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.892 qpair failed and we were unable to recover it. 00:27:47.892 [2024-11-29 02:32:51.383195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.383273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.383298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.892 qpair failed and we were unable to recover it. 00:27:47.892 [2024-11-29 02:32:51.383419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.383521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.383547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.892 qpair failed and we were unable to recover it. 00:27:47.892 [2024-11-29 02:32:51.383666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.383791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.383815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.892 qpair failed and we were unable to recover it. 00:27:47.892 [2024-11-29 02:32:51.383897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.383982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.384009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.892 qpair failed and we were unable to recover it. 00:27:47.892 [2024-11-29 02:32:51.384099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.384212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.384238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.892 qpair failed and we were unable to recover it. 00:27:47.892 [2024-11-29 02:32:51.384327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.384443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.384469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.892 qpair failed and we were unable to recover it. 00:27:47.892 [2024-11-29 02:32:51.384556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.384640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.384665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.892 qpair failed and we were unable to recover it. 00:27:47.892 [2024-11-29 02:32:51.384748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.384833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.892 [2024-11-29 02:32:51.384858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.384970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.385076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.385102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.385184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.385302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.385327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.385438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.385528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.385553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.385637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.385731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.385755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.385878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.385974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.385998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.386118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.386201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.386225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.386336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.386454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.386481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.386580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.386669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.386695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.386824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.386910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.386934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.387015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.387104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.387134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.387246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.387321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.387346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.387477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.387574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.387598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.387683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.387825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.387849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.387974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.388052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.388076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.388156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.388274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.388299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.388385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.388490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.388514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.388608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.388698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.388725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.388809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.388886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.388915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.388997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.389093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.389127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.389246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.389362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.389387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.389488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.389575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.389599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.389682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.389808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.389833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.389937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.390045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.390069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.390154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.390268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.390294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.390412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.390497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.390522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.390621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.390701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.390727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.390816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.390947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.390973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.391053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.391135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.893 [2024-11-29 02:32:51.391160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.893 qpair failed and we were unable to recover it. 00:27:47.893 [2024-11-29 02:32:51.391248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.391331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.391357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.391449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.391534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.391560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.391641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.391749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.391774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.391861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.391970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.391996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.392080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.392163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.392188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.392284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.392369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.392401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.392491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.392570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.392595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.392675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.392817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.392842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.392965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.393048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.393073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.393197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.393291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.393317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.393416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.393528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.393553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.393675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.393792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.393818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.393933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.394082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.394107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.394195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.394276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.394301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.394426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.394510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.394534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.394643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.394727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.394752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.394866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.394946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.394972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.395052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.395171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.395197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.395322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.395416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.395442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.395527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.395611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.395636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.395759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.395844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.395868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.395982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.396068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.396095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.396176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.396273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.396297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.396385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.396472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.396496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.396608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.396688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.396724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.396834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.396948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.396973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.397058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.397140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.397165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.397266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.397406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.397432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.397515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.397600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.894 [2024-11-29 02:32:51.397625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.894 qpair failed and we were unable to recover it. 00:27:47.894 [2024-11-29 02:32:51.397722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.397832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.397856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.398000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.398084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.398109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.398187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.398273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.398298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.398378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.398473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.398498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.398612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.398695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.398725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.398811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.398950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.398976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.399062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.399189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.399214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.399304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.399387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.399418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.399534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.399646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.399670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.399797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.399874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.399899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.399988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.400081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.400106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.400185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.400273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.400301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.400415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.400535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.400560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.400642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.400735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.400760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.400844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.400967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.400993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.401089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.401201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.401226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.401322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.401402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.401429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.401517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.401606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.401631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.401725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.401810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.401835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.401926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.402035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.402060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.402175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.402253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.402278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.402365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.402481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.402507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.402601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.402679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.402704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.402830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.402948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.402974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.403059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.403171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.403197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.403282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.403365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.403391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.403480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.403573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.403599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.403714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.403820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.403845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.403931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.404016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.404042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.895 qpair failed and we were unable to recover it. 00:27:47.895 [2024-11-29 02:32:51.404154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.895 [2024-11-29 02:32:51.404275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.404299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.404385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.404484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.404509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.404591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.404671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.404696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.404813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.404924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.404953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.405039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.405156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.405182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.405263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.405373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.405415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.405506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.405592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.405617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.405709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.405802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.405827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.405946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.406041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.406066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.406178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.406266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.406291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.406415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.406496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.406521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.406603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.406691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.406727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.406811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.406898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.406922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.407012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.407100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.407124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.407206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.407312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.407337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.407424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.407535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.407559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.407644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.407742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.407766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.407851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.407973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.407998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.408083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.408174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.408200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.408289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.408410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.408436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.408525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.408604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.408630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.408744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.408825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.408851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.408959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.409043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.409068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.409152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.409231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.409259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.409345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.409467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.409493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.409579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.409688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.409712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.409805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.409922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.409946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.410036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.410117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.410142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.410238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.410318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.410343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.896 qpair failed and we were unable to recover it. 00:27:47.896 [2024-11-29 02:32:51.410429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.896 [2024-11-29 02:32:51.410508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.410532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.897 qpair failed and we were unable to recover it. 00:27:47.897 [2024-11-29 02:32:51.410612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.410692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.410717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.897 qpair failed and we were unable to recover it. 00:27:47.897 [2024-11-29 02:32:51.410801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.410913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.410940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.897 qpair failed and we were unable to recover it. 00:27:47.897 [2024-11-29 02:32:51.411032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.411122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.411147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.897 qpair failed and we were unable to recover it. 00:27:47.897 [2024-11-29 02:32:51.411231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.411346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.411371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.897 qpair failed and we were unable to recover it. 00:27:47.897 [2024-11-29 02:32:51.411535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.411620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.411646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.897 qpair failed and we were unable to recover it. 00:27:47.897 [2024-11-29 02:32:51.411788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.411884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.411909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.897 qpair failed and we were unable to recover it. 00:27:47.897 [2024-11-29 02:32:51.412029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.412137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.412162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.897 qpair failed and we were unable to recover it. 00:27:47.897 [2024-11-29 02:32:51.412245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.412319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.412343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.897 qpair failed and we were unable to recover it. 00:27:47.897 [2024-11-29 02:32:51.412430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.412517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.412543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.897 qpair failed and we were unable to recover it. 00:27:47.897 [2024-11-29 02:32:51.412662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.412752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.412777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.897 qpair failed and we were unable to recover it. 00:27:47.897 [2024-11-29 02:32:51.412862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.412979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.413004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.897 qpair failed and we were unable to recover it. 00:27:47.897 [2024-11-29 02:32:51.413093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.413209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.413234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.897 qpair failed and we were unable to recover it. 00:27:47.897 [2024-11-29 02:32:51.413317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.413434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.413460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.897 qpair failed and we were unable to recover it. 00:27:47.897 [2024-11-29 02:32:51.413543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.413633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.413658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.897 qpair failed and we were unable to recover it. 00:27:47.897 [2024-11-29 02:32:51.413746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.413858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.413883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.897 qpair failed and we were unable to recover it. 00:27:47.897 [2024-11-29 02:32:51.413975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.414055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.414079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.897 qpair failed and we were unable to recover it. 00:27:47.897 [2024-11-29 02:32:51.414171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.414253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.414277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.897 qpair failed and we were unable to recover it. 00:27:47.897 [2024-11-29 02:32:51.414362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.414461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.414487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.897 qpair failed and we were unable to recover it. 00:27:47.897 [2024-11-29 02:32:51.414571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.414654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.414679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.897 qpair failed and we were unable to recover it. 00:27:47.897 [2024-11-29 02:32:51.414771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.414853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.414877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.897 qpair failed and we were unable to recover it. 00:27:47.897 [2024-11-29 02:32:51.414959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.415044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.415068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.897 qpair failed and we were unable to recover it. 00:27:47.897 [2024-11-29 02:32:51.415152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.415238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.415262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.897 qpair failed and we were unable to recover it. 00:27:47.897 [2024-11-29 02:32:51.415350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.415437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.415462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.897 qpair failed and we were unable to recover it. 00:27:47.897 [2024-11-29 02:32:51.415551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.415640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.415665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.897 qpair failed and we were unable to recover it. 00:27:47.897 [2024-11-29 02:32:51.415793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.415873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.415897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.897 qpair failed and we were unable to recover it. 00:27:47.897 [2024-11-29 02:32:51.415980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.897 [2024-11-29 02:32:51.416096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.416120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.416210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.416293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.416318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.416409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.416529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.416554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.416636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.416755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.416780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.416873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.417017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.417042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.417158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.417242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.417266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.417353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.417451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.417476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.417558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.417642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.417667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.417763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.417874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.417905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.417993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.418078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.418103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.418223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.418314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.418338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.418489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.418575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.418601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.418693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.418786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.418811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.418897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.418980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.419004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.419098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.419180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.419205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.419288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.419422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.419448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.419535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.419616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.419640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.419761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.419844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.419868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.419966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.420049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.420074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.420194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.420274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.420303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.420399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.420482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.420506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.420596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.420683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.420717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.420798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.420881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.420906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.421018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.421130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.421156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.421237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.421317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.421342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.421434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.421523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.421548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.421632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.421755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.421780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.421896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.421986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.422010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.422098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.422191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.422218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.898 qpair failed and we were unable to recover it. 00:27:47.898 [2024-11-29 02:32:51.422304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.898 [2024-11-29 02:32:51.422430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.422456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.422548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.422657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.422682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.422778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.422865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.422889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.423001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.423116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.423141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.423226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.423310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.423334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.423436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.423516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.423542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.423662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.423766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.423792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.423878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.423954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.423979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.424069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.424150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.424175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.424286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.424367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.424407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.424519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.424605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.424631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.424755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.424835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.424860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.424953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.425033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.425057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.425136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.425220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.425244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.425323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.425449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.425476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.425564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.425654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.425679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.425773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.425866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.425892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.426012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.426089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.426125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.426214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.426297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.426322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.426425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.426506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.426531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.426621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.426709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.426734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.426822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.426917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.426942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.427053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.427138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.427163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.427246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.427363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.427388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.427485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.427596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.427621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.427711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.427792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.427816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.427899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.427984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.428008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.428101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.428183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.428207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.428297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.428381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.428416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.899 qpair failed and we were unable to recover it. 00:27:47.899 [2024-11-29 02:32:51.428501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.899 [2024-11-29 02:32:51.428642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.428667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.428788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.428876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.428902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.428986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.429069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.429093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.429186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.429305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.429330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.429459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.429550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.429576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.429662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.429804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.429829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.429947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.430032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.430056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.430140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.430248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.430273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.430384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.430475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.430501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.430614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.430760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.430785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.430885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.431005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.431030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.431111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.431189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.431214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.431327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.431418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.431448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.431536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.431647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.431672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.431765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.431848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.431875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.431996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.432080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.432105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.432200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.432279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.432307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.432418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.432527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.432553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.432673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.432751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.432778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.432863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.433002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.433028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.433109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.433195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.433219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.433311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.433432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.433457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.433549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.433639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.433666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.433768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.433855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.433879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.433965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.434076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.434101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.434217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.434324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.434349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.434463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.434549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.434576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.434700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.434792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.434818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.434931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.435043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.435068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.900 qpair failed and we were unable to recover it. 00:27:47.900 [2024-11-29 02:32:51.435185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.900 [2024-11-29 02:32:51.435266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.435291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.435381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.435481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.435507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.435602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.435730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.435755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.435900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.435983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.436008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.436100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.436183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.436207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.436292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.436408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.436434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.436532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.436613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.436638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.436736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.436820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.436849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.436950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.437033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.437057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.437152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.437239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.437266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.437346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.437443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.437469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.437562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.437719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.437745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.437833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.437913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.437938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.438028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.438141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.438165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.438256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.438342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.438367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.438468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.438561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.438585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.438713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.438795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.438820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.438919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.438999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.439023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.439133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.439251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.439277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.439400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.439518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.439543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.439661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.439745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.439771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.439856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.439970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.439996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.440089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.440173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.440197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.440312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.440405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.440431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.440520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.440605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.440636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.440730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.440808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.440832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.440922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.441033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.441059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.901 qpair failed and we were unable to recover it. 00:27:47.901 [2024-11-29 02:32:51.441149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.901 [2024-11-29 02:32:51.441292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.441317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.902 qpair failed and we were unable to recover it. 00:27:47.902 [2024-11-29 02:32:51.441418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.441502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.441527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.902 qpair failed and we were unable to recover it. 00:27:47.902 [2024-11-29 02:32:51.441617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.441710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.441735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.902 qpair failed and we were unable to recover it. 00:27:47.902 [2024-11-29 02:32:51.441820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.441930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.441955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.902 qpair failed and we were unable to recover it. 00:27:47.902 [2024-11-29 02:32:51.442034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.442144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.442168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.902 qpair failed and we were unable to recover it. 00:27:47.902 [2024-11-29 02:32:51.442252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.442333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.442357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.902 qpair failed and we were unable to recover it. 00:27:47.902 [2024-11-29 02:32:51.442451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.442536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.442561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.902 qpair failed and we were unable to recover it. 00:27:47.902 [2024-11-29 02:32:51.442654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.442746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.442771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.902 qpair failed and we were unable to recover it. 00:27:47.902 [2024-11-29 02:32:51.442872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.442985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.443010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.902 qpair failed and we were unable to recover it. 00:27:47.902 [2024-11-29 02:32:51.443122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.443196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.443220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.902 qpair failed and we were unable to recover it. 00:27:47.902 [2024-11-29 02:32:51.443300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.443389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.443442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.902 qpair failed and we were unable to recover it. 00:27:47.902 [2024-11-29 02:32:51.443525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.443624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.443649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.902 qpair failed and we were unable to recover it. 00:27:47.902 [2024-11-29 02:32:51.443733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.443812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.443838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.902 qpair failed and we were unable to recover it. 00:27:47.902 [2024-11-29 02:32:51.443934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.444044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.444069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.902 qpair failed and we were unable to recover it. 00:27:47.902 [2024-11-29 02:32:51.444153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.444237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.444262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.902 qpair failed and we were unable to recover it. 00:27:47.902 [2024-11-29 02:32:51.444375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.444472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.444497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.902 qpair failed and we were unable to recover it. 00:27:47.902 [2024-11-29 02:32:51.444596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.444679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.444709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.902 qpair failed and we were unable to recover it. 00:27:47.902 [2024-11-29 02:32:51.444826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.444909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.444934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.902 qpair failed and we were unable to recover it. 00:27:47.902 [2024-11-29 02:32:51.445021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.445102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.445127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.902 qpair failed and we were unable to recover it. 00:27:47.902 [2024-11-29 02:32:51.445223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.445314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.445339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.902 qpair failed and we were unable to recover it. 00:27:47.902 [2024-11-29 02:32:51.445431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.445546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.445572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.902 qpair failed and we were unable to recover it. 00:27:47.902 [2024-11-29 02:32:51.445655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.445731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.445757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.902 qpair failed and we were unable to recover it. 00:27:47.902 [2024-11-29 02:32:51.445836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.445918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.902 [2024-11-29 02:32:51.445943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.446058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.446178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.446203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.446285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.446436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.446461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.446580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.446687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.446713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.446807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.446893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.446918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.447032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.447151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.447177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.447269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.447350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.447375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.447481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.447559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.447585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.447669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.447757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.447782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.447870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.447950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.447976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.448056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.448166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.448191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.448307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.448388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.448419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.448506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.448585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.448611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.448704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.448791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.448815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.448928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.449010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.449035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.449118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.449202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.449226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.449309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.449408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.449435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.449526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.449614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.449641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.449753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.449869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.449895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.449980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.450058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.450083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.450197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.450281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.450306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.450424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.450513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.450538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.450655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.450765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.450790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.450876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.450986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.451011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.451104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.451192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.451218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.451301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.451391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.451421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.451509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.451591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.451620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.451715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.451793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.451818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.451901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.451975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.451999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.452088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.452206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.452231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.452311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.452430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.452456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.452575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.452685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.452710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.452862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.452943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.452967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.453061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.453137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.453161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.453239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.453325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.453350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.453468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.453545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.453569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.453653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.453801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.453827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.453915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.453996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.454020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.454128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.454219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.454243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.454335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.454428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.454454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.903 qpair failed and we were unable to recover it. 00:27:47.903 [2024-11-29 02:32:51.454537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.903 [2024-11-29 02:32:51.454615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.454640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.454728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.454840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.454865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.454979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.455091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.455116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.455209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.455292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.455319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.455424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.455511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.455535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.455617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.455698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.455724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.455811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.455923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.455949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.456035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.456116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.456140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.456218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.456330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.456354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.456443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.456552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.456576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.456668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.456785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.456810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.456898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.457007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.457032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.457113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.457197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.457221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.457343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.457436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.457463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.457580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.457670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.457695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.457818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.457929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.457954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.458037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.458123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.458147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.458262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.458353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.458378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.458474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.458617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.458642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.458729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.458844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.458871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.458985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.459066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.459091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.459188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.459267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.459291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.459379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.459500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.459525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.459604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.459728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.459753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.459878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.459958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.459983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.460075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.460192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.460216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.460297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.460412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.460437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.460561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.460646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.460670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.460767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.460846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.460871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.460987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.461069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.461093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.461209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.461320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.461345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.461436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.461525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.461549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.461640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.461723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.461748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.461834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.461923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.461947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.462043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.462158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.462183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.462271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.462354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.462379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.462488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.462572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.462598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.462719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.462802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.462831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.462971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.463082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.463107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.463192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.463305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.463329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.463425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.463508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.904 [2024-11-29 02:32:51.463533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.904 qpair failed and we were unable to recover it. 00:27:47.904 [2024-11-29 02:32:51.463636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.463747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.463771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.463855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.463995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.464019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.464131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.464218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.464242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.464328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.464438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.464464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.464565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.464645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.464671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.464763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.464878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.464903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.464986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.465071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.465095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.465181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.465259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.465283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.465409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.465504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.465529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.465620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.465752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.465777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.465888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.465971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.465996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.466088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.466168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.466192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.466282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.466407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.466433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.466530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.466608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.466632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.466727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.466808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.466832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.466918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.467030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.467055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.467132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.467241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.467267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.467364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.467464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.467488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.467569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.467681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.467705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.467851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.467926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.467950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.468048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.468135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.468160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.468244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.468358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.468382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.468511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.468603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.468628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.468719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.468825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.468850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.468938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.469021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.469045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.469135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.469247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.469271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.469389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.469495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.469519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.469608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.469693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.469717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.469827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.469933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.469958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.470048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.470192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.470216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.470307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.470383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.470436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.470520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.470608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.470635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.470737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.470818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.470843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.470939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.471028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.471059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.471154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.471239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.905 [2024-11-29 02:32:51.471264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.905 qpair failed and we were unable to recover it. 00:27:47.905 [2024-11-29 02:32:51.471367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.471463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.471488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.471588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.471668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.471692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.471810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.471891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.471921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.472011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.472120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.472146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.472243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.472329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.472353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.472441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.472559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.472583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.472674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.472755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.472779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.472894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.472978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.473002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.473090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.473199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.473225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.473336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.473430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.473456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.473552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.473631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.473655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.473740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.473819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.473844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.473932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.474020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.474044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.474129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.474241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.474266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.474390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.474525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.474549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.474637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.474752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.474778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.474862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.474975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.475000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.475093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.475179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.475203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.475295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.475374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.475404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.475520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.475597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.475624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.475719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 02:32:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:47.906 [2024-11-29 02:32:51.475808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.475832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 02:32:51 -- common/autotest_common.sh@862 -- # return 0 00:27:47.906 [2024-11-29 02:32:51.475925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.476010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.476035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 02:32:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.476129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 02:32:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:47.906 [2024-11-29 02:32:51.476208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.476233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 02:32:51 -- common/autotest_common.sh@10 -- # set +x 00:27:47.906 [2024-11-29 02:32:51.476327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.476417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.476442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.476523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.476633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.476658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.476773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.476881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.476906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.476997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.477113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.477138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.477220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.477337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.477361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.477452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.477536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.477562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.477657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.477745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.477769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.477850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.477963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.477990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.478070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.478149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.478173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.478291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.478398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.478424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.478514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.478595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.478620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.478719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.478799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.478825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.478907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.479047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.479071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.479157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.479268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.479293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.479376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.479465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-29 02:32:51.479490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-29 02:32:51.479572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.479662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.479687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.479779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.479887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.479913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.479996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.480110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.480134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.480221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.480307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.480332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.480429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.480525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.480554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.480649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.480737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.480763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.480855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.480936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.480961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.481048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.481143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.481167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.481281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.481418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.481447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.481532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.481624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.481650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.481770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.481854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.481878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.481971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.482053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.482080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.482164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.482262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.482286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.482371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.482482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.482507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.482604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.482715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.482740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.482859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.482971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.482996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.483082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.483192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.483218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.483307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.483389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.483420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.483538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.483626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.483651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.483767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.483855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.483880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.483992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.484111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.484136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.484224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.484308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.484332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.484448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.484528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.484552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.484638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.484762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.484788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.484901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.485011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.485036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.485130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.485212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.485238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.485319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.485445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.485470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.485558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.485634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.485659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.485758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.485849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.485874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.485984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.486079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.486103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.486213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.486334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.486359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.486458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.486547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.486572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.486660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.486815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.486840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.486955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.487047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.487072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.487157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.487265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.487290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.487404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.487502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.487528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.487633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.487722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.487746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.487829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.487904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.487930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.488025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.488113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.488137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.488222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.488315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.488340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-29 02:32:51.488441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.488537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-29 02:32:51.488562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.488645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.488792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.488818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.488911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.489049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.489074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.489199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.489310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.489335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.489428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.489546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.489571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.489671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.489817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.489848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.489967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.490055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.490080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.490174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.490258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.490282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.490362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.490510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.490536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.490658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.490744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.490769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.490893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.490979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.491006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.491123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.491235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.491261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.491349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.491468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.491493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.491583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.491663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.491687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.491775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.491862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.491888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.491976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.492067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.492093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.492185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.492267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.492291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.492377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.492491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.492517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.492640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.492760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.492785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.492866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.492950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.492975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.493066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.493162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.493187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.493273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.493358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.493382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.493483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.493564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.493589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.493687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.493796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.493823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.493908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.494023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.494048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.494162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.494253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.494277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.494373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.494517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.494544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.494632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.494753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.494778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.494859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.494969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.494993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.495079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.495219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.495244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.495325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.495434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.495465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.495551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.495642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.495667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.495789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.495868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.495893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.496002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.496080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.496105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.496198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.496283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.496307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.496415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.496502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.496526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.496611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.496696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.496721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-29 02:32:51.496833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-29 02:32:51.496921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.496945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.497061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.497148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.497174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.497254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.497337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.497363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 02:32:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.497520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 02:32:51 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:47.909 [2024-11-29 02:32:51.497618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.497648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.497753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 02:32:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:47.909 [2024-11-29 02:32:51.497841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.497870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.497998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 02:32:51 -- common/autotest_common.sh@10 -- # set +x 00:27:47.909 [2024-11-29 02:32:51.498116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.498144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.498235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.498346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.498372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.498489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.498604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.498628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.498714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.498796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.498825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.498915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.499054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.499079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.499164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.499254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.499280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.499374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.499475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.499501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.499584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.499663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.499687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.499774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.499862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.499886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.499973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.500085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.500109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.500200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.500290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.500315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.500427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.500511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.500536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.500628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.500714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.500740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.500824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.500912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.500941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.501084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.501164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.501189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.501283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.501367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.501397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.501490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.501569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.501594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.501674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.501760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.501785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.501907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.501989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.502013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.502093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.502174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.502198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.502279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.502397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.502422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.502516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.502608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.502632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.502721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.502807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.502831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.502923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.503032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.503057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.503160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.503290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.503315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.503417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.503507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.503532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.503625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.503708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.503733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.503820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.503927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.503951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.504081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.504170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.504194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.504279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.504405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.504430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.504524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.504620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.504645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.504734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.504811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.504836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.504920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.505012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.505037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.505153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.505243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-29 02:32:51.505267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-29 02:32:51.505403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-29 02:32:51.505521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-29 02:32:51.505552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-29 02:32:51.505642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-29 02:32:51.505748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-29 02:32:51.505774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-29 02:32:51.505904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-29 02:32:51.506000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-29 02:32:51.506027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-29 02:32:51.506125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-29 02:32:51.506208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-29 02:32:51.506234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-29 02:32:51.506340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-29 02:32:51.506446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.506474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 02:32:51.506579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.506667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.506694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 02:32:51.506792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.506903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.506929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 02:32:51.507011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.507095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.507121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 02:32:51.507210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.507298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.507324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 02:32:51.507437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.507565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.507591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc05c000b90 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 02:32:51.507642] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfc1600 (9): Bad file descriptor 00:27:48.174 [2024-11-29 02:32:51.507830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.507967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.507997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 02:32:51.508097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.508192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.508220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 02:32:51.508314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.508416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.508444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 02:32:51.508544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.508630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.508656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 02:32:51.508758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.508866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.508894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 02:32:51.508988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.509070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.509095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 02:32:51.509183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.509291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.509317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 02:32:51.509436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.509534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.509561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 02:32:51.509654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.509751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.509778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 02:32:51.509878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.509969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.509996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 02:32:51.510091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.510177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.510203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 02:32:51.510294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.510382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.510416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 02:32:51.510529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.510616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.510642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 02:32:51.510744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.510831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.510857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 02:32:51.510948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.511036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.511063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 02:32:51.511158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.511242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.511267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 02:32:51.511382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.511516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.511542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 02:32:51.511624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 02:32:51.511750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.511777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 02:32:51.511868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.511952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.511978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 02:32:51.512092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.512178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.512204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 02:32:51.512326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.512418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.512446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 02:32:51.512536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.512621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.512646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 02:32:51.512740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.512864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.512889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 02:32:51.512977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.513062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.513089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 02:32:51.513176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.513263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.513289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 02:32:51.513401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.513490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.513516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 02:32:51.513631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.513715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.513740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 02:32:51.513854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.513939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.513966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 02:32:51.514100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.514185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.514210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 02:32:51.514328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.514412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.514438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 02:32:51.514541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.514627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.514654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 02:32:51.514782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.514869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.514894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 02:32:51.514982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.515076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.515101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 02:32:51.515185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.515268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.515294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 02:32:51.515381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.515500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.515525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 02:32:51.515645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.515733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.515761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 02:32:51.515849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.515937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.515963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 02:32:51.516059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.516169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.516195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 02:32:51.516290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.516366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.516400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 02:32:51.516530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.516616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.516642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 02:32:51.516768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.516854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.516880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 02:32:51.516996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.517083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.517108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 02:32:51.517229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.517347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.517373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc060000b90 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 02:32:51.517499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.517604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 02:32:51.517633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.517764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.517855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.517881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.518002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.518088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.518113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.518242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.518357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.518381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.518516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.518601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.518628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.518716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.518837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.518862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.518958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.519070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.519095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.519180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.519272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.519297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.519383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.519482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.519507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.519605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.519756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.519781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.519862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.519951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.519978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.520092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.520175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.520200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.520315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.520399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.520425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.520515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.520600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.520625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.520707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.520822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.520846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.520962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.521046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.521072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.521157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.521272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.521297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.521410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.521503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.521538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.521623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.521737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.521763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.521878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.521973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.521998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.522084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.522170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.522195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.522283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.522362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.522386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.522499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.522581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.522605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.522691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.522776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.522803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.522883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.522958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.522983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.523107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.523196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.523221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.523301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.523409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.523435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.523530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.523617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.523651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.523736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.523819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.523844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 02:32:51.523938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 02:32:51.524024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.524049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 02:32:51.524140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.524259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.524285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 02:32:51.524374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.524471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.524495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 02:32:51.524582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.524675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.524700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 02:32:51.524796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 Malloc0 00:27:48.177 [2024-11-29 02:32:51.524876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.524901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 02:32:51.524985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.525074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.525099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 02:32:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:48.177 [2024-11-29 02:32:51.525192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.525275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.525300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 02:32:51 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:48.177 [2024-11-29 02:32:51.525399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 02:32:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:48.177 [2024-11-29 02:32:51.525496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.525521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 02:32:51 -- common/autotest_common.sh@10 -- # set +x 00:27:48.177 [2024-11-29 02:32:51.525607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.525701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.525725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 02:32:51.525815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.525894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.525918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 02:32:51.526004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.526115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.526140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 02:32:51.526268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.526382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.526415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 02:32:51.526505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.526593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.526618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 02:32:51.526735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.526819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.526844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 02:32:51.526929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.527070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.527095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 02:32:51.527215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.527323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.527348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 02:32:51.527434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.527524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.527550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 02:32:51.527644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.527745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.527770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 02:32:51.527883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.527970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.527995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 02:32:51.528086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.528167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.528192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 02:32:51.528286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.528365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.528390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 02:32:51.528455] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:48.177 [2024-11-29 02:32:51.528502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.528595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.528619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 02:32:51.528700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.528813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.528837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 02:32:51.528930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.529013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.529038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 02:32:51.529118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.529203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.529228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 02:32:51.529343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.529426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.529455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 02:32:51.529542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.529623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.529648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 02:32:51.529737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.529883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 02:32:51.529908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 02:32:51.530024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.530112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.530138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 02:32:51.530218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.530300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.530325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 02:32:51.530420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.530516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.530541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 02:32:51.530624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.530706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.530731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 02:32:51.530827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.530921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.530947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 02:32:51.531038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.531147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.531172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 02:32:51.531261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.531344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.531370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 02:32:51.531480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.531562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.531588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 02:32:51.531670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.531762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.531788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 02:32:51.531889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.531978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.532004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 02:32:51.532116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.532199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.532228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 02:32:51.532318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.532416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.532442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 02:32:51.532529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.532608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.532633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 02:32:51.532718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.532811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.532839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 02:32:51.532932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.533014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.533039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 02:32:51.533129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.533224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.533249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 02:32:51.533346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.533459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.533485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 02:32:51.533566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.533682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.533708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 02:32:51.533792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.533871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.533897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 02:32:51.533983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.534062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.534086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 02:32:51.534201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.534292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.534317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 02:32:51.534438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.534524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 02:32:51.534548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 02:32:51.534644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.534761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.534785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 02:32:51.534873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.534986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.535012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 02:32:51.535098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.535180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.535205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 02:32:51.535316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.535403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.535429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 02:32:51.535514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.535608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.535634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 02:32:51.535747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.535831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.535855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 02:32:51.535950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.536059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.536083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 02:32:51.536173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.536282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.536307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 02:32:51.536402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.536496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.536521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 02:32:51.536619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 02:32:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:48.179 [2024-11-29 02:32:51.536710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.536736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 02:32:51 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:48.179 [2024-11-29 02:32:51.536850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 02:32:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:48.179 [2024-11-29 02:32:51.536957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.536982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 02:32:51 -- common/autotest_common.sh@10 -- # set +x 00:27:48.179 [2024-11-29 02:32:51.537071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.537182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.537207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 02:32:51.537291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.537371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.537401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 02:32:51.537496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.537611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.537636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 02:32:51.537761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.537846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.537873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 02:32:51.537961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.538046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.538070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 02:32:51.538163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.538245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.538270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 02:32:51.538418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.538520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.538545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 02:32:51.538633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.538722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.538752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 02:32:51.538851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.538968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.538992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 02:32:51.539083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.539191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.539216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 02:32:51.539301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.539416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.539442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 02:32:51.539521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.539627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.539652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 02:32:51.539763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.539851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.539876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 02:32:51.539969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.540056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.540080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 02:32:51.540191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.540279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.540305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 02:32:51.540397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.540485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.540510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 02:32:51.540602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.540718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 02:32:51.540744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 02:32:51.540831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.540948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.540974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 02:32:51.541092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.541178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.541202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 02:32:51.541321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.541410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.541435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 02:32:51.541521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.541608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.541633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 02:32:51.541719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.541808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.541833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 02:32:51.541946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.542029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.542054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 02:32:51.542138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.542227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.542254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 02:32:51.542339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.542461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.542487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 02:32:51.542571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.542657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.542682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 02:32:51.542793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.542878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.542905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 02:32:51.542996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.543109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.543134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 02:32:51.543225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.543304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.543330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 02:32:51.543416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.543512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.543538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 02:32:51.543651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.543749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.543775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 02:32:51.543890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.543973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.543998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 02:32:51.544094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.544205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.544231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 02:32:51.544315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.544455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.544481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 02:32:51.544565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.544648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.544673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 02:32:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:48.180 [2024-11-29 02:32:51.544765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 02:32:51 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:48.180 [2024-11-29 02:32:51.544876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.544902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 02:32:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:48.180 [2024-11-29 02:32:51.545021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 02:32:51 -- common/autotest_common.sh@10 -- # set +x 00:27:48.180 [2024-11-29 02:32:51.545110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.545134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 02:32:51.545218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.545334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.545360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 02:32:51.545459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.545550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.545575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 02:32:51.545667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.545785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.545810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 02:32:51.545891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.546005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.546030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 02:32:51.546116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.546206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.546232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 02:32:51.546344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.546430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.546456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 02:32:51.546548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.546670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.546694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 02:32:51.546782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.546898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 02:32:51.546923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.547011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.547095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.547121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.547205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.547319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.547344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.547425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.547548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.547578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.547676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.547766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.547791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.547881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.547969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.547994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.548083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.548166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.548192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.548304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.548381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.548411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.548503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.548589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.548614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.548735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.548814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.548839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.548931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.549017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.549041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.549158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.549243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.549268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.549356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.549443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.549467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.549561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.549643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.549669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.549767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.549849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.549874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.549961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.550037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.550061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.550176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.550265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.550292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.550381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.550528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.550553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.550641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.550750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.550774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.550861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.550976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.551003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.551117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.551205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.551230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.551321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.551433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.551459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.551547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.551638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.551661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.551745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.551820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.551845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.551971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.552056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.552081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.552175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.552314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.552339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.552423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.552538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.552563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 02:32:51.552651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 02:32:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:48.181 [2024-11-29 02:32:51.552762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 02:32:51.552787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 02:32:51 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:48.181 [2024-11-29 02:32:51.552870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 02:32:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:48.182 [2024-11-29 02:32:51.552961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.552985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 02:32:51 -- common/autotest_common.sh@10 -- # set +x 00:27:48.182 [2024-11-29 02:32:51.553064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.553182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.553208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 02:32:51.553288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.553406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.553432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 02:32:51.553513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.553598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.553622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 02:32:51.553711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.553797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.553823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 02:32:51.553945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.554054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.554086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 02:32:51.554208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.554324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.554349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 02:32:51.554451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.554542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.554567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 02:32:51.554656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.554773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.554798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 02:32:51.554882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.554969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.554995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 02:32:51.555082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.555197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.555223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 02:32:51.555342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.555454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.555481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 02:32:51.555573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.555688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.555713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 02:32:51.555800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.555890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.555916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 02:32:51.556040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.556124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.556150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 02:32:51.556265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.556353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.556378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfb3cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 02:32:51.556482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 02:32:51.556698] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:48.182 [2024-11-29 02:32:51.559409] posix.c: 670:posix_sock_psk_use_session_client_cb: *ERROR*: PSK is not set 00:27:48.182 [2024-11-29 02:32:51.559476] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfb3cb0 (107): Transport endpoint is not connected 00:27:48.182 [2024-11-29 02:32:51.559557] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 02:32:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:48.182 02:32:51 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:48.182 02:32:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:48.182 02:32:51 -- common/autotest_common.sh@10 -- # set +x 00:27:48.182 02:32:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:48.182 02:32:51 -- host/target_disconnect.sh@58 -- # wait 239046 00:27:48.182 [2024-11-29 02:32:51.569131] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.182 [2024-11-29 02:32:51.569255] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.182 [2024-11-29 02:32:51.569283] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.182 [2024-11-29 02:32:51.569299] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.182 [2024-11-29 02:32:51.569313] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.182 [2024-11-29 02:32:51.569341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 02:32:51.579071] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.182 [2024-11-29 02:32:51.579184] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.182 [2024-11-29 02:32:51.579211] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.182 [2024-11-29 02:32:51.579225] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.182 [2024-11-29 02:32:51.579238] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.182 [2024-11-29 02:32:51.579268] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 02:32:51.589040] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.182 [2024-11-29 02:32:51.589135] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.182 [2024-11-29 02:32:51.589161] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.182 [2024-11-29 02:32:51.589175] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.182 [2024-11-29 02:32:51.589188] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.182 [2024-11-29 02:32:51.589216] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 02:32:51.599014] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.182 [2024-11-29 02:32:51.599112] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.182 [2024-11-29 02:32:51.599138] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.182 [2024-11-29 02:32:51.599153] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.182 [2024-11-29 02:32:51.599167] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.182 [2024-11-29 02:32:51.599196] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 02:32:51.609037] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.182 [2024-11-29 02:32:51.609129] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.182 [2024-11-29 02:32:51.609155] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.182 [2024-11-29 02:32:51.609170] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.183 [2024-11-29 02:32:51.609183] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.183 [2024-11-29 02:32:51.609211] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 02:32:51.619049] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.183 [2024-11-29 02:32:51.619135] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.183 [2024-11-29 02:32:51.619160] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.183 [2024-11-29 02:32:51.619174] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.183 [2024-11-29 02:32:51.619187] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.183 [2024-11-29 02:32:51.619216] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 02:32:51.629071] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.183 [2024-11-29 02:32:51.629169] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.183 [2024-11-29 02:32:51.629198] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.183 [2024-11-29 02:32:51.629215] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.183 [2024-11-29 02:32:51.629228] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.183 [2024-11-29 02:32:51.629257] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 02:32:51.639115] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.183 [2024-11-29 02:32:51.639204] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.183 [2024-11-29 02:32:51.639230] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.183 [2024-11-29 02:32:51.639245] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.183 [2024-11-29 02:32:51.639263] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.183 [2024-11-29 02:32:51.639292] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 02:32:51.649104] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.183 [2024-11-29 02:32:51.649193] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.183 [2024-11-29 02:32:51.649219] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.183 [2024-11-29 02:32:51.649233] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.183 [2024-11-29 02:32:51.649246] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.183 [2024-11-29 02:32:51.649275] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 02:32:51.659138] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.183 [2024-11-29 02:32:51.659224] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.183 [2024-11-29 02:32:51.659250] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.183 [2024-11-29 02:32:51.659265] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.183 [2024-11-29 02:32:51.659278] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.183 [2024-11-29 02:32:51.659306] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 02:32:51.669177] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.183 [2024-11-29 02:32:51.669272] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.183 [2024-11-29 02:32:51.669298] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.183 [2024-11-29 02:32:51.669312] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.183 [2024-11-29 02:32:51.669325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.183 [2024-11-29 02:32:51.669353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 02:32:51.679228] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.183 [2024-11-29 02:32:51.679318] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.183 [2024-11-29 02:32:51.679347] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.183 [2024-11-29 02:32:51.679364] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.183 [2024-11-29 02:32:51.679377] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.183 [2024-11-29 02:32:51.679416] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 02:32:51.689334] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.183 [2024-11-29 02:32:51.689465] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.183 [2024-11-29 02:32:51.689491] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.183 [2024-11-29 02:32:51.689506] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.183 [2024-11-29 02:32:51.689519] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.183 [2024-11-29 02:32:51.689547] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 02:32:51.699317] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.183 [2024-11-29 02:32:51.699412] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.183 [2024-11-29 02:32:51.699438] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.183 [2024-11-29 02:32:51.699453] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.183 [2024-11-29 02:32:51.699466] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.183 [2024-11-29 02:32:51.699494] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 02:32:51.709334] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.183 [2024-11-29 02:32:51.709476] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.183 [2024-11-29 02:32:51.709502] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.183 [2024-11-29 02:32:51.709517] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.183 [2024-11-29 02:32:51.709530] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.183 [2024-11-29 02:32:51.709558] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 02:32:51.719449] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.183 [2024-11-29 02:32:51.719544] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.183 [2024-11-29 02:32:51.719568] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.183 [2024-11-29 02:32:51.719583] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.184 [2024-11-29 02:32:51.719597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.184 [2024-11-29 02:32:51.719625] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.184 qpair failed and we were unable to recover it. 00:27:48.184 [2024-11-29 02:32:51.729347] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.184 [2024-11-29 02:32:51.729443] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.184 [2024-11-29 02:32:51.729468] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.184 [2024-11-29 02:32:51.729483] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.184 [2024-11-29 02:32:51.729502] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.184 [2024-11-29 02:32:51.729531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.184 qpair failed and we were unable to recover it. 00:27:48.184 [2024-11-29 02:32:51.739400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.184 [2024-11-29 02:32:51.739497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.184 [2024-11-29 02:32:51.739522] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.184 [2024-11-29 02:32:51.739537] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.184 [2024-11-29 02:32:51.739550] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.184 [2024-11-29 02:32:51.739578] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.184 qpair failed and we were unable to recover it. 00:27:48.184 [2024-11-29 02:32:51.749439] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.184 [2024-11-29 02:32:51.749536] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.184 [2024-11-29 02:32:51.749565] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.184 [2024-11-29 02:32:51.749583] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.184 [2024-11-29 02:32:51.749597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.184 [2024-11-29 02:32:51.749627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.184 qpair failed and we were unable to recover it. 00:27:48.184 [2024-11-29 02:32:51.759448] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.184 [2024-11-29 02:32:51.759539] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.184 [2024-11-29 02:32:51.759565] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.184 [2024-11-29 02:32:51.759580] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.184 [2024-11-29 02:32:51.759594] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.184 [2024-11-29 02:32:51.759623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.184 qpair failed and we were unable to recover it. 00:27:48.184 [2024-11-29 02:32:51.769450] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.184 [2024-11-29 02:32:51.769545] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.184 [2024-11-29 02:32:51.769570] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.184 [2024-11-29 02:32:51.769584] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.184 [2024-11-29 02:32:51.769597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.184 [2024-11-29 02:32:51.769626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.184 qpair failed and we were unable to recover it. 00:27:48.184 [2024-11-29 02:32:51.779502] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.184 [2024-11-29 02:32:51.779600] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.184 [2024-11-29 02:32:51.779633] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.184 [2024-11-29 02:32:51.779656] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.184 [2024-11-29 02:32:51.779677] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.184 [2024-11-29 02:32:51.779717] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.184 qpair failed and we were unable to recover it. 00:27:48.184 [2024-11-29 02:32:51.789529] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.184 [2024-11-29 02:32:51.789621] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.184 [2024-11-29 02:32:51.789648] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.184 [2024-11-29 02:32:51.789663] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.184 [2024-11-29 02:32:51.789677] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.184 [2024-11-29 02:32:51.789707] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.184 qpair failed and we were unable to recover it. 00:27:48.184 [2024-11-29 02:32:51.799542] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.184 [2024-11-29 02:32:51.799635] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.184 [2024-11-29 02:32:51.799660] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.184 [2024-11-29 02:32:51.799674] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.184 [2024-11-29 02:32:51.799688] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.184 [2024-11-29 02:32:51.799716] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.184 qpair failed and we were unable to recover it. 00:27:48.184 [2024-11-29 02:32:51.809580] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.184 [2024-11-29 02:32:51.809667] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.184 [2024-11-29 02:32:51.809692] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.184 [2024-11-29 02:32:51.809707] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.184 [2024-11-29 02:32:51.809723] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.184 [2024-11-29 02:32:51.809756] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.184 qpair failed and we were unable to recover it. 00:27:48.184 [2024-11-29 02:32:51.819624] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.184 [2024-11-29 02:32:51.819719] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.184 [2024-11-29 02:32:51.819744] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.184 [2024-11-29 02:32:51.819765] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.184 [2024-11-29 02:32:51.819780] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.184 [2024-11-29 02:32:51.819808] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.184 qpair failed and we were unable to recover it. 00:27:48.184 [2024-11-29 02:32:51.829643] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.184 [2024-11-29 02:32:51.829736] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.184 [2024-11-29 02:32:51.829761] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.184 [2024-11-29 02:32:51.829776] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.184 [2024-11-29 02:32:51.829789] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.184 [2024-11-29 02:32:51.829817] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.184 qpair failed and we were unable to recover it. 00:27:48.184 [2024-11-29 02:32:51.839657] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.184 [2024-11-29 02:32:51.839747] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.184 [2024-11-29 02:32:51.839773] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.184 [2024-11-29 02:32:51.839787] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.184 [2024-11-29 02:32:51.839800] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.184 [2024-11-29 02:32:51.839829] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.184 qpair failed and we were unable to recover it. 00:27:48.444 [2024-11-29 02:32:51.849700] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.444 [2024-11-29 02:32:51.849791] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.444 [2024-11-29 02:32:51.849816] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.444 [2024-11-29 02:32:51.849831] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.444 [2024-11-29 02:32:51.849846] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.444 [2024-11-29 02:32:51.849879] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.444 qpair failed and we were unable to recover it. 00:27:48.444 [2024-11-29 02:32:51.859715] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.444 [2024-11-29 02:32:51.859797] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.444 [2024-11-29 02:32:51.859823] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.444 [2024-11-29 02:32:51.859838] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.444 [2024-11-29 02:32:51.859851] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:48.444 [2024-11-29 02:32:51.859879] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:48.444 qpair failed and we were unable to recover it. 00:27:48.444 [2024-11-29 02:32:51.869769] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.444 [2024-11-29 02:32:51.869874] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.444 [2024-11-29 02:32:51.869906] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.444 [2024-11-29 02:32:51.869922] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.444 [2024-11-29 02:32:51.869936] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.444 [2024-11-29 02:32:51.869967] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.444 qpair failed and we were unable to recover it. 00:27:48.444 [2024-11-29 02:32:51.879794] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.444 [2024-11-29 02:32:51.879888] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.444 [2024-11-29 02:32:51.879915] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.444 [2024-11-29 02:32:51.879930] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.444 [2024-11-29 02:32:51.879944] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.444 [2024-11-29 02:32:51.879975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.444 qpair failed and we were unable to recover it. 00:27:48.444 [2024-11-29 02:32:51.889851] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.444 [2024-11-29 02:32:51.889943] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.444 [2024-11-29 02:32:51.889969] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.444 [2024-11-29 02:32:51.889985] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.444 [2024-11-29 02:32:51.889998] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.445 [2024-11-29 02:32:51.890028] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.445 qpair failed and we were unable to recover it. 00:27:48.445 [2024-11-29 02:32:51.899837] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.445 [2024-11-29 02:32:51.899926] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.445 [2024-11-29 02:32:51.899952] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.445 [2024-11-29 02:32:51.899967] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.445 [2024-11-29 02:32:51.899980] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.445 [2024-11-29 02:32:51.900009] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.445 qpair failed and we were unable to recover it. 00:27:48.445 [2024-11-29 02:32:51.909881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.445 [2024-11-29 02:32:51.909973] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.445 [2024-11-29 02:32:51.910000] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.445 [2024-11-29 02:32:51.910022] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.445 [2024-11-29 02:32:51.910036] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.445 [2024-11-29 02:32:51.910066] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.445 qpair failed and we were unable to recover it. 00:27:48.445 [2024-11-29 02:32:51.919885] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.445 [2024-11-29 02:32:51.919977] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.445 [2024-11-29 02:32:51.920003] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.445 [2024-11-29 02:32:51.920018] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.445 [2024-11-29 02:32:51.920031] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.445 [2024-11-29 02:32:51.920060] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.445 qpair failed and we were unable to recover it. 00:27:48.445 [2024-11-29 02:32:51.929921] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.445 [2024-11-29 02:32:51.930008] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.445 [2024-11-29 02:32:51.930034] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.445 [2024-11-29 02:32:51.930048] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.445 [2024-11-29 02:32:51.930061] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.445 [2024-11-29 02:32:51.930091] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.445 qpair failed and we were unable to recover it. 00:27:48.445 [2024-11-29 02:32:51.939976] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.445 [2024-11-29 02:32:51.940071] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.445 [2024-11-29 02:32:51.940101] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.445 [2024-11-29 02:32:51.940116] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.445 [2024-11-29 02:32:51.940129] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.445 [2024-11-29 02:32:51.940161] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.445 qpair failed and we were unable to recover it. 00:27:48.445 [2024-11-29 02:32:51.950006] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.445 [2024-11-29 02:32:51.950131] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.445 [2024-11-29 02:32:51.950157] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.445 [2024-11-29 02:32:51.950172] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.445 [2024-11-29 02:32:51.950186] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.445 [2024-11-29 02:32:51.950217] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.445 qpair failed and we were unable to recover it. 00:27:48.445 [2024-11-29 02:32:51.960041] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.445 [2024-11-29 02:32:51.960130] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.445 [2024-11-29 02:32:51.960156] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.445 [2024-11-29 02:32:51.960171] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.445 [2024-11-29 02:32:51.960185] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.445 [2024-11-29 02:32:51.960214] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.445 qpair failed and we were unable to recover it. 00:27:48.445 [2024-11-29 02:32:51.970065] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.445 [2024-11-29 02:32:51.970155] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.445 [2024-11-29 02:32:51.970185] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.445 [2024-11-29 02:32:51.970200] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.445 [2024-11-29 02:32:51.970214] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.445 [2024-11-29 02:32:51.970243] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.445 qpair failed and we were unable to recover it. 00:27:48.445 [2024-11-29 02:32:51.980086] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.445 [2024-11-29 02:32:51.980187] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.445 [2024-11-29 02:32:51.980217] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.445 [2024-11-29 02:32:51.980233] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.445 [2024-11-29 02:32:51.980246] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.445 [2024-11-29 02:32:51.980277] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.445 qpair failed and we were unable to recover it. 00:27:48.445 [2024-11-29 02:32:51.990202] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.445 [2024-11-29 02:32:51.990292] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.445 [2024-11-29 02:32:51.990318] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.445 [2024-11-29 02:32:51.990332] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.445 [2024-11-29 02:32:51.990346] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.445 [2024-11-29 02:32:51.990377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.445 qpair failed and we were unable to recover it. 00:27:48.445 [2024-11-29 02:32:52.000139] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.445 [2024-11-29 02:32:52.000230] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.445 [2024-11-29 02:32:52.000260] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.445 [2024-11-29 02:32:52.000281] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.445 [2024-11-29 02:32:52.000295] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.445 [2024-11-29 02:32:52.000326] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.445 qpair failed and we were unable to recover it. 00:27:48.445 [2024-11-29 02:32:52.010170] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.445 [2024-11-29 02:32:52.010266] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.445 [2024-11-29 02:32:52.010292] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.445 [2024-11-29 02:32:52.010306] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.445 [2024-11-29 02:32:52.010320] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.445 [2024-11-29 02:32:52.010349] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.445 qpair failed and we were unable to recover it. 00:27:48.445 [2024-11-29 02:32:52.020181] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.445 [2024-11-29 02:32:52.020305] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.445 [2024-11-29 02:32:52.020331] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.445 [2024-11-29 02:32:52.020345] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.445 [2024-11-29 02:32:52.020359] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.445 [2024-11-29 02:32:52.020389] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.445 qpair failed and we were unable to recover it. 00:27:48.445 [2024-11-29 02:32:52.030223] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.446 [2024-11-29 02:32:52.030330] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.446 [2024-11-29 02:32:52.030355] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.446 [2024-11-29 02:32:52.030370] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.446 [2024-11-29 02:32:52.030384] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.446 [2024-11-29 02:32:52.030421] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.446 qpair failed and we were unable to recover it. 00:27:48.446 [2024-11-29 02:32:52.040269] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.446 [2024-11-29 02:32:52.040359] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.446 [2024-11-29 02:32:52.040385] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.446 [2024-11-29 02:32:52.040410] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.446 [2024-11-29 02:32:52.040425] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.446 [2024-11-29 02:32:52.040455] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.446 qpair failed and we were unable to recover it. 00:27:48.446 [2024-11-29 02:32:52.050304] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.446 [2024-11-29 02:32:52.050399] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.446 [2024-11-29 02:32:52.050426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.446 [2024-11-29 02:32:52.050441] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.446 [2024-11-29 02:32:52.050454] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.446 [2024-11-29 02:32:52.050483] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.446 qpair failed and we were unable to recover it. 00:27:48.446 [2024-11-29 02:32:52.060326] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.446 [2024-11-29 02:32:52.060448] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.446 [2024-11-29 02:32:52.060474] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.446 [2024-11-29 02:32:52.060489] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.446 [2024-11-29 02:32:52.060502] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.446 [2024-11-29 02:32:52.060533] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.446 qpair failed and we were unable to recover it. 00:27:48.446 [2024-11-29 02:32:52.070334] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.446 [2024-11-29 02:32:52.070471] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.446 [2024-11-29 02:32:52.070497] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.446 [2024-11-29 02:32:52.070511] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.446 [2024-11-29 02:32:52.070525] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.446 [2024-11-29 02:32:52.070554] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.446 qpair failed and we were unable to recover it. 00:27:48.446 [2024-11-29 02:32:52.080413] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.446 [2024-11-29 02:32:52.080518] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.446 [2024-11-29 02:32:52.080545] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.446 [2024-11-29 02:32:52.080559] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.446 [2024-11-29 02:32:52.080572] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.446 [2024-11-29 02:32:52.080603] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.446 qpair failed and we were unable to recover it. 00:27:48.446 [2024-11-29 02:32:52.090405] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.446 [2024-11-29 02:32:52.090495] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.446 [2024-11-29 02:32:52.090526] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.446 [2024-11-29 02:32:52.090541] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.446 [2024-11-29 02:32:52.090555] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.446 [2024-11-29 02:32:52.090586] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.446 qpair failed and we were unable to recover it. 00:27:48.446 [2024-11-29 02:32:52.100442] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.446 [2024-11-29 02:32:52.100538] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.446 [2024-11-29 02:32:52.100564] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.446 [2024-11-29 02:32:52.100579] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.446 [2024-11-29 02:32:52.100592] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.446 [2024-11-29 02:32:52.100623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.446 qpair failed and we were unable to recover it. 00:27:48.446 [2024-11-29 02:32:52.110549] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.446 [2024-11-29 02:32:52.110642] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.446 [2024-11-29 02:32:52.110668] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.446 [2024-11-29 02:32:52.110682] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.446 [2024-11-29 02:32:52.110696] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.446 [2024-11-29 02:32:52.110725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.446 qpair failed and we were unable to recover it. 00:27:48.446 [2024-11-29 02:32:52.120489] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.446 [2024-11-29 02:32:52.120586] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.446 [2024-11-29 02:32:52.120611] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.446 [2024-11-29 02:32:52.120625] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.446 [2024-11-29 02:32:52.120638] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.446 [2024-11-29 02:32:52.120668] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.446 qpair failed and we were unable to recover it. 00:27:48.704 [2024-11-29 02:32:52.130578] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.704 [2024-11-29 02:32:52.130690] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.704 [2024-11-29 02:32:52.130716] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.704 [2024-11-29 02:32:52.130730] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.704 [2024-11-29 02:32:52.130743] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.704 [2024-11-29 02:32:52.130779] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.704 qpair failed and we were unable to recover it. 00:27:48.704 [2024-11-29 02:32:52.140597] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.704 [2024-11-29 02:32:52.140691] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.704 [2024-11-29 02:32:52.140717] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.704 [2024-11-29 02:32:52.140731] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.704 [2024-11-29 02:32:52.140745] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.704 [2024-11-29 02:32:52.140774] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.704 qpair failed and we were unable to recover it. 00:27:48.704 [2024-11-29 02:32:52.150675] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.704 [2024-11-29 02:32:52.150792] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.704 [2024-11-29 02:32:52.150838] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.704 [2024-11-29 02:32:52.150855] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.704 [2024-11-29 02:32:52.150869] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:48.704 [2024-11-29 02:32:52.150917] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:48.704 qpair failed and we were unable to recover it. 00:27:48.704 [2024-11-29 02:32:52.160627] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.704 [2024-11-29 02:32:52.160718] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.704 [2024-11-29 02:32:52.160750] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.704 [2024-11-29 02:32:52.160766] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.704 [2024-11-29 02:32:52.160780] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.704 [2024-11-29 02:32:52.160810] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.704 qpair failed and we were unable to recover it. 00:27:48.704 [2024-11-29 02:32:52.170649] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.704 [2024-11-29 02:32:52.170738] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.704 [2024-11-29 02:32:52.170764] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.705 [2024-11-29 02:32:52.170779] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.705 [2024-11-29 02:32:52.170793] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.705 [2024-11-29 02:32:52.170822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.705 qpair failed and we were unable to recover it. 00:27:48.705 [2024-11-29 02:32:52.180743] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.705 [2024-11-29 02:32:52.180829] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.705 [2024-11-29 02:32:52.180861] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.705 [2024-11-29 02:32:52.180877] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.705 [2024-11-29 02:32:52.180891] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.705 [2024-11-29 02:32:52.180923] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.705 qpair failed and we were unable to recover it. 00:27:48.705 [2024-11-29 02:32:52.190722] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.705 [2024-11-29 02:32:52.190816] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.705 [2024-11-29 02:32:52.190843] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.705 [2024-11-29 02:32:52.190857] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.705 [2024-11-29 02:32:52.190871] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.705 [2024-11-29 02:32:52.190900] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.705 qpair failed and we were unable to recover it. 00:27:48.705 [2024-11-29 02:32:52.200697] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.705 [2024-11-29 02:32:52.200785] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.705 [2024-11-29 02:32:52.200812] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.705 [2024-11-29 02:32:52.200826] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.705 [2024-11-29 02:32:52.200840] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.705 [2024-11-29 02:32:52.200868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.705 qpair failed and we were unable to recover it. 00:27:48.705 [2024-11-29 02:32:52.210754] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.705 [2024-11-29 02:32:52.210883] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.705 [2024-11-29 02:32:52.210908] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.705 [2024-11-29 02:32:52.210924] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.705 [2024-11-29 02:32:52.210939] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.705 [2024-11-29 02:32:52.210974] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.705 qpair failed and we were unable to recover it. 00:27:48.705 [2024-11-29 02:32:52.220756] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.705 [2024-11-29 02:32:52.220845] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.705 [2024-11-29 02:32:52.220871] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.705 [2024-11-29 02:32:52.220885] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.705 [2024-11-29 02:32:52.220904] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.705 [2024-11-29 02:32:52.220936] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.705 qpair failed and we were unable to recover it. 00:27:48.705 [2024-11-29 02:32:52.230901] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.705 [2024-11-29 02:32:52.230991] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.705 [2024-11-29 02:32:52.231017] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.705 [2024-11-29 02:32:52.231032] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.705 [2024-11-29 02:32:52.231045] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.705 [2024-11-29 02:32:52.231076] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.705 qpair failed and we were unable to recover it. 00:27:48.705 [2024-11-29 02:32:52.240818] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.705 [2024-11-29 02:32:52.240910] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.705 [2024-11-29 02:32:52.240936] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.705 [2024-11-29 02:32:52.240951] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.705 [2024-11-29 02:32:52.240964] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.705 [2024-11-29 02:32:52.240993] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.705 qpair failed and we were unable to recover it. 00:27:48.705 [2024-11-29 02:32:52.250851] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.705 [2024-11-29 02:32:52.250940] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.705 [2024-11-29 02:32:52.250966] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.705 [2024-11-29 02:32:52.250980] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.705 [2024-11-29 02:32:52.250995] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.705 [2024-11-29 02:32:52.251025] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.705 qpair failed and we were unable to recover it. 00:27:48.705 [2024-11-29 02:32:52.261013] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.705 [2024-11-29 02:32:52.261145] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.705 [2024-11-29 02:32:52.261171] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.705 [2024-11-29 02:32:52.261185] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.705 [2024-11-29 02:32:52.261198] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.705 [2024-11-29 02:32:52.261228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.705 qpair failed and we were unable to recover it. 00:27:48.705 [2024-11-29 02:32:52.270911] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.705 [2024-11-29 02:32:52.271012] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.705 [2024-11-29 02:32:52.271038] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.705 [2024-11-29 02:32:52.271052] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.705 [2024-11-29 02:32:52.271065] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.705 [2024-11-29 02:32:52.271095] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.705 qpair failed and we were unable to recover it. 00:27:48.705 [2024-11-29 02:32:52.280951] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.705 [2024-11-29 02:32:52.281062] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.705 [2024-11-29 02:32:52.281087] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.705 [2024-11-29 02:32:52.281102] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.705 [2024-11-29 02:32:52.281115] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.705 [2024-11-29 02:32:52.281143] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.705 qpair failed and we were unable to recover it. 00:27:48.705 [2024-11-29 02:32:52.290963] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.705 [2024-11-29 02:32:52.291058] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.705 [2024-11-29 02:32:52.291083] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.705 [2024-11-29 02:32:52.291097] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.705 [2024-11-29 02:32:52.291111] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.705 [2024-11-29 02:32:52.291140] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.705 qpair failed and we were unable to recover it. 00:27:48.705 [2024-11-29 02:32:52.301000] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.705 [2024-11-29 02:32:52.301089] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.705 [2024-11-29 02:32:52.301114] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.705 [2024-11-29 02:32:52.301129] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.705 [2024-11-29 02:32:52.301142] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.705 [2024-11-29 02:32:52.301173] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.705 qpair failed and we were unable to recover it. 00:27:48.706 [2024-11-29 02:32:52.311042] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.706 [2024-11-29 02:32:52.311134] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.706 [2024-11-29 02:32:52.311159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.706 [2024-11-29 02:32:52.311173] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.706 [2024-11-29 02:32:52.311192] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.706 [2024-11-29 02:32:52.311224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.706 qpair failed and we were unable to recover it. 00:27:48.706 [2024-11-29 02:32:52.321089] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.706 [2024-11-29 02:32:52.321187] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.706 [2024-11-29 02:32:52.321213] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.706 [2024-11-29 02:32:52.321227] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.706 [2024-11-29 02:32:52.321240] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.706 [2024-11-29 02:32:52.321272] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.706 qpair failed and we were unable to recover it. 00:27:48.706 [2024-11-29 02:32:52.331105] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.706 [2024-11-29 02:32:52.331195] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.706 [2024-11-29 02:32:52.331223] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.706 [2024-11-29 02:32:52.331239] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.706 [2024-11-29 02:32:52.331252] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.706 [2024-11-29 02:32:52.331281] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.706 qpair failed and we were unable to recover it. 00:27:48.706 [2024-11-29 02:32:52.341161] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.706 [2024-11-29 02:32:52.341281] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.706 [2024-11-29 02:32:52.341307] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.706 [2024-11-29 02:32:52.341321] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.706 [2024-11-29 02:32:52.341334] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.706 [2024-11-29 02:32:52.341363] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.706 qpair failed and we were unable to recover it. 00:27:48.706 [2024-11-29 02:32:52.351163] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.706 [2024-11-29 02:32:52.351256] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.706 [2024-11-29 02:32:52.351282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.706 [2024-11-29 02:32:52.351297] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.706 [2024-11-29 02:32:52.351310] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.706 [2024-11-29 02:32:52.351340] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.706 qpair failed and we were unable to recover it. 00:27:48.706 [2024-11-29 02:32:52.361282] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.706 [2024-11-29 02:32:52.361421] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.706 [2024-11-29 02:32:52.361447] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.706 [2024-11-29 02:32:52.361461] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.706 [2024-11-29 02:32:52.361473] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.706 [2024-11-29 02:32:52.361504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.706 qpair failed and we were unable to recover it. 00:27:48.706 [2024-11-29 02:32:52.371213] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.706 [2024-11-29 02:32:52.371297] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.706 [2024-11-29 02:32:52.371323] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.706 [2024-11-29 02:32:52.371337] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.706 [2024-11-29 02:32:52.371350] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.706 [2024-11-29 02:32:52.371379] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.706 qpair failed and we were unable to recover it. 00:27:48.706 [2024-11-29 02:32:52.381239] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.706 [2024-11-29 02:32:52.381368] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.706 [2024-11-29 02:32:52.381402] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.706 [2024-11-29 02:32:52.381420] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.706 [2024-11-29 02:32:52.381433] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.706 [2024-11-29 02:32:52.381465] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.706 qpair failed and we were unable to recover it. 00:27:48.965 [2024-11-29 02:32:52.391316] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.965 [2024-11-29 02:32:52.391413] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.965 [2024-11-29 02:32:52.391439] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.965 [2024-11-29 02:32:52.391454] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.965 [2024-11-29 02:32:52.391467] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.965 [2024-11-29 02:32:52.391498] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.965 qpair failed and we were unable to recover it. 00:27:48.965 [2024-11-29 02:32:52.401325] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.965 [2024-11-29 02:32:52.401427] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.965 [2024-11-29 02:32:52.401453] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.965 [2024-11-29 02:32:52.401473] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.965 [2024-11-29 02:32:52.401487] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.965 [2024-11-29 02:32:52.401517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.965 qpair failed and we were unable to recover it. 00:27:48.965 [2024-11-29 02:32:52.411311] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.965 [2024-11-29 02:32:52.411412] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.965 [2024-11-29 02:32:52.411439] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.965 [2024-11-29 02:32:52.411454] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.965 [2024-11-29 02:32:52.411467] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.965 [2024-11-29 02:32:52.411498] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.965 qpair failed and we were unable to recover it. 00:27:48.965 [2024-11-29 02:32:52.421390] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.965 [2024-11-29 02:32:52.421524] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.965 [2024-11-29 02:32:52.421550] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.965 [2024-11-29 02:32:52.421564] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.965 [2024-11-29 02:32:52.421577] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.965 [2024-11-29 02:32:52.421607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.965 qpair failed and we were unable to recover it. 00:27:48.965 [2024-11-29 02:32:52.431390] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.965 [2024-11-29 02:32:52.431521] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.965 [2024-11-29 02:32:52.431547] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.965 [2024-11-29 02:32:52.431561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.965 [2024-11-29 02:32:52.431574] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.965 [2024-11-29 02:32:52.431604] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.965 qpair failed and we were unable to recover it. 00:27:48.965 [2024-11-29 02:32:52.441527] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.965 [2024-11-29 02:32:52.441625] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.965 [2024-11-29 02:32:52.441651] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.965 [2024-11-29 02:32:52.441665] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.965 [2024-11-29 02:32:52.441678] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.965 [2024-11-29 02:32:52.441707] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.965 qpair failed and we were unable to recover it. 00:27:48.965 [2024-11-29 02:32:52.451449] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.965 [2024-11-29 02:32:52.451540] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.965 [2024-11-29 02:32:52.451566] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.965 [2024-11-29 02:32:52.451580] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.965 [2024-11-29 02:32:52.451592] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.965 [2024-11-29 02:32:52.451620] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.965 qpair failed and we were unable to recover it. 00:27:48.965 [2024-11-29 02:32:52.461528] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.965 [2024-11-29 02:32:52.461639] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.965 [2024-11-29 02:32:52.461668] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.965 [2024-11-29 02:32:52.461684] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.965 [2024-11-29 02:32:52.461697] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.965 [2024-11-29 02:32:52.461727] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.965 qpair failed and we were unable to recover it. 00:27:48.965 [2024-11-29 02:32:52.471545] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.965 [2024-11-29 02:32:52.471665] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.965 [2024-11-29 02:32:52.471692] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.965 [2024-11-29 02:32:52.471706] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.965 [2024-11-29 02:32:52.471719] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.965 [2024-11-29 02:32:52.471748] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.965 qpair failed and we were unable to recover it. 00:27:48.965 [2024-11-29 02:32:52.481535] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.965 [2024-11-29 02:32:52.481632] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.965 [2024-11-29 02:32:52.481658] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.965 [2024-11-29 02:32:52.481672] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.965 [2024-11-29 02:32:52.481685] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.965 [2024-11-29 02:32:52.481715] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.965 qpair failed and we were unable to recover it. 00:27:48.965 [2024-11-29 02:32:52.491593] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.965 [2024-11-29 02:32:52.491680] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.965 [2024-11-29 02:32:52.491713] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.965 [2024-11-29 02:32:52.491735] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.965 [2024-11-29 02:32:52.491748] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.965 [2024-11-29 02:32:52.491778] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.965 qpair failed and we were unable to recover it. 00:27:48.966 [2024-11-29 02:32:52.501609] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.966 [2024-11-29 02:32:52.501698] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.966 [2024-11-29 02:32:52.501730] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.966 [2024-11-29 02:32:52.501745] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.966 [2024-11-29 02:32:52.501759] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.966 [2024-11-29 02:32:52.501788] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.966 qpair failed and we were unable to recover it. 00:27:48.966 [2024-11-29 02:32:52.511630] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.966 [2024-11-29 02:32:52.511730] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.966 [2024-11-29 02:32:52.511756] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.966 [2024-11-29 02:32:52.511771] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.966 [2024-11-29 02:32:52.511784] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.966 [2024-11-29 02:32:52.511814] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.966 qpair failed and we were unable to recover it. 00:27:48.966 [2024-11-29 02:32:52.521767] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.966 [2024-11-29 02:32:52.521866] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.966 [2024-11-29 02:32:52.521892] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.966 [2024-11-29 02:32:52.521906] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.966 [2024-11-29 02:32:52.521919] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.966 [2024-11-29 02:32:52.521948] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.966 qpair failed and we were unable to recover it. 00:27:48.966 [2024-11-29 02:32:52.531703] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.966 [2024-11-29 02:32:52.531826] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.966 [2024-11-29 02:32:52.531851] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.966 [2024-11-29 02:32:52.531864] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.966 [2024-11-29 02:32:52.531876] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.966 [2024-11-29 02:32:52.531904] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.966 qpair failed and we were unable to recover it. 00:27:48.966 [2024-11-29 02:32:52.541771] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.966 [2024-11-29 02:32:52.541867] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.966 [2024-11-29 02:32:52.541894] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.966 [2024-11-29 02:32:52.541908] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.966 [2024-11-29 02:32:52.541921] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.966 [2024-11-29 02:32:52.541950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.966 qpair failed and we were unable to recover it. 00:27:48.966 [2024-11-29 02:32:52.551780] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.966 [2024-11-29 02:32:52.551873] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.966 [2024-11-29 02:32:52.551898] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.966 [2024-11-29 02:32:52.551913] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.966 [2024-11-29 02:32:52.551926] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.966 [2024-11-29 02:32:52.551955] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.966 qpair failed and we were unable to recover it. 00:27:48.966 [2024-11-29 02:32:52.561801] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.966 [2024-11-29 02:32:52.561912] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.966 [2024-11-29 02:32:52.561939] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.966 [2024-11-29 02:32:52.561953] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.966 [2024-11-29 02:32:52.561966] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.966 [2024-11-29 02:32:52.561997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.966 qpair failed and we were unable to recover it. 00:27:48.966 [2024-11-29 02:32:52.571863] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.966 [2024-11-29 02:32:52.571950] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.966 [2024-11-29 02:32:52.571978] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.966 [2024-11-29 02:32:52.571996] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.966 [2024-11-29 02:32:52.572009] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.966 [2024-11-29 02:32:52.572040] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.966 qpair failed and we were unable to recover it. 00:27:48.966 [2024-11-29 02:32:52.581885] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.966 [2024-11-29 02:32:52.581985] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.966 [2024-11-29 02:32:52.582016] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.966 [2024-11-29 02:32:52.582032] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.966 [2024-11-29 02:32:52.582045] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.966 [2024-11-29 02:32:52.582077] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.966 qpair failed and we were unable to recover it. 00:27:48.966 [2024-11-29 02:32:52.591915] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.966 [2024-11-29 02:32:52.592006] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.966 [2024-11-29 02:32:52.592031] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.966 [2024-11-29 02:32:52.592046] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.966 [2024-11-29 02:32:52.592059] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.966 [2024-11-29 02:32:52.592088] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.966 qpair failed and we were unable to recover it. 00:27:48.966 [2024-11-29 02:32:52.601895] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.966 [2024-11-29 02:32:52.601983] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.966 [2024-11-29 02:32:52.602008] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.966 [2024-11-29 02:32:52.602023] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.966 [2024-11-29 02:32:52.602035] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.966 [2024-11-29 02:32:52.602064] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.966 qpair failed and we were unable to recover it. 00:27:48.966 [2024-11-29 02:32:52.612053] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.966 [2024-11-29 02:32:52.612135] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.966 [2024-11-29 02:32:52.612161] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.966 [2024-11-29 02:32:52.612176] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.966 [2024-11-29 02:32:52.612189] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.966 [2024-11-29 02:32:52.612218] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.966 qpair failed and we were unable to recover it. 00:27:48.966 [2024-11-29 02:32:52.621984] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.966 [2024-11-29 02:32:52.622112] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.966 [2024-11-29 02:32:52.622137] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.966 [2024-11-29 02:32:52.622152] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.966 [2024-11-29 02:32:52.622165] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.966 [2024-11-29 02:32:52.622200] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.966 qpair failed and we were unable to recover it. 00:27:48.966 [2024-11-29 02:32:52.632009] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.966 [2024-11-29 02:32:52.632102] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.966 [2024-11-29 02:32:52.632128] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.966 [2024-11-29 02:32:52.632142] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.966 [2024-11-29 02:32:52.632155] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.966 [2024-11-29 02:32:52.632185] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.966 qpair failed and we were unable to recover it. 00:27:48.966 [2024-11-29 02:32:52.642036] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.966 [2024-11-29 02:32:52.642127] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.966 [2024-11-29 02:32:52.642152] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.967 [2024-11-29 02:32:52.642166] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.967 [2024-11-29 02:32:52.642179] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:48.967 [2024-11-29 02:32:52.642210] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.967 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-29 02:32:52.652048] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.226 [2024-11-29 02:32:52.652140] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.226 [2024-11-29 02:32:52.652165] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.226 [2024-11-29 02:32:52.652180] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.226 [2024-11-29 02:32:52.652193] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.226 [2024-11-29 02:32:52.652223] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-29 02:32:52.662104] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.226 [2024-11-29 02:32:52.662204] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.226 [2024-11-29 02:32:52.662234] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.226 [2024-11-29 02:32:52.662249] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.226 [2024-11-29 02:32:52.662262] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.226 [2024-11-29 02:32:52.662293] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-29 02:32:52.672160] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.226 [2024-11-29 02:32:52.672295] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.226 [2024-11-29 02:32:52.672327] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.226 [2024-11-29 02:32:52.672342] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.226 [2024-11-29 02:32:52.672356] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.226 [2024-11-29 02:32:52.672385] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-29 02:32:52.682185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.226 [2024-11-29 02:32:52.682282] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.226 [2024-11-29 02:32:52.682307] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.226 [2024-11-29 02:32:52.682321] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.226 [2024-11-29 02:32:52.682334] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.227 [2024-11-29 02:32:52.682364] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-29 02:32:52.692181] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.227 [2024-11-29 02:32:52.692306] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.227 [2024-11-29 02:32:52.692331] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.227 [2024-11-29 02:32:52.692345] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.227 [2024-11-29 02:32:52.692358] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.227 [2024-11-29 02:32:52.692387] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-29 02:32:52.702241] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.227 [2024-11-29 02:32:52.702329] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.227 [2024-11-29 02:32:52.702354] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.227 [2024-11-29 02:32:52.702369] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.227 [2024-11-29 02:32:52.702382] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.227 [2024-11-29 02:32:52.702419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-29 02:32:52.712250] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.227 [2024-11-29 02:32:52.712370] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.227 [2024-11-29 02:32:52.712402] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.227 [2024-11-29 02:32:52.712419] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.227 [2024-11-29 02:32:52.712432] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.227 [2024-11-29 02:32:52.712470] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-29 02:32:52.722308] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.227 [2024-11-29 02:32:52.722407] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.227 [2024-11-29 02:32:52.722433] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.227 [2024-11-29 02:32:52.722448] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.227 [2024-11-29 02:32:52.722461] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.227 [2024-11-29 02:32:52.722491] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-29 02:32:52.732389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.227 [2024-11-29 02:32:52.732483] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.227 [2024-11-29 02:32:52.732509] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.227 [2024-11-29 02:32:52.732524] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.227 [2024-11-29 02:32:52.732537] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.227 [2024-11-29 02:32:52.732568] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-29 02:32:52.742370] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.227 [2024-11-29 02:32:52.742484] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.227 [2024-11-29 02:32:52.742510] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.227 [2024-11-29 02:32:52.742525] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.227 [2024-11-29 02:32:52.742538] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.227 [2024-11-29 02:32:52.742568] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-29 02:32:52.752383] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.227 [2024-11-29 02:32:52.752485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.227 [2024-11-29 02:32:52.752511] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.227 [2024-11-29 02:32:52.752526] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.227 [2024-11-29 02:32:52.752540] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.227 [2024-11-29 02:32:52.752572] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-29 02:32:52.762420] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.227 [2024-11-29 02:32:52.762519] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.227 [2024-11-29 02:32:52.762545] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.227 [2024-11-29 02:32:52.762561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.227 [2024-11-29 02:32:52.762575] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.227 [2024-11-29 02:32:52.762605] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-29 02:32:52.772453] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.227 [2024-11-29 02:32:52.772543] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.227 [2024-11-29 02:32:52.772569] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.227 [2024-11-29 02:32:52.772584] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.227 [2024-11-29 02:32:52.772597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.227 [2024-11-29 02:32:52.772626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-29 02:32:52.782460] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.227 [2024-11-29 02:32:52.782554] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.227 [2024-11-29 02:32:52.782583] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.227 [2024-11-29 02:32:52.782599] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.227 [2024-11-29 02:32:52.782613] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.227 [2024-11-29 02:32:52.782643] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-29 02:32:52.792474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.227 [2024-11-29 02:32:52.792570] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.227 [2024-11-29 02:32:52.792595] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.227 [2024-11-29 02:32:52.792610] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.228 [2024-11-29 02:32:52.792623] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.228 [2024-11-29 02:32:52.792652] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-29 02:32:52.802514] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.228 [2024-11-29 02:32:52.802641] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.228 [2024-11-29 02:32:52.802666] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.228 [2024-11-29 02:32:52.802680] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.228 [2024-11-29 02:32:52.802699] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.228 [2024-11-29 02:32:52.802731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-29 02:32:52.812546] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.228 [2024-11-29 02:32:52.812632] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.228 [2024-11-29 02:32:52.812657] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.228 [2024-11-29 02:32:52.812671] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.228 [2024-11-29 02:32:52.812684] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.228 [2024-11-29 02:32:52.812713] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-29 02:32:52.822568] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.228 [2024-11-29 02:32:52.822659] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.228 [2024-11-29 02:32:52.822685] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.228 [2024-11-29 02:32:52.822699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.228 [2024-11-29 02:32:52.822713] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.228 [2024-11-29 02:32:52.822742] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-29 02:32:52.832659] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.228 [2024-11-29 02:32:52.832805] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.228 [2024-11-29 02:32:52.832830] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.228 [2024-11-29 02:32:52.832844] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.228 [2024-11-29 02:32:52.832857] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.228 [2024-11-29 02:32:52.832887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-29 02:32:52.842614] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.228 [2024-11-29 02:32:52.842703] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.228 [2024-11-29 02:32:52.842728] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.228 [2024-11-29 02:32:52.842742] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.228 [2024-11-29 02:32:52.842755] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.228 [2024-11-29 02:32:52.842784] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-29 02:32:52.852642] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.228 [2024-11-29 02:32:52.852739] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.228 [2024-11-29 02:32:52.852764] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.228 [2024-11-29 02:32:52.852778] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.228 [2024-11-29 02:32:52.852791] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.228 [2024-11-29 02:32:52.852821] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-29 02:32:52.862690] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.228 [2024-11-29 02:32:52.862780] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.228 [2024-11-29 02:32:52.862808] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.228 [2024-11-29 02:32:52.862823] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.228 [2024-11-29 02:32:52.862836] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.228 [2024-11-29 02:32:52.862866] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-29 02:32:52.872715] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.228 [2024-11-29 02:32:52.872807] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.228 [2024-11-29 02:32:52.872833] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.228 [2024-11-29 02:32:52.872847] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.228 [2024-11-29 02:32:52.872860] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.228 [2024-11-29 02:32:52.872890] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-29 02:32:52.882754] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.228 [2024-11-29 02:32:52.882845] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.228 [2024-11-29 02:32:52.882870] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.228 [2024-11-29 02:32:52.882885] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.228 [2024-11-29 02:32:52.882898] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.228 [2024-11-29 02:32:52.882926] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-29 02:32:52.892763] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.228 [2024-11-29 02:32:52.892848] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.228 [2024-11-29 02:32:52.892874] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.228 [2024-11-29 02:32:52.892894] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.228 [2024-11-29 02:32:52.892909] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.228 [2024-11-29 02:32:52.892938] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-29 02:32:52.902806] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.228 [2024-11-29 02:32:52.902903] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.228 [2024-11-29 02:32:52.902929] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.228 [2024-11-29 02:32:52.902943] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.228 [2024-11-29 02:32:52.902956] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.228 [2024-11-29 02:32:52.902986] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.486 [2024-11-29 02:32:52.912825] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.486 [2024-11-29 02:32:52.912947] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.487 [2024-11-29 02:32:52.912972] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.487 [2024-11-29 02:32:52.912986] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.487 [2024-11-29 02:32:52.913000] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.487 [2024-11-29 02:32:52.913028] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.487 qpair failed and we were unable to recover it. 00:27:49.487 [2024-11-29 02:32:52.922952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.487 [2024-11-29 02:32:52.923048] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.487 [2024-11-29 02:32:52.923073] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.487 [2024-11-29 02:32:52.923088] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.487 [2024-11-29 02:32:52.923101] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.487 [2024-11-29 02:32:52.923131] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.487 qpair failed and we were unable to recover it. 00:27:49.487 [2024-11-29 02:32:52.932926] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.487 [2024-11-29 02:32:52.933014] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.487 [2024-11-29 02:32:52.933039] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.487 [2024-11-29 02:32:52.933053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.487 [2024-11-29 02:32:52.933066] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.487 [2024-11-29 02:32:52.933096] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.487 qpair failed and we were unable to recover it. 00:27:49.487 [2024-11-29 02:32:52.942927] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.487 [2024-11-29 02:32:52.943049] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.487 [2024-11-29 02:32:52.943075] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.487 [2024-11-29 02:32:52.943089] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.487 [2024-11-29 02:32:52.943102] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.487 [2024-11-29 02:32:52.943131] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.487 qpair failed and we were unable to recover it. 00:27:49.487 [2024-11-29 02:32:52.952953] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.487 [2024-11-29 02:32:52.953078] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.487 [2024-11-29 02:32:52.953104] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.487 [2024-11-29 02:32:52.953118] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.487 [2024-11-29 02:32:52.953131] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.487 [2024-11-29 02:32:52.953160] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.487 qpair failed and we were unable to recover it. 00:27:49.487 [2024-11-29 02:32:52.962993] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.487 [2024-11-29 02:32:52.963084] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.487 [2024-11-29 02:32:52.963109] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.487 [2024-11-29 02:32:52.963123] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.487 [2024-11-29 02:32:52.963136] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.487 [2024-11-29 02:32:52.963166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.487 qpair failed and we were unable to recover it. 00:27:49.487 [2024-11-29 02:32:52.973015] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.487 [2024-11-29 02:32:52.973136] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.487 [2024-11-29 02:32:52.973161] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.487 [2024-11-29 02:32:52.973176] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.487 [2024-11-29 02:32:52.973189] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.487 [2024-11-29 02:32:52.973221] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.487 qpair failed and we were unable to recover it. 00:27:49.487 [2024-11-29 02:32:52.983043] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.487 [2024-11-29 02:32:52.983135] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.487 [2024-11-29 02:32:52.983162] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.487 [2024-11-29 02:32:52.983183] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.487 [2024-11-29 02:32:52.983197] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.487 [2024-11-29 02:32:52.983227] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.487 qpair failed and we were unable to recover it. 00:27:49.487 [2024-11-29 02:32:52.993111] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.487 [2024-11-29 02:32:52.993235] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.487 [2024-11-29 02:32:52.993261] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.487 [2024-11-29 02:32:52.993276] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.487 [2024-11-29 02:32:52.993288] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.487 [2024-11-29 02:32:52.993317] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.487 qpair failed and we were unable to recover it. 00:27:49.487 [2024-11-29 02:32:53.003129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.487 [2024-11-29 02:32:53.003259] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.487 [2024-11-29 02:32:53.003285] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.487 [2024-11-29 02:32:53.003299] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.487 [2024-11-29 02:32:53.003312] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.487 [2024-11-29 02:32:53.003341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.487 qpair failed and we were unable to recover it. 00:27:49.487 [2024-11-29 02:32:53.013153] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.487 [2024-11-29 02:32:53.013267] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.487 [2024-11-29 02:32:53.013292] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.487 [2024-11-29 02:32:53.013306] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.488 [2024-11-29 02:32:53.013319] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.488 [2024-11-29 02:32:53.013348] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.488 qpair failed and we were unable to recover it. 00:27:49.488 [2024-11-29 02:32:53.023143] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.488 [2024-11-29 02:32:53.023232] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.488 [2024-11-29 02:32:53.023258] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.488 [2024-11-29 02:32:53.023272] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.488 [2024-11-29 02:32:53.023285] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.488 [2024-11-29 02:32:53.023314] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.488 qpair failed and we were unable to recover it. 00:27:49.488 [2024-11-29 02:32:53.033286] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.488 [2024-11-29 02:32:53.033422] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.488 [2024-11-29 02:32:53.033448] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.488 [2024-11-29 02:32:53.033463] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.488 [2024-11-29 02:32:53.033475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.488 [2024-11-29 02:32:53.033506] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.488 qpair failed and we were unable to recover it. 00:27:49.488 [2024-11-29 02:32:53.043218] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.488 [2024-11-29 02:32:53.043309] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.488 [2024-11-29 02:32:53.043335] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.488 [2024-11-29 02:32:53.043349] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.488 [2024-11-29 02:32:53.043362] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.488 [2024-11-29 02:32:53.043391] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.488 qpair failed and we were unable to recover it. 00:27:49.488 [2024-11-29 02:32:53.053256] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.488 [2024-11-29 02:32:53.053391] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.488 [2024-11-29 02:32:53.053424] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.488 [2024-11-29 02:32:53.053438] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.488 [2024-11-29 02:32:53.053451] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.488 [2024-11-29 02:32:53.053482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.488 qpair failed and we were unable to recover it. 00:27:49.488 [2024-11-29 02:32:53.063347] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.488 [2024-11-29 02:32:53.063452] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.488 [2024-11-29 02:32:53.063478] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.488 [2024-11-29 02:32:53.063493] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.488 [2024-11-29 02:32:53.063506] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.488 [2024-11-29 02:32:53.063538] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.488 qpair failed and we were unable to recover it. 00:27:49.488 [2024-11-29 02:32:53.073318] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.488 [2024-11-29 02:32:53.073413] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.488 [2024-11-29 02:32:53.073444] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.488 [2024-11-29 02:32:53.073459] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.488 [2024-11-29 02:32:53.073472] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.488 [2024-11-29 02:32:53.073503] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.488 qpair failed and we were unable to recover it. 00:27:49.488 [2024-11-29 02:32:53.083314] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.488 [2024-11-29 02:32:53.083411] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.488 [2024-11-29 02:32:53.083437] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.488 [2024-11-29 02:32:53.083451] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.488 [2024-11-29 02:32:53.083464] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.488 [2024-11-29 02:32:53.083495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.488 qpair failed and we were unable to recover it. 00:27:49.488 [2024-11-29 02:32:53.093350] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.488 [2024-11-29 02:32:53.093449] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.488 [2024-11-29 02:32:53.093475] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.488 [2024-11-29 02:32:53.093490] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.488 [2024-11-29 02:32:53.093503] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.488 [2024-11-29 02:32:53.093532] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.488 qpair failed and we were unable to recover it. 00:27:49.488 [2024-11-29 02:32:53.103495] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.488 [2024-11-29 02:32:53.103632] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.488 [2024-11-29 02:32:53.103657] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.488 [2024-11-29 02:32:53.103671] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.488 [2024-11-29 02:32:53.103684] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.488 [2024-11-29 02:32:53.103714] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.488 qpair failed and we were unable to recover it. 00:27:49.488 [2024-11-29 02:32:53.113464] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.488 [2024-11-29 02:32:53.113557] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.488 [2024-11-29 02:32:53.113581] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.488 [2024-11-29 02:32:53.113595] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.488 [2024-11-29 02:32:53.113608] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.488 [2024-11-29 02:32:53.113644] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.488 qpair failed and we were unable to recover it. 00:27:49.488 [2024-11-29 02:32:53.123549] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.488 [2024-11-29 02:32:53.123679] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.488 [2024-11-29 02:32:53.123704] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.488 [2024-11-29 02:32:53.123719] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.488 [2024-11-29 02:32:53.123731] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.488 [2024-11-29 02:32:53.123762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.488 qpair failed and we were unable to recover it. 00:27:49.488 [2024-11-29 02:32:53.133455] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.488 [2024-11-29 02:32:53.133544] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.488 [2024-11-29 02:32:53.133570] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.488 [2024-11-29 02:32:53.133584] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.488 [2024-11-29 02:32:53.133597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.488 [2024-11-29 02:32:53.133626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.488 qpair failed and we were unable to recover it. 00:27:49.488 [2024-11-29 02:32:53.143498] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.488 [2024-11-29 02:32:53.143588] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.488 [2024-11-29 02:32:53.143613] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.488 [2024-11-29 02:32:53.143627] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.488 [2024-11-29 02:32:53.143640] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.488 [2024-11-29 02:32:53.143670] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.488 qpair failed and we were unable to recover it. 00:27:49.488 [2024-11-29 02:32:53.153549] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.488 [2024-11-29 02:32:53.153642] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.489 [2024-11-29 02:32:53.153668] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.489 [2024-11-29 02:32:53.153682] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.489 [2024-11-29 02:32:53.153696] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.489 [2024-11-29 02:32:53.153725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.489 qpair failed and we were unable to recover it. 00:27:49.489 [2024-11-29 02:32:53.163685] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.489 [2024-11-29 02:32:53.163770] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.489 [2024-11-29 02:32:53.163800] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.489 [2024-11-29 02:32:53.163815] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.489 [2024-11-29 02:32:53.163828] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.489 [2024-11-29 02:32:53.163858] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.489 qpair failed and we were unable to recover it. 00:27:49.748 [2024-11-29 02:32:53.173579] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.748 [2024-11-29 02:32:53.173701] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.748 [2024-11-29 02:32:53.173727] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.748 [2024-11-29 02:32:53.173741] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.748 [2024-11-29 02:32:53.173754] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.748 [2024-11-29 02:32:53.173783] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.748 qpair failed and we were unable to recover it. 00:27:49.748 [2024-11-29 02:32:53.183621] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.748 [2024-11-29 02:32:53.183751] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.748 [2024-11-29 02:32:53.183776] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.748 [2024-11-29 02:32:53.183791] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.748 [2024-11-29 02:32:53.183804] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.748 [2024-11-29 02:32:53.183834] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.748 qpair failed and we were unable to recover it. 00:27:49.748 [2024-11-29 02:32:53.193694] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.748 [2024-11-29 02:32:53.193814] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.748 [2024-11-29 02:32:53.193839] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.748 [2024-11-29 02:32:53.193853] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.748 [2024-11-29 02:32:53.193866] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.748 [2024-11-29 02:32:53.193896] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.748 qpair failed and we were unable to recover it. 00:27:49.748 [2024-11-29 02:32:53.203670] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.748 [2024-11-29 02:32:53.203765] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.748 [2024-11-29 02:32:53.203794] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.748 [2024-11-29 02:32:53.203811] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.748 [2024-11-29 02:32:53.203824] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.748 [2024-11-29 02:32:53.203860] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.748 qpair failed and we were unable to recover it. 00:27:49.748 [2024-11-29 02:32:53.213686] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.748 [2024-11-29 02:32:53.213772] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.748 [2024-11-29 02:32:53.213799] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.748 [2024-11-29 02:32:53.213815] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.748 [2024-11-29 02:32:53.213828] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.748 [2024-11-29 02:32:53.213859] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.748 qpair failed and we were unable to recover it. 00:27:49.748 [2024-11-29 02:32:53.223715] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.748 [2024-11-29 02:32:53.223845] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.748 [2024-11-29 02:32:53.223871] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.748 [2024-11-29 02:32:53.223887] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.748 [2024-11-29 02:32:53.223901] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.748 [2024-11-29 02:32:53.223935] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.748 qpair failed and we were unable to recover it. 00:27:49.748 [2024-11-29 02:32:53.233762] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.748 [2024-11-29 02:32:53.233868] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.748 [2024-11-29 02:32:53.233893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.748 [2024-11-29 02:32:53.233907] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.748 [2024-11-29 02:32:53.233920] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.748 [2024-11-29 02:32:53.233950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.748 qpair failed and we were unable to recover it. 00:27:49.748 [2024-11-29 02:32:53.243776] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.748 [2024-11-29 02:32:53.243865] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.748 [2024-11-29 02:32:53.243891] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.748 [2024-11-29 02:32:53.243906] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.748 [2024-11-29 02:32:53.243919] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.748 [2024-11-29 02:32:53.243947] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.748 qpair failed and we were unable to recover it. 00:27:49.748 [2024-11-29 02:32:53.253919] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.748 [2024-11-29 02:32:53.254048] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.748 [2024-11-29 02:32:53.254079] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.748 [2024-11-29 02:32:53.254094] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.748 [2024-11-29 02:32:53.254107] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.748 [2024-11-29 02:32:53.254137] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.748 qpair failed and we were unable to recover it. 00:27:49.748 [2024-11-29 02:32:53.263933] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.748 [2024-11-29 02:32:53.264031] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.748 [2024-11-29 02:32:53.264057] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.748 [2024-11-29 02:32:53.264072] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.748 [2024-11-29 02:32:53.264085] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.748 [2024-11-29 02:32:53.264114] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.748 qpair failed and we were unable to recover it. 00:27:49.748 [2024-11-29 02:32:53.273943] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.748 [2024-11-29 02:32:53.274035] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.748 [2024-11-29 02:32:53.274060] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.748 [2024-11-29 02:32:53.274074] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.748 [2024-11-29 02:32:53.274087] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.748 [2024-11-29 02:32:53.274116] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.748 qpair failed and we were unable to recover it. 00:27:49.748 [2024-11-29 02:32:53.283936] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.748 [2024-11-29 02:32:53.284055] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.748 [2024-11-29 02:32:53.284080] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.748 [2024-11-29 02:32:53.284094] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.748 [2024-11-29 02:32:53.284107] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.748 [2024-11-29 02:32:53.284137] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.748 qpair failed and we were unable to recover it. 00:27:49.749 [2024-11-29 02:32:53.293944] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.749 [2024-11-29 02:32:53.294036] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.749 [2024-11-29 02:32:53.294061] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.749 [2024-11-29 02:32:53.294075] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.749 [2024-11-29 02:32:53.294094] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.749 [2024-11-29 02:32:53.294125] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.749 qpair failed and we were unable to recover it. 00:27:49.749 [2024-11-29 02:32:53.303981] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.749 [2024-11-29 02:32:53.304072] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.749 [2024-11-29 02:32:53.304101] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.749 [2024-11-29 02:32:53.304115] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.749 [2024-11-29 02:32:53.304129] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.749 [2024-11-29 02:32:53.304159] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.749 qpair failed and we were unable to recover it. 00:27:49.749 [2024-11-29 02:32:53.314025] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.749 [2024-11-29 02:32:53.314162] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.749 [2024-11-29 02:32:53.314188] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.749 [2024-11-29 02:32:53.314202] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.749 [2024-11-29 02:32:53.314216] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.749 [2024-11-29 02:32:53.314245] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.749 qpair failed and we were unable to recover it. 00:27:49.749 [2024-11-29 02:32:53.324137] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.749 [2024-11-29 02:32:53.324267] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.749 [2024-11-29 02:32:53.324293] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.749 [2024-11-29 02:32:53.324307] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.749 [2024-11-29 02:32:53.324320] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.749 [2024-11-29 02:32:53.324351] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.749 qpair failed and we were unable to recover it. 00:27:49.749 [2024-11-29 02:32:53.334063] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.749 [2024-11-29 02:32:53.334154] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.749 [2024-11-29 02:32:53.334179] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.749 [2024-11-29 02:32:53.334194] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.749 [2024-11-29 02:32:53.334207] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.749 [2024-11-29 02:32:53.334235] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.749 qpair failed and we were unable to recover it. 00:27:49.749 [2024-11-29 02:32:53.344085] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.749 [2024-11-29 02:32:53.344181] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.749 [2024-11-29 02:32:53.344210] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.749 [2024-11-29 02:32:53.344225] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.749 [2024-11-29 02:32:53.344238] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.749 [2024-11-29 02:32:53.344269] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.749 qpair failed and we were unable to recover it. 00:27:49.749 [2024-11-29 02:32:53.354140] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.749 [2024-11-29 02:32:53.354249] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.749 [2024-11-29 02:32:53.354275] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.749 [2024-11-29 02:32:53.354289] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.749 [2024-11-29 02:32:53.354303] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.749 [2024-11-29 02:32:53.354332] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.749 qpair failed and we were unable to recover it. 00:27:49.749 [2024-11-29 02:32:53.364121] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.749 [2024-11-29 02:32:53.364221] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.749 [2024-11-29 02:32:53.364247] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.749 [2024-11-29 02:32:53.364261] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.749 [2024-11-29 02:32:53.364274] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.749 [2024-11-29 02:32:53.364303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.749 qpair failed and we were unable to recover it. 00:27:49.749 [2024-11-29 02:32:53.374181] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.749 [2024-11-29 02:32:53.374271] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.749 [2024-11-29 02:32:53.374297] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.749 [2024-11-29 02:32:53.374311] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.749 [2024-11-29 02:32:53.374324] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.749 [2024-11-29 02:32:53.374354] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.749 qpair failed and we were unable to recover it. 00:27:49.749 [2024-11-29 02:32:53.384206] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.749 [2024-11-29 02:32:53.384299] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.749 [2024-11-29 02:32:53.384325] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.749 [2024-11-29 02:32:53.384339] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.749 [2024-11-29 02:32:53.384359] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.749 [2024-11-29 02:32:53.384390] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.749 qpair failed and we were unable to recover it. 00:27:49.749 [2024-11-29 02:32:53.394333] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.749 [2024-11-29 02:32:53.394461] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.749 [2024-11-29 02:32:53.394486] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.749 [2024-11-29 02:32:53.394500] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.749 [2024-11-29 02:32:53.394513] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.749 [2024-11-29 02:32:53.394544] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.749 qpair failed and we were unable to recover it. 00:27:49.749 [2024-11-29 02:32:53.404288] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.749 [2024-11-29 02:32:53.404420] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.749 [2024-11-29 02:32:53.404446] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.749 [2024-11-29 02:32:53.404460] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.749 [2024-11-29 02:32:53.404473] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.749 [2024-11-29 02:32:53.404502] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.749 qpair failed and we were unable to recover it. 00:27:49.749 [2024-11-29 02:32:53.414264] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.749 [2024-11-29 02:32:53.414358] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.749 [2024-11-29 02:32:53.414383] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.749 [2024-11-29 02:32:53.414404] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.749 [2024-11-29 02:32:53.414419] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.749 [2024-11-29 02:32:53.414449] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.749 qpair failed and we were unable to recover it. 00:27:49.749 [2024-11-29 02:32:53.424323] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.749 [2024-11-29 02:32:53.424443] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.749 [2024-11-29 02:32:53.424468] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.750 [2024-11-29 02:32:53.424482] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.750 [2024-11-29 02:32:53.424496] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:49.750 [2024-11-29 02:32:53.424525] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.750 qpair failed and we were unable to recover it. 00:27:50.009 [2024-11-29 02:32:53.434325] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.009 [2024-11-29 02:32:53.434452] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.009 [2024-11-29 02:32:53.434478] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.009 [2024-11-29 02:32:53.434492] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.009 [2024-11-29 02:32:53.434504] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.009 [2024-11-29 02:32:53.434534] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.009 qpair failed and we were unable to recover it. 00:27:50.009 [2024-11-29 02:32:53.444374] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.009 [2024-11-29 02:32:53.444507] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.009 [2024-11-29 02:32:53.444533] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.009 [2024-11-29 02:32:53.444547] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.009 [2024-11-29 02:32:53.444560] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.009 [2024-11-29 02:32:53.444589] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.009 qpair failed and we were unable to recover it. 00:27:50.009 [2024-11-29 02:32:53.454385] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.009 [2024-11-29 02:32:53.454502] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.009 [2024-11-29 02:32:53.454527] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.009 [2024-11-29 02:32:53.454542] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.010 [2024-11-29 02:32:53.454554] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.010 [2024-11-29 02:32:53.454584] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.010 qpair failed and we were unable to recover it. 00:27:50.010 [2024-11-29 02:32:53.464523] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.010 [2024-11-29 02:32:53.464611] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.010 [2024-11-29 02:32:53.464638] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.010 [2024-11-29 02:32:53.464652] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.010 [2024-11-29 02:32:53.464665] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.010 [2024-11-29 02:32:53.464695] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.010 qpair failed and we were unable to recover it. 00:27:50.010 [2024-11-29 02:32:53.474446] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.010 [2024-11-29 02:32:53.474553] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.010 [2024-11-29 02:32:53.474578] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.010 [2024-11-29 02:32:53.474599] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.010 [2024-11-29 02:32:53.474612] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.010 [2024-11-29 02:32:53.474642] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.010 qpair failed and we were unable to recover it. 00:27:50.010 [2024-11-29 02:32:53.484559] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.010 [2024-11-29 02:32:53.484652] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.010 [2024-11-29 02:32:53.484677] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.010 [2024-11-29 02:32:53.484691] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.010 [2024-11-29 02:32:53.484704] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.010 [2024-11-29 02:32:53.484734] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.010 qpair failed and we were unable to recover it. 00:27:50.010 [2024-11-29 02:32:53.494491] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.010 [2024-11-29 02:32:53.494596] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.010 [2024-11-29 02:32:53.494622] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.010 [2024-11-29 02:32:53.494637] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.010 [2024-11-29 02:32:53.494650] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.010 [2024-11-29 02:32:53.494679] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.010 qpair failed and we were unable to recover it. 00:27:50.010 [2024-11-29 02:32:53.504619] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.010 [2024-11-29 02:32:53.504713] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.010 [2024-11-29 02:32:53.504742] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.010 [2024-11-29 02:32:53.504758] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.010 [2024-11-29 02:32:53.504771] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.010 [2024-11-29 02:32:53.504801] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.010 qpair failed and we were unable to recover it. 00:27:50.010 [2024-11-29 02:32:53.514590] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.010 [2024-11-29 02:32:53.514711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.010 [2024-11-29 02:32:53.514737] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.010 [2024-11-29 02:32:53.514751] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.010 [2024-11-29 02:32:53.514764] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.010 [2024-11-29 02:32:53.514795] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.010 qpair failed and we were unable to recover it. 00:27:50.010 [2024-11-29 02:32:53.524590] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.010 [2024-11-29 02:32:53.524687] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.010 [2024-11-29 02:32:53.524713] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.010 [2024-11-29 02:32:53.524727] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.010 [2024-11-29 02:32:53.524740] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.010 [2024-11-29 02:32:53.524770] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.010 qpair failed and we were unable to recover it. 00:27:50.010 [2024-11-29 02:32:53.534677] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.010 [2024-11-29 02:32:53.534779] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.010 [2024-11-29 02:32:53.534803] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.010 [2024-11-29 02:32:53.534817] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.010 [2024-11-29 02:32:53.534829] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.010 [2024-11-29 02:32:53.534858] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.010 qpair failed and we were unable to recover it. 00:27:50.010 [2024-11-29 02:32:53.544680] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.010 [2024-11-29 02:32:53.544774] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.010 [2024-11-29 02:32:53.544799] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.010 [2024-11-29 02:32:53.544814] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.010 [2024-11-29 02:32:53.544827] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.010 [2024-11-29 02:32:53.544856] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.010 qpair failed and we were unable to recover it. 00:27:50.010 [2024-11-29 02:32:53.554667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.010 [2024-11-29 02:32:53.554767] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.010 [2024-11-29 02:32:53.554796] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.010 [2024-11-29 02:32:53.554813] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.010 [2024-11-29 02:32:53.554826] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.010 [2024-11-29 02:32:53.554858] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.010 qpair failed and we were unable to recover it. 00:27:50.010 [2024-11-29 02:32:53.564700] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.010 [2024-11-29 02:32:53.564803] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.010 [2024-11-29 02:32:53.564835] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.010 [2024-11-29 02:32:53.564850] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.010 [2024-11-29 02:32:53.564863] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.010 [2024-11-29 02:32:53.564892] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.010 qpair failed and we were unable to recover it. 00:27:50.010 [2024-11-29 02:32:53.574737] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.010 [2024-11-29 02:32:53.574825] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.010 [2024-11-29 02:32:53.574850] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.010 [2024-11-29 02:32:53.574865] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.010 [2024-11-29 02:32:53.574878] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.010 [2024-11-29 02:32:53.574907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.010 qpair failed and we were unable to recover it. 00:27:50.010 [2024-11-29 02:32:53.584767] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.010 [2024-11-29 02:32:53.584863] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.010 [2024-11-29 02:32:53.584888] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.010 [2024-11-29 02:32:53.584902] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.010 [2024-11-29 02:32:53.584916] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.010 [2024-11-29 02:32:53.584946] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.010 qpair failed and we were unable to recover it. 00:27:50.011 [2024-11-29 02:32:53.594790] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.011 [2024-11-29 02:32:53.594922] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.011 [2024-11-29 02:32:53.594947] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.011 [2024-11-29 02:32:53.594961] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.011 [2024-11-29 02:32:53.594974] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.011 [2024-11-29 02:32:53.595005] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.011 qpair failed and we were unable to recover it. 00:27:50.011 [2024-11-29 02:32:53.604791] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.011 [2024-11-29 02:32:53.604918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.011 [2024-11-29 02:32:53.604944] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.011 [2024-11-29 02:32:53.604958] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.011 [2024-11-29 02:32:53.604971] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.011 [2024-11-29 02:32:53.604999] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.011 qpair failed and we were unable to recover it. 00:27:50.011 [2024-11-29 02:32:53.614829] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.011 [2024-11-29 02:32:53.614945] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.011 [2024-11-29 02:32:53.614971] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.011 [2024-11-29 02:32:53.614985] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.011 [2024-11-29 02:32:53.614998] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.011 [2024-11-29 02:32:53.615027] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.011 qpair failed and we were unable to recover it. 00:27:50.011 [2024-11-29 02:32:53.624945] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.011 [2024-11-29 02:32:53.625034] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.011 [2024-11-29 02:32:53.625059] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.011 [2024-11-29 02:32:53.625073] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.011 [2024-11-29 02:32:53.625087] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.011 [2024-11-29 02:32:53.625116] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.011 qpair failed and we were unable to recover it. 00:27:50.011 [2024-11-29 02:32:53.634900] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.011 [2024-11-29 02:32:53.634991] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.011 [2024-11-29 02:32:53.635017] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.011 [2024-11-29 02:32:53.635032] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.011 [2024-11-29 02:32:53.635044] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.011 [2024-11-29 02:32:53.635075] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.011 qpair failed and we were unable to recover it. 00:27:50.011 [2024-11-29 02:32:53.644948] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.011 [2024-11-29 02:32:53.645038] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.011 [2024-11-29 02:32:53.645063] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.011 [2024-11-29 02:32:53.645077] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.011 [2024-11-29 02:32:53.645091] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.011 [2024-11-29 02:32:53.645119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.011 qpair failed and we were unable to recover it. 00:27:50.011 [2024-11-29 02:32:53.654971] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.011 [2024-11-29 02:32:53.655070] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.011 [2024-11-29 02:32:53.655104] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.011 [2024-11-29 02:32:53.655121] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.011 [2024-11-29 02:32:53.655134] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.011 [2024-11-29 02:32:53.655163] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.011 qpair failed and we were unable to recover it. 00:27:50.011 [2024-11-29 02:32:53.664965] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.011 [2024-11-29 02:32:53.665050] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.011 [2024-11-29 02:32:53.665075] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.011 [2024-11-29 02:32:53.665090] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.011 [2024-11-29 02:32:53.665103] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.011 [2024-11-29 02:32:53.665133] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.011 qpair failed and we were unable to recover it. 00:27:50.011 [2024-11-29 02:32:53.675046] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.011 [2024-11-29 02:32:53.675140] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.011 [2024-11-29 02:32:53.675166] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.011 [2024-11-29 02:32:53.675180] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.011 [2024-11-29 02:32:53.675194] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.011 [2024-11-29 02:32:53.675223] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.011 qpair failed and we were unable to recover it. 00:27:50.011 [2024-11-29 02:32:53.685056] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.011 [2024-11-29 02:32:53.685181] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.011 [2024-11-29 02:32:53.685206] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.011 [2024-11-29 02:32:53.685220] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.011 [2024-11-29 02:32:53.685233] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.011 [2024-11-29 02:32:53.685262] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.011 qpair failed and we were unable to recover it. 00:27:50.271 [2024-11-29 02:32:53.695171] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.271 [2024-11-29 02:32:53.695269] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.271 [2024-11-29 02:32:53.695295] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.271 [2024-11-29 02:32:53.695309] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.271 [2024-11-29 02:32:53.695323] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.271 [2024-11-29 02:32:53.695358] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.271 qpair failed and we were unable to recover it. 00:27:50.271 [2024-11-29 02:32:53.705145] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.271 [2024-11-29 02:32:53.705240] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.271 [2024-11-29 02:32:53.705265] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.271 [2024-11-29 02:32:53.705279] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.271 [2024-11-29 02:32:53.705292] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.271 [2024-11-29 02:32:53.705321] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.271 qpair failed and we were unable to recover it. 00:27:50.271 [2024-11-29 02:32:53.715212] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.271 [2024-11-29 02:32:53.715305] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.271 [2024-11-29 02:32:53.715330] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.271 [2024-11-29 02:32:53.715344] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.271 [2024-11-29 02:32:53.715358] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.271 [2024-11-29 02:32:53.715389] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.271 qpair failed and we were unable to recover it. 00:27:50.271 [2024-11-29 02:32:53.725202] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.271 [2024-11-29 02:32:53.725317] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.271 [2024-11-29 02:32:53.725343] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.271 [2024-11-29 02:32:53.725357] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.271 [2024-11-29 02:32:53.725371] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.271 [2024-11-29 02:32:53.725407] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.271 qpair failed and we were unable to recover it. 00:27:50.271 [2024-11-29 02:32:53.735192] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.271 [2024-11-29 02:32:53.735298] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.271 [2024-11-29 02:32:53.735324] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.271 [2024-11-29 02:32:53.735339] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.271 [2024-11-29 02:32:53.735352] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.271 [2024-11-29 02:32:53.735381] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.271 qpair failed and we were unable to recover it. 00:27:50.271 [2024-11-29 02:32:53.745206] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.271 [2024-11-29 02:32:53.745300] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.271 [2024-11-29 02:32:53.745332] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.271 [2024-11-29 02:32:53.745347] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.271 [2024-11-29 02:32:53.745360] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.271 [2024-11-29 02:32:53.745389] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.271 qpair failed and we were unable to recover it. 00:27:50.271 [2024-11-29 02:32:53.755239] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.271 [2024-11-29 02:32:53.755359] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.271 [2024-11-29 02:32:53.755383] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.271 [2024-11-29 02:32:53.755407] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.271 [2024-11-29 02:32:53.755422] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.271 [2024-11-29 02:32:53.755451] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.271 qpair failed and we were unable to recover it. 00:27:50.271 [2024-11-29 02:32:53.765257] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.271 [2024-11-29 02:32:53.765380] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.271 [2024-11-29 02:32:53.765413] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.271 [2024-11-29 02:32:53.765428] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.271 [2024-11-29 02:32:53.765441] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.271 [2024-11-29 02:32:53.765470] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.271 qpair failed and we were unable to recover it. 00:27:50.271 [2024-11-29 02:32:53.775294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.271 [2024-11-29 02:32:53.775399] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.271 [2024-11-29 02:32:53.775428] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.271 [2024-11-29 02:32:53.775443] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.271 [2024-11-29 02:32:53.775456] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.271 [2024-11-29 02:32:53.775486] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.271 qpair failed and we were unable to recover it. 00:27:50.271 [2024-11-29 02:32:53.785321] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.271 [2024-11-29 02:32:53.785428] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.271 [2024-11-29 02:32:53.785455] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.271 [2024-11-29 02:32:53.785470] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.272 [2024-11-29 02:32:53.785492] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.272 [2024-11-29 02:32:53.785524] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.272 qpair failed and we were unable to recover it. 00:27:50.272 [2024-11-29 02:32:53.795369] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.272 [2024-11-29 02:32:53.795476] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.272 [2024-11-29 02:32:53.795501] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.272 [2024-11-29 02:32:53.795516] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.272 [2024-11-29 02:32:53.795529] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.272 [2024-11-29 02:32:53.795558] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.272 qpair failed and we were unable to recover it. 00:27:50.272 [2024-11-29 02:32:53.805377] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.272 [2024-11-29 02:32:53.805476] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.272 [2024-11-29 02:32:53.805502] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.272 [2024-11-29 02:32:53.805516] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.272 [2024-11-29 02:32:53.805529] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.272 [2024-11-29 02:32:53.805559] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.272 qpair failed and we were unable to recover it. 00:27:50.272 [2024-11-29 02:32:53.815538] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.272 [2024-11-29 02:32:53.815627] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.272 [2024-11-29 02:32:53.815652] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.272 [2024-11-29 02:32:53.815666] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.272 [2024-11-29 02:32:53.815679] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.272 [2024-11-29 02:32:53.815709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.272 qpair failed and we were unable to recover it. 00:27:50.272 [2024-11-29 02:32:53.825479] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.272 [2024-11-29 02:32:53.825575] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.272 [2024-11-29 02:32:53.825600] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.272 [2024-11-29 02:32:53.825614] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.272 [2024-11-29 02:32:53.825627] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.272 [2024-11-29 02:32:53.825657] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.272 qpair failed and we were unable to recover it. 00:27:50.272 [2024-11-29 02:32:53.835483] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.272 [2024-11-29 02:32:53.835577] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.272 [2024-11-29 02:32:53.835602] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.272 [2024-11-29 02:32:53.835617] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.272 [2024-11-29 02:32:53.835630] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.272 [2024-11-29 02:32:53.835659] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.272 qpair failed and we were unable to recover it. 00:27:50.272 [2024-11-29 02:32:53.845543] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.272 [2024-11-29 02:32:53.845637] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.272 [2024-11-29 02:32:53.845662] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.272 [2024-11-29 02:32:53.845676] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.272 [2024-11-29 02:32:53.845689] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.272 [2024-11-29 02:32:53.845718] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.272 qpair failed and we were unable to recover it. 00:27:50.272 [2024-11-29 02:32:53.855552] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.272 [2024-11-29 02:32:53.855678] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.272 [2024-11-29 02:32:53.855703] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.272 [2024-11-29 02:32:53.855717] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.272 [2024-11-29 02:32:53.855731] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.272 [2024-11-29 02:32:53.855761] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.272 qpair failed and we were unable to recover it. 00:27:50.272 [2024-11-29 02:32:53.865552] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.272 [2024-11-29 02:32:53.865639] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.272 [2024-11-29 02:32:53.865664] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.272 [2024-11-29 02:32:53.865678] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.272 [2024-11-29 02:32:53.865691] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.272 [2024-11-29 02:32:53.865720] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.272 qpair failed and we were unable to recover it. 00:27:50.272 [2024-11-29 02:32:53.875621] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.272 [2024-11-29 02:32:53.875716] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.272 [2024-11-29 02:32:53.875741] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.272 [2024-11-29 02:32:53.875756] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.272 [2024-11-29 02:32:53.875774] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.272 [2024-11-29 02:32:53.875806] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.272 qpair failed and we were unable to recover it. 00:27:50.272 [2024-11-29 02:32:53.885627] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.272 [2024-11-29 02:32:53.885719] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.272 [2024-11-29 02:32:53.885744] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.272 [2024-11-29 02:32:53.885758] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.272 [2024-11-29 02:32:53.885771] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.272 [2024-11-29 02:32:53.885800] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.272 qpair failed and we were unable to recover it. 00:27:50.272 [2024-11-29 02:32:53.895679] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.272 [2024-11-29 02:32:53.895783] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.272 [2024-11-29 02:32:53.895808] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.272 [2024-11-29 02:32:53.895822] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.272 [2024-11-29 02:32:53.895836] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.272 [2024-11-29 02:32:53.895866] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.272 qpair failed and we were unable to recover it. 00:27:50.272 [2024-11-29 02:32:53.905703] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.272 [2024-11-29 02:32:53.905791] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.272 [2024-11-29 02:32:53.905817] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.272 [2024-11-29 02:32:53.905832] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.272 [2024-11-29 02:32:53.905845] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.272 [2024-11-29 02:32:53.905874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.272 qpair failed and we were unable to recover it. 00:27:50.272 [2024-11-29 02:32:53.915790] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.272 [2024-11-29 02:32:53.915886] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.272 [2024-11-29 02:32:53.915911] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.272 [2024-11-29 02:32:53.915925] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.272 [2024-11-29 02:32:53.915938] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.272 [2024-11-29 02:32:53.915967] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.273 qpair failed and we were unable to recover it. 00:27:50.273 [2024-11-29 02:32:53.925838] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.273 [2024-11-29 02:32:53.925933] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.273 [2024-11-29 02:32:53.925958] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.273 [2024-11-29 02:32:53.925973] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.273 [2024-11-29 02:32:53.925985] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.273 [2024-11-29 02:32:53.926016] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.273 qpair failed and we were unable to recover it. 00:27:50.273 [2024-11-29 02:32:53.935773] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.273 [2024-11-29 02:32:53.935898] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.273 [2024-11-29 02:32:53.935923] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.273 [2024-11-29 02:32:53.935937] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.273 [2024-11-29 02:32:53.935950] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.273 [2024-11-29 02:32:53.935979] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.273 qpair failed and we were unable to recover it. 00:27:50.273 [2024-11-29 02:32:53.945827] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.273 [2024-11-29 02:32:53.945919] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.273 [2024-11-29 02:32:53.945948] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.273 [2024-11-29 02:32:53.945963] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.273 [2024-11-29 02:32:53.945976] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.273 [2024-11-29 02:32:53.946007] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.273 qpair failed and we were unable to recover it. 00:27:50.532 [2024-11-29 02:32:53.955842] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.532 [2024-11-29 02:32:53.955937] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.532 [2024-11-29 02:32:53.955963] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.532 [2024-11-29 02:32:53.955977] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.532 [2024-11-29 02:32:53.955990] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.532 [2024-11-29 02:32:53.956022] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.532 qpair failed and we were unable to recover it. 00:27:50.532 [2024-11-29 02:32:53.965851] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.532 [2024-11-29 02:32:53.965978] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.532 [2024-11-29 02:32:53.966003] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.532 [2024-11-29 02:32:53.966024] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.532 [2024-11-29 02:32:53.966038] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.532 [2024-11-29 02:32:53.966067] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.532 qpair failed and we were unable to recover it. 00:27:50.532 [2024-11-29 02:32:53.975884] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.532 [2024-11-29 02:32:53.976015] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.532 [2024-11-29 02:32:53.976040] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.532 [2024-11-29 02:32:53.976055] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.532 [2024-11-29 02:32:53.976067] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.532 [2024-11-29 02:32:53.976097] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.532 qpair failed and we were unable to recover it. 00:27:50.532 [2024-11-29 02:32:53.985917] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.532 [2024-11-29 02:32:53.986014] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.532 [2024-11-29 02:32:53.986040] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.532 [2024-11-29 02:32:53.986055] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.532 [2024-11-29 02:32:53.986068] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.532 [2024-11-29 02:32:53.986097] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.532 qpair failed and we were unable to recover it. 00:27:50.532 [2024-11-29 02:32:53.996039] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.532 [2024-11-29 02:32:53.996132] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.532 [2024-11-29 02:32:53.996157] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.532 [2024-11-29 02:32:53.996171] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.532 [2024-11-29 02:32:53.996184] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.532 [2024-11-29 02:32:53.996214] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.532 qpair failed and we were unable to recover it. 00:27:50.532 [2024-11-29 02:32:54.005960] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.532 [2024-11-29 02:32:54.006047] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.532 [2024-11-29 02:32:54.006071] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.532 [2024-11-29 02:32:54.006085] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.532 [2024-11-29 02:32:54.006099] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.532 [2024-11-29 02:32:54.006127] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.532 qpair failed and we were unable to recover it. 00:27:50.532 [2024-11-29 02:32:54.016011] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.532 [2024-11-29 02:32:54.016130] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.533 [2024-11-29 02:32:54.016155] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.533 [2024-11-29 02:32:54.016169] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.533 [2024-11-29 02:32:54.016182] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.533 [2024-11-29 02:32:54.016211] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.533 qpair failed and we were unable to recover it. 00:27:50.533 [2024-11-29 02:32:54.026026] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.533 [2024-11-29 02:32:54.026116] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.533 [2024-11-29 02:32:54.026141] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.533 [2024-11-29 02:32:54.026155] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.533 [2024-11-29 02:32:54.026168] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.533 [2024-11-29 02:32:54.026198] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.533 qpair failed and we were unable to recover it. 00:27:50.533 [2024-11-29 02:32:54.036058] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.533 [2024-11-29 02:32:54.036146] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.533 [2024-11-29 02:32:54.036171] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.533 [2024-11-29 02:32:54.036186] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.533 [2024-11-29 02:32:54.036199] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.533 [2024-11-29 02:32:54.036228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.533 qpair failed and we were unable to recover it. 00:27:50.533 [2024-11-29 02:32:54.046076] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.533 [2024-11-29 02:32:54.046159] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.533 [2024-11-29 02:32:54.046184] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.533 [2024-11-29 02:32:54.046198] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.533 [2024-11-29 02:32:54.046211] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.533 [2024-11-29 02:32:54.046242] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.533 qpair failed and we were unable to recover it. 00:27:50.533 [2024-11-29 02:32:54.056100] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.533 [2024-11-29 02:32:54.056186] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.533 [2024-11-29 02:32:54.056211] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.533 [2024-11-29 02:32:54.056231] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.533 [2024-11-29 02:32:54.056245] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.533 [2024-11-29 02:32:54.056276] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.533 qpair failed and we were unable to recover it. 00:27:50.533 [2024-11-29 02:32:54.066139] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.533 [2024-11-29 02:32:54.066227] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.533 [2024-11-29 02:32:54.066252] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.533 [2024-11-29 02:32:54.066267] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.533 [2024-11-29 02:32:54.066280] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.533 [2024-11-29 02:32:54.066309] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.533 qpair failed and we were unable to recover it. 00:27:50.533 [2024-11-29 02:32:54.076183] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.533 [2024-11-29 02:32:54.076275] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.533 [2024-11-29 02:32:54.076301] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.533 [2024-11-29 02:32:54.076316] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.533 [2024-11-29 02:32:54.076329] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.533 [2024-11-29 02:32:54.076360] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.533 qpair failed and we were unable to recover it. 00:27:50.533 [2024-11-29 02:32:54.086184] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.533 [2024-11-29 02:32:54.086271] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.533 [2024-11-29 02:32:54.086296] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.533 [2024-11-29 02:32:54.086310] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.533 [2024-11-29 02:32:54.086324] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.533 [2024-11-29 02:32:54.086353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.533 qpair failed and we were unable to recover it. 00:27:50.533 [2024-11-29 02:32:54.096228] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.533 [2024-11-29 02:32:54.096345] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.533 [2024-11-29 02:32:54.096374] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.533 [2024-11-29 02:32:54.096389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.533 [2024-11-29 02:32:54.096409] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.533 [2024-11-29 02:32:54.096439] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.533 qpair failed and we were unable to recover it. 00:27:50.533 [2024-11-29 02:32:54.106264] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.533 [2024-11-29 02:32:54.106387] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.533 [2024-11-29 02:32:54.106421] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.533 [2024-11-29 02:32:54.106436] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.533 [2024-11-29 02:32:54.106449] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.533 [2024-11-29 02:32:54.106480] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.533 qpair failed and we were unable to recover it. 00:27:50.533 [2024-11-29 02:32:54.116383] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.533 [2024-11-29 02:32:54.116510] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.533 [2024-11-29 02:32:54.116536] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.533 [2024-11-29 02:32:54.116550] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.533 [2024-11-29 02:32:54.116563] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.533 [2024-11-29 02:32:54.116593] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.533 qpair failed and we were unable to recover it. 00:27:50.533 [2024-11-29 02:32:54.126297] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.533 [2024-11-29 02:32:54.126406] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.533 [2024-11-29 02:32:54.126433] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.533 [2024-11-29 02:32:54.126447] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.533 [2024-11-29 02:32:54.126460] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.533 [2024-11-29 02:32:54.126490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.533 qpair failed and we were unable to recover it. 00:27:50.533 [2024-11-29 02:32:54.136330] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.533 [2024-11-29 02:32:54.136444] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.533 [2024-11-29 02:32:54.136471] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.533 [2024-11-29 02:32:54.136486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.533 [2024-11-29 02:32:54.136499] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.533 [2024-11-29 02:32:54.136531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.533 qpair failed and we were unable to recover it. 00:27:50.533 [2024-11-29 02:32:54.146463] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.533 [2024-11-29 02:32:54.146556] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.533 [2024-11-29 02:32:54.146586] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.533 [2024-11-29 02:32:54.146602] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.534 [2024-11-29 02:32:54.146615] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.534 [2024-11-29 02:32:54.146647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.534 qpair failed and we were unable to recover it. 00:27:50.534 [2024-11-29 02:32:54.156495] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.534 [2024-11-29 02:32:54.156598] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.534 [2024-11-29 02:32:54.156626] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.534 [2024-11-29 02:32:54.156642] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.534 [2024-11-29 02:32:54.156655] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.534 [2024-11-29 02:32:54.156686] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.534 qpair failed and we were unable to recover it. 00:27:50.534 [2024-11-29 02:32:54.166436] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.534 [2024-11-29 02:32:54.166526] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.534 [2024-11-29 02:32:54.166552] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.534 [2024-11-29 02:32:54.166566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.534 [2024-11-29 02:32:54.166579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.534 [2024-11-29 02:32:54.166610] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.534 qpair failed and we were unable to recover it. 00:27:50.534 [2024-11-29 02:32:54.176460] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.534 [2024-11-29 02:32:54.176547] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.534 [2024-11-29 02:32:54.176572] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.534 [2024-11-29 02:32:54.176586] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.534 [2024-11-29 02:32:54.176599] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.534 [2024-11-29 02:32:54.176630] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.534 qpair failed and we were unable to recover it. 00:27:50.534 [2024-11-29 02:32:54.186505] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.534 [2024-11-29 02:32:54.186599] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.534 [2024-11-29 02:32:54.186624] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.534 [2024-11-29 02:32:54.186640] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.534 [2024-11-29 02:32:54.186653] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.534 [2024-11-29 02:32:54.186690] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.534 qpair failed and we were unable to recover it. 00:27:50.534 [2024-11-29 02:32:54.196573] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.534 [2024-11-29 02:32:54.196699] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.534 [2024-11-29 02:32:54.196727] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.534 [2024-11-29 02:32:54.196742] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.534 [2024-11-29 02:32:54.196755] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.534 [2024-11-29 02:32:54.196785] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.534 qpair failed and we were unable to recover it. 00:27:50.534 [2024-11-29 02:32:54.206537] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.534 [2024-11-29 02:32:54.206645] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.534 [2024-11-29 02:32:54.206671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.534 [2024-11-29 02:32:54.206686] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.534 [2024-11-29 02:32:54.206699] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.534 [2024-11-29 02:32:54.206728] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.534 qpair failed and we were unable to recover it. 00:27:50.794 [2024-11-29 02:32:54.216556] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.794 [2024-11-29 02:32:54.216653] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.794 [2024-11-29 02:32:54.216683] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.794 [2024-11-29 02:32:54.216698] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.794 [2024-11-29 02:32:54.216711] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.794 [2024-11-29 02:32:54.216742] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.794 qpair failed and we were unable to recover it. 00:27:50.794 [2024-11-29 02:32:54.226602] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.794 [2024-11-29 02:32:54.226695] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.794 [2024-11-29 02:32:54.226724] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.794 [2024-11-29 02:32:54.226740] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.794 [2024-11-29 02:32:54.226753] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.794 [2024-11-29 02:32:54.226783] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.794 qpair failed and we were unable to recover it. 00:27:50.794 [2024-11-29 02:32:54.236653] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.794 [2024-11-29 02:32:54.236757] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.794 [2024-11-29 02:32:54.236791] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.794 [2024-11-29 02:32:54.236807] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.794 [2024-11-29 02:32:54.236828] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.794 [2024-11-29 02:32:54.236858] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.794 qpair failed and we were unable to recover it. 00:27:50.794 [2024-11-29 02:32:54.246645] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.794 [2024-11-29 02:32:54.246737] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.794 [2024-11-29 02:32:54.246763] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.794 [2024-11-29 02:32:54.246776] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.794 [2024-11-29 02:32:54.246790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.794 [2024-11-29 02:32:54.246820] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.794 qpair failed and we were unable to recover it. 00:27:50.794 [2024-11-29 02:32:54.256661] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.794 [2024-11-29 02:32:54.256779] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.794 [2024-11-29 02:32:54.256805] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.794 [2024-11-29 02:32:54.256819] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.794 [2024-11-29 02:32:54.256832] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.794 [2024-11-29 02:32:54.256862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.794 qpair failed and we were unable to recover it. 00:27:50.794 [2024-11-29 02:32:54.266698] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.794 [2024-11-29 02:32:54.266791] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.794 [2024-11-29 02:32:54.266816] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.794 [2024-11-29 02:32:54.266830] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.794 [2024-11-29 02:32:54.266843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.794 [2024-11-29 02:32:54.266873] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.794 qpair failed and we were unable to recover it. 00:27:50.794 [2024-11-29 02:32:54.276764] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.794 [2024-11-29 02:32:54.276862] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.794 [2024-11-29 02:32:54.276888] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.794 [2024-11-29 02:32:54.276902] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.794 [2024-11-29 02:32:54.276915] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.794 [2024-11-29 02:32:54.276951] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.794 qpair failed and we were unable to recover it. 00:27:50.794 [2024-11-29 02:32:54.286821] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.794 [2024-11-29 02:32:54.286919] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.794 [2024-11-29 02:32:54.286944] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.794 [2024-11-29 02:32:54.286958] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.794 [2024-11-29 02:32:54.286971] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.794 [2024-11-29 02:32:54.287000] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.794 qpair failed and we were unable to recover it. 00:27:50.794 [2024-11-29 02:32:54.296924] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.794 [2024-11-29 02:32:54.297008] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.794 [2024-11-29 02:32:54.297034] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.794 [2024-11-29 02:32:54.297048] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.794 [2024-11-29 02:32:54.297060] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.794 [2024-11-29 02:32:54.297091] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.794 qpair failed and we were unable to recover it. 00:27:50.794 [2024-11-29 02:32:54.306847] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.794 [2024-11-29 02:32:54.306936] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.794 [2024-11-29 02:32:54.306962] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.794 [2024-11-29 02:32:54.306976] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.794 [2024-11-29 02:32:54.306989] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.794 [2024-11-29 02:32:54.307020] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.794 qpair failed and we were unable to recover it. 00:27:50.795 [2024-11-29 02:32:54.316846] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.795 [2024-11-29 02:32:54.316959] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.795 [2024-11-29 02:32:54.316984] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.795 [2024-11-29 02:32:54.316998] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.795 [2024-11-29 02:32:54.317011] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.795 [2024-11-29 02:32:54.317040] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.795 qpair failed and we were unable to recover it. 00:27:50.795 [2024-11-29 02:32:54.326970] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.795 [2024-11-29 02:32:54.327069] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.795 [2024-11-29 02:32:54.327095] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.795 [2024-11-29 02:32:54.327109] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.795 [2024-11-29 02:32:54.327122] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.795 [2024-11-29 02:32:54.327153] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.795 qpair failed and we were unable to recover it. 00:27:50.795 [2024-11-29 02:32:54.337032] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.795 [2024-11-29 02:32:54.337123] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.795 [2024-11-29 02:32:54.337148] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.795 [2024-11-29 02:32:54.337162] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.795 [2024-11-29 02:32:54.337175] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.795 [2024-11-29 02:32:54.337204] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.795 qpair failed and we were unable to recover it. 00:27:50.795 [2024-11-29 02:32:54.346949] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.795 [2024-11-29 02:32:54.347042] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.795 [2024-11-29 02:32:54.347067] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.795 [2024-11-29 02:32:54.347082] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.795 [2024-11-29 02:32:54.347096] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.795 [2024-11-29 02:32:54.347124] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.795 qpair failed and we were unable to recover it. 00:27:50.795 [2024-11-29 02:32:54.356961] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.795 [2024-11-29 02:32:54.357053] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.795 [2024-11-29 02:32:54.357078] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.795 [2024-11-29 02:32:54.357093] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.795 [2024-11-29 02:32:54.357106] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.795 [2024-11-29 02:32:54.357134] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.795 qpair failed and we were unable to recover it. 00:27:50.795 [2024-11-29 02:32:54.367023] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.795 [2024-11-29 02:32:54.367119] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.795 [2024-11-29 02:32:54.367144] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.795 [2024-11-29 02:32:54.367158] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.795 [2024-11-29 02:32:54.367177] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.795 [2024-11-29 02:32:54.367208] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.795 qpair failed and we were unable to recover it. 00:27:50.795 [2024-11-29 02:32:54.377031] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.795 [2024-11-29 02:32:54.377117] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.795 [2024-11-29 02:32:54.377143] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.795 [2024-11-29 02:32:54.377157] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.795 [2024-11-29 02:32:54.377170] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.795 [2024-11-29 02:32:54.377199] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.795 qpair failed and we were unable to recover it. 00:27:50.795 [2024-11-29 02:32:54.387061] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.795 [2024-11-29 02:32:54.387152] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.795 [2024-11-29 02:32:54.387177] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.795 [2024-11-29 02:32:54.387192] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.795 [2024-11-29 02:32:54.387205] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.795 [2024-11-29 02:32:54.387234] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.795 qpair failed and we were unable to recover it. 00:27:50.795 [2024-11-29 02:32:54.397106] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.795 [2024-11-29 02:32:54.397203] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.795 [2024-11-29 02:32:54.397233] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.795 [2024-11-29 02:32:54.397249] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.795 [2024-11-29 02:32:54.397262] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.795 [2024-11-29 02:32:54.397293] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.795 qpair failed and we were unable to recover it. 00:27:50.795 [2024-11-29 02:32:54.407129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.795 [2024-11-29 02:32:54.407211] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.795 [2024-11-29 02:32:54.407238] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.795 [2024-11-29 02:32:54.407252] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.795 [2024-11-29 02:32:54.407265] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.795 [2024-11-29 02:32:54.407295] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.795 qpair failed and we were unable to recover it. 00:27:50.795 [2024-11-29 02:32:54.417261] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.795 [2024-11-29 02:32:54.417355] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.795 [2024-11-29 02:32:54.417381] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.795 [2024-11-29 02:32:54.417403] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.795 [2024-11-29 02:32:54.417418] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.795 [2024-11-29 02:32:54.417448] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.795 qpair failed and we were unable to recover it. 00:27:50.795 [2024-11-29 02:32:54.427182] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.795 [2024-11-29 02:32:54.427276] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.795 [2024-11-29 02:32:54.427302] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.795 [2024-11-29 02:32:54.427316] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.795 [2024-11-29 02:32:54.427329] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.795 [2024-11-29 02:32:54.427359] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.795 qpair failed and we were unable to recover it. 00:27:50.795 [2024-11-29 02:32:54.437215] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.795 [2024-11-29 02:32:54.437302] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.795 [2024-11-29 02:32:54.437328] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.795 [2024-11-29 02:32:54.437342] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.795 [2024-11-29 02:32:54.437355] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.795 [2024-11-29 02:32:54.437386] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.795 qpair failed and we were unable to recover it. 00:27:50.795 [2024-11-29 02:32:54.447240] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.795 [2024-11-29 02:32:54.447329] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.795 [2024-11-29 02:32:54.447355] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.796 [2024-11-29 02:32:54.447369] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.796 [2024-11-29 02:32:54.447382] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.796 [2024-11-29 02:32:54.447419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.796 qpair failed and we were unable to recover it. 00:27:50.796 [2024-11-29 02:32:54.457298] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.796 [2024-11-29 02:32:54.457384] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.796 [2024-11-29 02:32:54.457417] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.796 [2024-11-29 02:32:54.457438] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.796 [2024-11-29 02:32:54.457452] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.796 [2024-11-29 02:32:54.457480] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.796 qpair failed and we were unable to recover it. 00:27:50.796 [2024-11-29 02:32:54.467325] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.796 [2024-11-29 02:32:54.467452] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.796 [2024-11-29 02:32:54.467478] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.796 [2024-11-29 02:32:54.467492] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.796 [2024-11-29 02:32:54.467505] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:50.796 [2024-11-29 02:32:54.467534] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:50.796 qpair failed and we were unable to recover it. 00:27:51.055 [2024-11-29 02:32:54.477343] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.055 [2024-11-29 02:32:54.477437] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.055 [2024-11-29 02:32:54.477463] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.055 [2024-11-29 02:32:54.477478] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.055 [2024-11-29 02:32:54.477491] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.055 [2024-11-29 02:32:54.477521] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.055 qpair failed and we were unable to recover it. 00:27:51.055 [2024-11-29 02:32:54.487360] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.055 [2024-11-29 02:32:54.487461] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.055 [2024-11-29 02:32:54.487486] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.055 [2024-11-29 02:32:54.487500] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.055 [2024-11-29 02:32:54.487513] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.055 [2024-11-29 02:32:54.487544] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.055 qpair failed and we were unable to recover it. 00:27:51.055 [2024-11-29 02:32:54.497411] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.055 [2024-11-29 02:32:54.497499] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.055 [2024-11-29 02:32:54.497524] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.055 [2024-11-29 02:32:54.497538] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.055 [2024-11-29 02:32:54.497551] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.055 [2024-11-29 02:32:54.497581] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.055 qpair failed and we were unable to recover it. 00:27:51.055 [2024-11-29 02:32:54.507435] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.055 [2024-11-29 02:32:54.507526] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.055 [2024-11-29 02:32:54.507552] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.055 [2024-11-29 02:32:54.507566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.055 [2024-11-29 02:32:54.507579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.055 [2024-11-29 02:32:54.507609] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.055 qpair failed and we were unable to recover it. 00:27:51.055 [2024-11-29 02:32:54.517474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.055 [2024-11-29 02:32:54.517576] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.055 [2024-11-29 02:32:54.517601] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.055 [2024-11-29 02:32:54.517616] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.055 [2024-11-29 02:32:54.517629] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.055 [2024-11-29 02:32:54.517658] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.055 qpair failed and we were unable to recover it. 00:27:51.055 [2024-11-29 02:32:54.527504] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.055 [2024-11-29 02:32:54.527600] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.055 [2024-11-29 02:32:54.527625] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.056 [2024-11-29 02:32:54.527642] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.056 [2024-11-29 02:32:54.527655] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.056 [2024-11-29 02:32:54.527685] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.056 qpair failed and we were unable to recover it. 00:27:51.056 [2024-11-29 02:32:54.537535] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.056 [2024-11-29 02:32:54.537631] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.056 [2024-11-29 02:32:54.537655] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.056 [2024-11-29 02:32:54.537668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.056 [2024-11-29 02:32:54.537681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.056 [2024-11-29 02:32:54.537709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.056 qpair failed and we were unable to recover it. 00:27:51.056 [2024-11-29 02:32:54.547529] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.056 [2024-11-29 02:32:54.547646] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.056 [2024-11-29 02:32:54.547672] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.056 [2024-11-29 02:32:54.547692] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.056 [2024-11-29 02:32:54.547706] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.056 [2024-11-29 02:32:54.547737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.056 qpair failed and we were unable to recover it. 00:27:51.056 [2024-11-29 02:32:54.557643] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.056 [2024-11-29 02:32:54.557741] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.056 [2024-11-29 02:32:54.557766] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.056 [2024-11-29 02:32:54.557780] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.056 [2024-11-29 02:32:54.557793] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.056 [2024-11-29 02:32:54.557822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.056 qpair failed and we were unable to recover it. 00:27:51.056 [2024-11-29 02:32:54.567596] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.056 [2024-11-29 02:32:54.567689] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.056 [2024-11-29 02:32:54.567714] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.056 [2024-11-29 02:32:54.567729] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.056 [2024-11-29 02:32:54.567742] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.056 [2024-11-29 02:32:54.567770] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.056 qpair failed and we were unable to recover it. 00:27:51.056 [2024-11-29 02:32:54.577604] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.056 [2024-11-29 02:32:54.577697] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.056 [2024-11-29 02:32:54.577723] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.056 [2024-11-29 02:32:54.577737] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.056 [2024-11-29 02:32:54.577750] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.056 [2024-11-29 02:32:54.577781] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.056 qpair failed and we were unable to recover it. 00:27:51.056 [2024-11-29 02:32:54.587645] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.056 [2024-11-29 02:32:54.587730] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.056 [2024-11-29 02:32:54.587756] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.056 [2024-11-29 02:32:54.587770] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.056 [2024-11-29 02:32:54.587784] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.056 [2024-11-29 02:32:54.587813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.056 qpair failed and we were unable to recover it. 00:27:51.056 [2024-11-29 02:32:54.597687] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.056 [2024-11-29 02:32:54.597808] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.056 [2024-11-29 02:32:54.597834] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.056 [2024-11-29 02:32:54.597848] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.056 [2024-11-29 02:32:54.597861] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.056 [2024-11-29 02:32:54.597891] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.056 qpair failed and we were unable to recover it. 00:27:51.056 [2024-11-29 02:32:54.607704] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.056 [2024-11-29 02:32:54.607795] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.056 [2024-11-29 02:32:54.607821] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.056 [2024-11-29 02:32:54.607836] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.056 [2024-11-29 02:32:54.607849] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.056 [2024-11-29 02:32:54.607880] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.056 qpair failed and we were unable to recover it. 00:27:51.056 [2024-11-29 02:32:54.617709] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.056 [2024-11-29 02:32:54.617799] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.056 [2024-11-29 02:32:54.617825] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.056 [2024-11-29 02:32:54.617839] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.056 [2024-11-29 02:32:54.617852] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.056 [2024-11-29 02:32:54.617881] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.056 qpair failed and we were unable to recover it. 00:27:51.056 [2024-11-29 02:32:54.627789] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.056 [2024-11-29 02:32:54.627897] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.056 [2024-11-29 02:32:54.627923] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.056 [2024-11-29 02:32:54.627938] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.056 [2024-11-29 02:32:54.627951] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.056 [2024-11-29 02:32:54.627981] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.056 qpair failed and we were unable to recover it. 00:27:51.056 [2024-11-29 02:32:54.637787] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.056 [2024-11-29 02:32:54.637884] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.056 [2024-11-29 02:32:54.637915] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.056 [2024-11-29 02:32:54.637930] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.056 [2024-11-29 02:32:54.637943] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.056 [2024-11-29 02:32:54.637972] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.056 qpair failed and we were unable to recover it. 00:27:51.056 [2024-11-29 02:32:54.647832] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.056 [2024-11-29 02:32:54.647924] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.056 [2024-11-29 02:32:54.647949] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.056 [2024-11-29 02:32:54.647963] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.056 [2024-11-29 02:32:54.647976] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.056 [2024-11-29 02:32:54.648006] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.056 qpair failed and we were unable to recover it. 00:27:51.056 [2024-11-29 02:32:54.657959] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.056 [2024-11-29 02:32:54.658049] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.056 [2024-11-29 02:32:54.658074] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.056 [2024-11-29 02:32:54.658089] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.056 [2024-11-29 02:32:54.658102] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.057 [2024-11-29 02:32:54.658131] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.057 qpair failed and we were unable to recover it. 00:27:51.057 [2024-11-29 02:32:54.667887] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.057 [2024-11-29 02:32:54.667982] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.057 [2024-11-29 02:32:54.668008] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.057 [2024-11-29 02:32:54.668023] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.057 [2024-11-29 02:32:54.668036] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.057 [2024-11-29 02:32:54.668065] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.057 qpair failed and we were unable to recover it. 00:27:51.057 [2024-11-29 02:32:54.677924] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.057 [2024-11-29 02:32:54.678017] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.057 [2024-11-29 02:32:54.678042] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.057 [2024-11-29 02:32:54.678057] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.057 [2024-11-29 02:32:54.678070] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.057 [2024-11-29 02:32:54.678108] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.057 qpair failed and we were unable to recover it. 00:27:51.057 [2024-11-29 02:32:54.687928] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.057 [2024-11-29 02:32:54.688015] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.057 [2024-11-29 02:32:54.688041] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.057 [2024-11-29 02:32:54.688055] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.057 [2024-11-29 02:32:54.688068] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.057 [2024-11-29 02:32:54.688097] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.057 qpair failed and we were unable to recover it. 00:27:51.057 [2024-11-29 02:32:54.697941] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.057 [2024-11-29 02:32:54.698030] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.057 [2024-11-29 02:32:54.698055] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.057 [2024-11-29 02:32:54.698069] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.057 [2024-11-29 02:32:54.698082] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.057 [2024-11-29 02:32:54.698111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.057 qpair failed and we were unable to recover it. 00:27:51.057 [2024-11-29 02:32:54.708001] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.057 [2024-11-29 02:32:54.708098] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.057 [2024-11-29 02:32:54.708123] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.057 [2024-11-29 02:32:54.708137] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.057 [2024-11-29 02:32:54.708151] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.057 [2024-11-29 02:32:54.708180] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.057 qpair failed and we were unable to recover it. 00:27:51.057 [2024-11-29 02:32:54.718033] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.057 [2024-11-29 02:32:54.718157] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.057 [2024-11-29 02:32:54.718182] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.057 [2024-11-29 02:32:54.718196] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.057 [2024-11-29 02:32:54.718209] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.057 [2024-11-29 02:32:54.718238] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.057 qpair failed and we were unable to recover it. 00:27:51.057 [2024-11-29 02:32:54.728123] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.057 [2024-11-29 02:32:54.728210] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.057 [2024-11-29 02:32:54.728240] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.057 [2024-11-29 02:32:54.728256] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.057 [2024-11-29 02:32:54.728269] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.057 [2024-11-29 02:32:54.728297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.057 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-29 02:32:54.738069] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.317 [2024-11-29 02:32:54.738156] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.317 [2024-11-29 02:32:54.738181] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.317 [2024-11-29 02:32:54.738195] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.317 [2024-11-29 02:32:54.738208] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.317 [2024-11-29 02:32:54.738239] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-29 02:32:54.748112] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.317 [2024-11-29 02:32:54.748214] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.317 [2024-11-29 02:32:54.748243] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.317 [2024-11-29 02:32:54.748259] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.317 [2024-11-29 02:32:54.748272] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.317 [2024-11-29 02:32:54.748302] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-29 02:32:54.758170] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.317 [2024-11-29 02:32:54.758285] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.317 [2024-11-29 02:32:54.758310] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.317 [2024-11-29 02:32:54.758325] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.317 [2024-11-29 02:32:54.758338] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.317 [2024-11-29 02:32:54.758367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-29 02:32:54.768156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.317 [2024-11-29 02:32:54.768245] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.317 [2024-11-29 02:32:54.768271] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.317 [2024-11-29 02:32:54.768286] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.317 [2024-11-29 02:32:54.768299] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.317 [2024-11-29 02:32:54.768335] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-29 02:32:54.778173] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.317 [2024-11-29 02:32:54.778260] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.317 [2024-11-29 02:32:54.778286] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.317 [2024-11-29 02:32:54.778302] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.317 [2024-11-29 02:32:54.778316] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.318 [2024-11-29 02:32:54.778345] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-29 02:32:54.788270] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.318 [2024-11-29 02:32:54.788367] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.318 [2024-11-29 02:32:54.788401] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.318 [2024-11-29 02:32:54.788420] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.318 [2024-11-29 02:32:54.788433] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.318 [2024-11-29 02:32:54.788463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-29 02:32:54.798256] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.318 [2024-11-29 02:32:54.798347] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.318 [2024-11-29 02:32:54.798373] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.318 [2024-11-29 02:32:54.798388] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.318 [2024-11-29 02:32:54.798411] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.318 [2024-11-29 02:32:54.798441] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-29 02:32:54.808352] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.318 [2024-11-29 02:32:54.808461] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.318 [2024-11-29 02:32:54.808487] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.318 [2024-11-29 02:32:54.808501] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.318 [2024-11-29 02:32:54.808514] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.318 [2024-11-29 02:32:54.808544] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-29 02:32:54.818289] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.318 [2024-11-29 02:32:54.818379] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.318 [2024-11-29 02:32:54.818417] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.318 [2024-11-29 02:32:54.818433] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.318 [2024-11-29 02:32:54.818446] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.318 [2024-11-29 02:32:54.818475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-29 02:32:54.828322] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.318 [2024-11-29 02:32:54.828421] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.318 [2024-11-29 02:32:54.828456] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.318 [2024-11-29 02:32:54.828471] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.318 [2024-11-29 02:32:54.828484] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.318 [2024-11-29 02:32:54.828514] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-29 02:32:54.838373] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.318 [2024-11-29 02:32:54.838491] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.318 [2024-11-29 02:32:54.838516] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.318 [2024-11-29 02:32:54.838530] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.318 [2024-11-29 02:32:54.838543] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.318 [2024-11-29 02:32:54.838573] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-29 02:32:54.848412] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.318 [2024-11-29 02:32:54.848509] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.318 [2024-11-29 02:32:54.848534] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.318 [2024-11-29 02:32:54.848548] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.318 [2024-11-29 02:32:54.848561] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.318 [2024-11-29 02:32:54.848591] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-29 02:32:54.858434] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.318 [2024-11-29 02:32:54.858556] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.318 [2024-11-29 02:32:54.858581] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.318 [2024-11-29 02:32:54.858595] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.318 [2024-11-29 02:32:54.858614] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.318 [2024-11-29 02:32:54.858645] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-29 02:32:54.868495] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.318 [2024-11-29 02:32:54.868587] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.318 [2024-11-29 02:32:54.868612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.318 [2024-11-29 02:32:54.868627] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.318 [2024-11-29 02:32:54.868651] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.318 [2024-11-29 02:32:54.868680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-29 02:32:54.878501] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.318 [2024-11-29 02:32:54.878615] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.318 [2024-11-29 02:32:54.878643] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.318 [2024-11-29 02:32:54.878659] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.318 [2024-11-29 02:32:54.878672] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.318 [2024-11-29 02:32:54.878703] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-29 02:32:54.888537] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.318 [2024-11-29 02:32:54.888632] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.318 [2024-11-29 02:32:54.888659] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.318 [2024-11-29 02:32:54.888673] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.318 [2024-11-29 02:32:54.888687] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.318 [2024-11-29 02:32:54.888717] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-29 02:32:54.898580] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.318 [2024-11-29 02:32:54.898700] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.318 [2024-11-29 02:32:54.898726] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.318 [2024-11-29 02:32:54.898741] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.318 [2024-11-29 02:32:54.898754] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.318 [2024-11-29 02:32:54.898784] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-29 02:32:54.908595] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.318 [2024-11-29 02:32:54.908715] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.318 [2024-11-29 02:32:54.908740] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.318 [2024-11-29 02:32:54.908754] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.318 [2024-11-29 02:32:54.908768] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.318 [2024-11-29 02:32:54.908797] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-29 02:32:54.918615] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.319 [2024-11-29 02:32:54.918714] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.319 [2024-11-29 02:32:54.918740] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.319 [2024-11-29 02:32:54.918754] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.319 [2024-11-29 02:32:54.918767] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.319 [2024-11-29 02:32:54.918798] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-29 02:32:54.928676] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.319 [2024-11-29 02:32:54.928792] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.319 [2024-11-29 02:32:54.928817] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.319 [2024-11-29 02:32:54.928832] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.319 [2024-11-29 02:32:54.928845] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.319 [2024-11-29 02:32:54.928874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-29 02:32:54.938696] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.319 [2024-11-29 02:32:54.938785] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.319 [2024-11-29 02:32:54.938809] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.319 [2024-11-29 02:32:54.938824] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.319 [2024-11-29 02:32:54.938837] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.319 [2024-11-29 02:32:54.938867] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-29 02:32:54.948679] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.319 [2024-11-29 02:32:54.948782] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.319 [2024-11-29 02:32:54.948807] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.319 [2024-11-29 02:32:54.948822] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.319 [2024-11-29 02:32:54.948840] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.319 [2024-11-29 02:32:54.948871] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-29 02:32:54.958722] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.319 [2024-11-29 02:32:54.958841] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.319 [2024-11-29 02:32:54.958866] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.319 [2024-11-29 02:32:54.958880] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.319 [2024-11-29 02:32:54.958893] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.319 [2024-11-29 02:32:54.958922] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-29 02:32:54.968746] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.319 [2024-11-29 02:32:54.968838] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.319 [2024-11-29 02:32:54.968863] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.319 [2024-11-29 02:32:54.968877] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.319 [2024-11-29 02:32:54.968890] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.319 [2024-11-29 02:32:54.968920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-29 02:32:54.978825] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.319 [2024-11-29 02:32:54.978940] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.319 [2024-11-29 02:32:54.978969] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.319 [2024-11-29 02:32:54.978985] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.319 [2024-11-29 02:32:54.978998] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.319 [2024-11-29 02:32:54.979028] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-29 02:32:54.988845] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.319 [2024-11-29 02:32:54.988941] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.319 [2024-11-29 02:32:54.988967] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.319 [2024-11-29 02:32:54.988981] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.319 [2024-11-29 02:32:54.988994] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.319 [2024-11-29 02:32:54.989024] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.577 [2024-11-29 02:32:54.998885] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.577 [2024-11-29 02:32:54.998976] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.577 [2024-11-29 02:32:54.999002] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.577 [2024-11-29 02:32:54.999016] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.577 [2024-11-29 02:32:54.999029] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.577 [2024-11-29 02:32:54.999059] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.577 qpair failed and we were unable to recover it. 00:27:51.577 [2024-11-29 02:32:55.008872] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.577 [2024-11-29 02:32:55.008962] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.577 [2024-11-29 02:32:55.008987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.577 [2024-11-29 02:32:55.009002] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.577 [2024-11-29 02:32:55.009014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.577 [2024-11-29 02:32:55.009044] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.577 qpair failed and we were unable to recover it. 00:27:51.577 [2024-11-29 02:32:55.018887] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.577 [2024-11-29 02:32:55.018984] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.577 [2024-11-29 02:32:55.019009] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.577 [2024-11-29 02:32:55.019023] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.577 [2024-11-29 02:32:55.019036] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.577 [2024-11-29 02:32:55.019065] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.577 qpair failed and we were unable to recover it. 00:27:51.577 [2024-11-29 02:32:55.028970] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.577 [2024-11-29 02:32:55.029061] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.577 [2024-11-29 02:32:55.029087] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.577 [2024-11-29 02:32:55.029102] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.577 [2024-11-29 02:32:55.029115] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.577 [2024-11-29 02:32:55.029143] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.577 qpair failed and we were unable to recover it. 00:27:51.577 [2024-11-29 02:32:55.038983] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.577 [2024-11-29 02:32:55.039071] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.577 [2024-11-29 02:32:55.039096] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.577 [2024-11-29 02:32:55.039119] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.577 [2024-11-29 02:32:55.039133] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.577 [2024-11-29 02:32:55.039163] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.577 qpair failed and we were unable to recover it. 00:27:51.577 [2024-11-29 02:32:55.048989] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.577 [2024-11-29 02:32:55.049078] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.577 [2024-11-29 02:32:55.049103] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.577 [2024-11-29 02:32:55.049118] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.577 [2024-11-29 02:32:55.049131] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.578 [2024-11-29 02:32:55.049160] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.578 qpair failed and we were unable to recover it. 00:27:51.578 [2024-11-29 02:32:55.059031] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.578 [2024-11-29 02:32:55.059114] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.578 [2024-11-29 02:32:55.059140] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.578 [2024-11-29 02:32:55.059154] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.578 [2024-11-29 02:32:55.059167] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.578 [2024-11-29 02:32:55.059196] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.578 qpair failed and we were unable to recover it. 00:27:51.578 [2024-11-29 02:32:55.069041] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.578 [2024-11-29 02:32:55.069172] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.578 [2024-11-29 02:32:55.069197] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.578 [2024-11-29 02:32:55.069212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.578 [2024-11-29 02:32:55.069224] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.578 [2024-11-29 02:32:55.069255] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.578 qpair failed and we were unable to recover it. 00:27:51.578 [2024-11-29 02:32:55.079085] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.578 [2024-11-29 02:32:55.079180] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.578 [2024-11-29 02:32:55.079206] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.578 [2024-11-29 02:32:55.079220] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.578 [2024-11-29 02:32:55.079233] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.578 [2024-11-29 02:32:55.079262] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.578 qpair failed and we were unable to recover it. 00:27:51.578 [2024-11-29 02:32:55.089098] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.578 [2024-11-29 02:32:55.089185] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.578 [2024-11-29 02:32:55.089211] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.578 [2024-11-29 02:32:55.089225] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.578 [2024-11-29 02:32:55.089238] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.578 [2024-11-29 02:32:55.089267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.578 qpair failed and we were unable to recover it. 00:27:51.578 [2024-11-29 02:32:55.099128] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.578 [2024-11-29 02:32:55.099222] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.578 [2024-11-29 02:32:55.099247] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.578 [2024-11-29 02:32:55.099262] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.578 [2024-11-29 02:32:55.099275] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.578 [2024-11-29 02:32:55.099305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.578 qpair failed and we were unable to recover it. 00:27:51.578 [2024-11-29 02:32:55.109295] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.578 [2024-11-29 02:32:55.109385] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.578 [2024-11-29 02:32:55.109419] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.578 [2024-11-29 02:32:55.109434] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.578 [2024-11-29 02:32:55.109457] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.578 [2024-11-29 02:32:55.109486] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.578 qpair failed and we were unable to recover it. 00:27:51.578 [2024-11-29 02:32:55.119194] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.578 [2024-11-29 02:32:55.119284] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.578 [2024-11-29 02:32:55.119310] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.578 [2024-11-29 02:32:55.119324] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.578 [2024-11-29 02:32:55.119337] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.578 [2024-11-29 02:32:55.119366] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.578 qpair failed and we were unable to recover it. 00:27:51.578 [2024-11-29 02:32:55.129265] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.578 [2024-11-29 02:32:55.129402] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.578 [2024-11-29 02:32:55.129433] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.578 [2024-11-29 02:32:55.129449] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.578 [2024-11-29 02:32:55.129462] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.578 [2024-11-29 02:32:55.129492] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.578 qpair failed and we were unable to recover it. 00:27:51.578 [2024-11-29 02:32:55.139253] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.578 [2024-11-29 02:32:55.139344] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.578 [2024-11-29 02:32:55.139370] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.578 [2024-11-29 02:32:55.139384] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.578 [2024-11-29 02:32:55.139405] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.578 [2024-11-29 02:32:55.139437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.578 qpair failed and we were unable to recover it. 00:27:51.578 [2024-11-29 02:32:55.149267] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.578 [2024-11-29 02:32:55.149362] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.578 [2024-11-29 02:32:55.149388] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.578 [2024-11-29 02:32:55.149416] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.578 [2024-11-29 02:32:55.149430] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.578 [2024-11-29 02:32:55.149460] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.578 qpair failed and we were unable to recover it. 00:27:51.578 [2024-11-29 02:32:55.159349] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.578 [2024-11-29 02:32:55.159449] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.578 [2024-11-29 02:32:55.159477] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.578 [2024-11-29 02:32:55.159493] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.578 [2024-11-29 02:32:55.159506] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.578 [2024-11-29 02:32:55.159537] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.578 qpair failed and we were unable to recover it. 00:27:51.578 [2024-11-29 02:32:55.169358] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.578 [2024-11-29 02:32:55.169456] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.578 [2024-11-29 02:32:55.169483] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.578 [2024-11-29 02:32:55.169497] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.578 [2024-11-29 02:32:55.169510] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.578 [2024-11-29 02:32:55.169539] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.578 qpair failed and we were unable to recover it. 00:27:51.578 [2024-11-29 02:32:55.179357] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.578 [2024-11-29 02:32:55.179481] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.578 [2024-11-29 02:32:55.179507] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.578 [2024-11-29 02:32:55.179521] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.578 [2024-11-29 02:32:55.179534] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.578 [2024-11-29 02:32:55.179564] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.578 qpair failed and we were unable to recover it. 00:27:51.578 [2024-11-29 02:32:55.189423] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.578 [2024-11-29 02:32:55.189518] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.578 [2024-11-29 02:32:55.189544] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.578 [2024-11-29 02:32:55.189558] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.578 [2024-11-29 02:32:55.189571] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.578 [2024-11-29 02:32:55.189601] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.578 qpair failed and we were unable to recover it. 00:27:51.578 [2024-11-29 02:32:55.199537] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.578 [2024-11-29 02:32:55.199629] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.578 [2024-11-29 02:32:55.199654] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.578 [2024-11-29 02:32:55.199668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.578 [2024-11-29 02:32:55.199681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.578 [2024-11-29 02:32:55.199711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.578 qpair failed and we were unable to recover it. 00:27:51.578 [2024-11-29 02:32:55.209460] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.578 [2024-11-29 02:32:55.209549] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.578 [2024-11-29 02:32:55.209574] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.578 [2024-11-29 02:32:55.209589] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.578 [2024-11-29 02:32:55.209602] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.578 [2024-11-29 02:32:55.209632] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.578 qpair failed and we were unable to recover it. 00:27:51.578 [2024-11-29 02:32:55.219480] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.578 [2024-11-29 02:32:55.219571] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.578 [2024-11-29 02:32:55.219601] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.578 [2024-11-29 02:32:55.219616] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.578 [2024-11-29 02:32:55.219630] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.578 [2024-11-29 02:32:55.219659] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.578 qpair failed and we were unable to recover it. 00:27:51.578 [2024-11-29 02:32:55.229530] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.578 [2024-11-29 02:32:55.229623] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.578 [2024-11-29 02:32:55.229653] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.578 [2024-11-29 02:32:55.229669] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.578 [2024-11-29 02:32:55.229682] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.578 [2024-11-29 02:32:55.229714] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.578 qpair failed and we were unable to recover it. 00:27:51.578 [2024-11-29 02:32:55.239641] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.578 [2024-11-29 02:32:55.239735] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.578 [2024-11-29 02:32:55.239762] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.578 [2024-11-29 02:32:55.239776] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.578 [2024-11-29 02:32:55.239790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.578 [2024-11-29 02:32:55.239819] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.578 qpair failed and we were unable to recover it. 00:27:51.578 [2024-11-29 02:32:55.249674] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.578 [2024-11-29 02:32:55.249791] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.578 [2024-11-29 02:32:55.249817] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.578 [2024-11-29 02:32:55.249832] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.578 [2024-11-29 02:32:55.249845] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.578 [2024-11-29 02:32:55.249875] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.578 qpair failed and we were unable to recover it. 00:27:51.837 [2024-11-29 02:32:55.259614] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.837 [2024-11-29 02:32:55.259715] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.837 [2024-11-29 02:32:55.259744] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.837 [2024-11-29 02:32:55.259759] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.837 [2024-11-29 02:32:55.259771] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.837 [2024-11-29 02:32:55.259807] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.837 qpair failed and we were unable to recover it. 00:27:51.837 [2024-11-29 02:32:55.269643] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.837 [2024-11-29 02:32:55.269730] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.837 [2024-11-29 02:32:55.269756] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.837 [2024-11-29 02:32:55.269770] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.837 [2024-11-29 02:32:55.269783] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.837 [2024-11-29 02:32:55.269812] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.837 qpair failed and we were unable to recover it. 00:27:51.837 [2024-11-29 02:32:55.279660] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.837 [2024-11-29 02:32:55.279754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.837 [2024-11-29 02:32:55.279779] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.837 [2024-11-29 02:32:55.279793] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.837 [2024-11-29 02:32:55.279806] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.837 [2024-11-29 02:32:55.279836] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.837 qpair failed and we were unable to recover it. 00:27:51.837 [2024-11-29 02:32:55.289678] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.837 [2024-11-29 02:32:55.289766] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.837 [2024-11-29 02:32:55.289791] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.837 [2024-11-29 02:32:55.289806] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.837 [2024-11-29 02:32:55.289819] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.837 [2024-11-29 02:32:55.289848] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.837 qpair failed and we were unable to recover it. 00:27:51.837 [2024-11-29 02:32:55.299718] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.837 [2024-11-29 02:32:55.299805] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.837 [2024-11-29 02:32:55.299830] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.837 [2024-11-29 02:32:55.299844] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.837 [2024-11-29 02:32:55.299857] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.837 [2024-11-29 02:32:55.299887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.837 qpair failed and we were unable to recover it. 00:27:51.837 [2024-11-29 02:32:55.309746] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.837 [2024-11-29 02:32:55.309840] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.837 [2024-11-29 02:32:55.309871] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.837 [2024-11-29 02:32:55.309886] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.837 [2024-11-29 02:32:55.309899] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.837 [2024-11-29 02:32:55.309928] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.837 qpair failed and we were unable to recover it. 00:27:51.837 [2024-11-29 02:32:55.319765] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.837 [2024-11-29 02:32:55.319859] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.837 [2024-11-29 02:32:55.319884] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.837 [2024-11-29 02:32:55.319899] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.837 [2024-11-29 02:32:55.319912] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.837 [2024-11-29 02:32:55.319941] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.837 qpair failed and we were unable to recover it. 00:27:51.838 [2024-11-29 02:32:55.329796] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.838 [2024-11-29 02:32:55.329884] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.838 [2024-11-29 02:32:55.329908] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.838 [2024-11-29 02:32:55.329922] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.838 [2024-11-29 02:32:55.329935] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.838 [2024-11-29 02:32:55.329964] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.838 qpair failed and we were unable to recover it. 00:27:51.838 [2024-11-29 02:32:55.339881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.838 [2024-11-29 02:32:55.339978] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.838 [2024-11-29 02:32:55.340003] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.838 [2024-11-29 02:32:55.340018] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.838 [2024-11-29 02:32:55.340031] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.838 [2024-11-29 02:32:55.340061] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.838 qpair failed and we were unable to recover it. 00:27:51.838 [2024-11-29 02:32:55.349853] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.838 [2024-11-29 02:32:55.349966] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.838 [2024-11-29 02:32:55.349992] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.838 [2024-11-29 02:32:55.350006] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.838 [2024-11-29 02:32:55.350024] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.838 [2024-11-29 02:32:55.350056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.838 qpair failed and we were unable to recover it. 00:27:51.838 [2024-11-29 02:32:55.359900] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.838 [2024-11-29 02:32:55.359993] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.838 [2024-11-29 02:32:55.360018] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.838 [2024-11-29 02:32:55.360033] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.838 [2024-11-29 02:32:55.360046] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.838 [2024-11-29 02:32:55.360075] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.838 qpair failed and we were unable to recover it. 00:27:51.838 [2024-11-29 02:32:55.369931] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.838 [2024-11-29 02:32:55.370023] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.838 [2024-11-29 02:32:55.370048] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.838 [2024-11-29 02:32:55.370062] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.838 [2024-11-29 02:32:55.370076] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.838 [2024-11-29 02:32:55.370105] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.838 qpair failed and we were unable to recover it. 00:27:51.838 [2024-11-29 02:32:55.379979] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.838 [2024-11-29 02:32:55.380074] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.838 [2024-11-29 02:32:55.380099] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.838 [2024-11-29 02:32:55.380113] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.838 [2024-11-29 02:32:55.380126] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.838 [2024-11-29 02:32:55.380155] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.838 qpair failed and we were unable to recover it. 00:27:51.838 [2024-11-29 02:32:55.389974] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.838 [2024-11-29 02:32:55.390097] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.838 [2024-11-29 02:32:55.390122] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.838 [2024-11-29 02:32:55.390137] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.838 [2024-11-29 02:32:55.390150] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.838 [2024-11-29 02:32:55.390179] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.838 qpair failed and we were unable to recover it. 00:27:51.838 [2024-11-29 02:32:55.400098] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.838 [2024-11-29 02:32:55.400195] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.838 [2024-11-29 02:32:55.400221] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.838 [2024-11-29 02:32:55.400236] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.838 [2024-11-29 02:32:55.400250] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.838 [2024-11-29 02:32:55.400279] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.838 qpair failed and we were unable to recover it. 00:27:51.838 [2024-11-29 02:32:55.410046] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.838 [2024-11-29 02:32:55.410163] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.838 [2024-11-29 02:32:55.410188] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.838 [2024-11-29 02:32:55.410202] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.838 [2024-11-29 02:32:55.410216] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.838 [2024-11-29 02:32:55.410244] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.838 qpair failed and we were unable to recover it. 00:27:51.838 [2024-11-29 02:32:55.420085] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.838 [2024-11-29 02:32:55.420175] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.838 [2024-11-29 02:32:55.420200] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.838 [2024-11-29 02:32:55.420214] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.838 [2024-11-29 02:32:55.420227] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.838 [2024-11-29 02:32:55.420257] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.838 qpair failed and we were unable to recover it. 00:27:51.838 [2024-11-29 02:32:55.430085] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.838 [2024-11-29 02:32:55.430185] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.838 [2024-11-29 02:32:55.430210] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.838 [2024-11-29 02:32:55.430225] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.838 [2024-11-29 02:32:55.430238] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.838 [2024-11-29 02:32:55.430267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.838 qpair failed and we were unable to recover it. 00:27:51.838 [2024-11-29 02:32:55.440261] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.838 [2024-11-29 02:32:55.440353] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.838 [2024-11-29 02:32:55.440378] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.838 [2024-11-29 02:32:55.440400] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.839 [2024-11-29 02:32:55.440430] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.839 [2024-11-29 02:32:55.440463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.839 qpair failed and we were unable to recover it. 00:27:51.839 [2024-11-29 02:32:55.450169] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.839 [2024-11-29 02:32:55.450256] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.839 [2024-11-29 02:32:55.450280] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.839 [2024-11-29 02:32:55.450294] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.839 [2024-11-29 02:32:55.450307] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.839 [2024-11-29 02:32:55.450337] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.839 qpair failed and we were unable to recover it. 00:27:51.839 [2024-11-29 02:32:55.460219] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.839 [2024-11-29 02:32:55.460313] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.839 [2024-11-29 02:32:55.460338] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.839 [2024-11-29 02:32:55.460352] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.839 [2024-11-29 02:32:55.460365] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.839 [2024-11-29 02:32:55.460400] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.839 qpair failed and we were unable to recover it. 00:27:51.839 [2024-11-29 02:32:55.470212] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.839 [2024-11-29 02:32:55.470342] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.839 [2024-11-29 02:32:55.470367] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.839 [2024-11-29 02:32:55.470382] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.839 [2024-11-29 02:32:55.470405] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.839 [2024-11-29 02:32:55.470439] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.839 qpair failed and we were unable to recover it. 00:27:51.839 [2024-11-29 02:32:55.480253] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.839 [2024-11-29 02:32:55.480350] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.839 [2024-11-29 02:32:55.480375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.839 [2024-11-29 02:32:55.480390] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.839 [2024-11-29 02:32:55.480412] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.839 [2024-11-29 02:32:55.480442] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.839 qpair failed and we were unable to recover it. 00:27:51.839 [2024-11-29 02:32:55.490340] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.839 [2024-11-29 02:32:55.490443] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.839 [2024-11-29 02:32:55.490468] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.839 [2024-11-29 02:32:55.490483] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.839 [2024-11-29 02:32:55.490496] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.839 [2024-11-29 02:32:55.490525] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.839 qpair failed and we were unable to recover it. 00:27:51.839 [2024-11-29 02:32:55.500326] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.839 [2024-11-29 02:32:55.500459] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.839 [2024-11-29 02:32:55.500485] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.839 [2024-11-29 02:32:55.500499] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.839 [2024-11-29 02:32:55.500512] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.839 [2024-11-29 02:32:55.500543] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.839 qpair failed and we were unable to recover it. 00:27:51.839 [2024-11-29 02:32:55.510323] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.839 [2024-11-29 02:32:55.510421] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.839 [2024-11-29 02:32:55.510447] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.839 [2024-11-29 02:32:55.510462] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.839 [2024-11-29 02:32:55.510475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:51.839 [2024-11-29 02:32:55.510504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.839 qpair failed and we were unable to recover it. 00:27:52.098 [2024-11-29 02:32:55.520374] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.098 [2024-11-29 02:32:55.520478] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.098 [2024-11-29 02:32:55.520504] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.098 [2024-11-29 02:32:55.520518] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.098 [2024-11-29 02:32:55.520531] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.098 [2024-11-29 02:32:55.520560] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.098 qpair failed and we were unable to recover it. 00:27:52.098 [2024-11-29 02:32:55.530370] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.098 [2024-11-29 02:32:55.530468] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.098 [2024-11-29 02:32:55.530494] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.099 [2024-11-29 02:32:55.530515] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.099 [2024-11-29 02:32:55.530528] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.099 [2024-11-29 02:32:55.530558] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.099 qpair failed and we were unable to recover it. 00:27:52.099 [2024-11-29 02:32:55.540459] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.099 [2024-11-29 02:32:55.540574] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.099 [2024-11-29 02:32:55.540598] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.099 [2024-11-29 02:32:55.540612] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.099 [2024-11-29 02:32:55.540624] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.099 [2024-11-29 02:32:55.540653] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.099 qpair failed and we were unable to recover it. 00:27:52.099 [2024-11-29 02:32:55.550455] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.099 [2024-11-29 02:32:55.550548] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.099 [2024-11-29 02:32:55.550573] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.099 [2024-11-29 02:32:55.550588] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.099 [2024-11-29 02:32:55.550601] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.099 [2024-11-29 02:32:55.550631] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.099 qpair failed and we were unable to recover it. 00:27:52.099 [2024-11-29 02:32:55.560509] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.099 [2024-11-29 02:32:55.560598] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.099 [2024-11-29 02:32:55.560623] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.099 [2024-11-29 02:32:55.560637] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.099 [2024-11-29 02:32:55.560650] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.099 [2024-11-29 02:32:55.560680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.099 qpair failed and we were unable to recover it. 00:27:52.099 [2024-11-29 02:32:55.570532] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.099 [2024-11-29 02:32:55.570650] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.099 [2024-11-29 02:32:55.570676] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.099 [2024-11-29 02:32:55.570690] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.099 [2024-11-29 02:32:55.570703] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.099 [2024-11-29 02:32:55.570732] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.099 qpair failed and we were unable to recover it. 00:27:52.099 [2024-11-29 02:32:55.580536] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.099 [2024-11-29 02:32:55.580642] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.099 [2024-11-29 02:32:55.580668] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.099 [2024-11-29 02:32:55.580683] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.099 [2024-11-29 02:32:55.580697] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.099 [2024-11-29 02:32:55.580725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.099 qpair failed and we were unable to recover it. 00:27:52.099 [2024-11-29 02:32:55.590561] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.099 [2024-11-29 02:32:55.590652] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.099 [2024-11-29 02:32:55.590679] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.099 [2024-11-29 02:32:55.590693] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.099 [2024-11-29 02:32:55.590706] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.099 [2024-11-29 02:32:55.590737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.099 qpair failed and we were unable to recover it. 00:27:52.099 [2024-11-29 02:32:55.600654] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.099 [2024-11-29 02:32:55.600765] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.099 [2024-11-29 02:32:55.600790] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.099 [2024-11-29 02:32:55.600804] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.099 [2024-11-29 02:32:55.600817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.099 [2024-11-29 02:32:55.600848] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.099 qpair failed and we were unable to recover it. 00:27:52.099 [2024-11-29 02:32:55.610707] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.099 [2024-11-29 02:32:55.610797] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.099 [2024-11-29 02:32:55.610823] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.099 [2024-11-29 02:32:55.610838] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.099 [2024-11-29 02:32:55.610851] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.099 [2024-11-29 02:32:55.610880] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.099 qpair failed and we were unable to recover it. 00:27:52.099 [2024-11-29 02:32:55.620636] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.099 [2024-11-29 02:32:55.620723] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.099 [2024-11-29 02:32:55.620748] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.099 [2024-11-29 02:32:55.620770] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.099 [2024-11-29 02:32:55.620784] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.099 [2024-11-29 02:32:55.620813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.099 qpair failed and we were unable to recover it. 00:27:52.099 [2024-11-29 02:32:55.630664] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.099 [2024-11-29 02:32:55.630792] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.099 [2024-11-29 02:32:55.630818] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.099 [2024-11-29 02:32:55.630832] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.099 [2024-11-29 02:32:55.630845] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.099 [2024-11-29 02:32:55.630875] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.099 qpair failed and we were unable to recover it. 00:27:52.099 [2024-11-29 02:32:55.640739] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.100 [2024-11-29 02:32:55.640839] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.100 [2024-11-29 02:32:55.640867] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.100 [2024-11-29 02:32:55.640884] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.100 [2024-11-29 02:32:55.640898] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.100 [2024-11-29 02:32:55.640927] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.100 qpair failed and we were unable to recover it. 00:27:52.100 [2024-11-29 02:32:55.650813] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.100 [2024-11-29 02:32:55.650921] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.100 [2024-11-29 02:32:55.650948] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.100 [2024-11-29 02:32:55.650962] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.100 [2024-11-29 02:32:55.650975] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.100 [2024-11-29 02:32:55.651004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.100 qpair failed and we were unable to recover it. 00:27:52.100 [2024-11-29 02:32:55.660850] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.100 [2024-11-29 02:32:55.660980] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.100 [2024-11-29 02:32:55.661005] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.100 [2024-11-29 02:32:55.661019] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.100 [2024-11-29 02:32:55.661032] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.100 [2024-11-29 02:32:55.661061] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.100 qpair failed and we were unable to recover it. 00:27:52.100 [2024-11-29 02:32:55.670801] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.100 [2024-11-29 02:32:55.670932] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.100 [2024-11-29 02:32:55.670957] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.100 [2024-11-29 02:32:55.670972] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.100 [2024-11-29 02:32:55.670985] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.100 [2024-11-29 02:32:55.671015] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.100 qpair failed and we were unable to recover it. 00:27:52.100 [2024-11-29 02:32:55.680832] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.100 [2024-11-29 02:32:55.680923] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.100 [2024-11-29 02:32:55.680949] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.100 [2024-11-29 02:32:55.680964] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.100 [2024-11-29 02:32:55.680977] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.100 [2024-11-29 02:32:55.681008] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.100 qpair failed and we were unable to recover it. 00:27:52.100 [2024-11-29 02:32:55.690844] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.100 [2024-11-29 02:32:55.690937] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.100 [2024-11-29 02:32:55.690963] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.100 [2024-11-29 02:32:55.690977] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.100 [2024-11-29 02:32:55.690990] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.100 [2024-11-29 02:32:55.691020] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.100 qpair failed and we were unable to recover it. 00:27:52.100 [2024-11-29 02:32:55.700932] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.100 [2024-11-29 02:32:55.701029] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.100 [2024-11-29 02:32:55.701054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.100 [2024-11-29 02:32:55.701068] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.100 [2024-11-29 02:32:55.701081] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.100 [2024-11-29 02:32:55.701110] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.100 qpair failed and we were unable to recover it. 00:27:52.100 [2024-11-29 02:32:55.711003] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.100 [2024-11-29 02:32:55.711105] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.100 [2024-11-29 02:32:55.711135] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.100 [2024-11-29 02:32:55.711151] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.100 [2024-11-29 02:32:55.711164] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.100 [2024-11-29 02:32:55.711195] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.100 qpair failed and we were unable to recover it. 00:27:52.100 [2024-11-29 02:32:55.720951] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.100 [2024-11-29 02:32:55.721044] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.100 [2024-11-29 02:32:55.721070] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.100 [2024-11-29 02:32:55.721084] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.100 [2024-11-29 02:32:55.721097] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.100 [2024-11-29 02:32:55.721126] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.100 qpair failed and we were unable to recover it. 00:27:52.100 [2024-11-29 02:32:55.730989] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.100 [2024-11-29 02:32:55.731108] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.100 [2024-11-29 02:32:55.731134] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.100 [2024-11-29 02:32:55.731149] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.100 [2024-11-29 02:32:55.731162] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.100 [2024-11-29 02:32:55.731193] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.100 qpair failed and we were unable to recover it. 00:27:52.100 [2024-11-29 02:32:55.741025] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.100 [2024-11-29 02:32:55.741113] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.100 [2024-11-29 02:32:55.741139] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.100 [2024-11-29 02:32:55.741153] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.100 [2024-11-29 02:32:55.741166] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.100 [2024-11-29 02:32:55.741195] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.100 qpair failed and we were unable to recover it. 00:27:52.100 [2024-11-29 02:32:55.751013] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.101 [2024-11-29 02:32:55.751103] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.101 [2024-11-29 02:32:55.751129] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.101 [2024-11-29 02:32:55.751143] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.101 [2024-11-29 02:32:55.751156] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.101 [2024-11-29 02:32:55.751194] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.101 qpair failed and we were unable to recover it. 00:27:52.101 [2024-11-29 02:32:55.761053] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.101 [2024-11-29 02:32:55.761144] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.101 [2024-11-29 02:32:55.761170] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.101 [2024-11-29 02:32:55.761184] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.101 [2024-11-29 02:32:55.761197] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.101 [2024-11-29 02:32:55.761226] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.101 qpair failed and we were unable to recover it. 00:27:52.101 [2024-11-29 02:32:55.771100] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.101 [2024-11-29 02:32:55.771202] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.101 [2024-11-29 02:32:55.771227] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.101 [2024-11-29 02:32:55.771241] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.101 [2024-11-29 02:32:55.771255] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.101 [2024-11-29 02:32:55.771284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.101 qpair failed and we were unable to recover it. 00:27:52.361 [2024-11-29 02:32:55.781098] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.361 [2024-11-29 02:32:55.781190] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.361 [2024-11-29 02:32:55.781216] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.361 [2024-11-29 02:32:55.781230] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.361 [2024-11-29 02:32:55.781243] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.361 [2024-11-29 02:32:55.781274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.361 qpair failed and we were unable to recover it. 00:27:52.361 [2024-11-29 02:32:55.791231] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.361 [2024-11-29 02:32:55.791328] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.361 [2024-11-29 02:32:55.791354] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.361 [2024-11-29 02:32:55.791368] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.361 [2024-11-29 02:32:55.791381] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.361 [2024-11-29 02:32:55.791418] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.361 qpair failed and we were unable to recover it. 00:27:52.361 [2024-11-29 02:32:55.801209] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.361 [2024-11-29 02:32:55.801315] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.361 [2024-11-29 02:32:55.801346] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.361 [2024-11-29 02:32:55.801361] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.361 [2024-11-29 02:32:55.801374] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.361 [2024-11-29 02:32:55.801415] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.361 qpair failed and we were unable to recover it. 00:27:52.361 [2024-11-29 02:32:55.811205] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.361 [2024-11-29 02:32:55.811306] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.361 [2024-11-29 02:32:55.811331] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.361 [2024-11-29 02:32:55.811345] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.361 [2024-11-29 02:32:55.811358] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.362 [2024-11-29 02:32:55.811388] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.362 qpair failed and we were unable to recover it. 00:27:52.362 [2024-11-29 02:32:55.821221] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.362 [2024-11-29 02:32:55.821312] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.362 [2024-11-29 02:32:55.821338] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.362 [2024-11-29 02:32:55.821353] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.362 [2024-11-29 02:32:55.821367] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.362 [2024-11-29 02:32:55.821405] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.362 qpair failed and we were unable to recover it. 00:27:52.362 [2024-11-29 02:32:55.831267] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.362 [2024-11-29 02:32:55.831373] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.362 [2024-11-29 02:32:55.831407] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.362 [2024-11-29 02:32:55.831424] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.362 [2024-11-29 02:32:55.831437] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.362 [2024-11-29 02:32:55.831468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.362 qpair failed and we were unable to recover it. 00:27:52.362 [2024-11-29 02:32:55.841321] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.362 [2024-11-29 02:32:55.841425] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.362 [2024-11-29 02:32:55.841451] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.362 [2024-11-29 02:32:55.841465] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.362 [2024-11-29 02:32:55.841478] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.362 [2024-11-29 02:32:55.841514] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.362 qpair failed and we were unable to recover it. 00:27:52.362 [2024-11-29 02:32:55.851315] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.362 [2024-11-29 02:32:55.851414] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.362 [2024-11-29 02:32:55.851440] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.362 [2024-11-29 02:32:55.851455] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.362 [2024-11-29 02:32:55.851467] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.362 [2024-11-29 02:32:55.851497] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.362 qpair failed and we were unable to recover it. 00:27:52.362 [2024-11-29 02:32:55.861430] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.362 [2024-11-29 02:32:55.861524] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.362 [2024-11-29 02:32:55.861549] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.362 [2024-11-29 02:32:55.861563] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.362 [2024-11-29 02:32:55.861576] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.362 [2024-11-29 02:32:55.861607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.362 qpair failed and we were unable to recover it. 00:27:52.362 [2024-11-29 02:32:55.871494] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.362 [2024-11-29 02:32:55.871622] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.362 [2024-11-29 02:32:55.871647] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.362 [2024-11-29 02:32:55.871662] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.362 [2024-11-29 02:32:55.871675] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.362 [2024-11-29 02:32:55.871706] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.362 qpair failed and we were unable to recover it. 00:27:52.362 [2024-11-29 02:32:55.881404] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.362 [2024-11-29 02:32:55.881498] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.362 [2024-11-29 02:32:55.881523] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.362 [2024-11-29 02:32:55.881537] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.362 [2024-11-29 02:32:55.881550] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.362 [2024-11-29 02:32:55.881580] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.362 qpair failed and we were unable to recover it. 00:27:52.362 [2024-11-29 02:32:55.891508] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.362 [2024-11-29 02:32:55.891607] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.362 [2024-11-29 02:32:55.891633] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.362 [2024-11-29 02:32:55.891647] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.362 [2024-11-29 02:32:55.891660] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.362 [2024-11-29 02:32:55.891690] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.362 qpair failed and we were unable to recover it. 00:27:52.362 [2024-11-29 02:32:55.901455] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.362 [2024-11-29 02:32:55.901542] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.362 [2024-11-29 02:32:55.901568] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.362 [2024-11-29 02:32:55.901583] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.362 [2024-11-29 02:32:55.901596] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.362 [2024-11-29 02:32:55.901628] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.362 qpair failed and we were unable to recover it. 00:27:52.362 [2024-11-29 02:32:55.911493] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.362 [2024-11-29 02:32:55.911579] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.362 [2024-11-29 02:32:55.911605] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.362 [2024-11-29 02:32:55.911620] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.362 [2024-11-29 02:32:55.911633] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.362 [2024-11-29 02:32:55.911662] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.362 qpair failed and we were unable to recover it. 00:27:52.363 [2024-11-29 02:32:55.921607] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.363 [2024-11-29 02:32:55.921734] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.363 [2024-11-29 02:32:55.921760] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.363 [2024-11-29 02:32:55.921774] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.363 [2024-11-29 02:32:55.921787] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.363 [2024-11-29 02:32:55.921816] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.363 qpair failed and we were unable to recover it. 00:27:52.363 [2024-11-29 02:32:55.931581] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.363 [2024-11-29 02:32:55.931707] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.363 [2024-11-29 02:32:55.931736] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.363 [2024-11-29 02:32:55.931750] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.363 [2024-11-29 02:32:55.931769] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.363 [2024-11-29 02:32:55.931800] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.363 qpair failed and we were unable to recover it. 00:27:52.363 [2024-11-29 02:32:55.941619] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.363 [2024-11-29 02:32:55.941730] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.363 [2024-11-29 02:32:55.941756] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.363 [2024-11-29 02:32:55.941770] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.363 [2024-11-29 02:32:55.941783] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.363 [2024-11-29 02:32:55.941812] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.363 qpair failed and we were unable to recover it. 00:27:52.363 [2024-11-29 02:32:55.951619] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.363 [2024-11-29 02:32:55.951707] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.363 [2024-11-29 02:32:55.951733] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.363 [2024-11-29 02:32:55.951749] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.363 [2024-11-29 02:32:55.951762] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.363 [2024-11-29 02:32:55.951792] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.363 qpair failed and we were unable to recover it. 00:27:52.363 [2024-11-29 02:32:55.961724] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.363 [2024-11-29 02:32:55.961818] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.363 [2024-11-29 02:32:55.961843] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.363 [2024-11-29 02:32:55.961858] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.363 [2024-11-29 02:32:55.961872] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.363 [2024-11-29 02:32:55.961901] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.363 qpair failed and we were unable to recover it. 00:27:52.363 [2024-11-29 02:32:55.971687] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.363 [2024-11-29 02:32:55.971814] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.363 [2024-11-29 02:32:55.971843] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.363 [2024-11-29 02:32:55.971862] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.363 [2024-11-29 02:32:55.971876] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.363 [2024-11-29 02:32:55.971906] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.363 qpair failed and we were unable to recover it. 00:27:52.363 [2024-11-29 02:32:55.981701] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.363 [2024-11-29 02:32:55.981803] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.363 [2024-11-29 02:32:55.981829] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.363 [2024-11-29 02:32:55.981844] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.363 [2024-11-29 02:32:55.981857] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.363 [2024-11-29 02:32:55.981886] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.363 qpair failed and we were unable to recover it. 00:27:52.363 [2024-11-29 02:32:55.991728] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.363 [2024-11-29 02:32:55.991822] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.363 [2024-11-29 02:32:55.991847] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.363 [2024-11-29 02:32:55.991861] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.363 [2024-11-29 02:32:55.991874] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.363 [2024-11-29 02:32:55.991904] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.363 qpair failed and we were unable to recover it. 00:27:52.363 [2024-11-29 02:32:56.001746] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.363 [2024-11-29 02:32:56.001840] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.363 [2024-11-29 02:32:56.001866] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.363 [2024-11-29 02:32:56.001880] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.363 [2024-11-29 02:32:56.001893] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.363 [2024-11-29 02:32:56.001924] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.363 qpair failed and we were unable to recover it. 00:27:52.363 [2024-11-29 02:32:56.011856] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.363 [2024-11-29 02:32:56.011948] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.363 [2024-11-29 02:32:56.011973] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.363 [2024-11-29 02:32:56.011987] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.363 [2024-11-29 02:32:56.012000] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.363 [2024-11-29 02:32:56.012029] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.363 qpair failed and we were unable to recover it. 00:27:52.363 [2024-11-29 02:32:56.021795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.363 [2024-11-29 02:32:56.021886] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.363 [2024-11-29 02:32:56.021912] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.363 [2024-11-29 02:32:56.021933] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.363 [2024-11-29 02:32:56.021946] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.364 [2024-11-29 02:32:56.021976] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.364 qpair failed and we were unable to recover it. 00:27:52.364 [2024-11-29 02:32:56.031910] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.364 [2024-11-29 02:32:56.032041] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.364 [2024-11-29 02:32:56.032066] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.364 [2024-11-29 02:32:56.032081] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.364 [2024-11-29 02:32:56.032095] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.364 [2024-11-29 02:32:56.032126] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.364 qpair failed and we were unable to recover it. 00:27:52.623 [2024-11-29 02:32:56.041849] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.623 [2024-11-29 02:32:56.041948] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.623 [2024-11-29 02:32:56.041973] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.623 [2024-11-29 02:32:56.041988] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.623 [2024-11-29 02:32:56.042001] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.623 [2024-11-29 02:32:56.042033] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.623 qpair failed and we were unable to recover it. 00:27:52.623 [2024-11-29 02:32:56.051883] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.623 [2024-11-29 02:32:56.051971] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.623 [2024-11-29 02:32:56.051997] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.623 [2024-11-29 02:32:56.052011] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.623 [2024-11-29 02:32:56.052023] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.623 [2024-11-29 02:32:56.052052] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.623 qpair failed and we were unable to recover it. 00:27:52.623 [2024-11-29 02:32:56.061912] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.623 [2024-11-29 02:32:56.062036] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.623 [2024-11-29 02:32:56.062061] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.623 [2024-11-29 02:32:56.062076] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.623 [2024-11-29 02:32:56.062089] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.623 [2024-11-29 02:32:56.062119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.623 qpair failed and we were unable to recover it. 00:27:52.623 [2024-11-29 02:32:56.071944] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.623 [2024-11-29 02:32:56.072035] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.623 [2024-11-29 02:32:56.072061] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.623 [2024-11-29 02:32:56.072075] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.624 [2024-11-29 02:32:56.072088] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.624 [2024-11-29 02:32:56.072118] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.624 qpair failed and we were unable to recover it. 00:27:52.624 [2024-11-29 02:32:56.081985] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.624 [2024-11-29 02:32:56.082075] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.624 [2024-11-29 02:32:56.082100] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.624 [2024-11-29 02:32:56.082115] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.624 [2024-11-29 02:32:56.082128] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.624 [2024-11-29 02:32:56.082158] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.624 qpair failed and we were unable to recover it. 00:27:52.624 [2024-11-29 02:32:56.092039] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.624 [2024-11-29 02:32:56.092133] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.624 [2024-11-29 02:32:56.092160] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.624 [2024-11-29 02:32:56.092175] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.624 [2024-11-29 02:32:56.092188] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.624 [2024-11-29 02:32:56.092222] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.624 qpair failed and we were unable to recover it. 00:27:52.624 [2024-11-29 02:32:56.102046] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.624 [2024-11-29 02:32:56.102139] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.624 [2024-11-29 02:32:56.102165] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.624 [2024-11-29 02:32:56.102180] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.624 [2024-11-29 02:32:56.102193] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.624 [2024-11-29 02:32:56.102222] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.624 qpair failed and we were unable to recover it. 00:27:52.624 [2024-11-29 02:32:56.112066] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.624 [2024-11-29 02:32:56.112165] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.624 [2024-11-29 02:32:56.112191] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.624 [2024-11-29 02:32:56.112212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.624 [2024-11-29 02:32:56.112226] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.624 [2024-11-29 02:32:56.112256] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.624 qpair failed and we were unable to recover it. 00:27:52.624 [2024-11-29 02:32:56.122118] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.624 [2024-11-29 02:32:56.122230] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.624 [2024-11-29 02:32:56.122255] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.624 [2024-11-29 02:32:56.122270] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.624 [2024-11-29 02:32:56.122283] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.624 [2024-11-29 02:32:56.122312] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.624 qpair failed and we were unable to recover it. 00:27:52.624 [2024-11-29 02:32:56.132127] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.624 [2024-11-29 02:32:56.132215] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.624 [2024-11-29 02:32:56.132240] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.624 [2024-11-29 02:32:56.132254] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.624 [2024-11-29 02:32:56.132267] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.624 [2024-11-29 02:32:56.132297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.624 qpair failed and we were unable to recover it. 00:27:52.624 [2024-11-29 02:32:56.142230] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.624 [2024-11-29 02:32:56.142326] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.624 [2024-11-29 02:32:56.142351] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.624 [2024-11-29 02:32:56.142365] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.624 [2024-11-29 02:32:56.142379] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.624 [2024-11-29 02:32:56.142415] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.624 qpair failed and we were unable to recover it. 00:27:52.624 [2024-11-29 02:32:56.152193] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.624 [2024-11-29 02:32:56.152295] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.624 [2024-11-29 02:32:56.152320] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.624 [2024-11-29 02:32:56.152335] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.624 [2024-11-29 02:32:56.152348] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.624 [2024-11-29 02:32:56.152378] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.624 qpair failed and we were unable to recover it. 00:27:52.624 [2024-11-29 02:32:56.162256] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.624 [2024-11-29 02:32:56.162375] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.624 [2024-11-29 02:32:56.162409] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.624 [2024-11-29 02:32:56.162424] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.624 [2024-11-29 02:32:56.162437] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.624 [2024-11-29 02:32:56.162467] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.624 qpair failed and we were unable to recover it. 00:27:52.624 [2024-11-29 02:32:56.172220] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.624 [2024-11-29 02:32:56.172316] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.624 [2024-11-29 02:32:56.172342] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.624 [2024-11-29 02:32:56.172356] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.624 [2024-11-29 02:32:56.172369] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.624 [2024-11-29 02:32:56.172408] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.624 qpair failed and we were unable to recover it. 00:27:52.624 [2024-11-29 02:32:56.182281] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.624 [2024-11-29 02:32:56.182372] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.624 [2024-11-29 02:32:56.182407] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.625 [2024-11-29 02:32:56.182424] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.625 [2024-11-29 02:32:56.182437] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.625 [2024-11-29 02:32:56.182466] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.625 qpair failed and we were unable to recover it. 00:27:52.625 [2024-11-29 02:32:56.192290] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.625 [2024-11-29 02:32:56.192380] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.625 [2024-11-29 02:32:56.192415] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.625 [2024-11-29 02:32:56.192430] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.625 [2024-11-29 02:32:56.192443] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.625 [2024-11-29 02:32:56.192473] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.625 qpair failed and we were unable to recover it. 00:27:52.625 [2024-11-29 02:32:56.202365] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.625 [2024-11-29 02:32:56.202484] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.625 [2024-11-29 02:32:56.202514] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.625 [2024-11-29 02:32:56.202530] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.625 [2024-11-29 02:32:56.202543] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.625 [2024-11-29 02:32:56.202572] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.625 qpair failed and we were unable to recover it. 00:27:52.625 [2024-11-29 02:32:56.212346] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.625 [2024-11-29 02:32:56.212447] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.625 [2024-11-29 02:32:56.212473] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.625 [2024-11-29 02:32:56.212488] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.625 [2024-11-29 02:32:56.212501] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.625 [2024-11-29 02:32:56.212532] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.625 qpair failed and we were unable to recover it. 00:27:52.625 [2024-11-29 02:32:56.222447] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.625 [2024-11-29 02:32:56.222538] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.625 [2024-11-29 02:32:56.222566] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.625 [2024-11-29 02:32:56.222581] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.625 [2024-11-29 02:32:56.222594] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.625 [2024-11-29 02:32:56.222625] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.625 qpair failed and we were unable to recover it. 00:27:52.625 [2024-11-29 02:32:56.232398] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.625 [2024-11-29 02:32:56.232492] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.625 [2024-11-29 02:32:56.232518] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.625 [2024-11-29 02:32:56.232532] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.625 [2024-11-29 02:32:56.232545] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.625 [2024-11-29 02:32:56.232575] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.625 qpair failed and we were unable to recover it. 00:27:52.625 [2024-11-29 02:32:56.242477] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.625 [2024-11-29 02:32:56.242569] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.625 [2024-11-29 02:32:56.242595] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.625 [2024-11-29 02:32:56.242609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.625 [2024-11-29 02:32:56.242622] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.625 [2024-11-29 02:32:56.242657] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.625 qpair failed and we were unable to recover it. 00:27:52.625 [2024-11-29 02:32:56.252493] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.625 [2024-11-29 02:32:56.252584] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.625 [2024-11-29 02:32:56.252609] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.625 [2024-11-29 02:32:56.252624] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.625 [2024-11-29 02:32:56.252637] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.625 [2024-11-29 02:32:56.252666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.625 qpair failed and we were unable to recover it. 00:27:52.625 [2024-11-29 02:32:56.262511] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.625 [2024-11-29 02:32:56.262617] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.625 [2024-11-29 02:32:56.262642] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.625 [2024-11-29 02:32:56.262658] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.625 [2024-11-29 02:32:56.262672] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.625 [2024-11-29 02:32:56.262701] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.625 qpair failed and we were unable to recover it. 00:27:52.625 [2024-11-29 02:32:56.272634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.625 [2024-11-29 02:32:56.272730] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.625 [2024-11-29 02:32:56.272756] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.625 [2024-11-29 02:32:56.272771] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.625 [2024-11-29 02:32:56.272784] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.625 [2024-11-29 02:32:56.272813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.625 qpair failed and we were unable to recover it. 00:27:52.625 [2024-11-29 02:32:56.282550] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.625 [2024-11-29 02:32:56.282641] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.625 [2024-11-29 02:32:56.282666] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.625 [2024-11-29 02:32:56.282681] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.626 [2024-11-29 02:32:56.282693] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.626 [2024-11-29 02:32:56.282722] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.626 qpair failed and we were unable to recover it. 00:27:52.626 [2024-11-29 02:32:56.292673] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.626 [2024-11-29 02:32:56.292771] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.626 [2024-11-29 02:32:56.292803] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.626 [2024-11-29 02:32:56.292818] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.626 [2024-11-29 02:32:56.292831] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.626 [2024-11-29 02:32:56.292861] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.626 qpair failed and we were unable to recover it. 00:27:52.886 [2024-11-29 02:32:56.302638] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.886 [2024-11-29 02:32:56.302754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.886 [2024-11-29 02:32:56.302779] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.886 [2024-11-29 02:32:56.302793] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.886 [2024-11-29 02:32:56.302806] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.886 [2024-11-29 02:32:56.302835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.886 qpair failed and we were unable to recover it. 00:27:52.886 [2024-11-29 02:32:56.312725] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.886 [2024-11-29 02:32:56.312848] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.886 [2024-11-29 02:32:56.312875] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.886 [2024-11-29 02:32:56.312889] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.886 [2024-11-29 02:32:56.312902] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.886 [2024-11-29 02:32:56.312931] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.886 qpair failed and we were unable to recover it. 00:27:52.886 [2024-11-29 02:32:56.322760] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.886 [2024-11-29 02:32:56.322856] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.886 [2024-11-29 02:32:56.322881] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.886 [2024-11-29 02:32:56.322895] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.886 [2024-11-29 02:32:56.322908] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.886 [2024-11-29 02:32:56.322937] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.886 qpair failed and we were unable to recover it. 00:27:52.886 [2024-11-29 02:32:56.332682] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.886 [2024-11-29 02:32:56.332806] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.886 [2024-11-29 02:32:56.332830] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.886 [2024-11-29 02:32:56.332844] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.886 [2024-11-29 02:32:56.332857] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.886 [2024-11-29 02:32:56.332893] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.886 qpair failed and we were unable to recover it. 00:27:52.886 [2024-11-29 02:32:56.342797] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.886 [2024-11-29 02:32:56.342887] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.886 [2024-11-29 02:32:56.342912] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.886 [2024-11-29 02:32:56.342926] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.886 [2024-11-29 02:32:56.342940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.886 [2024-11-29 02:32:56.342970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.886 qpair failed and we were unable to recover it. 00:27:52.886 [2024-11-29 02:32:56.352725] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.886 [2024-11-29 02:32:56.352820] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.886 [2024-11-29 02:32:56.352846] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.886 [2024-11-29 02:32:56.352860] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.887 [2024-11-29 02:32:56.352873] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.887 [2024-11-29 02:32:56.352902] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.887 qpair failed and we were unable to recover it. 00:27:52.887 [2024-11-29 02:32:56.362761] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.887 [2024-11-29 02:32:56.362885] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.887 [2024-11-29 02:32:56.362910] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.887 [2024-11-29 02:32:56.362924] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.887 [2024-11-29 02:32:56.362937] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.887 [2024-11-29 02:32:56.362968] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.887 qpair failed and we were unable to recover it. 00:27:52.887 [2024-11-29 02:32:56.372781] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.887 [2024-11-29 02:32:56.372876] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.887 [2024-11-29 02:32:56.372901] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.887 [2024-11-29 02:32:56.372915] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.887 [2024-11-29 02:32:56.372928] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.887 [2024-11-29 02:32:56.372958] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.887 qpair failed and we were unable to recover it. 00:27:52.887 [2024-11-29 02:32:56.382806] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.887 [2024-11-29 02:32:56.382892] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.887 [2024-11-29 02:32:56.382923] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.887 [2024-11-29 02:32:56.382938] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.887 [2024-11-29 02:32:56.382952] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.887 [2024-11-29 02:32:56.382981] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.887 qpair failed and we were unable to recover it. 00:27:52.887 [2024-11-29 02:32:56.392887] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.887 [2024-11-29 02:32:56.392995] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.887 [2024-11-29 02:32:56.393021] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.887 [2024-11-29 02:32:56.393035] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.887 [2024-11-29 02:32:56.393048] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.887 [2024-11-29 02:32:56.393077] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.887 qpair failed and we were unable to recover it. 00:27:52.887 [2024-11-29 02:32:56.402934] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.887 [2024-11-29 02:32:56.403025] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.887 [2024-11-29 02:32:56.403050] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.887 [2024-11-29 02:32:56.403065] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.887 [2024-11-29 02:32:56.403078] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.887 [2024-11-29 02:32:56.403107] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.887 qpair failed and we were unable to recover it. 00:27:52.887 [2024-11-29 02:32:56.412915] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.887 [2024-11-29 02:32:56.413001] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.887 [2024-11-29 02:32:56.413027] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.887 [2024-11-29 02:32:56.413041] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.887 [2024-11-29 02:32:56.413054] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.887 [2024-11-29 02:32:56.413084] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.887 qpair failed and we were unable to recover it. 00:27:52.887 [2024-11-29 02:32:56.423027] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.887 [2024-11-29 02:32:56.423126] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.887 [2024-11-29 02:32:56.423151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.887 [2024-11-29 02:32:56.423166] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.887 [2024-11-29 02:32:56.423184] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.887 [2024-11-29 02:32:56.423214] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.887 qpair failed and we were unable to recover it. 00:27:52.887 [2024-11-29 02:32:56.433077] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.887 [2024-11-29 02:32:56.433174] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.887 [2024-11-29 02:32:56.433202] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.887 [2024-11-29 02:32:56.433217] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.887 [2024-11-29 02:32:56.433230] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.887 [2024-11-29 02:32:56.433261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.887 qpair failed and we were unable to recover it. 00:27:52.887 [2024-11-29 02:32:56.443014] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.887 [2024-11-29 02:32:56.443113] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.887 [2024-11-29 02:32:56.443138] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.887 [2024-11-29 02:32:56.443152] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.887 [2024-11-29 02:32:56.443165] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.887 [2024-11-29 02:32:56.443196] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.887 qpair failed and we were unable to recover it. 00:27:52.887 [2024-11-29 02:32:56.453027] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.887 [2024-11-29 02:32:56.453138] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.887 [2024-11-29 02:32:56.453164] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.887 [2024-11-29 02:32:56.453178] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.887 [2024-11-29 02:32:56.453191] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.887 [2024-11-29 02:32:56.453220] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.887 qpair failed and we were unable to recover it. 00:27:52.887 [2024-11-29 02:32:56.463169] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.887 [2024-11-29 02:32:56.463258] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.887 [2024-11-29 02:32:56.463283] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.887 [2024-11-29 02:32:56.463298] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.887 [2024-11-29 02:32:56.463309] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.887 [2024-11-29 02:32:56.463338] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.887 qpair failed and we were unable to recover it. 00:27:52.887 [2024-11-29 02:32:56.473108] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.887 [2024-11-29 02:32:56.473205] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.887 [2024-11-29 02:32:56.473234] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.887 [2024-11-29 02:32:56.473250] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.887 [2024-11-29 02:32:56.473263] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.887 [2024-11-29 02:32:56.473294] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.887 qpair failed and we were unable to recover it. 00:27:52.887 [2024-11-29 02:32:56.483145] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.887 [2024-11-29 02:32:56.483237] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.887 [2024-11-29 02:32:56.483266] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.887 [2024-11-29 02:32:56.483282] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.887 [2024-11-29 02:32:56.483295] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.887 [2024-11-29 02:32:56.483326] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.887 qpair failed and we were unable to recover it. 00:27:52.888 [2024-11-29 02:32:56.493241] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.888 [2024-11-29 02:32:56.493358] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.888 [2024-11-29 02:32:56.493384] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.888 [2024-11-29 02:32:56.493412] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.888 [2024-11-29 02:32:56.493427] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.888 [2024-11-29 02:32:56.493457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.888 qpair failed and we were unable to recover it. 00:27:52.888 [2024-11-29 02:32:56.503206] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.888 [2024-11-29 02:32:56.503303] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.888 [2024-11-29 02:32:56.503328] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.888 [2024-11-29 02:32:56.503342] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.888 [2024-11-29 02:32:56.503355] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.888 [2024-11-29 02:32:56.503385] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.888 qpair failed and we were unable to recover it. 00:27:52.888 [2024-11-29 02:32:56.513210] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.888 [2024-11-29 02:32:56.513307] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.888 [2024-11-29 02:32:56.513332] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.888 [2024-11-29 02:32:56.513346] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.888 [2024-11-29 02:32:56.513365] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.888 [2024-11-29 02:32:56.513405] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.888 qpair failed and we were unable to recover it. 00:27:52.888 [2024-11-29 02:32:56.523236] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.888 [2024-11-29 02:32:56.523325] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.888 [2024-11-29 02:32:56.523350] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.888 [2024-11-29 02:32:56.523365] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.888 [2024-11-29 02:32:56.523378] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.888 [2024-11-29 02:32:56.523413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.888 qpair failed and we were unable to recover it. 00:27:52.888 [2024-11-29 02:32:56.533296] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.888 [2024-11-29 02:32:56.533390] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.888 [2024-11-29 02:32:56.533422] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.888 [2024-11-29 02:32:56.533437] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.888 [2024-11-29 02:32:56.533449] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.888 [2024-11-29 02:32:56.533478] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.888 qpair failed and we were unable to recover it. 00:27:52.888 [2024-11-29 02:32:56.543300] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.888 [2024-11-29 02:32:56.543390] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.888 [2024-11-29 02:32:56.543425] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.888 [2024-11-29 02:32:56.543439] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.888 [2024-11-29 02:32:56.543451] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.888 [2024-11-29 02:32:56.543480] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.888 qpair failed and we were unable to recover it. 00:27:52.888 [2024-11-29 02:32:56.553410] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.888 [2024-11-29 02:32:56.553541] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.888 [2024-11-29 02:32:56.553567] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.888 [2024-11-29 02:32:56.553582] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.888 [2024-11-29 02:32:56.553595] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.888 [2024-11-29 02:32:56.553624] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.888 qpair failed and we were unable to recover it. 00:27:52.888 [2024-11-29 02:32:56.563461] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.888 [2024-11-29 02:32:56.563590] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.888 [2024-11-29 02:32:56.563615] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.888 [2024-11-29 02:32:56.563629] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.888 [2024-11-29 02:32:56.563642] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:52.888 [2024-11-29 02:32:56.563671] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:52.888 qpair failed and we were unable to recover it. 00:27:53.150 [2024-11-29 02:32:56.573404] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.150 [2024-11-29 02:32:56.573499] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.150 [2024-11-29 02:32:56.573523] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.150 [2024-11-29 02:32:56.573538] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.150 [2024-11-29 02:32:56.573551] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:53.150 [2024-11-29 02:32:56.573580] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:53.150 qpair failed and we were unable to recover it. 00:27:53.150 [2024-11-29 02:32:56.583460] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.150 [2024-11-29 02:32:56.583572] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.150 [2024-11-29 02:32:56.583597] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.150 [2024-11-29 02:32:56.583612] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.150 [2024-11-29 02:32:56.583624] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:53.150 [2024-11-29 02:32:56.583654] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:53.150 qpair failed and we were unable to recover it. 00:27:53.150 [2024-11-29 02:32:56.593439] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.150 [2024-11-29 02:32:56.593533] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.150 [2024-11-29 02:32:56.593558] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.150 [2024-11-29 02:32:56.593573] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.150 [2024-11-29 02:32:56.593586] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:53.150 [2024-11-29 02:32:56.593615] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:53.150 qpair failed and we were unable to recover it. 00:27:53.150 [2024-11-29 02:32:56.603494] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.150 [2024-11-29 02:32:56.603607] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.150 [2024-11-29 02:32:56.603632] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.150 [2024-11-29 02:32:56.603655] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.150 [2024-11-29 02:32:56.603669] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:53.150 [2024-11-29 02:32:56.603698] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:53.150 qpair failed and we were unable to recover it. 00:27:53.150 [2024-11-29 02:32:56.613531] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.150 [2024-11-29 02:32:56.613663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.150 [2024-11-29 02:32:56.613688] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.150 [2024-11-29 02:32:56.613702] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.150 [2024-11-29 02:32:56.613714] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:53.150 [2024-11-29 02:32:56.613744] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:53.150 qpair failed and we were unable to recover it. 00:27:53.150 [2024-11-29 02:32:56.623531] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.150 [2024-11-29 02:32:56.623625] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.150 [2024-11-29 02:32:56.623650] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.150 [2024-11-29 02:32:56.623664] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.150 [2024-11-29 02:32:56.623677] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:53.150 [2024-11-29 02:32:56.623706] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:53.150 qpair failed and we were unable to recover it. 00:27:53.150 [2024-11-29 02:32:56.633567] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.150 [2024-11-29 02:32:56.633688] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.150 [2024-11-29 02:32:56.633714] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.150 [2024-11-29 02:32:56.633728] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.150 [2024-11-29 02:32:56.633741] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:53.150 [2024-11-29 02:32:56.633770] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:53.150 qpair failed and we were unable to recover it. 00:27:53.150 [2024-11-29 02:32:56.643703] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.150 [2024-11-29 02:32:56.643796] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.150 [2024-11-29 02:32:56.643821] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.150 [2024-11-29 02:32:56.643836] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.150 [2024-11-29 02:32:56.643848] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:53.150 [2024-11-29 02:32:56.643877] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:53.150 qpair failed and we were unable to recover it. 00:27:53.150 [2024-11-29 02:32:56.653663] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.150 [2024-11-29 02:32:56.653788] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.150 [2024-11-29 02:32:56.653813] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.150 [2024-11-29 02:32:56.653827] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.150 [2024-11-29 02:32:56.653840] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:53.150 [2024-11-29 02:32:56.653870] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:53.150 qpair failed and we were unable to recover it. 00:27:53.150 [2024-11-29 02:32:56.663668] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.150 [2024-11-29 02:32:56.663758] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.150 [2024-11-29 02:32:56.663783] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.150 [2024-11-29 02:32:56.663799] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.150 [2024-11-29 02:32:56.663812] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:53.151 [2024-11-29 02:32:56.663842] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:53.151 qpair failed and we were unable to recover it. 00:27:53.151 [2024-11-29 02:32:56.673692] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.151 [2024-11-29 02:32:56.673781] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.151 [2024-11-29 02:32:56.673806] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.151 [2024-11-29 02:32:56.673821] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.151 [2024-11-29 02:32:56.673834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:53.151 [2024-11-29 02:32:56.673863] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:53.151 qpair failed and we were unable to recover it. 00:27:53.151 [2024-11-29 02:32:56.683744] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.151 [2024-11-29 02:32:56.683837] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.151 [2024-11-29 02:32:56.683862] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.151 [2024-11-29 02:32:56.683876] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.151 [2024-11-29 02:32:56.683889] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:53.151 [2024-11-29 02:32:56.683918] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:53.151 qpair failed and we were unable to recover it. 00:27:53.151 [2024-11-29 02:32:56.693759] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.151 [2024-11-29 02:32:56.693857] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.151 [2024-11-29 02:32:56.693887] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.151 [2024-11-29 02:32:56.693902] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.151 [2024-11-29 02:32:56.693915] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:53.151 [2024-11-29 02:32:56.693944] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:53.151 qpair failed and we were unable to recover it. 00:27:53.151 [2024-11-29 02:32:56.703758] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.151 [2024-11-29 02:32:56.703852] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.151 [2024-11-29 02:32:56.703877] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.151 [2024-11-29 02:32:56.703891] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.151 [2024-11-29 02:32:56.703904] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:53.151 [2024-11-29 02:32:56.703933] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:53.151 qpair failed and we were unable to recover it. 00:27:53.151 [2024-11-29 02:32:56.713796] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.151 [2024-11-29 02:32:56.713887] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.151 [2024-11-29 02:32:56.713913] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.151 [2024-11-29 02:32:56.713928] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.151 [2024-11-29 02:32:56.713940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:53.151 [2024-11-29 02:32:56.713971] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:53.151 qpair failed and we were unable to recover it. 00:27:53.151 [2024-11-29 02:32:56.723915] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.151 [2024-11-29 02:32:56.724013] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.151 [2024-11-29 02:32:56.724037] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.151 [2024-11-29 02:32:56.724052] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.151 [2024-11-29 02:32:56.724065] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:53.151 [2024-11-29 02:32:56.724094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:53.151 qpair failed and we were unable to recover it. 00:27:53.151 [2024-11-29 02:32:56.733857] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.151 [2024-11-29 02:32:56.733954] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.151 [2024-11-29 02:32:56.733979] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.151 [2024-11-29 02:32:56.733993] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.151 [2024-11-29 02:32:56.734006] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:53.151 [2024-11-29 02:32:56.734035] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:53.151 qpair failed and we were unable to recover it. 00:27:53.151 [2024-11-29 02:32:56.743918] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.151 [2024-11-29 02:32:56.744012] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.151 [2024-11-29 02:32:56.744037] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.151 [2024-11-29 02:32:56.744051] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.151 [2024-11-29 02:32:56.744064] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:53.151 [2024-11-29 02:32:56.744094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:53.151 qpair failed and we were unable to recover it. 00:27:53.151 [2024-11-29 02:32:56.753956] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.151 [2024-11-29 02:32:56.754072] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.151 [2024-11-29 02:32:56.754097] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.151 [2024-11-29 02:32:56.754112] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.151 [2024-11-29 02:32:56.754125] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:53.151 [2024-11-29 02:32:56.754154] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:53.151 qpair failed and we were unable to recover it. 00:27:53.151 [2024-11-29 02:32:56.763942] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.151 [2024-11-29 02:32:56.764035] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.151 [2024-11-29 02:32:56.764060] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.151 [2024-11-29 02:32:56.764075] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.151 [2024-11-29 02:32:56.764088] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:53.151 [2024-11-29 02:32:56.764117] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:53.151 qpair failed and we were unable to recover it. 00:27:53.151 [2024-11-29 02:32:56.773963] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.151 [2024-11-29 02:32:56.774052] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.152 [2024-11-29 02:32:56.774078] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.152 [2024-11-29 02:32:56.774092] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.152 [2024-11-29 02:32:56.774105] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc068000b90 00:27:53.152 [2024-11-29 02:32:56.774134] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:53.152 qpair failed and we were unable to recover it. 00:27:53.152 [2024-11-29 02:32:56.784028] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.152 [2024-11-29 02:32:56.784125] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.152 [2024-11-29 02:32:56.784164] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.152 [2024-11-29 02:32:56.784181] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.152 [2024-11-29 02:32:56.784195] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc060000b90 00:27:53.152 [2024-11-29 02:32:56.784228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.152 qpair failed and we were unable to recover it. 00:27:53.152 [2024-11-29 02:32:56.794133] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.152 [2024-11-29 02:32:56.794275] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.152 [2024-11-29 02:32:56.794302] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.152 [2024-11-29 02:32:56.794317] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.152 [2024-11-29 02:32:56.794331] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc060000b90 00:27:53.152 [2024-11-29 02:32:56.794363] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.152 qpair failed and we were unable to recover it. 00:27:53.152 [2024-11-29 02:32:56.804091] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.152 [2024-11-29 02:32:56.804187] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.152 [2024-11-29 02:32:56.804219] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.152 [2024-11-29 02:32:56.804235] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.152 [2024-11-29 02:32:56.804248] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:53.152 [2024-11-29 02:32:56.804278] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.152 qpair failed and we were unable to recover it. 00:27:53.152 [2024-11-29 02:32:56.814095] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.152 [2024-11-29 02:32:56.814186] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.152 [2024-11-29 02:32:56.814213] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.152 [2024-11-29 02:32:56.814228] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.152 [2024-11-29 02:32:56.814242] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xfb3cb0 00:27:53.152 [2024-11-29 02:32:56.814271] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.152 qpair failed and we were unable to recover it. 00:27:53.152 [2024-11-29 02:32:56.814390] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:27:53.152 A controller has encountered a failure and is being reset. 00:27:53.152 [2024-11-29 02:32:56.824115] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.152 [2024-11-29 02:32:56.824204] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.152 [2024-11-29 02:32:56.824236] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.152 [2024-11-29 02:32:56.824251] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.152 [2024-11-29 02:32:56.824272] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:53.152 [2024-11-29 02:32:56.824305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:53.152 qpair failed and we were unable to recover it. 00:27:53.411 [2024-11-29 02:32:56.834148] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.411 [2024-11-29 02:32:56.834236] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.411 [2024-11-29 02:32:56.834262] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.411 [2024-11-29 02:32:56.834277] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.411 [2024-11-29 02:32:56.834290] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc05c000b90 00:27:53.411 [2024-11-29 02:32:56.834320] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:53.411 qpair failed and we were unable to recover it. 00:27:53.411 Controller properly reset. 00:27:53.411 Initializing NVMe Controllers 00:27:53.411 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:53.411 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:53.411 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:27:53.411 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:27:53.411 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:27:53.411 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:27:53.411 Initialization complete. Launching workers. 00:27:53.411 Starting thread on core 1 00:27:53.411 Starting thread on core 2 00:27:53.411 Starting thread on core 3 00:27:53.411 Starting thread on core 0 00:27:53.411 02:32:56 -- host/target_disconnect.sh@59 -- # sync 00:27:53.411 00:27:53.411 real 0m11.658s 00:27:53.411 user 0m21.340s 00:27:53.411 sys 0m5.339s 00:27:53.411 02:32:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:53.411 02:32:56 -- common/autotest_common.sh@10 -- # set +x 00:27:53.411 ************************************ 00:27:53.411 END TEST nvmf_target_disconnect_tc2 00:27:53.411 ************************************ 00:27:53.411 02:32:57 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:27:53.411 02:32:57 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:27:53.411 02:32:57 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:27:53.411 02:32:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:53.411 02:32:57 -- nvmf/common.sh@116 -- # sync 00:27:53.411 02:32:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:53.411 02:32:57 -- nvmf/common.sh@119 -- # set +e 00:27:53.411 02:32:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:53.411 02:32:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:53.411 rmmod nvme_tcp 00:27:53.411 rmmod nvme_fabrics 00:27:53.411 rmmod nvme_keyring 00:27:53.411 02:32:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:53.411 02:32:57 -- nvmf/common.sh@123 -- # set -e 00:27:53.411 02:32:57 -- nvmf/common.sh@124 -- # return 0 00:27:53.411 02:32:57 -- nvmf/common.sh@477 -- # '[' -n 239590 ']' 00:27:53.411 02:32:57 -- nvmf/common.sh@478 -- # killprocess 239590 00:27:53.411 02:32:57 -- common/autotest_common.sh@936 -- # '[' -z 239590 ']' 00:27:53.411 02:32:57 -- common/autotest_common.sh@940 -- # kill -0 239590 00:27:53.411 02:32:57 -- common/autotest_common.sh@941 -- # uname 00:27:53.411 02:32:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:53.411 02:32:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 239590 00:27:53.670 02:32:57 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:27:53.670 02:32:57 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:27:53.670 02:32:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 239590' 00:27:53.670 killing process with pid 239590 00:27:53.670 02:32:57 -- common/autotest_common.sh@955 -- # kill 239590 00:27:53.670 02:32:57 -- common/autotest_common.sh@960 -- # wait 239590 00:27:53.929 02:32:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:53.929 02:32:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:53.929 02:32:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:53.929 02:32:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:53.929 02:32:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:53.929 02:32:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:53.929 02:32:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:53.929 02:32:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:55.837 02:32:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:55.838 00:27:55.838 real 0m16.442s 00:27:55.838 user 0m48.464s 00:27:55.838 sys 0m7.184s 00:27:55.838 02:32:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:55.838 02:32:59 -- common/autotest_common.sh@10 -- # set +x 00:27:55.838 ************************************ 00:27:55.838 END TEST nvmf_target_disconnect 00:27:55.838 ************************************ 00:27:55.838 02:32:59 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:27:55.838 02:32:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:55.838 02:32:59 -- common/autotest_common.sh@10 -- # set +x 00:27:55.838 02:32:59 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:27:55.838 00:27:55.838 real 21m28.983s 00:27:55.838 user 62m21.926s 00:27:55.838 sys 5m1.072s 00:27:55.838 02:32:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:55.838 02:32:59 -- common/autotest_common.sh@10 -- # set +x 00:27:55.838 ************************************ 00:27:55.838 END TEST nvmf_tcp 00:27:55.838 ************************************ 00:27:55.838 02:32:59 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:27:55.838 02:32:59 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:27:55.838 02:32:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:55.838 02:32:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:55.838 02:32:59 -- common/autotest_common.sh@10 -- # set +x 00:27:55.838 ************************************ 00:27:55.838 START TEST spdkcli_nvmf_tcp 00:27:55.838 ************************************ 00:27:55.838 02:32:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:27:56.097 * Looking for test storage... 00:27:56.097 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:27:56.097 02:32:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:56.097 02:32:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:56.097 02:32:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:56.097 02:32:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:56.097 02:32:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:56.097 02:32:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:56.097 02:32:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:56.097 02:32:59 -- scripts/common.sh@335 -- # IFS=.-: 00:27:56.097 02:32:59 -- scripts/common.sh@335 -- # read -ra ver1 00:27:56.097 02:32:59 -- scripts/common.sh@336 -- # IFS=.-: 00:27:56.097 02:32:59 -- scripts/common.sh@336 -- # read -ra ver2 00:27:56.097 02:32:59 -- scripts/common.sh@337 -- # local 'op=<' 00:27:56.097 02:32:59 -- scripts/common.sh@339 -- # ver1_l=2 00:27:56.097 02:32:59 -- scripts/common.sh@340 -- # ver2_l=1 00:27:56.097 02:32:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:56.097 02:32:59 -- scripts/common.sh@343 -- # case "$op" in 00:27:56.097 02:32:59 -- scripts/common.sh@344 -- # : 1 00:27:56.097 02:32:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:56.097 02:32:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:56.097 02:32:59 -- scripts/common.sh@364 -- # decimal 1 00:27:56.097 02:32:59 -- scripts/common.sh@352 -- # local d=1 00:27:56.097 02:32:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:56.097 02:32:59 -- scripts/common.sh@354 -- # echo 1 00:27:56.097 02:32:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:56.097 02:32:59 -- scripts/common.sh@365 -- # decimal 2 00:27:56.097 02:32:59 -- scripts/common.sh@352 -- # local d=2 00:27:56.097 02:32:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:56.097 02:32:59 -- scripts/common.sh@354 -- # echo 2 00:27:56.097 02:32:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:56.097 02:32:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:56.097 02:32:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:56.097 02:32:59 -- scripts/common.sh@367 -- # return 0 00:27:56.097 02:32:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:56.098 02:32:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:56.098 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:56.098 --rc genhtml_branch_coverage=1 00:27:56.098 --rc genhtml_function_coverage=1 00:27:56.098 --rc genhtml_legend=1 00:27:56.098 --rc geninfo_all_blocks=1 00:27:56.098 --rc geninfo_unexecuted_blocks=1 00:27:56.098 00:27:56.098 ' 00:27:56.098 02:32:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:56.098 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:56.098 --rc genhtml_branch_coverage=1 00:27:56.098 --rc genhtml_function_coverage=1 00:27:56.098 --rc genhtml_legend=1 00:27:56.098 --rc geninfo_all_blocks=1 00:27:56.098 --rc geninfo_unexecuted_blocks=1 00:27:56.098 00:27:56.098 ' 00:27:56.098 02:32:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:56.098 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:56.098 --rc genhtml_branch_coverage=1 00:27:56.098 --rc genhtml_function_coverage=1 00:27:56.098 --rc genhtml_legend=1 00:27:56.098 --rc geninfo_all_blocks=1 00:27:56.098 --rc geninfo_unexecuted_blocks=1 00:27:56.098 00:27:56.098 ' 00:27:56.098 02:32:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:56.098 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:56.098 --rc genhtml_branch_coverage=1 00:27:56.098 --rc genhtml_function_coverage=1 00:27:56.098 --rc genhtml_legend=1 00:27:56.098 --rc geninfo_all_blocks=1 00:27:56.098 --rc geninfo_unexecuted_blocks=1 00:27:56.098 00:27:56.098 ' 00:27:56.098 02:32:59 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:27:56.098 02:32:59 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:27:56.098 02:32:59 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:27:56.098 02:32:59 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:56.098 02:32:59 -- nvmf/common.sh@7 -- # uname -s 00:27:56.098 02:32:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:56.098 02:32:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:56.098 02:32:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:56.098 02:32:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:56.098 02:32:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:56.098 02:32:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:56.098 02:32:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:56.098 02:32:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:56.098 02:32:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:56.098 02:32:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:56.098 02:32:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:56.098 02:32:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:56.098 02:32:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:56.098 02:32:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:56.098 02:32:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:56.098 02:32:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:56.098 02:32:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:56.098 02:32:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:56.098 02:32:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:56.098 02:32:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:56.098 02:32:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:56.098 02:32:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:56.098 02:32:59 -- paths/export.sh@5 -- # export PATH 00:27:56.098 02:32:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:56.098 02:32:59 -- nvmf/common.sh@46 -- # : 0 00:27:56.098 02:32:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:56.098 02:32:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:56.098 02:32:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:56.098 02:32:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:56.098 02:32:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:56.098 02:32:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:56.098 02:32:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:56.098 02:32:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:56.098 02:32:59 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:27:56.098 02:32:59 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:27:56.098 02:32:59 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:27:56.098 02:32:59 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:27:56.098 02:32:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:56.098 02:32:59 -- common/autotest_common.sh@10 -- # set +x 00:27:56.098 02:32:59 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:27:56.098 02:32:59 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=240820 00:27:56.098 02:32:59 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:27:56.098 02:32:59 -- spdkcli/common.sh@34 -- # waitforlisten 240820 00:27:56.098 02:32:59 -- common/autotest_common.sh@829 -- # '[' -z 240820 ']' 00:27:56.098 02:32:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:56.098 02:32:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:56.098 02:32:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:56.098 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:56.098 02:32:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:56.098 02:32:59 -- common/autotest_common.sh@10 -- # set +x 00:27:56.098 [2024-11-29 02:32:59.665431] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:56.098 [2024-11-29 02:32:59.665511] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid240820 ] 00:27:56.098 EAL: No free 2048 kB hugepages reported on node 1 00:27:56.098 [2024-11-29 02:32:59.727517] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:56.358 [2024-11-29 02:32:59.833562] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:56.358 [2024-11-29 02:32:59.833776] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:56.358 [2024-11-29 02:32:59.833782] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:57.295 02:33:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:57.295 02:33:00 -- common/autotest_common.sh@862 -- # return 0 00:27:57.295 02:33:00 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:27:57.295 02:33:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:57.295 02:33:00 -- common/autotest_common.sh@10 -- # set +x 00:27:57.295 02:33:00 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:27:57.295 02:33:00 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:27:57.295 02:33:00 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:27:57.295 02:33:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:57.295 02:33:00 -- common/autotest_common.sh@10 -- # set +x 00:27:57.295 02:33:00 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:27:57.295 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:27:57.295 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:27:57.295 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:27:57.295 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:27:57.295 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:27:57.295 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:27:57.295 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:27:57.295 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:27:57.295 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:27:57.295 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:57.295 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:57.295 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:27:57.295 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:57.295 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:57.295 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:27:57.295 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:57.295 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:27:57.295 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:27:57.295 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:57.295 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:27:57.295 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:27:57.295 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:27:57.295 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:27:57.295 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:57.296 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:27:57.296 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:27:57.296 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:27:57.296 ' 00:27:57.554 [2024-11-29 02:33:01.084140] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:00.092 [2024-11-29 02:33:03.263958] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:01.045 [2024-11-29 02:33:04.504383] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:28:03.577 [2024-11-29 02:33:06.791617] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:28:05.483 [2024-11-29 02:33:08.786345] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:28:06.860 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:28:06.860 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:28:06.860 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:28:06.860 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:28:06.860 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:28:06.860 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:28:06.860 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:28:06.860 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:06.860 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:28:06.860 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:28:06.860 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:06.861 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:06.861 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:28:06.861 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:06.861 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:06.861 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:28:06.861 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:06.861 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:06.861 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:06.861 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:06.861 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:28:06.861 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:28:06.861 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:06.861 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:28:06.861 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:06.861 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:28:06.861 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:28:06.861 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:28:06.861 02:33:10 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:28:06.861 02:33:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:06.861 02:33:10 -- common/autotest_common.sh@10 -- # set +x 00:28:06.861 02:33:10 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:28:06.861 02:33:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:06.861 02:33:10 -- common/autotest_common.sh@10 -- # set +x 00:28:06.861 02:33:10 -- spdkcli/nvmf.sh@69 -- # check_match 00:28:06.861 02:33:10 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:28:07.433 02:33:10 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:28:07.433 02:33:10 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:28:07.433 02:33:10 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:28:07.433 02:33:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:07.433 02:33:10 -- common/autotest_common.sh@10 -- # set +x 00:28:07.433 02:33:10 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:28:07.433 02:33:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:07.433 02:33:10 -- common/autotest_common.sh@10 -- # set +x 00:28:07.433 02:33:10 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:28:07.433 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:28:07.433 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:07.433 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:28:07.433 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:28:07.433 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:28:07.433 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:28:07.433 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:07.433 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:28:07.433 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:28:07.433 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:28:07.433 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:28:07.433 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:28:07.433 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:28:07.433 ' 00:28:12.793 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:28:12.793 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:28:12.793 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:12.793 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:28:12.793 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:28:12.793 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:28:12.793 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:28:12.793 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:12.793 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:28:12.793 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:28:12.793 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:28:12.793 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:28:12.793 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:28:12.793 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:28:12.793 02:33:16 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:28:12.793 02:33:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:12.793 02:33:16 -- common/autotest_common.sh@10 -- # set +x 00:28:12.793 02:33:16 -- spdkcli/nvmf.sh@90 -- # killprocess 240820 00:28:12.793 02:33:16 -- common/autotest_common.sh@936 -- # '[' -z 240820 ']' 00:28:12.793 02:33:16 -- common/autotest_common.sh@940 -- # kill -0 240820 00:28:12.793 02:33:16 -- common/autotest_common.sh@941 -- # uname 00:28:12.793 02:33:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:12.793 02:33:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 240820 00:28:12.793 02:33:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:12.793 02:33:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:12.793 02:33:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 240820' 00:28:12.793 killing process with pid 240820 00:28:12.793 02:33:16 -- common/autotest_common.sh@955 -- # kill 240820 00:28:12.793 [2024-11-29 02:33:16.311617] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:12.793 02:33:16 -- common/autotest_common.sh@960 -- # wait 240820 00:28:13.052 02:33:16 -- spdkcli/nvmf.sh@1 -- # cleanup 00:28:13.052 02:33:16 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:28:13.052 02:33:16 -- spdkcli/common.sh@13 -- # '[' -n 240820 ']' 00:28:13.052 02:33:16 -- spdkcli/common.sh@14 -- # killprocess 240820 00:28:13.052 02:33:16 -- common/autotest_common.sh@936 -- # '[' -z 240820 ']' 00:28:13.052 02:33:16 -- common/autotest_common.sh@940 -- # kill -0 240820 00:28:13.052 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (240820) - No such process 00:28:13.052 02:33:16 -- common/autotest_common.sh@963 -- # echo 'Process with pid 240820 is not found' 00:28:13.052 Process with pid 240820 is not found 00:28:13.052 02:33:16 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:28:13.052 02:33:16 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:28:13.052 02:33:16 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:28:13.052 00:28:13.052 real 0m17.091s 00:28:13.052 user 0m36.401s 00:28:13.052 sys 0m0.820s 00:28:13.052 02:33:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:13.052 02:33:16 -- common/autotest_common.sh@10 -- # set +x 00:28:13.052 ************************************ 00:28:13.052 END TEST spdkcli_nvmf_tcp 00:28:13.052 ************************************ 00:28:13.052 02:33:16 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:13.052 02:33:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:13.052 02:33:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:13.052 02:33:16 -- common/autotest_common.sh@10 -- # set +x 00:28:13.052 ************************************ 00:28:13.052 START TEST nvmf_identify_passthru 00:28:13.052 ************************************ 00:28:13.052 02:33:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:13.052 * Looking for test storage... 00:28:13.052 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:13.052 02:33:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:13.052 02:33:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:13.052 02:33:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:13.052 02:33:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:13.052 02:33:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:13.052 02:33:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:13.052 02:33:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:13.052 02:33:16 -- scripts/common.sh@335 -- # IFS=.-: 00:28:13.052 02:33:16 -- scripts/common.sh@335 -- # read -ra ver1 00:28:13.052 02:33:16 -- scripts/common.sh@336 -- # IFS=.-: 00:28:13.052 02:33:16 -- scripts/common.sh@336 -- # read -ra ver2 00:28:13.052 02:33:16 -- scripts/common.sh@337 -- # local 'op=<' 00:28:13.052 02:33:16 -- scripts/common.sh@339 -- # ver1_l=2 00:28:13.052 02:33:16 -- scripts/common.sh@340 -- # ver2_l=1 00:28:13.052 02:33:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:13.052 02:33:16 -- scripts/common.sh@343 -- # case "$op" in 00:28:13.052 02:33:16 -- scripts/common.sh@344 -- # : 1 00:28:13.052 02:33:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:13.052 02:33:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:13.052 02:33:16 -- scripts/common.sh@364 -- # decimal 1 00:28:13.052 02:33:16 -- scripts/common.sh@352 -- # local d=1 00:28:13.052 02:33:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:13.052 02:33:16 -- scripts/common.sh@354 -- # echo 1 00:28:13.052 02:33:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:13.052 02:33:16 -- scripts/common.sh@365 -- # decimal 2 00:28:13.052 02:33:16 -- scripts/common.sh@352 -- # local d=2 00:28:13.052 02:33:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:13.052 02:33:16 -- scripts/common.sh@354 -- # echo 2 00:28:13.311 02:33:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:13.311 02:33:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:13.311 02:33:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:13.311 02:33:16 -- scripts/common.sh@367 -- # return 0 00:28:13.311 02:33:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:13.311 02:33:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:13.311 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:13.311 --rc genhtml_branch_coverage=1 00:28:13.311 --rc genhtml_function_coverage=1 00:28:13.311 --rc genhtml_legend=1 00:28:13.311 --rc geninfo_all_blocks=1 00:28:13.311 --rc geninfo_unexecuted_blocks=1 00:28:13.311 00:28:13.311 ' 00:28:13.311 02:33:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:13.311 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:13.311 --rc genhtml_branch_coverage=1 00:28:13.311 --rc genhtml_function_coverage=1 00:28:13.311 --rc genhtml_legend=1 00:28:13.311 --rc geninfo_all_blocks=1 00:28:13.311 --rc geninfo_unexecuted_blocks=1 00:28:13.311 00:28:13.311 ' 00:28:13.311 02:33:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:13.311 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:13.311 --rc genhtml_branch_coverage=1 00:28:13.311 --rc genhtml_function_coverage=1 00:28:13.311 --rc genhtml_legend=1 00:28:13.311 --rc geninfo_all_blocks=1 00:28:13.311 --rc geninfo_unexecuted_blocks=1 00:28:13.311 00:28:13.311 ' 00:28:13.311 02:33:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:13.311 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:13.311 --rc genhtml_branch_coverage=1 00:28:13.311 --rc genhtml_function_coverage=1 00:28:13.311 --rc genhtml_legend=1 00:28:13.311 --rc geninfo_all_blocks=1 00:28:13.311 --rc geninfo_unexecuted_blocks=1 00:28:13.311 00:28:13.311 ' 00:28:13.311 02:33:16 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:13.311 02:33:16 -- nvmf/common.sh@7 -- # uname -s 00:28:13.311 02:33:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:13.311 02:33:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:13.311 02:33:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:13.311 02:33:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:13.311 02:33:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:13.311 02:33:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:13.311 02:33:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:13.311 02:33:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:13.311 02:33:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:13.311 02:33:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:13.311 02:33:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:13.311 02:33:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:13.311 02:33:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:13.311 02:33:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:13.311 02:33:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:13.311 02:33:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:13.311 02:33:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:13.311 02:33:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:13.311 02:33:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:13.311 02:33:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.311 02:33:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.311 02:33:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.311 02:33:16 -- paths/export.sh@5 -- # export PATH 00:28:13.312 02:33:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.312 02:33:16 -- nvmf/common.sh@46 -- # : 0 00:28:13.312 02:33:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:13.312 02:33:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:13.312 02:33:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:13.312 02:33:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:13.312 02:33:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:13.312 02:33:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:13.312 02:33:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:13.312 02:33:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:13.312 02:33:16 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:13.312 02:33:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:13.312 02:33:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:13.312 02:33:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:13.312 02:33:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.312 02:33:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.312 02:33:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.312 02:33:16 -- paths/export.sh@5 -- # export PATH 00:28:13.312 02:33:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.312 02:33:16 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:28:13.312 02:33:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:13.312 02:33:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:13.312 02:33:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:13.312 02:33:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:13.312 02:33:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:13.312 02:33:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:13.312 02:33:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:13.312 02:33:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:13.312 02:33:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:13.312 02:33:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:13.312 02:33:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:13.312 02:33:16 -- common/autotest_common.sh@10 -- # set +x 00:28:15.215 02:33:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:15.215 02:33:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:15.215 02:33:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:15.215 02:33:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:15.215 02:33:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:15.215 02:33:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:15.215 02:33:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:15.215 02:33:18 -- nvmf/common.sh@294 -- # net_devs=() 00:28:15.215 02:33:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:15.215 02:33:18 -- nvmf/common.sh@295 -- # e810=() 00:28:15.215 02:33:18 -- nvmf/common.sh@295 -- # local -ga e810 00:28:15.215 02:33:18 -- nvmf/common.sh@296 -- # x722=() 00:28:15.215 02:33:18 -- nvmf/common.sh@296 -- # local -ga x722 00:28:15.215 02:33:18 -- nvmf/common.sh@297 -- # mlx=() 00:28:15.215 02:33:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:15.215 02:33:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:15.215 02:33:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:15.215 02:33:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:15.215 02:33:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:15.215 02:33:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:15.215 02:33:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:15.215 02:33:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:15.215 02:33:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:15.215 02:33:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:15.215 02:33:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:15.215 02:33:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:15.215 02:33:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:15.215 02:33:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:15.215 02:33:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:15.215 02:33:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:15.215 02:33:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:15.215 02:33:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:15.215 02:33:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:15.215 02:33:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:15.215 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:15.215 02:33:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:15.215 02:33:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:15.215 02:33:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:15.215 02:33:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:15.215 02:33:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:15.215 02:33:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:15.215 02:33:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:15.215 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:15.215 02:33:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:15.215 02:33:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:15.215 02:33:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:15.215 02:33:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:15.215 02:33:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:15.215 02:33:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:15.215 02:33:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:15.215 02:33:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:15.215 02:33:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:15.215 02:33:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:15.215 02:33:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:15.215 02:33:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:15.215 02:33:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:15.215 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:15.215 02:33:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:15.215 02:33:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:15.215 02:33:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:15.215 02:33:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:15.215 02:33:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:15.215 02:33:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:15.215 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:15.215 02:33:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:15.215 02:33:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:15.215 02:33:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:15.215 02:33:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:15.215 02:33:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:15.215 02:33:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:15.215 02:33:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:15.215 02:33:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:15.215 02:33:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:15.215 02:33:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:15.215 02:33:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:15.215 02:33:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:15.215 02:33:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:15.215 02:33:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:15.215 02:33:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:15.215 02:33:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:15.215 02:33:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:15.215 02:33:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:15.215 02:33:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:15.215 02:33:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:15.215 02:33:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:15.215 02:33:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:15.216 02:33:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:15.216 02:33:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:15.216 02:33:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:15.216 02:33:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:15.216 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:15.216 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.263 ms 00:28:15.216 00:28:15.216 --- 10.0.0.2 ping statistics --- 00:28:15.216 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:15.216 rtt min/avg/max/mdev = 0.263/0.263/0.263/0.000 ms 00:28:15.216 02:33:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:15.216 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:15.216 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.079 ms 00:28:15.216 00:28:15.216 --- 10.0.0.1 ping statistics --- 00:28:15.216 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:15.216 rtt min/avg/max/mdev = 0.079/0.079/0.079/0.000 ms 00:28:15.216 02:33:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:15.216 02:33:18 -- nvmf/common.sh@410 -- # return 0 00:28:15.216 02:33:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:15.216 02:33:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:15.216 02:33:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:15.216 02:33:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:15.216 02:33:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:15.216 02:33:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:15.216 02:33:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:15.216 02:33:18 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:28:15.216 02:33:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:15.216 02:33:18 -- common/autotest_common.sh@10 -- # set +x 00:28:15.216 02:33:18 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:28:15.216 02:33:18 -- common/autotest_common.sh@1519 -- # bdfs=() 00:28:15.216 02:33:18 -- common/autotest_common.sh@1519 -- # local bdfs 00:28:15.216 02:33:18 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:28:15.216 02:33:18 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:28:15.216 02:33:18 -- common/autotest_common.sh@1508 -- # bdfs=() 00:28:15.216 02:33:18 -- common/autotest_common.sh@1508 -- # local bdfs 00:28:15.216 02:33:18 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:28:15.216 02:33:18 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:28:15.216 02:33:18 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:28:15.475 02:33:18 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:28:15.475 02:33:18 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:28:15.475 02:33:18 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:28:15.475 02:33:18 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:28:15.475 02:33:18 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:28:15.475 02:33:18 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:15.475 02:33:18 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:28:15.475 02:33:18 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:28:15.475 EAL: No free 2048 kB hugepages reported on node 1 00:28:19.669 02:33:23 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:28:19.669 02:33:23 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:19.669 02:33:23 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:28:19.669 02:33:23 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:28:19.669 EAL: No free 2048 kB hugepages reported on node 1 00:28:23.870 02:33:27 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:28:23.870 02:33:27 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:28:23.870 02:33:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:23.870 02:33:27 -- common/autotest_common.sh@10 -- # set +x 00:28:23.870 02:33:27 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:28:23.870 02:33:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:23.870 02:33:27 -- common/autotest_common.sh@10 -- # set +x 00:28:23.871 02:33:27 -- target/identify_passthru.sh@31 -- # nvmfpid=246190 00:28:23.871 02:33:27 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:28:23.871 02:33:27 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:23.871 02:33:27 -- target/identify_passthru.sh@35 -- # waitforlisten 246190 00:28:23.871 02:33:27 -- common/autotest_common.sh@829 -- # '[' -z 246190 ']' 00:28:23.871 02:33:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:23.871 02:33:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:23.871 02:33:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:23.871 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:23.871 02:33:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:23.871 02:33:27 -- common/autotest_common.sh@10 -- # set +x 00:28:23.871 [2024-11-29 02:33:27.423694] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:23.871 [2024-11-29 02:33:27.423806] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:23.871 EAL: No free 2048 kB hugepages reported on node 1 00:28:23.871 [2024-11-29 02:33:27.490102] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:24.129 [2024-11-29 02:33:27.599861] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:24.129 [2024-11-29 02:33:27.600029] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:24.129 [2024-11-29 02:33:27.600046] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:24.129 [2024-11-29 02:33:27.600059] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:24.129 [2024-11-29 02:33:27.600122] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:24.129 [2024-11-29 02:33:27.600182] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:24.129 [2024-11-29 02:33:27.600249] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:24.129 [2024-11-29 02:33:27.600252] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:24.129 02:33:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:24.129 02:33:27 -- common/autotest_common.sh@862 -- # return 0 00:28:24.129 02:33:27 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:28:24.129 02:33:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:24.129 02:33:27 -- common/autotest_common.sh@10 -- # set +x 00:28:24.129 INFO: Log level set to 20 00:28:24.129 INFO: Requests: 00:28:24.129 { 00:28:24.129 "jsonrpc": "2.0", 00:28:24.129 "method": "nvmf_set_config", 00:28:24.129 "id": 1, 00:28:24.129 "params": { 00:28:24.129 "admin_cmd_passthru": { 00:28:24.129 "identify_ctrlr": true 00:28:24.129 } 00:28:24.129 } 00:28:24.129 } 00:28:24.129 00:28:24.129 INFO: response: 00:28:24.129 { 00:28:24.129 "jsonrpc": "2.0", 00:28:24.129 "id": 1, 00:28:24.129 "result": true 00:28:24.129 } 00:28:24.129 00:28:24.129 02:33:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:24.129 02:33:27 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:28:24.129 02:33:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:24.129 02:33:27 -- common/autotest_common.sh@10 -- # set +x 00:28:24.129 INFO: Setting log level to 20 00:28:24.129 INFO: Setting log level to 20 00:28:24.129 INFO: Log level set to 20 00:28:24.129 INFO: Log level set to 20 00:28:24.129 INFO: Requests: 00:28:24.129 { 00:28:24.129 "jsonrpc": "2.0", 00:28:24.129 "method": "framework_start_init", 00:28:24.129 "id": 1 00:28:24.129 } 00:28:24.129 00:28:24.129 INFO: Requests: 00:28:24.129 { 00:28:24.129 "jsonrpc": "2.0", 00:28:24.129 "method": "framework_start_init", 00:28:24.129 "id": 1 00:28:24.129 } 00:28:24.129 00:28:24.129 [2024-11-29 02:33:27.755640] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:28:24.129 INFO: response: 00:28:24.129 { 00:28:24.129 "jsonrpc": "2.0", 00:28:24.129 "id": 1, 00:28:24.129 "result": true 00:28:24.129 } 00:28:24.129 00:28:24.129 INFO: response: 00:28:24.129 { 00:28:24.129 "jsonrpc": "2.0", 00:28:24.129 "id": 1, 00:28:24.129 "result": true 00:28:24.129 } 00:28:24.129 00:28:24.129 02:33:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:24.129 02:33:27 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:24.129 02:33:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:24.129 02:33:27 -- common/autotest_common.sh@10 -- # set +x 00:28:24.129 INFO: Setting log level to 40 00:28:24.129 INFO: Setting log level to 40 00:28:24.129 INFO: Setting log level to 40 00:28:24.129 [2024-11-29 02:33:27.765773] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:24.129 02:33:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:24.129 02:33:27 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:28:24.129 02:33:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:24.129 02:33:27 -- common/autotest_common.sh@10 -- # set +x 00:28:24.129 02:33:27 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:28:24.129 02:33:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:24.129 02:33:27 -- common/autotest_common.sh@10 -- # set +x 00:28:27.418 Nvme0n1 00:28:27.418 02:33:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:27.418 02:33:30 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:28:27.418 02:33:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:27.418 02:33:30 -- common/autotest_common.sh@10 -- # set +x 00:28:27.418 02:33:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:27.418 02:33:30 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:28:27.418 02:33:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:27.418 02:33:30 -- common/autotest_common.sh@10 -- # set +x 00:28:27.418 02:33:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:27.418 02:33:30 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:27.418 02:33:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:27.418 02:33:30 -- common/autotest_common.sh@10 -- # set +x 00:28:27.418 [2024-11-29 02:33:30.659812] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:27.418 02:33:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:27.418 02:33:30 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:28:27.418 02:33:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:27.418 02:33:30 -- common/autotest_common.sh@10 -- # set +x 00:28:27.418 [2024-11-29 02:33:30.667484] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:27.418 [ 00:28:27.418 { 00:28:27.418 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:28:27.418 "subtype": "Discovery", 00:28:27.418 "listen_addresses": [], 00:28:27.418 "allow_any_host": true, 00:28:27.418 "hosts": [] 00:28:27.418 }, 00:28:27.418 { 00:28:27.418 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:28:27.418 "subtype": "NVMe", 00:28:27.418 "listen_addresses": [ 00:28:27.418 { 00:28:27.418 "transport": "TCP", 00:28:27.418 "trtype": "TCP", 00:28:27.418 "adrfam": "IPv4", 00:28:27.418 "traddr": "10.0.0.2", 00:28:27.418 "trsvcid": "4420" 00:28:27.418 } 00:28:27.418 ], 00:28:27.418 "allow_any_host": true, 00:28:27.418 "hosts": [], 00:28:27.418 "serial_number": "SPDK00000000000001", 00:28:27.418 "model_number": "SPDK bdev Controller", 00:28:27.418 "max_namespaces": 1, 00:28:27.418 "min_cntlid": 1, 00:28:27.418 "max_cntlid": 65519, 00:28:27.418 "namespaces": [ 00:28:27.418 { 00:28:27.418 "nsid": 1, 00:28:27.418 "bdev_name": "Nvme0n1", 00:28:27.418 "name": "Nvme0n1", 00:28:27.418 "nguid": "DE89E69169B14A1D9B4F1AA23EB72353", 00:28:27.418 "uuid": "de89e691-69b1-4a1d-9b4f-1aa23eb72353" 00:28:27.418 } 00:28:27.418 ] 00:28:27.418 } 00:28:27.418 ] 00:28:27.418 02:33:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:27.418 02:33:30 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:27.418 02:33:30 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:28:27.418 02:33:30 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:28:27.418 EAL: No free 2048 kB hugepages reported on node 1 00:28:27.418 02:33:30 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:28:27.418 02:33:30 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:27.418 02:33:30 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:28:27.418 02:33:30 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:28:27.418 EAL: No free 2048 kB hugepages reported on node 1 00:28:27.418 02:33:31 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:28:27.418 02:33:31 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:28:27.418 02:33:31 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:28:27.418 02:33:31 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:27.419 02:33:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:27.419 02:33:31 -- common/autotest_common.sh@10 -- # set +x 00:28:27.679 02:33:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:27.679 02:33:31 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:28:27.679 02:33:31 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:28:27.679 02:33:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:27.679 02:33:31 -- nvmf/common.sh@116 -- # sync 00:28:27.679 02:33:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:27.679 02:33:31 -- nvmf/common.sh@119 -- # set +e 00:28:27.679 02:33:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:27.679 02:33:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:27.679 rmmod nvme_tcp 00:28:27.679 rmmod nvme_fabrics 00:28:27.679 rmmod nvme_keyring 00:28:27.679 02:33:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:27.679 02:33:31 -- nvmf/common.sh@123 -- # set -e 00:28:27.679 02:33:31 -- nvmf/common.sh@124 -- # return 0 00:28:27.679 02:33:31 -- nvmf/common.sh@477 -- # '[' -n 246190 ']' 00:28:27.679 02:33:31 -- nvmf/common.sh@478 -- # killprocess 246190 00:28:27.679 02:33:31 -- common/autotest_common.sh@936 -- # '[' -z 246190 ']' 00:28:27.679 02:33:31 -- common/autotest_common.sh@940 -- # kill -0 246190 00:28:27.679 02:33:31 -- common/autotest_common.sh@941 -- # uname 00:28:27.679 02:33:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:27.679 02:33:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 246190 00:28:27.679 02:33:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:27.679 02:33:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:27.679 02:33:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 246190' 00:28:27.680 killing process with pid 246190 00:28:27.680 02:33:31 -- common/autotest_common.sh@955 -- # kill 246190 00:28:27.680 [2024-11-29 02:33:31.212648] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:27.680 02:33:31 -- common/autotest_common.sh@960 -- # wait 246190 00:28:29.598 02:33:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:29.598 02:33:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:29.598 02:33:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:29.598 02:33:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:29.598 02:33:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:29.598 02:33:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:29.598 02:33:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:29.598 02:33:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:31.513 02:33:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:31.513 00:28:31.513 real 0m18.267s 00:28:31.513 user 0m27.248s 00:28:31.513 sys 0m2.350s 00:28:31.513 02:33:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:31.513 02:33:34 -- common/autotest_common.sh@10 -- # set +x 00:28:31.513 ************************************ 00:28:31.513 END TEST nvmf_identify_passthru 00:28:31.513 ************************************ 00:28:31.513 02:33:34 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:31.513 02:33:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:31.513 02:33:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:31.513 02:33:34 -- common/autotest_common.sh@10 -- # set +x 00:28:31.513 ************************************ 00:28:31.513 START TEST nvmf_dif 00:28:31.513 ************************************ 00:28:31.513 02:33:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:31.513 * Looking for test storage... 00:28:31.513 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:31.513 02:33:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:31.513 02:33:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:31.513 02:33:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:31.513 02:33:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:31.513 02:33:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:31.513 02:33:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:31.513 02:33:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:31.513 02:33:35 -- scripts/common.sh@335 -- # IFS=.-: 00:28:31.513 02:33:35 -- scripts/common.sh@335 -- # read -ra ver1 00:28:31.513 02:33:35 -- scripts/common.sh@336 -- # IFS=.-: 00:28:31.513 02:33:35 -- scripts/common.sh@336 -- # read -ra ver2 00:28:31.513 02:33:35 -- scripts/common.sh@337 -- # local 'op=<' 00:28:31.513 02:33:35 -- scripts/common.sh@339 -- # ver1_l=2 00:28:31.513 02:33:35 -- scripts/common.sh@340 -- # ver2_l=1 00:28:31.513 02:33:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:31.513 02:33:35 -- scripts/common.sh@343 -- # case "$op" in 00:28:31.513 02:33:35 -- scripts/common.sh@344 -- # : 1 00:28:31.513 02:33:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:31.514 02:33:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:31.514 02:33:35 -- scripts/common.sh@364 -- # decimal 1 00:28:31.514 02:33:35 -- scripts/common.sh@352 -- # local d=1 00:28:31.514 02:33:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:31.514 02:33:35 -- scripts/common.sh@354 -- # echo 1 00:28:31.514 02:33:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:31.514 02:33:35 -- scripts/common.sh@365 -- # decimal 2 00:28:31.514 02:33:35 -- scripts/common.sh@352 -- # local d=2 00:28:31.514 02:33:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:31.514 02:33:35 -- scripts/common.sh@354 -- # echo 2 00:28:31.514 02:33:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:31.514 02:33:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:31.514 02:33:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:31.514 02:33:35 -- scripts/common.sh@367 -- # return 0 00:28:31.514 02:33:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:31.514 02:33:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:31.514 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:31.514 --rc genhtml_branch_coverage=1 00:28:31.514 --rc genhtml_function_coverage=1 00:28:31.514 --rc genhtml_legend=1 00:28:31.514 --rc geninfo_all_blocks=1 00:28:31.514 --rc geninfo_unexecuted_blocks=1 00:28:31.514 00:28:31.514 ' 00:28:31.514 02:33:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:31.514 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:31.514 --rc genhtml_branch_coverage=1 00:28:31.514 --rc genhtml_function_coverage=1 00:28:31.514 --rc genhtml_legend=1 00:28:31.514 --rc geninfo_all_blocks=1 00:28:31.514 --rc geninfo_unexecuted_blocks=1 00:28:31.514 00:28:31.514 ' 00:28:31.515 02:33:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:31.515 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:31.515 --rc genhtml_branch_coverage=1 00:28:31.515 --rc genhtml_function_coverage=1 00:28:31.515 --rc genhtml_legend=1 00:28:31.515 --rc geninfo_all_blocks=1 00:28:31.515 --rc geninfo_unexecuted_blocks=1 00:28:31.515 00:28:31.515 ' 00:28:31.515 02:33:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:31.515 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:31.515 --rc genhtml_branch_coverage=1 00:28:31.515 --rc genhtml_function_coverage=1 00:28:31.515 --rc genhtml_legend=1 00:28:31.515 --rc geninfo_all_blocks=1 00:28:31.515 --rc geninfo_unexecuted_blocks=1 00:28:31.515 00:28:31.515 ' 00:28:31.515 02:33:35 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:31.515 02:33:35 -- nvmf/common.sh@7 -- # uname -s 00:28:31.515 02:33:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:31.515 02:33:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:31.515 02:33:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:31.515 02:33:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:31.515 02:33:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:31.515 02:33:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:31.515 02:33:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:31.515 02:33:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:31.515 02:33:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:31.515 02:33:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:31.515 02:33:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:31.515 02:33:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:31.515 02:33:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:31.515 02:33:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:31.515 02:33:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:31.516 02:33:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:31.516 02:33:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:31.516 02:33:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:31.516 02:33:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:31.516 02:33:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:31.516 02:33:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:31.516 02:33:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:31.516 02:33:35 -- paths/export.sh@5 -- # export PATH 00:28:31.516 02:33:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:31.516 02:33:35 -- nvmf/common.sh@46 -- # : 0 00:28:31.516 02:33:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:31.516 02:33:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:31.516 02:33:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:31.516 02:33:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:31.516 02:33:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:31.516 02:33:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:31.516 02:33:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:31.516 02:33:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:31.516 02:33:35 -- target/dif.sh@15 -- # NULL_META=16 00:28:31.516 02:33:35 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:28:31.516 02:33:35 -- target/dif.sh@15 -- # NULL_SIZE=64 00:28:31.516 02:33:35 -- target/dif.sh@15 -- # NULL_DIF=1 00:28:31.516 02:33:35 -- target/dif.sh@135 -- # nvmftestinit 00:28:31.516 02:33:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:31.516 02:33:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:31.516 02:33:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:31.516 02:33:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:31.516 02:33:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:31.516 02:33:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:31.516 02:33:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:31.516 02:33:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:31.516 02:33:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:31.516 02:33:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:31.516 02:33:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:31.516 02:33:35 -- common/autotest_common.sh@10 -- # set +x 00:28:33.437 02:33:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:33.437 02:33:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:33.437 02:33:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:33.437 02:33:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:33.437 02:33:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:33.437 02:33:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:33.437 02:33:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:33.437 02:33:36 -- nvmf/common.sh@294 -- # net_devs=() 00:28:33.437 02:33:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:33.437 02:33:36 -- nvmf/common.sh@295 -- # e810=() 00:28:33.437 02:33:36 -- nvmf/common.sh@295 -- # local -ga e810 00:28:33.437 02:33:36 -- nvmf/common.sh@296 -- # x722=() 00:28:33.437 02:33:36 -- nvmf/common.sh@296 -- # local -ga x722 00:28:33.437 02:33:36 -- nvmf/common.sh@297 -- # mlx=() 00:28:33.437 02:33:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:33.437 02:33:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:33.437 02:33:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:33.437 02:33:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:33.437 02:33:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:33.437 02:33:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:33.437 02:33:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:33.437 02:33:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:33.437 02:33:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:33.437 02:33:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:33.437 02:33:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:33.437 02:33:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:33.437 02:33:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:33.437 02:33:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:33.437 02:33:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:33.437 02:33:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:33.437 02:33:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:33.437 02:33:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:33.437 02:33:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:33.437 02:33:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:33.437 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:33.437 02:33:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:33.437 02:33:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:33.437 02:33:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:33.437 02:33:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:33.437 02:33:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:33.437 02:33:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:33.437 02:33:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:33.437 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:33.438 02:33:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:33.438 02:33:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:33.438 02:33:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:33.438 02:33:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:33.438 02:33:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:33.438 02:33:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:33.438 02:33:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:33.438 02:33:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:33.438 02:33:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:33.438 02:33:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:33.438 02:33:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:33.438 02:33:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:33.438 02:33:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:33.438 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:33.438 02:33:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:33.438 02:33:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:33.438 02:33:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:33.438 02:33:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:33.438 02:33:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:33.438 02:33:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:33.438 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:33.438 02:33:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:33.438 02:33:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:33.438 02:33:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:33.438 02:33:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:33.438 02:33:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:33.438 02:33:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:33.438 02:33:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:33.438 02:33:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:33.438 02:33:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:33.438 02:33:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:33.438 02:33:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:33.438 02:33:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:33.438 02:33:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:33.438 02:33:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:33.438 02:33:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:33.438 02:33:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:33.438 02:33:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:33.438 02:33:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:33.438 02:33:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:33.438 02:33:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:33.438 02:33:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:33.438 02:33:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:33.438 02:33:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:33.438 02:33:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:33.438 02:33:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:33.438 02:33:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:33.438 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:33.438 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.302 ms 00:28:33.438 00:28:33.438 --- 10.0.0.2 ping statistics --- 00:28:33.438 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:33.438 rtt min/avg/max/mdev = 0.302/0.302/0.302/0.000 ms 00:28:33.438 02:33:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:33.438 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:33.438 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.046 ms 00:28:33.438 00:28:33.438 --- 10.0.0.1 ping statistics --- 00:28:33.438 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:33.438 rtt min/avg/max/mdev = 0.046/0.046/0.046/0.000 ms 00:28:33.438 02:33:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:33.438 02:33:37 -- nvmf/common.sh@410 -- # return 0 00:28:33.438 02:33:37 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:28:33.438 02:33:37 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:28:34.817 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:34.817 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:28:34.817 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:34.817 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:34.817 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:34.817 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:34.817 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:34.817 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:34.817 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:34.817 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:34.817 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:34.817 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:34.817 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:34.817 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:34.817 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:34.817 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:34.817 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:34.817 02:33:38 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:34.817 02:33:38 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:34.817 02:33:38 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:34.817 02:33:38 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:34.817 02:33:38 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:34.817 02:33:38 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:34.817 02:33:38 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:28:34.817 02:33:38 -- target/dif.sh@137 -- # nvmfappstart 00:28:34.817 02:33:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:34.817 02:33:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:34.817 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:28:34.817 02:33:38 -- nvmf/common.sh@469 -- # nvmfpid=249513 00:28:34.817 02:33:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:28:34.817 02:33:38 -- nvmf/common.sh@470 -- # waitforlisten 249513 00:28:34.817 02:33:38 -- common/autotest_common.sh@829 -- # '[' -z 249513 ']' 00:28:34.817 02:33:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:34.817 02:33:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:34.817 02:33:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:34.817 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:34.817 02:33:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:34.817 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:28:34.817 [2024-11-29 02:33:38.412384] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:34.817 [2024-11-29 02:33:38.412475] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:34.817 EAL: No free 2048 kB hugepages reported on node 1 00:28:34.817 [2024-11-29 02:33:38.481350] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:35.078 [2024-11-29 02:33:38.595192] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:35.078 [2024-11-29 02:33:38.595373] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:35.078 [2024-11-29 02:33:38.595413] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:35.078 [2024-11-29 02:33:38.595429] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:35.078 [2024-11-29 02:33:38.595460] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:36.021 02:33:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:36.021 02:33:39 -- common/autotest_common.sh@862 -- # return 0 00:28:36.021 02:33:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:36.021 02:33:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:36.021 02:33:39 -- common/autotest_common.sh@10 -- # set +x 00:28:36.021 02:33:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:36.021 02:33:39 -- target/dif.sh@139 -- # create_transport 00:28:36.021 02:33:39 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:28:36.021 02:33:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:36.021 02:33:39 -- common/autotest_common.sh@10 -- # set +x 00:28:36.021 [2024-11-29 02:33:39.407735] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:36.021 02:33:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:36.021 02:33:39 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:28:36.021 02:33:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:36.021 02:33:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:36.021 02:33:39 -- common/autotest_common.sh@10 -- # set +x 00:28:36.021 ************************************ 00:28:36.021 START TEST fio_dif_1_default 00:28:36.021 ************************************ 00:28:36.021 02:33:39 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:28:36.021 02:33:39 -- target/dif.sh@86 -- # create_subsystems 0 00:28:36.021 02:33:39 -- target/dif.sh@28 -- # local sub 00:28:36.021 02:33:39 -- target/dif.sh@30 -- # for sub in "$@" 00:28:36.021 02:33:39 -- target/dif.sh@31 -- # create_subsystem 0 00:28:36.021 02:33:39 -- target/dif.sh@18 -- # local sub_id=0 00:28:36.021 02:33:39 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:36.021 02:33:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:36.021 02:33:39 -- common/autotest_common.sh@10 -- # set +x 00:28:36.021 bdev_null0 00:28:36.021 02:33:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:36.021 02:33:39 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:36.021 02:33:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:36.021 02:33:39 -- common/autotest_common.sh@10 -- # set +x 00:28:36.021 02:33:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:36.021 02:33:39 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:36.021 02:33:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:36.021 02:33:39 -- common/autotest_common.sh@10 -- # set +x 00:28:36.021 02:33:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:36.021 02:33:39 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:36.021 02:33:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:36.021 02:33:39 -- common/autotest_common.sh@10 -- # set +x 00:28:36.021 [2024-11-29 02:33:39.443971] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:36.021 02:33:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:36.021 02:33:39 -- target/dif.sh@87 -- # fio /dev/fd/62 00:28:36.021 02:33:39 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:28:36.021 02:33:39 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:36.021 02:33:39 -- nvmf/common.sh@520 -- # config=() 00:28:36.021 02:33:39 -- nvmf/common.sh@520 -- # local subsystem config 00:28:36.021 02:33:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:36.022 02:33:39 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:36.022 02:33:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:36.022 { 00:28:36.022 "params": { 00:28:36.022 "name": "Nvme$subsystem", 00:28:36.022 "trtype": "$TEST_TRANSPORT", 00:28:36.022 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:36.022 "adrfam": "ipv4", 00:28:36.022 "trsvcid": "$NVMF_PORT", 00:28:36.022 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:36.022 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:36.022 "hdgst": ${hdgst:-false}, 00:28:36.022 "ddgst": ${ddgst:-false} 00:28:36.022 }, 00:28:36.022 "method": "bdev_nvme_attach_controller" 00:28:36.022 } 00:28:36.022 EOF 00:28:36.022 )") 00:28:36.022 02:33:39 -- target/dif.sh@82 -- # gen_fio_conf 00:28:36.022 02:33:39 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:36.022 02:33:39 -- target/dif.sh@54 -- # local file 00:28:36.022 02:33:39 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:36.022 02:33:39 -- target/dif.sh@56 -- # cat 00:28:36.022 02:33:39 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:36.022 02:33:39 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:36.022 02:33:39 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:36.022 02:33:39 -- common/autotest_common.sh@1330 -- # shift 00:28:36.022 02:33:39 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:36.022 02:33:39 -- nvmf/common.sh@542 -- # cat 00:28:36.022 02:33:39 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:36.022 02:33:39 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:36.022 02:33:39 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:36.022 02:33:39 -- target/dif.sh@72 -- # (( file <= files )) 00:28:36.022 02:33:39 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:36.022 02:33:39 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:36.022 02:33:39 -- nvmf/common.sh@544 -- # jq . 00:28:36.022 02:33:39 -- nvmf/common.sh@545 -- # IFS=, 00:28:36.022 02:33:39 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:36.022 "params": { 00:28:36.022 "name": "Nvme0", 00:28:36.022 "trtype": "tcp", 00:28:36.022 "traddr": "10.0.0.2", 00:28:36.022 "adrfam": "ipv4", 00:28:36.022 "trsvcid": "4420", 00:28:36.022 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:36.022 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:36.022 "hdgst": false, 00:28:36.022 "ddgst": false 00:28:36.022 }, 00:28:36.022 "method": "bdev_nvme_attach_controller" 00:28:36.022 }' 00:28:36.022 02:33:39 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:36.022 02:33:39 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:36.022 02:33:39 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:36.022 02:33:39 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:36.022 02:33:39 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:36.022 02:33:39 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:36.022 02:33:39 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:36.022 02:33:39 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:36.022 02:33:39 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:36.022 02:33:39 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:36.281 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:36.281 fio-3.35 00:28:36.281 Starting 1 thread 00:28:36.281 EAL: No free 2048 kB hugepages reported on node 1 00:28:36.849 [2024-11-29 02:33:40.304604] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:36.849 [2024-11-29 02:33:40.304660] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:46.834 00:28:46.834 filename0: (groupid=0, jobs=1): err= 0: pid=249831: Fri Nov 29 02:33:50 2024 00:28:46.834 read: IOPS=172, BW=692KiB/s (708kB/s)(6928KiB/10014msec) 00:28:46.834 slat (nsec): min=4913, max=95289, avg=8986.73, stdev=3487.46 00:28:46.834 clat (usec): min=498, max=42402, avg=23098.67, stdev=20349.96 00:28:46.834 lat (usec): min=506, max=42414, avg=23107.65, stdev=20349.74 00:28:46.834 clat percentiles (usec): 00:28:46.834 | 1.00th=[ 562], 5.00th=[ 570], 10.00th=[ 578], 20.00th=[ 586], 00:28:46.834 | 30.00th=[ 603], 40.00th=[ 644], 50.00th=[41157], 60.00th=[41157], 00:28:46.834 | 70.00th=[41157], 80.00th=[41157], 90.00th=[42206], 95.00th=[42206], 00:28:46.834 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:28:46.834 | 99.99th=[42206] 00:28:46.834 bw ( KiB/s): min= 448, max= 768, per=99.88%, avg=691.20, stdev=91.34, samples=20 00:28:46.834 iops : min= 112, max= 192, avg=172.80, stdev=22.83, samples=20 00:28:46.834 lat (usec) : 500=0.06%, 750=44.57%, 1000=0.17% 00:28:46.834 lat (msec) : 10=0.23%, 50=54.97% 00:28:46.834 cpu : usr=91.84%, sys=7.54%, ctx=30, majf=0, minf=282 00:28:46.834 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:46.834 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:46.834 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:46.834 issued rwts: total=1732,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:46.834 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:46.834 00:28:46.834 Run status group 0 (all jobs): 00:28:46.834 READ: bw=692KiB/s (708kB/s), 692KiB/s-692KiB/s (708kB/s-708kB/s), io=6928KiB (7094kB), run=10014-10014msec 00:28:47.093 02:33:50 -- target/dif.sh@88 -- # destroy_subsystems 0 00:28:47.093 02:33:50 -- target/dif.sh@43 -- # local sub 00:28:47.093 02:33:50 -- target/dif.sh@45 -- # for sub in "$@" 00:28:47.093 02:33:50 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:47.093 02:33:50 -- target/dif.sh@36 -- # local sub_id=0 00:28:47.093 02:33:50 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:47.093 02:33:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.093 02:33:50 -- common/autotest_common.sh@10 -- # set +x 00:28:47.093 02:33:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.093 02:33:50 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:47.093 02:33:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.093 02:33:50 -- common/autotest_common.sh@10 -- # set +x 00:28:47.093 02:33:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.093 00:28:47.093 real 0m11.257s 00:28:47.093 user 0m10.408s 00:28:47.093 sys 0m1.078s 00:28:47.093 02:33:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:47.093 02:33:50 -- common/autotest_common.sh@10 -- # set +x 00:28:47.093 ************************************ 00:28:47.093 END TEST fio_dif_1_default 00:28:47.093 ************************************ 00:28:47.093 02:33:50 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:28:47.093 02:33:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:47.093 02:33:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:47.093 02:33:50 -- common/autotest_common.sh@10 -- # set +x 00:28:47.093 ************************************ 00:28:47.093 START TEST fio_dif_1_multi_subsystems 00:28:47.093 ************************************ 00:28:47.093 02:33:50 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:28:47.093 02:33:50 -- target/dif.sh@92 -- # local files=1 00:28:47.093 02:33:50 -- target/dif.sh@94 -- # create_subsystems 0 1 00:28:47.093 02:33:50 -- target/dif.sh@28 -- # local sub 00:28:47.093 02:33:50 -- target/dif.sh@30 -- # for sub in "$@" 00:28:47.093 02:33:50 -- target/dif.sh@31 -- # create_subsystem 0 00:28:47.093 02:33:50 -- target/dif.sh@18 -- # local sub_id=0 00:28:47.094 02:33:50 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:47.094 02:33:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.094 02:33:50 -- common/autotest_common.sh@10 -- # set +x 00:28:47.094 bdev_null0 00:28:47.094 02:33:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.094 02:33:50 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:47.094 02:33:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.094 02:33:50 -- common/autotest_common.sh@10 -- # set +x 00:28:47.094 02:33:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.094 02:33:50 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:47.094 02:33:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.094 02:33:50 -- common/autotest_common.sh@10 -- # set +x 00:28:47.094 02:33:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.094 02:33:50 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:47.094 02:33:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.094 02:33:50 -- common/autotest_common.sh@10 -- # set +x 00:28:47.094 [2024-11-29 02:33:50.732722] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:47.094 02:33:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.094 02:33:50 -- target/dif.sh@30 -- # for sub in "$@" 00:28:47.094 02:33:50 -- target/dif.sh@31 -- # create_subsystem 1 00:28:47.094 02:33:50 -- target/dif.sh@18 -- # local sub_id=1 00:28:47.094 02:33:50 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:28:47.094 02:33:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.094 02:33:50 -- common/autotest_common.sh@10 -- # set +x 00:28:47.094 bdev_null1 00:28:47.094 02:33:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.094 02:33:50 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:47.094 02:33:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.094 02:33:50 -- common/autotest_common.sh@10 -- # set +x 00:28:47.094 02:33:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.094 02:33:50 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:47.094 02:33:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.094 02:33:50 -- common/autotest_common.sh@10 -- # set +x 00:28:47.094 02:33:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.094 02:33:50 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:47.094 02:33:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.094 02:33:50 -- common/autotest_common.sh@10 -- # set +x 00:28:47.094 02:33:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.094 02:33:50 -- target/dif.sh@95 -- # fio /dev/fd/62 00:28:47.094 02:33:50 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:28:47.094 02:33:50 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:28:47.094 02:33:50 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:47.094 02:33:50 -- nvmf/common.sh@520 -- # config=() 00:28:47.094 02:33:50 -- nvmf/common.sh@520 -- # local subsystem config 00:28:47.094 02:33:50 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:47.094 02:33:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:47.094 02:33:50 -- target/dif.sh@82 -- # gen_fio_conf 00:28:47.094 02:33:50 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:47.094 02:33:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:47.094 { 00:28:47.094 "params": { 00:28:47.094 "name": "Nvme$subsystem", 00:28:47.094 "trtype": "$TEST_TRANSPORT", 00:28:47.094 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:47.094 "adrfam": "ipv4", 00:28:47.094 "trsvcid": "$NVMF_PORT", 00:28:47.094 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:47.094 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:47.094 "hdgst": ${hdgst:-false}, 00:28:47.094 "ddgst": ${ddgst:-false} 00:28:47.094 }, 00:28:47.094 "method": "bdev_nvme_attach_controller" 00:28:47.094 } 00:28:47.094 EOF 00:28:47.094 )") 00:28:47.094 02:33:50 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:47.094 02:33:50 -- target/dif.sh@54 -- # local file 00:28:47.094 02:33:50 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:47.094 02:33:50 -- target/dif.sh@56 -- # cat 00:28:47.094 02:33:50 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:47.094 02:33:50 -- common/autotest_common.sh@1330 -- # shift 00:28:47.094 02:33:50 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:47.094 02:33:50 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:47.094 02:33:50 -- nvmf/common.sh@542 -- # cat 00:28:47.353 02:33:50 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:47.353 02:33:50 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:47.353 02:33:50 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:47.353 02:33:50 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:47.353 02:33:50 -- target/dif.sh@72 -- # (( file <= files )) 00:28:47.353 02:33:50 -- target/dif.sh@73 -- # cat 00:28:47.353 02:33:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:47.353 02:33:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:47.353 { 00:28:47.353 "params": { 00:28:47.353 "name": "Nvme$subsystem", 00:28:47.353 "trtype": "$TEST_TRANSPORT", 00:28:47.353 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:47.353 "adrfam": "ipv4", 00:28:47.353 "trsvcid": "$NVMF_PORT", 00:28:47.353 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:47.353 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:47.353 "hdgst": ${hdgst:-false}, 00:28:47.353 "ddgst": ${ddgst:-false} 00:28:47.353 }, 00:28:47.353 "method": "bdev_nvme_attach_controller" 00:28:47.353 } 00:28:47.353 EOF 00:28:47.353 )") 00:28:47.353 02:33:50 -- target/dif.sh@72 -- # (( file++ )) 00:28:47.353 02:33:50 -- target/dif.sh@72 -- # (( file <= files )) 00:28:47.353 02:33:50 -- nvmf/common.sh@542 -- # cat 00:28:47.353 02:33:50 -- nvmf/common.sh@544 -- # jq . 00:28:47.353 02:33:50 -- nvmf/common.sh@545 -- # IFS=, 00:28:47.353 02:33:50 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:47.353 "params": { 00:28:47.353 "name": "Nvme0", 00:28:47.353 "trtype": "tcp", 00:28:47.353 "traddr": "10.0.0.2", 00:28:47.353 "adrfam": "ipv4", 00:28:47.353 "trsvcid": "4420", 00:28:47.353 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:47.353 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:47.353 "hdgst": false, 00:28:47.353 "ddgst": false 00:28:47.353 }, 00:28:47.353 "method": "bdev_nvme_attach_controller" 00:28:47.353 },{ 00:28:47.353 "params": { 00:28:47.353 "name": "Nvme1", 00:28:47.353 "trtype": "tcp", 00:28:47.353 "traddr": "10.0.0.2", 00:28:47.353 "adrfam": "ipv4", 00:28:47.353 "trsvcid": "4420", 00:28:47.353 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:47.353 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:47.353 "hdgst": false, 00:28:47.353 "ddgst": false 00:28:47.353 }, 00:28:47.353 "method": "bdev_nvme_attach_controller" 00:28:47.353 }' 00:28:47.353 02:33:50 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:47.353 02:33:50 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:47.353 02:33:50 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:47.353 02:33:50 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:47.353 02:33:50 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:47.353 02:33:50 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:47.353 02:33:50 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:47.353 02:33:50 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:47.353 02:33:50 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:47.353 02:33:50 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:47.353 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:47.353 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:47.353 fio-3.35 00:28:47.353 Starting 2 threads 00:28:47.610 EAL: No free 2048 kB hugepages reported on node 1 00:28:48.177 [2024-11-29 02:33:51.755349] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:48.177 [2024-11-29 02:33:51.755411] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:00.371 00:29:00.371 filename0: (groupid=0, jobs=1): err= 0: pid=251320: Fri Nov 29 02:34:01 2024 00:29:00.371 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10010msec) 00:29:00.371 slat (nsec): min=6816, max=51001, avg=10336.64, stdev=5006.67 00:29:00.371 clat (usec): min=40838, max=42846, avg=40987.28, stdev=168.75 00:29:00.371 lat (usec): min=40846, max=42890, avg=40997.61, stdev=169.99 00:29:00.371 clat percentiles (usec): 00:29:00.371 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:29:00.371 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:29:00.371 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:29:00.371 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42730], 99.95th=[42730], 00:29:00.371 | 99.99th=[42730] 00:29:00.371 bw ( KiB/s): min= 384, max= 416, per=49.75%, avg=388.80, stdev=11.72, samples=20 00:29:00.371 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:29:00.371 lat (msec) : 50=100.00% 00:29:00.371 cpu : usr=98.11%, sys=1.59%, ctx=15, majf=0, minf=206 00:29:00.371 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:00.371 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:00.371 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:00.371 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:00.371 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:00.371 filename1: (groupid=0, jobs=1): err= 0: pid=251321: Fri Nov 29 02:34:01 2024 00:29:00.371 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10012msec) 00:29:00.371 slat (nsec): min=4668, max=39328, avg=11433.21, stdev=5550.19 00:29:00.371 clat (usec): min=40811, max=43913, avg=40995.55, stdev=236.11 00:29:00.371 lat (usec): min=40819, max=43943, avg=41006.98, stdev=236.59 00:29:00.371 clat percentiles (usec): 00:29:00.371 | 1.00th=[40633], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:29:00.371 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:29:00.371 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:29:00.371 | 99.00th=[42206], 99.50th=[42206], 99.90th=[43779], 99.95th=[43779], 00:29:00.371 | 99.99th=[43779] 00:29:00.371 bw ( KiB/s): min= 384, max= 416, per=49.75%, avg=388.80, stdev=11.72, samples=20 00:29:00.371 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:29:00.371 lat (msec) : 50=100.00% 00:29:00.371 cpu : usr=96.89%, sys=2.82%, ctx=15, majf=0, minf=66 00:29:00.371 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:00.371 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:00.371 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:00.371 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:00.371 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:00.371 00:29:00.371 Run status group 0 (all jobs): 00:29:00.371 READ: bw=780KiB/s (799kB/s), 390KiB/s-390KiB/s (399kB/s-399kB/s), io=7808KiB (7995kB), run=10010-10012msec 00:29:00.371 02:34:02 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:29:00.371 02:34:02 -- target/dif.sh@43 -- # local sub 00:29:00.371 02:34:02 -- target/dif.sh@45 -- # for sub in "$@" 00:29:00.371 02:34:02 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:00.371 02:34:02 -- target/dif.sh@36 -- # local sub_id=0 00:29:00.371 02:34:02 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:00.371 02:34:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.371 02:34:02 -- common/autotest_common.sh@10 -- # set +x 00:29:00.371 02:34:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.371 02:34:02 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:00.371 02:34:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.371 02:34:02 -- common/autotest_common.sh@10 -- # set +x 00:29:00.371 02:34:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.371 02:34:02 -- target/dif.sh@45 -- # for sub in "$@" 00:29:00.371 02:34:02 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:00.371 02:34:02 -- target/dif.sh@36 -- # local sub_id=1 00:29:00.371 02:34:02 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:00.371 02:34:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.371 02:34:02 -- common/autotest_common.sh@10 -- # set +x 00:29:00.371 02:34:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.371 02:34:02 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:00.371 02:34:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.371 02:34:02 -- common/autotest_common.sh@10 -- # set +x 00:29:00.371 02:34:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.371 00:29:00.371 real 0m11.511s 00:29:00.371 user 0m21.039s 00:29:00.371 sys 0m0.791s 00:29:00.371 02:34:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:00.371 02:34:02 -- common/autotest_common.sh@10 -- # set +x 00:29:00.371 ************************************ 00:29:00.372 END TEST fio_dif_1_multi_subsystems 00:29:00.372 ************************************ 00:29:00.372 02:34:02 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:29:00.372 02:34:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:00.372 02:34:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:00.372 02:34:02 -- common/autotest_common.sh@10 -- # set +x 00:29:00.372 ************************************ 00:29:00.372 START TEST fio_dif_rand_params 00:29:00.372 ************************************ 00:29:00.372 02:34:02 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:29:00.372 02:34:02 -- target/dif.sh@100 -- # local NULL_DIF 00:29:00.372 02:34:02 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:29:00.372 02:34:02 -- target/dif.sh@103 -- # NULL_DIF=3 00:29:00.372 02:34:02 -- target/dif.sh@103 -- # bs=128k 00:29:00.372 02:34:02 -- target/dif.sh@103 -- # numjobs=3 00:29:00.372 02:34:02 -- target/dif.sh@103 -- # iodepth=3 00:29:00.372 02:34:02 -- target/dif.sh@103 -- # runtime=5 00:29:00.372 02:34:02 -- target/dif.sh@105 -- # create_subsystems 0 00:29:00.372 02:34:02 -- target/dif.sh@28 -- # local sub 00:29:00.372 02:34:02 -- target/dif.sh@30 -- # for sub in "$@" 00:29:00.372 02:34:02 -- target/dif.sh@31 -- # create_subsystem 0 00:29:00.372 02:34:02 -- target/dif.sh@18 -- # local sub_id=0 00:29:00.372 02:34:02 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:00.372 02:34:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.372 02:34:02 -- common/autotest_common.sh@10 -- # set +x 00:29:00.372 bdev_null0 00:29:00.372 02:34:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.372 02:34:02 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:00.372 02:34:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.372 02:34:02 -- common/autotest_common.sh@10 -- # set +x 00:29:00.372 02:34:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.372 02:34:02 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:00.372 02:34:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.372 02:34:02 -- common/autotest_common.sh@10 -- # set +x 00:29:00.372 02:34:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.372 02:34:02 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:00.372 02:34:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.372 02:34:02 -- common/autotest_common.sh@10 -- # set +x 00:29:00.372 [2024-11-29 02:34:02.277492] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:00.372 02:34:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.372 02:34:02 -- target/dif.sh@106 -- # fio /dev/fd/62 00:29:00.372 02:34:02 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:29:00.372 02:34:02 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:00.372 02:34:02 -- nvmf/common.sh@520 -- # config=() 00:29:00.372 02:34:02 -- nvmf/common.sh@520 -- # local subsystem config 00:29:00.372 02:34:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:00.372 02:34:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:00.372 { 00:29:00.372 "params": { 00:29:00.372 "name": "Nvme$subsystem", 00:29:00.372 "trtype": "$TEST_TRANSPORT", 00:29:00.372 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:00.372 "adrfam": "ipv4", 00:29:00.372 "trsvcid": "$NVMF_PORT", 00:29:00.372 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:00.372 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:00.372 "hdgst": ${hdgst:-false}, 00:29:00.372 "ddgst": ${ddgst:-false} 00:29:00.372 }, 00:29:00.372 "method": "bdev_nvme_attach_controller" 00:29:00.372 } 00:29:00.372 EOF 00:29:00.372 )") 00:29:00.372 02:34:02 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:00.372 02:34:02 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:00.372 02:34:02 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:00.372 02:34:02 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:00.372 02:34:02 -- target/dif.sh@82 -- # gen_fio_conf 00:29:00.372 02:34:02 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:00.372 02:34:02 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:00.372 02:34:02 -- target/dif.sh@54 -- # local file 00:29:00.372 02:34:02 -- common/autotest_common.sh@1330 -- # shift 00:29:00.372 02:34:02 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:00.372 02:34:02 -- target/dif.sh@56 -- # cat 00:29:00.372 02:34:02 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:00.372 02:34:02 -- nvmf/common.sh@542 -- # cat 00:29:00.372 02:34:02 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:00.372 02:34:02 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:00.372 02:34:02 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:00.372 02:34:02 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:00.372 02:34:02 -- target/dif.sh@72 -- # (( file <= files )) 00:29:00.372 02:34:02 -- nvmf/common.sh@544 -- # jq . 00:29:00.372 02:34:02 -- nvmf/common.sh@545 -- # IFS=, 00:29:00.372 02:34:02 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:00.372 "params": { 00:29:00.372 "name": "Nvme0", 00:29:00.372 "trtype": "tcp", 00:29:00.372 "traddr": "10.0.0.2", 00:29:00.372 "adrfam": "ipv4", 00:29:00.372 "trsvcid": "4420", 00:29:00.372 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:00.372 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:00.372 "hdgst": false, 00:29:00.372 "ddgst": false 00:29:00.372 }, 00:29:00.372 "method": "bdev_nvme_attach_controller" 00:29:00.372 }' 00:29:00.372 02:34:02 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:00.372 02:34:02 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:00.372 02:34:02 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:00.372 02:34:02 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:00.372 02:34:02 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:00.372 02:34:02 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:00.372 02:34:02 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:00.372 02:34:02 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:00.372 02:34:02 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:00.372 02:34:02 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:00.372 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:00.372 ... 00:29:00.372 fio-3.35 00:29:00.372 Starting 3 threads 00:29:00.372 EAL: No free 2048 kB hugepages reported on node 1 00:29:00.372 [2024-11-29 02:34:02.915493] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:00.372 [2024-11-29 02:34:02.915566] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:04.558 00:29:04.558 filename0: (groupid=0, jobs=1): err= 0: pid=252758: Fri Nov 29 02:34:08 2024 00:29:04.558 read: IOPS=217, BW=27.2MiB/s (28.6MB/s)(138MiB/5046msec) 00:29:04.558 slat (nsec): min=7162, max=36299, avg=12217.95, stdev=2528.10 00:29:04.558 clat (usec): min=6114, max=55867, avg=13705.41, stdev=6426.56 00:29:04.558 lat (usec): min=6133, max=55878, avg=13717.63, stdev=6426.58 00:29:04.558 clat percentiles (usec): 00:29:04.558 | 1.00th=[ 8094], 5.00th=[ 9110], 10.00th=[10290], 20.00th=[11076], 00:29:04.558 | 30.00th=[11731], 40.00th=[12256], 50.00th=[12649], 60.00th=[13304], 00:29:04.558 | 70.00th=[13960], 80.00th=[14746], 90.00th=[15533], 95.00th=[16581], 00:29:04.558 | 99.00th=[51643], 99.50th=[53216], 99.90th=[55837], 99.95th=[55837], 00:29:04.558 | 99.99th=[55837] 00:29:04.558 bw ( KiB/s): min=24832, max=29952, per=32.02%, avg=28083.20, stdev=2055.28, samples=10 00:29:04.558 iops : min= 194, max= 234, avg=219.40, stdev=16.06, samples=10 00:29:04.558 lat (msec) : 10=8.45%, 20=88.91%, 50=1.00%, 100=1.64% 00:29:04.558 cpu : usr=93.62%, sys=5.89%, ctx=9, majf=0, minf=115 00:29:04.558 IO depths : 1=0.4%, 2=99.6%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:04.558 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:04.558 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:04.558 issued rwts: total=1100,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:04.558 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:04.558 filename0: (groupid=0, jobs=1): err= 0: pid=252759: Fri Nov 29 02:34:08 2024 00:29:04.558 read: IOPS=222, BW=27.9MiB/s (29.2MB/s)(141MiB/5045msec) 00:29:04.558 slat (nsec): min=7106, max=36362, avg=12098.18, stdev=2348.10 00:29:04.558 clat (usec): min=4983, max=58237, avg=13399.76, stdev=5598.04 00:29:04.558 lat (usec): min=4991, max=58249, avg=13411.86, stdev=5597.73 00:29:04.558 clat percentiles (usec): 00:29:04.558 | 1.00th=[ 5145], 5.00th=[ 8356], 10.00th=[ 9503], 20.00th=[11076], 00:29:04.558 | 30.00th=[11731], 40.00th=[12387], 50.00th=[12911], 60.00th=[13566], 00:29:04.558 | 70.00th=[14091], 80.00th=[14746], 90.00th=[15926], 95.00th=[16712], 00:29:04.558 | 99.00th=[50070], 99.50th=[52691], 99.90th=[57410], 99.95th=[58459], 00:29:04.558 | 99.99th=[58459] 00:29:04.558 bw ( KiB/s): min=24832, max=30976, per=32.74%, avg=28723.20, stdev=1963.78, samples=10 00:29:04.558 iops : min= 194, max= 242, avg=224.40, stdev=15.34, samples=10 00:29:04.558 lat (msec) : 10=12.71%, 20=85.51%, 50=0.62%, 100=1.16% 00:29:04.558 cpu : usr=93.06%, sys=6.46%, ctx=15, majf=0, minf=121 00:29:04.558 IO depths : 1=0.9%, 2=99.1%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:04.558 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:04.558 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:04.558 issued rwts: total=1125,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:04.558 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:04.558 filename0: (groupid=0, jobs=1): err= 0: pid=252760: Fri Nov 29 02:34:08 2024 00:29:04.558 read: IOPS=244, BW=30.5MiB/s (32.0MB/s)(154MiB/5045msec) 00:29:04.558 slat (nsec): min=7066, max=75372, avg=11710.63, stdev=2520.81 00:29:04.558 clat (usec): min=4112, max=57001, avg=12193.50, stdev=4792.78 00:29:04.558 lat (usec): min=4123, max=57046, avg=12205.21, stdev=4793.20 00:29:04.558 clat percentiles (usec): 00:29:04.558 | 1.00th=[ 6783], 5.00th=[ 8717], 10.00th=[ 9503], 20.00th=[10421], 00:29:04.558 | 30.00th=[10945], 40.00th=[11207], 50.00th=[11731], 60.00th=[12125], 00:29:04.558 | 70.00th=[12649], 80.00th=[13173], 90.00th=[14222], 95.00th=[15008], 00:29:04.558 | 99.00th=[47449], 99.50th=[52167], 99.90th=[54264], 99.95th=[56886], 00:29:04.558 | 99.99th=[56886] 00:29:04.558 bw ( KiB/s): min=27648, max=34048, per=35.90%, avg=31488.00, stdev=2037.31, samples=10 00:29:04.558 iops : min= 216, max= 266, avg=246.00, stdev=15.92, samples=10 00:29:04.558 lat (msec) : 10=13.71%, 20=85.00%, 50=0.57%, 100=0.73% 00:29:04.558 cpu : usr=92.37%, sys=7.16%, ctx=8, majf=0, minf=138 00:29:04.558 IO depths : 1=0.4%, 2=99.6%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:04.558 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:04.558 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:04.558 issued rwts: total=1233,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:04.558 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:04.558 00:29:04.558 Run status group 0 (all jobs): 00:29:04.558 READ: bw=85.7MiB/s (89.8MB/s), 27.2MiB/s-30.5MiB/s (28.6MB/s-32.0MB/s), io=432MiB (453MB), run=5045-5046msec 00:29:04.818 02:34:08 -- target/dif.sh@107 -- # destroy_subsystems 0 00:29:04.818 02:34:08 -- target/dif.sh@43 -- # local sub 00:29:04.818 02:34:08 -- target/dif.sh@45 -- # for sub in "$@" 00:29:04.818 02:34:08 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:04.818 02:34:08 -- target/dif.sh@36 -- # local sub_id=0 00:29:04.818 02:34:08 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:04.818 02:34:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.818 02:34:08 -- common/autotest_common.sh@10 -- # set +x 00:29:04.818 02:34:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.818 02:34:08 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:04.818 02:34:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.818 02:34:08 -- common/autotest_common.sh@10 -- # set +x 00:29:04.818 02:34:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.818 02:34:08 -- target/dif.sh@109 -- # NULL_DIF=2 00:29:04.818 02:34:08 -- target/dif.sh@109 -- # bs=4k 00:29:04.818 02:34:08 -- target/dif.sh@109 -- # numjobs=8 00:29:04.818 02:34:08 -- target/dif.sh@109 -- # iodepth=16 00:29:04.818 02:34:08 -- target/dif.sh@109 -- # runtime= 00:29:04.818 02:34:08 -- target/dif.sh@109 -- # files=2 00:29:04.818 02:34:08 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:29:04.818 02:34:08 -- target/dif.sh@28 -- # local sub 00:29:04.818 02:34:08 -- target/dif.sh@30 -- # for sub in "$@" 00:29:04.818 02:34:08 -- target/dif.sh@31 -- # create_subsystem 0 00:29:04.818 02:34:08 -- target/dif.sh@18 -- # local sub_id=0 00:29:04.818 02:34:08 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:29:04.818 02:34:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.818 02:34:08 -- common/autotest_common.sh@10 -- # set +x 00:29:04.818 bdev_null0 00:29:04.818 02:34:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.818 02:34:08 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:04.818 02:34:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.818 02:34:08 -- common/autotest_common.sh@10 -- # set +x 00:29:04.818 02:34:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.818 02:34:08 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:04.818 02:34:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.818 02:34:08 -- common/autotest_common.sh@10 -- # set +x 00:29:04.818 02:34:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.818 02:34:08 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:04.818 02:34:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.818 02:34:08 -- common/autotest_common.sh@10 -- # set +x 00:29:04.818 [2024-11-29 02:34:08.344858] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:04.818 02:34:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.818 02:34:08 -- target/dif.sh@30 -- # for sub in "$@" 00:29:04.818 02:34:08 -- target/dif.sh@31 -- # create_subsystem 1 00:29:04.818 02:34:08 -- target/dif.sh@18 -- # local sub_id=1 00:29:04.818 02:34:08 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:29:04.818 02:34:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.818 02:34:08 -- common/autotest_common.sh@10 -- # set +x 00:29:04.818 bdev_null1 00:29:04.818 02:34:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.818 02:34:08 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:04.818 02:34:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.818 02:34:08 -- common/autotest_common.sh@10 -- # set +x 00:29:04.818 02:34:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.818 02:34:08 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:04.818 02:34:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.818 02:34:08 -- common/autotest_common.sh@10 -- # set +x 00:29:04.818 02:34:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.818 02:34:08 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:04.818 02:34:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.818 02:34:08 -- common/autotest_common.sh@10 -- # set +x 00:29:04.818 02:34:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.818 02:34:08 -- target/dif.sh@30 -- # for sub in "$@" 00:29:04.818 02:34:08 -- target/dif.sh@31 -- # create_subsystem 2 00:29:04.818 02:34:08 -- target/dif.sh@18 -- # local sub_id=2 00:29:04.818 02:34:08 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:29:04.818 02:34:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.818 02:34:08 -- common/autotest_common.sh@10 -- # set +x 00:29:04.818 bdev_null2 00:29:04.818 02:34:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.818 02:34:08 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:29:04.818 02:34:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.818 02:34:08 -- common/autotest_common.sh@10 -- # set +x 00:29:04.818 02:34:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.818 02:34:08 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:29:04.818 02:34:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.818 02:34:08 -- common/autotest_common.sh@10 -- # set +x 00:29:04.818 02:34:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.818 02:34:08 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:29:04.818 02:34:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.818 02:34:08 -- common/autotest_common.sh@10 -- # set +x 00:29:04.818 02:34:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.818 02:34:08 -- target/dif.sh@112 -- # fio /dev/fd/62 00:29:04.818 02:34:08 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:29:04.818 02:34:08 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:29:04.818 02:34:08 -- nvmf/common.sh@520 -- # config=() 00:29:04.818 02:34:08 -- nvmf/common.sh@520 -- # local subsystem config 00:29:04.818 02:34:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:04.818 02:34:08 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:04.818 02:34:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:04.818 { 00:29:04.818 "params": { 00:29:04.818 "name": "Nvme$subsystem", 00:29:04.818 "trtype": "$TEST_TRANSPORT", 00:29:04.818 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:04.818 "adrfam": "ipv4", 00:29:04.818 "trsvcid": "$NVMF_PORT", 00:29:04.818 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:04.818 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:04.818 "hdgst": ${hdgst:-false}, 00:29:04.818 "ddgst": ${ddgst:-false} 00:29:04.818 }, 00:29:04.818 "method": "bdev_nvme_attach_controller" 00:29:04.818 } 00:29:04.818 EOF 00:29:04.818 )") 00:29:04.818 02:34:08 -- target/dif.sh@82 -- # gen_fio_conf 00:29:04.819 02:34:08 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:04.819 02:34:08 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:04.819 02:34:08 -- target/dif.sh@54 -- # local file 00:29:04.819 02:34:08 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:04.819 02:34:08 -- target/dif.sh@56 -- # cat 00:29:04.819 02:34:08 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:04.819 02:34:08 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:04.819 02:34:08 -- common/autotest_common.sh@1330 -- # shift 00:29:04.819 02:34:08 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:04.819 02:34:08 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:04.819 02:34:08 -- nvmf/common.sh@542 -- # cat 00:29:04.819 02:34:08 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:04.819 02:34:08 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:04.819 02:34:08 -- target/dif.sh@72 -- # (( file <= files )) 00:29:04.819 02:34:08 -- target/dif.sh@73 -- # cat 00:29:04.819 02:34:08 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:04.819 02:34:08 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:04.819 02:34:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:04.819 02:34:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:04.819 { 00:29:04.819 "params": { 00:29:04.819 "name": "Nvme$subsystem", 00:29:04.819 "trtype": "$TEST_TRANSPORT", 00:29:04.819 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:04.819 "adrfam": "ipv4", 00:29:04.819 "trsvcid": "$NVMF_PORT", 00:29:04.819 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:04.819 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:04.819 "hdgst": ${hdgst:-false}, 00:29:04.819 "ddgst": ${ddgst:-false} 00:29:04.819 }, 00:29:04.819 "method": "bdev_nvme_attach_controller" 00:29:04.819 } 00:29:04.819 EOF 00:29:04.819 )") 00:29:04.819 02:34:08 -- target/dif.sh@72 -- # (( file++ )) 00:29:04.819 02:34:08 -- nvmf/common.sh@542 -- # cat 00:29:04.819 02:34:08 -- target/dif.sh@72 -- # (( file <= files )) 00:29:04.819 02:34:08 -- target/dif.sh@73 -- # cat 00:29:04.819 02:34:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:04.819 02:34:08 -- target/dif.sh@72 -- # (( file++ )) 00:29:04.819 02:34:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:04.819 { 00:29:04.819 "params": { 00:29:04.819 "name": "Nvme$subsystem", 00:29:04.819 "trtype": "$TEST_TRANSPORT", 00:29:04.819 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:04.819 "adrfam": "ipv4", 00:29:04.819 "trsvcid": "$NVMF_PORT", 00:29:04.819 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:04.819 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:04.819 "hdgst": ${hdgst:-false}, 00:29:04.819 "ddgst": ${ddgst:-false} 00:29:04.819 }, 00:29:04.819 "method": "bdev_nvme_attach_controller" 00:29:04.819 } 00:29:04.819 EOF 00:29:04.819 )") 00:29:04.819 02:34:08 -- target/dif.sh@72 -- # (( file <= files )) 00:29:04.819 02:34:08 -- nvmf/common.sh@542 -- # cat 00:29:04.819 02:34:08 -- nvmf/common.sh@544 -- # jq . 00:29:04.819 02:34:08 -- nvmf/common.sh@545 -- # IFS=, 00:29:04.819 02:34:08 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:04.819 "params": { 00:29:04.819 "name": "Nvme0", 00:29:04.819 "trtype": "tcp", 00:29:04.819 "traddr": "10.0.0.2", 00:29:04.819 "adrfam": "ipv4", 00:29:04.819 "trsvcid": "4420", 00:29:04.819 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:04.819 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:04.819 "hdgst": false, 00:29:04.819 "ddgst": false 00:29:04.819 }, 00:29:04.819 "method": "bdev_nvme_attach_controller" 00:29:04.819 },{ 00:29:04.819 "params": { 00:29:04.819 "name": "Nvme1", 00:29:04.819 "trtype": "tcp", 00:29:04.819 "traddr": "10.0.0.2", 00:29:04.819 "adrfam": "ipv4", 00:29:04.819 "trsvcid": "4420", 00:29:04.819 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:04.819 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:04.819 "hdgst": false, 00:29:04.819 "ddgst": false 00:29:04.819 }, 00:29:04.819 "method": "bdev_nvme_attach_controller" 00:29:04.819 },{ 00:29:04.819 "params": { 00:29:04.819 "name": "Nvme2", 00:29:04.819 "trtype": "tcp", 00:29:04.819 "traddr": "10.0.0.2", 00:29:04.819 "adrfam": "ipv4", 00:29:04.819 "trsvcid": "4420", 00:29:04.819 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:29:04.819 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:29:04.819 "hdgst": false, 00:29:04.819 "ddgst": false 00:29:04.819 }, 00:29:04.819 "method": "bdev_nvme_attach_controller" 00:29:04.819 }' 00:29:04.819 02:34:08 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:04.819 02:34:08 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:04.819 02:34:08 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:04.819 02:34:08 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:04.819 02:34:08 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:04.819 02:34:08 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:04.819 02:34:08 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:04.819 02:34:08 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:04.819 02:34:08 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:04.819 02:34:08 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:05.079 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:05.079 ... 00:29:05.079 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:05.079 ... 00:29:05.079 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:05.079 ... 00:29:05.079 fio-3.35 00:29:05.079 Starting 24 threads 00:29:05.079 EAL: No free 2048 kB hugepages reported on node 1 00:29:06.017 [2024-11-29 02:34:09.435698] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:06.017 [2024-11-29 02:34:09.435780] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:15.995 00:29:15.995 filename0: (groupid=0, jobs=1): err= 0: pid=253527: Fri Nov 29 02:34:19 2024 00:29:15.995 read: IOPS=505, BW=2021KiB/s (2070kB/s)(19.8MiB/10006msec) 00:29:15.995 slat (usec): min=8, max=167, avg=44.76, stdev=24.20 00:29:15.995 clat (usec): min=28198, max=57755, avg=31204.40, stdev=1803.40 00:29:15.995 lat (usec): min=28206, max=57787, avg=31249.16, stdev=1804.20 00:29:15.995 clat percentiles (usec): 00:29:15.996 | 1.00th=[30016], 5.00th=[30278], 10.00th=[30540], 20.00th=[30540], 00:29:15.996 | 30.00th=[30802], 40.00th=[30802], 50.00th=[31065], 60.00th=[31065], 00:29:15.996 | 70.00th=[31327], 80.00th=[31327], 90.00th=[31851], 95.00th=[32113], 00:29:15.996 | 99.00th=[36439], 99.50th=[41157], 99.90th=[57410], 99.95th=[57934], 00:29:15.996 | 99.99th=[57934] 00:29:15.996 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=2021.05, stdev=68.52, samples=19 00:29:15.996 iops : min= 448, max= 512, avg=505.26, stdev=17.13, samples=19 00:29:15.996 lat (msec) : 50=99.68%, 100=0.32% 00:29:15.996 cpu : usr=98.61%, sys=0.95%, ctx=18, majf=0, minf=78 00:29:15.996 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:15.996 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.996 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.996 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:15.996 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:15.996 filename0: (groupid=0, jobs=1): err= 0: pid=253528: Fri Nov 29 02:34:19 2024 00:29:15.996 read: IOPS=505, BW=2021KiB/s (2070kB/s)(19.8MiB/10005msec) 00:29:15.996 slat (nsec): min=7405, max=78356, avg=28210.20, stdev=11276.16 00:29:15.996 clat (usec): min=24428, max=57336, avg=31403.96, stdev=1783.95 00:29:15.996 lat (usec): min=24436, max=57363, avg=31432.17, stdev=1783.18 00:29:15.996 clat percentiles (usec): 00:29:15.996 | 1.00th=[28967], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:29:15.996 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:29:15.996 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[32375], 00:29:15.996 | 99.00th=[39584], 99.50th=[41157], 99.90th=[54264], 99.95th=[54264], 00:29:15.996 | 99.99th=[57410] 00:29:15.996 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=2021.05, stdev=68.52, samples=19 00:29:15.996 iops : min= 448, max= 512, avg=505.26, stdev=17.13, samples=19 00:29:15.996 lat (msec) : 50=99.68%, 100=0.32% 00:29:15.996 cpu : usr=96.90%, sys=1.73%, ctx=196, majf=0, minf=71 00:29:15.996 IO depths : 1=5.2%, 2=11.4%, 4=24.8%, 8=51.3%, 16=7.3%, 32=0.0%, >=64=0.0% 00:29:15.996 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.996 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.996 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:15.996 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:15.996 filename0: (groupid=0, jobs=1): err= 0: pid=253529: Fri Nov 29 02:34:19 2024 00:29:15.996 read: IOPS=505, BW=2021KiB/s (2070kB/s)(19.8MiB/10005msec) 00:29:15.996 slat (usec): min=8, max=164, avg=39.25, stdev=16.36 00:29:15.996 clat (usec): min=28581, max=57866, avg=31305.93, stdev=1796.20 00:29:15.996 lat (usec): min=28634, max=57903, avg=31345.18, stdev=1795.65 00:29:15.996 clat percentiles (usec): 00:29:15.996 | 1.00th=[30278], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:29:15.996 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31065], 00:29:15.996 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32113], 00:29:15.996 | 99.00th=[36439], 99.50th=[41157], 99.90th=[57934], 99.95th=[57934], 00:29:15.996 | 99.99th=[57934] 00:29:15.996 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=2021.05, stdev=68.52, samples=19 00:29:15.996 iops : min= 448, max= 512, avg=505.26, stdev=17.13, samples=19 00:29:15.996 lat (msec) : 50=99.68%, 100=0.32% 00:29:15.996 cpu : usr=97.68%, sys=1.51%, ctx=36, majf=0, minf=47 00:29:15.996 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:15.996 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.996 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.996 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:15.996 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:15.996 filename0: (groupid=0, jobs=1): err= 0: pid=253530: Fri Nov 29 02:34:19 2024 00:29:15.996 read: IOPS=507, BW=2031KiB/s (2079kB/s)(19.9MiB/10023msec) 00:29:15.996 slat (usec): min=6, max=136, avg=41.54, stdev=21.44 00:29:15.996 clat (usec): min=14424, max=41289, avg=31162.12, stdev=1388.64 00:29:15.996 lat (usec): min=14438, max=41326, avg=31203.66, stdev=1387.23 00:29:15.996 clat percentiles (usec): 00:29:15.996 | 1.00th=[29754], 5.00th=[30278], 10.00th=[30540], 20.00th=[30802], 00:29:15.996 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31065], 00:29:15.996 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32113], 00:29:15.996 | 99.00th=[34866], 99.50th=[40633], 99.90th=[41157], 99.95th=[41157], 00:29:15.996 | 99.99th=[41157] 00:29:15.996 bw ( KiB/s): min= 1920, max= 2052, per=4.17%, avg=2029.00, stdev=46.99, samples=20 00:29:15.996 iops : min= 480, max= 513, avg=507.25, stdev=11.75, samples=20 00:29:15.996 lat (msec) : 20=0.31%, 50=99.69% 00:29:15.996 cpu : usr=98.55%, sys=1.05%, ctx=19, majf=0, minf=82 00:29:15.996 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:15.996 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.996 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.996 issued rwts: total=5088,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:15.996 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:15.996 filename0: (groupid=0, jobs=1): err= 0: pid=253531: Fri Nov 29 02:34:19 2024 00:29:15.996 read: IOPS=508, BW=2036KiB/s (2085kB/s)(19.9MiB/10028msec) 00:29:15.996 slat (nsec): min=6539, max=61407, avg=23168.12, stdev=11744.18 00:29:15.996 clat (usec): min=8732, max=41329, avg=31252.52, stdev=1984.49 00:29:15.996 lat (usec): min=8741, max=41345, avg=31275.69, stdev=1984.28 00:29:15.996 clat percentiles (usec): 00:29:15.996 | 1.00th=[30278], 5.00th=[30540], 10.00th=[30802], 20.00th=[30802], 00:29:15.996 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:29:15.996 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[32375], 00:29:15.996 | 99.00th=[34866], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:29:15.996 | 99.99th=[41157] 00:29:15.996 bw ( KiB/s): min= 1920, max= 2176, per=4.19%, avg=2035.20, stdev=70.72, samples=20 00:29:15.996 iops : min= 480, max= 544, avg=508.80, stdev=17.68, samples=20 00:29:15.996 lat (msec) : 10=0.31%, 20=0.31%, 50=99.37% 00:29:15.996 cpu : usr=98.70%, sys=0.91%, ctx=15, majf=0, minf=69 00:29:15.996 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:15.996 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.996 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.996 issued rwts: total=5104,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:15.996 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:15.996 filename0: (groupid=0, jobs=1): err= 0: pid=253532: Fri Nov 29 02:34:19 2024 00:29:15.996 read: IOPS=506, BW=2027KiB/s (2076kB/s)(19.8MiB/10008msec) 00:29:15.996 slat (usec): min=10, max=111, avg=39.34, stdev=10.67 00:29:15.996 clat (usec): min=15354, max=43659, avg=31214.38, stdev=1502.93 00:29:15.996 lat (usec): min=15388, max=43694, avg=31253.71, stdev=1503.11 00:29:15.996 clat percentiles (usec): 00:29:15.996 | 1.00th=[30278], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:29:15.996 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31065], 00:29:15.996 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32375], 00:29:15.996 | 99.00th=[36439], 99.50th=[41157], 99.90th=[43779], 99.95th=[43779], 00:29:15.996 | 99.99th=[43779] 00:29:15.996 bw ( KiB/s): min= 1920, max= 2048, per=4.16%, avg=2021.05, stdev=53.61, samples=19 00:29:15.996 iops : min= 480, max= 512, avg=505.26, stdev=13.40, samples=19 00:29:15.996 lat (msec) : 20=0.32%, 50=99.68% 00:29:15.996 cpu : usr=97.91%, sys=1.29%, ctx=108, majf=0, minf=61 00:29:15.996 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:15.996 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.996 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.996 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:15.996 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:15.996 filename0: (groupid=0, jobs=1): err= 0: pid=253533: Fri Nov 29 02:34:19 2024 00:29:15.996 read: IOPS=506, BW=2028KiB/s (2076kB/s)(19.8MiB/10006msec) 00:29:15.996 slat (usec): min=9, max=124, avg=41.39, stdev=16.49 00:29:15.996 clat (usec): min=15367, max=41532, avg=31202.79, stdev=1460.31 00:29:15.996 lat (usec): min=15411, max=41572, avg=31244.18, stdev=1460.20 00:29:15.996 clat percentiles (usec): 00:29:15.996 | 1.00th=[29754], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:29:15.996 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31065], 00:29:15.996 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32375], 00:29:15.996 | 99.00th=[37487], 99.50th=[40633], 99.90th=[41157], 99.95th=[41681], 00:29:15.996 | 99.99th=[41681] 00:29:15.996 bw ( KiB/s): min= 1920, max= 2048, per=4.16%, avg=2021.05, stdev=53.61, samples=19 00:29:15.996 iops : min= 480, max= 512, avg=505.26, stdev=13.40, samples=19 00:29:15.996 lat (msec) : 20=0.32%, 50=99.68% 00:29:15.996 cpu : usr=98.17%, sys=1.07%, ctx=108, majf=0, minf=72 00:29:15.996 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:15.996 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.996 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.996 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:15.996 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:15.996 filename0: (groupid=0, jobs=1): err= 0: pid=253534: Fri Nov 29 02:34:19 2024 00:29:15.996 read: IOPS=506, BW=2027KiB/s (2075kB/s)(19.8MiB/10010msec) 00:29:15.996 slat (usec): min=12, max=146, avg=41.20, stdev=14.23 00:29:15.996 clat (usec): min=15321, max=45425, avg=31195.07, stdev=1553.40 00:29:15.996 lat (usec): min=15353, max=45455, avg=31236.27, stdev=1553.59 00:29:15.996 clat percentiles (usec): 00:29:15.996 | 1.00th=[30016], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:29:15.996 | 30.00th=[30802], 40.00th=[30802], 50.00th=[31065], 60.00th=[31065], 00:29:15.996 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32113], 00:29:15.996 | 99.00th=[36439], 99.50th=[41157], 99.90th=[45351], 99.95th=[45351], 00:29:15.996 | 99.99th=[45351] 00:29:15.996 bw ( KiB/s): min= 1920, max= 2048, per=4.16%, avg=2021.05, stdev=53.61, samples=19 00:29:15.996 iops : min= 480, max= 512, avg=505.26, stdev=13.40, samples=19 00:29:15.996 lat (msec) : 20=0.32%, 50=99.68% 00:29:15.996 cpu : usr=98.08%, sys=1.26%, ctx=78, majf=0, minf=69 00:29:15.996 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:15.996 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.997 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.997 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:15.997 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:15.997 filename1: (groupid=0, jobs=1): err= 0: pid=253535: Fri Nov 29 02:34:19 2024 00:29:15.997 read: IOPS=506, BW=2027KiB/s (2075kB/s)(19.8MiB/10010msec) 00:29:15.997 slat (usec): min=6, max=124, avg=39.33, stdev=11.81 00:29:15.997 clat (usec): min=15290, max=54051, avg=31238.95, stdev=2852.77 00:29:15.997 lat (usec): min=15314, max=54095, avg=31278.29, stdev=2854.03 00:29:15.997 clat percentiles (usec): 00:29:15.997 | 1.00th=[19530], 5.00th=[30278], 10.00th=[30540], 20.00th=[30802], 00:29:15.997 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31065], 00:29:15.997 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[32900], 00:29:15.997 | 99.00th=[43254], 99.50th=[44303], 99.90th=[45876], 99.95th=[45876], 00:29:15.997 | 99.99th=[54264] 00:29:15.997 bw ( KiB/s): min= 1920, max= 2048, per=4.16%, avg=2021.05, stdev=53.61, samples=19 00:29:15.997 iops : min= 480, max= 512, avg=505.26, stdev=13.40, samples=19 00:29:15.997 lat (msec) : 20=1.95%, 50=98.01%, 100=0.04% 00:29:15.997 cpu : usr=96.11%, sys=2.24%, ctx=215, majf=0, minf=51 00:29:15.997 IO depths : 1=5.0%, 2=11.3%, 4=25.0%, 8=51.2%, 16=7.5%, 32=0.0%, >=64=0.0% 00:29:15.997 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.997 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.997 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:15.997 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:15.997 filename1: (groupid=0, jobs=1): err= 0: pid=253536: Fri Nov 29 02:34:19 2024 00:29:15.997 read: IOPS=505, BW=2021KiB/s (2070kB/s)(19.8MiB/10006msec) 00:29:15.997 slat (usec): min=7, max=195, avg=37.60, stdev=22.62 00:29:15.997 clat (usec): min=28814, max=57834, avg=31322.70, stdev=1807.67 00:29:15.997 lat (usec): min=28854, max=57857, avg=31360.30, stdev=1805.98 00:29:15.997 clat percentiles (usec): 00:29:15.997 | 1.00th=[30016], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:29:15.997 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31065], 00:29:15.997 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32375], 00:29:15.997 | 99.00th=[36439], 99.50th=[41681], 99.90th=[57934], 99.95th=[57934], 00:29:15.997 | 99.99th=[57934] 00:29:15.997 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=2021.05, stdev=68.52, samples=19 00:29:15.997 iops : min= 448, max= 512, avg=505.26, stdev=17.13, samples=19 00:29:15.997 lat (msec) : 50=99.68%, 100=0.32% 00:29:15.997 cpu : usr=97.45%, sys=1.46%, ctx=173, majf=0, minf=73 00:29:15.997 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:15.997 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.997 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.997 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:15.997 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:15.997 filename1: (groupid=0, jobs=1): err= 0: pid=253537: Fri Nov 29 02:34:19 2024 00:29:15.997 read: IOPS=505, BW=2021KiB/s (2070kB/s)(19.8MiB/10006msec) 00:29:15.997 slat (usec): min=8, max=110, avg=35.07, stdev=11.95 00:29:15.997 clat (usec): min=28422, max=57856, avg=31370.90, stdev=1787.39 00:29:15.997 lat (usec): min=28468, max=57891, avg=31405.97, stdev=1786.69 00:29:15.997 clat percentiles (usec): 00:29:15.997 | 1.00th=[30278], 5.00th=[30540], 10.00th=[30802], 20.00th=[30802], 00:29:15.997 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:29:15.997 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32375], 00:29:15.997 | 99.00th=[36439], 99.50th=[40633], 99.90th=[57934], 99.95th=[57934], 00:29:15.997 | 99.99th=[57934] 00:29:15.997 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=2021.05, stdev=68.52, samples=19 00:29:15.997 iops : min= 448, max= 512, avg=505.26, stdev=17.13, samples=19 00:29:15.997 lat (msec) : 50=99.68%, 100=0.32% 00:29:15.997 cpu : usr=97.84%, sys=1.43%, ctx=77, majf=0, minf=75 00:29:15.997 IO depths : 1=6.0%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.5%, 32=0.0%, >=64=0.0% 00:29:15.997 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.997 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.997 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:15.997 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:15.997 filename1: (groupid=0, jobs=1): err= 0: pid=253538: Fri Nov 29 02:34:19 2024 00:29:15.997 read: IOPS=509, BW=2036KiB/s (2085kB/s)(19.9MiB/10027msec) 00:29:15.997 slat (usec): min=4, max=129, avg=25.40, stdev=21.38 00:29:15.997 clat (usec): min=7430, max=41393, avg=31221.07, stdev=2022.41 00:29:15.997 lat (usec): min=7443, max=41413, avg=31246.47, stdev=2022.61 00:29:15.997 clat percentiles (usec): 00:29:15.997 | 1.00th=[29492], 5.00th=[30540], 10.00th=[30802], 20.00th=[30802], 00:29:15.997 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:29:15.997 | 70.00th=[31589], 80.00th=[31589], 90.00th=[32113], 95.00th=[32375], 00:29:15.997 | 99.00th=[35914], 99.50th=[39584], 99.90th=[41157], 99.95th=[41157], 00:29:15.997 | 99.99th=[41157] 00:29:15.997 bw ( KiB/s): min= 1920, max= 2180, per=4.19%, avg=2035.40, stdev=71.14, samples=20 00:29:15.997 iops : min= 480, max= 545, avg=508.85, stdev=17.79, samples=20 00:29:15.997 lat (msec) : 10=0.31%, 20=0.31%, 50=99.37% 00:29:15.997 cpu : usr=98.61%, sys=0.97%, ctx=23, majf=0, minf=72 00:29:15.997 IO depths : 1=6.1%, 2=12.3%, 4=24.8%, 8=50.4%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:15.997 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.997 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.997 issued rwts: total=5104,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:15.997 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:15.997 filename1: (groupid=0, jobs=1): err= 0: pid=253539: Fri Nov 29 02:34:19 2024 00:29:15.997 read: IOPS=506, BW=2028KiB/s (2077kB/s)(19.8MiB/10004msec) 00:29:15.997 slat (usec): min=8, max=111, avg=39.51, stdev=12.46 00:29:15.997 clat (usec): min=15383, max=53131, avg=31194.00, stdev=1513.14 00:29:15.997 lat (usec): min=15425, max=53163, avg=31233.51, stdev=1513.58 00:29:15.997 clat percentiles (usec): 00:29:15.997 | 1.00th=[30016], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:29:15.997 | 30.00th=[30802], 40.00th=[30802], 50.00th=[31065], 60.00th=[31065], 00:29:15.997 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32113], 00:29:15.997 | 99.00th=[36439], 99.50th=[40633], 99.90th=[41157], 99.95th=[41681], 00:29:15.997 | 99.99th=[53216] 00:29:15.997 bw ( KiB/s): min= 1920, max= 2048, per=4.16%, avg=2021.21, stdev=53.30, samples=19 00:29:15.997 iops : min= 480, max= 512, avg=505.26, stdev=13.40, samples=19 00:29:15.997 lat (msec) : 20=0.35%, 50=99.61%, 100=0.04% 00:29:15.997 cpu : usr=98.75%, sys=0.78%, ctx=12, majf=0, minf=63 00:29:15.997 IO depths : 1=6.0%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.5%, 32=0.0%, >=64=0.0% 00:29:15.997 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.997 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.997 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:15.997 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:15.997 filename1: (groupid=0, jobs=1): err= 0: pid=253540: Fri Nov 29 02:34:19 2024 00:29:15.997 read: IOPS=505, BW=2023KiB/s (2072kB/s)(19.8MiB/10017msec) 00:29:15.997 slat (usec): min=6, max=110, avg=37.86, stdev=16.34 00:29:15.997 clat (usec): min=16516, max=57003, avg=31341.02, stdev=1776.19 00:29:15.997 lat (usec): min=16540, max=57022, avg=31378.88, stdev=1774.93 00:29:15.997 clat percentiles (usec): 00:29:15.997 | 1.00th=[30016], 5.00th=[30540], 10.00th=[30802], 20.00th=[30802], 00:29:15.997 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:29:15.997 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32375], 00:29:15.997 | 99.00th=[39060], 99.50th=[41157], 99.90th=[53216], 99.95th=[53216], 00:29:15.997 | 99.99th=[56886] 00:29:15.997 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=2021.05, stdev=68.52, samples=19 00:29:15.997 iops : min= 448, max= 512, avg=505.26, stdev=17.13, samples=19 00:29:15.997 lat (msec) : 20=0.22%, 50=99.47%, 100=0.32% 00:29:15.997 cpu : usr=96.71%, sys=1.73%, ctx=148, majf=0, minf=63 00:29:15.997 IO depths : 1=0.8%, 2=7.1%, 4=25.0%, 8=55.4%, 16=11.6%, 32=0.0%, >=64=0.0% 00:29:15.997 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.997 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.997 issued rwts: total=5067,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:15.997 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:15.997 filename1: (groupid=0, jobs=1): err= 0: pid=253541: Fri Nov 29 02:34:19 2024 00:29:15.997 read: IOPS=508, BW=2036KiB/s (2084kB/s)(19.9MiB/10002msec) 00:29:15.997 slat (usec): min=7, max=120, avg=36.41, stdev=19.31 00:29:15.997 clat (usec): min=8085, max=68042, avg=31164.30, stdev=2489.86 00:29:15.997 lat (usec): min=8094, max=68088, avg=31200.71, stdev=2490.62 00:29:15.997 clat percentiles (usec): 00:29:15.997 | 1.00th=[21365], 5.00th=[30278], 10.00th=[30540], 20.00th=[30802], 00:29:15.997 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:29:15.997 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[32375], 00:29:15.997 | 99.00th=[40633], 99.50th=[42206], 99.90th=[51643], 99.95th=[53740], 00:29:15.997 | 99.99th=[67634] 00:29:15.997 bw ( KiB/s): min= 1904, max= 2144, per=4.17%, avg=2028.63, stdev=60.94, samples=19 00:29:15.997 iops : min= 476, max= 536, avg=507.16, stdev=15.24, samples=19 00:29:15.997 lat (msec) : 10=0.20%, 20=0.69%, 50=98.88%, 100=0.24% 00:29:15.997 cpu : usr=97.89%, sys=1.26%, ctx=111, majf=0, minf=74 00:29:15.997 IO depths : 1=0.7%, 2=6.7%, 4=24.1%, 8=56.6%, 16=11.9%, 32=0.0%, >=64=0.0% 00:29:15.997 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.997 complete : 0=0.0%, 4=94.2%, 8=0.4%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.997 issued rwts: total=5090,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:15.997 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:15.997 filename1: (groupid=0, jobs=1): err= 0: pid=253542: Fri Nov 29 02:34:19 2024 00:29:15.997 read: IOPS=508, BW=2034KiB/s (2082kB/s)(19.9MiB/10008msec) 00:29:15.997 slat (usec): min=6, max=107, avg=14.43, stdev=11.80 00:29:15.997 clat (usec): min=14741, max=40751, avg=31328.09, stdev=1490.26 00:29:15.997 lat (usec): min=14749, max=40772, avg=31342.52, stdev=1490.18 00:29:15.997 clat percentiles (usec): 00:29:15.997 | 1.00th=[28705], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:29:15.997 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31327], 60.00th=[31327], 00:29:15.997 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32113], 00:29:15.997 | 99.00th=[37487], 99.50th=[39584], 99.90th=[40633], 99.95th=[40633], 00:29:15.997 | 99.99th=[40633] 00:29:15.997 bw ( KiB/s): min= 1920, max= 2176, per=4.18%, avg=2034.53, stdev=58.73, samples=19 00:29:15.998 iops : min= 480, max= 544, avg=508.63, stdev=14.68, samples=19 00:29:15.998 lat (msec) : 20=0.31%, 50=99.69% 00:29:15.998 cpu : usr=96.48%, sys=1.95%, ctx=146, majf=0, minf=103 00:29:15.998 IO depths : 1=6.2%, 2=12.4%, 4=24.9%, 8=50.2%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:15.998 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.998 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.998 issued rwts: total=5088,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:15.998 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:15.998 filename2: (groupid=0, jobs=1): err= 0: pid=253543: Fri Nov 29 02:34:19 2024 00:29:15.998 read: IOPS=506, BW=2027KiB/s (2075kB/s)(19.8MiB/10011msec) 00:29:15.998 slat (usec): min=6, max=133, avg=37.36, stdev=15.06 00:29:15.998 clat (usec): min=14895, max=47650, avg=31224.86, stdev=1636.58 00:29:15.998 lat (usec): min=14903, max=47666, avg=31262.23, stdev=1636.66 00:29:15.998 clat percentiles (usec): 00:29:15.998 | 1.00th=[30016], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:29:15.998 | 30.00th=[30802], 40.00th=[30802], 50.00th=[31065], 60.00th=[31065], 00:29:15.998 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32113], 00:29:15.998 | 99.00th=[36439], 99.50th=[41157], 99.90th=[47449], 99.95th=[47449], 00:29:15.998 | 99.99th=[47449] 00:29:15.998 bw ( KiB/s): min= 1920, max= 2048, per=4.16%, avg=2021.05, stdev=53.61, samples=19 00:29:15.998 iops : min= 480, max= 512, avg=505.26, stdev=13.40, samples=19 00:29:15.998 lat (msec) : 20=0.32%, 50=99.68% 00:29:15.998 cpu : usr=98.74%, sys=0.85%, ctx=14, majf=0, minf=59 00:29:15.998 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:15.998 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.998 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.998 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:15.998 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:15.998 filename2: (groupid=0, jobs=1): err= 0: pid=253544: Fri Nov 29 02:34:19 2024 00:29:15.998 read: IOPS=505, BW=2021KiB/s (2070kB/s)(19.8MiB/10006msec) 00:29:15.998 slat (usec): min=8, max=169, avg=38.23, stdev=22.57 00:29:15.998 clat (usec): min=17745, max=61940, avg=31347.31, stdev=3038.84 00:29:15.998 lat (usec): min=17858, max=61960, avg=31385.54, stdev=3039.07 00:29:15.998 clat percentiles (usec): 00:29:15.998 | 1.00th=[19792], 5.00th=[30278], 10.00th=[30540], 20.00th=[30802], 00:29:15.998 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:29:15.998 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[33162], 00:29:15.998 | 99.00th=[43254], 99.50th=[44303], 99.90th=[57934], 99.95th=[57934], 00:29:15.998 | 99.99th=[62129] 00:29:15.998 bw ( KiB/s): min= 1792, max= 2064, per=4.16%, avg=2021.05, stdev=68.73, samples=19 00:29:15.998 iops : min= 448, max= 516, avg=505.26, stdev=17.18, samples=19 00:29:15.998 lat (msec) : 20=1.66%, 50=97.98%, 100=0.36% 00:29:15.998 cpu : usr=98.66%, sys=0.93%, ctx=29, majf=0, minf=75 00:29:15.998 IO depths : 1=3.3%, 2=9.6%, 4=25.0%, 8=52.9%, 16=9.2%, 32=0.0%, >=64=0.0% 00:29:15.998 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.998 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.998 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:15.998 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:15.998 filename2: (groupid=0, jobs=1): err= 0: pid=253545: Fri Nov 29 02:34:19 2024 00:29:15.998 read: IOPS=508, BW=2035KiB/s (2084kB/s)(19.9MiB/10001msec) 00:29:15.998 slat (usec): min=7, max=150, avg=44.89, stdev=24.28 00:29:15.998 clat (usec): min=8615, max=41582, avg=30994.42, stdev=1981.29 00:29:15.998 lat (usec): min=8624, max=41613, avg=31039.31, stdev=1984.28 00:29:15.998 clat percentiles (usec): 00:29:15.998 | 1.00th=[29754], 5.00th=[30278], 10.00th=[30540], 20.00th=[30540], 00:29:15.998 | 30.00th=[30802], 40.00th=[30802], 50.00th=[31065], 60.00th=[31065], 00:29:15.998 | 70.00th=[31327], 80.00th=[31327], 90.00th=[31851], 95.00th=[32113], 00:29:15.998 | 99.00th=[34866], 99.50th=[40109], 99.90th=[41157], 99.95th=[41681], 00:29:15.998 | 99.99th=[41681] 00:29:15.998 bw ( KiB/s): min= 1920, max= 2176, per=4.18%, avg=2034.53, stdev=58.73, samples=19 00:29:15.998 iops : min= 480, max= 544, avg=508.63, stdev=14.68, samples=19 00:29:15.998 lat (msec) : 10=0.31%, 20=0.31%, 50=99.37% 00:29:15.998 cpu : usr=98.73%, sys=0.83%, ctx=17, majf=0, minf=51 00:29:15.998 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:15.998 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.998 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.998 issued rwts: total=5088,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:15.998 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:15.998 filename2: (groupid=0, jobs=1): err= 0: pid=253546: Fri Nov 29 02:34:19 2024 00:29:15.998 read: IOPS=517, BW=2072KiB/s (2122kB/s)(20.2MiB/10002msec) 00:29:15.998 slat (usec): min=7, max=132, avg=27.29, stdev=26.63 00:29:15.998 clat (usec): min=6109, max=68916, avg=30741.43, stdev=4959.01 00:29:15.998 lat (usec): min=6148, max=68959, avg=30768.72, stdev=4960.61 00:29:15.998 clat percentiles (usec): 00:29:15.998 | 1.00th=[15533], 5.00th=[21627], 10.00th=[25560], 20.00th=[30540], 00:29:15.998 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:29:15.998 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32375], 95.00th=[34866], 00:29:15.998 | 99.00th=[45876], 99.50th=[54264], 99.90th=[65799], 99.95th=[65799], 00:29:15.998 | 99.99th=[68682] 00:29:15.998 bw ( KiB/s): min= 1888, max= 2272, per=4.25%, avg=2066.95, stdev=88.81, samples=19 00:29:15.998 iops : min= 472, max= 568, avg=516.74, stdev=22.20, samples=19 00:29:15.998 lat (msec) : 10=0.73%, 20=2.12%, 50=96.35%, 100=0.79% 00:29:15.998 cpu : usr=97.61%, sys=1.50%, ctx=121, majf=0, minf=95 00:29:15.998 IO depths : 1=0.3%, 2=1.2%, 4=4.8%, 8=77.4%, 16=16.2%, 32=0.0%, >=64=0.0% 00:29:15.998 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.998 complete : 0=0.0%, 4=89.9%, 8=8.3%, 16=1.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.998 issued rwts: total=5181,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:15.998 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:15.998 filename2: (groupid=0, jobs=1): err= 0: pid=253547: Fri Nov 29 02:34:19 2024 00:29:15.998 read: IOPS=507, BW=2031KiB/s (2079kB/s)(19.9MiB/10023msec) 00:29:15.998 slat (usec): min=7, max=143, avg=38.71, stdev=16.52 00:29:15.998 clat (usec): min=14340, max=41234, avg=31178.44, stdev=1384.45 00:29:15.998 lat (usec): min=14348, max=41256, avg=31217.15, stdev=1384.80 00:29:15.998 clat percentiles (usec): 00:29:15.998 | 1.00th=[30016], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:29:15.998 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31065], 00:29:15.998 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32113], 00:29:15.998 | 99.00th=[34866], 99.50th=[40633], 99.90th=[41157], 99.95th=[41157], 00:29:15.998 | 99.99th=[41157] 00:29:15.998 bw ( KiB/s): min= 1920, max= 2052, per=4.17%, avg=2029.00, stdev=46.99, samples=20 00:29:15.998 iops : min= 480, max= 513, avg=507.25, stdev=11.75, samples=20 00:29:15.998 lat (msec) : 20=0.31%, 50=99.69% 00:29:15.998 cpu : usr=97.34%, sys=1.59%, ctx=256, majf=0, minf=66 00:29:15.998 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:15.998 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.998 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.998 issued rwts: total=5088,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:15.998 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:15.998 filename2: (groupid=0, jobs=1): err= 0: pid=253548: Fri Nov 29 02:34:19 2024 00:29:15.998 read: IOPS=506, BW=2028KiB/s (2077kB/s)(19.8MiB/10004msec) 00:29:15.998 slat (usec): min=8, max=111, avg=36.75, stdev=11.64 00:29:15.998 clat (usec): min=15412, max=41491, avg=31236.34, stdev=1404.75 00:29:15.998 lat (usec): min=15435, max=41520, avg=31273.09, stdev=1404.32 00:29:15.998 clat percentiles (usec): 00:29:15.998 | 1.00th=[30278], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:29:15.998 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31065], 00:29:15.998 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32375], 00:29:15.998 | 99.00th=[36439], 99.50th=[40633], 99.90th=[41157], 99.95th=[41681], 00:29:15.998 | 99.99th=[41681] 00:29:15.998 bw ( KiB/s): min= 1920, max= 2048, per=4.16%, avg=2021.05, stdev=53.61, samples=19 00:29:15.998 iops : min= 480, max= 512, avg=505.26, stdev=13.40, samples=19 00:29:15.998 lat (msec) : 20=0.32%, 50=99.68% 00:29:15.998 cpu : usr=98.40%, sys=1.21%, ctx=19, majf=0, minf=55 00:29:15.998 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:15.998 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.998 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.998 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:15.998 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:15.998 filename2: (groupid=0, jobs=1): err= 0: pid=253549: Fri Nov 29 02:34:19 2024 00:29:15.998 read: IOPS=507, BW=2028KiB/s (2077kB/s)(19.8MiB/10002msec) 00:29:15.998 slat (usec): min=7, max=127, avg=33.95, stdev=15.21 00:29:15.998 clat (usec): min=15345, max=41810, avg=31235.97, stdev=1453.77 00:29:15.998 lat (usec): min=15367, max=41850, avg=31269.92, stdev=1453.51 00:29:15.998 clat percentiles (usec): 00:29:15.998 | 1.00th=[30278], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:29:15.998 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31065], 00:29:15.998 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32113], 00:29:15.998 | 99.00th=[36439], 99.50th=[41157], 99.90th=[41681], 99.95th=[41681], 00:29:15.998 | 99.99th=[41681] 00:29:15.998 bw ( KiB/s): min= 1920, max= 2048, per=4.16%, avg=2021.05, stdev=53.61, samples=19 00:29:15.998 iops : min= 480, max= 512, avg=505.26, stdev=13.40, samples=19 00:29:15.998 lat (msec) : 20=0.32%, 50=99.68% 00:29:15.998 cpu : usr=98.54%, sys=1.02%, ctx=16, majf=0, minf=61 00:29:15.998 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:15.998 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.998 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.998 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:15.998 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:15.998 filename2: (groupid=0, jobs=1): err= 0: pid=253550: Fri Nov 29 02:34:19 2024 00:29:15.998 read: IOPS=505, BW=2021KiB/s (2070kB/s)(19.8MiB/10005msec) 00:29:15.998 slat (usec): min=8, max=112, avg=34.75, stdev=13.65 00:29:15.998 clat (usec): min=29644, max=57868, avg=31362.64, stdev=1793.15 00:29:15.998 lat (usec): min=29678, max=57883, avg=31397.39, stdev=1791.97 00:29:15.999 clat percentiles (usec): 00:29:15.999 | 1.00th=[30278], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:29:15.999 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:29:15.999 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32113], 00:29:15.999 | 99.00th=[36439], 99.50th=[41157], 99.90th=[57934], 99.95th=[57934], 00:29:15.999 | 99.99th=[57934] 00:29:15.999 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=2021.05, stdev=68.52, samples=19 00:29:15.999 iops : min= 448, max= 512, avg=505.26, stdev=17.13, samples=19 00:29:15.999 lat (msec) : 50=99.68%, 100=0.32% 00:29:15.999 cpu : usr=98.84%, sys=0.75%, ctx=13, majf=0, minf=83 00:29:15.999 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:15.999 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.999 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.999 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:15.999 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:15.999 00:29:15.999 Run status group 0 (all jobs): 00:29:15.999 READ: bw=47.5MiB/s (49.8MB/s), 2021KiB/s-2072KiB/s (2070kB/s-2122kB/s), io=476MiB (499MB), run=10001-10028msec 00:29:16.262 02:34:19 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:29:16.262 02:34:19 -- target/dif.sh@43 -- # local sub 00:29:16.262 02:34:19 -- target/dif.sh@45 -- # for sub in "$@" 00:29:16.262 02:34:19 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:16.262 02:34:19 -- target/dif.sh@36 -- # local sub_id=0 00:29:16.262 02:34:19 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:16.262 02:34:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.262 02:34:19 -- common/autotest_common.sh@10 -- # set +x 00:29:16.262 02:34:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.262 02:34:19 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:16.262 02:34:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.262 02:34:19 -- common/autotest_common.sh@10 -- # set +x 00:29:16.262 02:34:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.262 02:34:19 -- target/dif.sh@45 -- # for sub in "$@" 00:29:16.262 02:34:19 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:16.262 02:34:19 -- target/dif.sh@36 -- # local sub_id=1 00:29:16.262 02:34:19 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:16.262 02:34:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.262 02:34:19 -- common/autotest_common.sh@10 -- # set +x 00:29:16.262 02:34:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.262 02:34:19 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:16.262 02:34:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.262 02:34:19 -- common/autotest_common.sh@10 -- # set +x 00:29:16.262 02:34:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.262 02:34:19 -- target/dif.sh@45 -- # for sub in "$@" 00:29:16.262 02:34:19 -- target/dif.sh@46 -- # destroy_subsystem 2 00:29:16.262 02:34:19 -- target/dif.sh@36 -- # local sub_id=2 00:29:16.262 02:34:19 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:29:16.262 02:34:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.262 02:34:19 -- common/autotest_common.sh@10 -- # set +x 00:29:16.559 02:34:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.559 02:34:19 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:29:16.559 02:34:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.559 02:34:19 -- common/autotest_common.sh@10 -- # set +x 00:29:16.559 02:34:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.559 02:34:19 -- target/dif.sh@115 -- # NULL_DIF=1 00:29:16.559 02:34:19 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:29:16.559 02:34:19 -- target/dif.sh@115 -- # numjobs=2 00:29:16.559 02:34:19 -- target/dif.sh@115 -- # iodepth=8 00:29:16.559 02:34:19 -- target/dif.sh@115 -- # runtime=5 00:29:16.559 02:34:19 -- target/dif.sh@115 -- # files=1 00:29:16.559 02:34:19 -- target/dif.sh@117 -- # create_subsystems 0 1 00:29:16.559 02:34:19 -- target/dif.sh@28 -- # local sub 00:29:16.559 02:34:19 -- target/dif.sh@30 -- # for sub in "$@" 00:29:16.559 02:34:19 -- target/dif.sh@31 -- # create_subsystem 0 00:29:16.559 02:34:19 -- target/dif.sh@18 -- # local sub_id=0 00:29:16.559 02:34:19 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:29:16.559 02:34:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.559 02:34:19 -- common/autotest_common.sh@10 -- # set +x 00:29:16.559 bdev_null0 00:29:16.559 02:34:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.559 02:34:19 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:16.559 02:34:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.559 02:34:19 -- common/autotest_common.sh@10 -- # set +x 00:29:16.559 02:34:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.559 02:34:19 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:16.559 02:34:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.559 02:34:19 -- common/autotest_common.sh@10 -- # set +x 00:29:16.559 02:34:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.559 02:34:19 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:16.559 02:34:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.559 02:34:19 -- common/autotest_common.sh@10 -- # set +x 00:29:16.559 [2024-11-29 02:34:19.974549] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:16.559 02:34:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.559 02:34:19 -- target/dif.sh@30 -- # for sub in "$@" 00:29:16.559 02:34:19 -- target/dif.sh@31 -- # create_subsystem 1 00:29:16.559 02:34:19 -- target/dif.sh@18 -- # local sub_id=1 00:29:16.559 02:34:19 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:29:16.559 02:34:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.559 02:34:19 -- common/autotest_common.sh@10 -- # set +x 00:29:16.559 bdev_null1 00:29:16.559 02:34:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.559 02:34:19 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:16.559 02:34:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.559 02:34:19 -- common/autotest_common.sh@10 -- # set +x 00:29:16.559 02:34:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.559 02:34:19 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:16.559 02:34:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.559 02:34:19 -- common/autotest_common.sh@10 -- # set +x 00:29:16.559 02:34:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.559 02:34:20 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:16.559 02:34:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.559 02:34:20 -- common/autotest_common.sh@10 -- # set +x 00:29:16.559 02:34:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.559 02:34:20 -- target/dif.sh@118 -- # fio /dev/fd/62 00:29:16.559 02:34:20 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:29:16.559 02:34:20 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:29:16.559 02:34:20 -- nvmf/common.sh@520 -- # config=() 00:29:16.559 02:34:20 -- nvmf/common.sh@520 -- # local subsystem config 00:29:16.559 02:34:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:16.559 02:34:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:16.559 { 00:29:16.559 "params": { 00:29:16.559 "name": "Nvme$subsystem", 00:29:16.559 "trtype": "$TEST_TRANSPORT", 00:29:16.559 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:16.559 "adrfam": "ipv4", 00:29:16.559 "trsvcid": "$NVMF_PORT", 00:29:16.559 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:16.559 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:16.559 "hdgst": ${hdgst:-false}, 00:29:16.559 "ddgst": ${ddgst:-false} 00:29:16.559 }, 00:29:16.559 "method": "bdev_nvme_attach_controller" 00:29:16.559 } 00:29:16.559 EOF 00:29:16.559 )") 00:29:16.559 02:34:20 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:16.559 02:34:20 -- target/dif.sh@82 -- # gen_fio_conf 00:29:16.559 02:34:20 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:16.559 02:34:20 -- target/dif.sh@54 -- # local file 00:29:16.559 02:34:20 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:16.559 02:34:20 -- target/dif.sh@56 -- # cat 00:29:16.559 02:34:20 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:16.559 02:34:20 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:16.559 02:34:20 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:16.559 02:34:20 -- common/autotest_common.sh@1330 -- # shift 00:29:16.559 02:34:20 -- nvmf/common.sh@542 -- # cat 00:29:16.559 02:34:20 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:16.559 02:34:20 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:16.559 02:34:20 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:16.559 02:34:20 -- target/dif.sh@72 -- # (( file <= files )) 00:29:16.559 02:34:20 -- target/dif.sh@73 -- # cat 00:29:16.559 02:34:20 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:16.559 02:34:20 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:16.559 02:34:20 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:16.559 02:34:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:16.559 02:34:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:16.559 { 00:29:16.559 "params": { 00:29:16.559 "name": "Nvme$subsystem", 00:29:16.559 "trtype": "$TEST_TRANSPORT", 00:29:16.559 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:16.559 "adrfam": "ipv4", 00:29:16.559 "trsvcid": "$NVMF_PORT", 00:29:16.559 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:16.559 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:16.559 "hdgst": ${hdgst:-false}, 00:29:16.559 "ddgst": ${ddgst:-false} 00:29:16.559 }, 00:29:16.559 "method": "bdev_nvme_attach_controller" 00:29:16.559 } 00:29:16.559 EOF 00:29:16.559 )") 00:29:16.559 02:34:20 -- nvmf/common.sh@542 -- # cat 00:29:16.559 02:34:20 -- target/dif.sh@72 -- # (( file++ )) 00:29:16.559 02:34:20 -- target/dif.sh@72 -- # (( file <= files )) 00:29:16.559 02:34:20 -- nvmf/common.sh@544 -- # jq . 00:29:16.559 02:34:20 -- nvmf/common.sh@545 -- # IFS=, 00:29:16.559 02:34:20 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:16.559 "params": { 00:29:16.559 "name": "Nvme0", 00:29:16.559 "trtype": "tcp", 00:29:16.559 "traddr": "10.0.0.2", 00:29:16.559 "adrfam": "ipv4", 00:29:16.559 "trsvcid": "4420", 00:29:16.559 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:16.559 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:16.559 "hdgst": false, 00:29:16.559 "ddgst": false 00:29:16.559 }, 00:29:16.559 "method": "bdev_nvme_attach_controller" 00:29:16.559 },{ 00:29:16.559 "params": { 00:29:16.559 "name": "Nvme1", 00:29:16.559 "trtype": "tcp", 00:29:16.560 "traddr": "10.0.0.2", 00:29:16.560 "adrfam": "ipv4", 00:29:16.560 "trsvcid": "4420", 00:29:16.560 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:16.560 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:16.560 "hdgst": false, 00:29:16.560 "ddgst": false 00:29:16.560 }, 00:29:16.560 "method": "bdev_nvme_attach_controller" 00:29:16.560 }' 00:29:16.560 02:34:20 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:16.560 02:34:20 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:16.560 02:34:20 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:16.560 02:34:20 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:16.560 02:34:20 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:16.560 02:34:20 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:16.560 02:34:20 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:16.560 02:34:20 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:16.560 02:34:20 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:16.560 02:34:20 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:16.846 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:16.846 ... 00:29:16.846 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:16.846 ... 00:29:16.846 fio-3.35 00:29:16.846 Starting 4 threads 00:29:16.846 EAL: No free 2048 kB hugepages reported on node 1 00:29:17.416 [2024-11-29 02:34:21.071709] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:17.416 [2024-11-29 02:34:21.071799] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:22.685 00:29:22.685 filename0: (groupid=0, jobs=1): err= 0: pid=254971: Fri Nov 29 02:34:26 2024 00:29:22.685 read: IOPS=1801, BW=14.1MiB/s (14.8MB/s)(70.4MiB/5002msec) 00:29:22.685 slat (nsec): min=4692, max=70713, avg=14676.67, stdev=8104.63 00:29:22.685 clat (usec): min=731, max=8102, avg=4391.49, stdev=649.00 00:29:22.685 lat (usec): min=743, max=8143, avg=4406.17, stdev=649.10 00:29:22.685 clat percentiles (usec): 00:29:22.685 | 1.00th=[ 2638], 5.00th=[ 3425], 10.00th=[ 3720], 20.00th=[ 4080], 00:29:22.685 | 30.00th=[ 4293], 40.00th=[ 4359], 50.00th=[ 4359], 60.00th=[ 4424], 00:29:22.685 | 70.00th=[ 4490], 80.00th=[ 4555], 90.00th=[ 4883], 95.00th=[ 5604], 00:29:22.685 | 99.00th=[ 6783], 99.50th=[ 7308], 99.90th=[ 7832], 99.95th=[ 7898], 00:29:22.685 | 99.99th=[ 8094] 00:29:22.685 bw ( KiB/s): min=13840, max=15040, per=24.96%, avg=14409.60, stdev=376.84, samples=10 00:29:22.685 iops : min= 1730, max= 1880, avg=1801.20, stdev=47.10, samples=10 00:29:22.685 lat (usec) : 750=0.01%, 1000=0.01% 00:29:22.685 lat (msec) : 2=0.34%, 4=16.43%, 10=83.21% 00:29:22.685 cpu : usr=94.82%, sys=4.64%, ctx=8, majf=0, minf=0 00:29:22.685 IO depths : 1=0.1%, 2=12.9%, 4=58.7%, 8=28.2%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:22.685 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.685 complete : 0=0.0%, 4=92.7%, 8=7.3%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.685 issued rwts: total=9009,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.686 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:22.686 filename0: (groupid=0, jobs=1): err= 0: pid=254972: Fri Nov 29 02:34:26 2024 00:29:22.686 read: IOPS=1816, BW=14.2MiB/s (14.9MB/s)(71.0MiB/5003msec) 00:29:22.686 slat (usec): min=4, max=141, avg=16.75, stdev=10.16 00:29:22.686 clat (usec): min=804, max=8018, avg=4345.49, stdev=629.48 00:29:22.686 lat (usec): min=824, max=8032, avg=4362.24, stdev=629.88 00:29:22.686 clat percentiles (usec): 00:29:22.686 | 1.00th=[ 2442], 5.00th=[ 3392], 10.00th=[ 3720], 20.00th=[ 4015], 00:29:22.686 | 30.00th=[ 4228], 40.00th=[ 4293], 50.00th=[ 4359], 60.00th=[ 4424], 00:29:22.686 | 70.00th=[ 4490], 80.00th=[ 4555], 90.00th=[ 4817], 95.00th=[ 5276], 00:29:22.686 | 99.00th=[ 6718], 99.50th=[ 7373], 99.90th=[ 7832], 99.95th=[ 7898], 00:29:22.686 | 99.99th=[ 8029] 00:29:22.686 bw ( KiB/s): min=14096, max=14896, per=25.17%, avg=14531.20, stdev=256.42, samples=10 00:29:22.686 iops : min= 1762, max= 1862, avg=1816.40, stdev=32.05, samples=10 00:29:22.686 lat (usec) : 1000=0.02% 00:29:22.686 lat (msec) : 2=0.51%, 4=18.20%, 10=81.27% 00:29:22.686 cpu : usr=89.70%, sys=6.94%, ctx=119, majf=0, minf=9 00:29:22.686 IO depths : 1=0.2%, 2=12.2%, 4=59.8%, 8=27.8%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:22.686 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.686 complete : 0=0.0%, 4=92.4%, 8=7.6%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.686 issued rwts: total=9089,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.686 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:22.686 filename1: (groupid=0, jobs=1): err= 0: pid=254973: Fri Nov 29 02:34:26 2024 00:29:22.686 read: IOPS=1810, BW=14.1MiB/s (14.8MB/s)(70.7MiB/5002msec) 00:29:22.686 slat (nsec): min=4568, max=60215, avg=14851.02, stdev=8236.28 00:29:22.686 clat (usec): min=863, max=8001, avg=4367.69, stdev=649.10 00:29:22.686 lat (usec): min=901, max=8009, avg=4382.54, stdev=649.14 00:29:22.686 clat percentiles (usec): 00:29:22.686 | 1.00th=[ 2573], 5.00th=[ 3425], 10.00th=[ 3720], 20.00th=[ 4047], 00:29:22.686 | 30.00th=[ 4228], 40.00th=[ 4293], 50.00th=[ 4359], 60.00th=[ 4424], 00:29:22.686 | 70.00th=[ 4490], 80.00th=[ 4555], 90.00th=[ 4883], 95.00th=[ 5473], 00:29:22.686 | 99.00th=[ 6849], 99.50th=[ 7242], 99.90th=[ 7767], 99.95th=[ 7898], 00:29:22.686 | 99.99th=[ 8029] 00:29:22.686 bw ( KiB/s): min=13755, max=14944, per=25.08%, avg=14482.70, stdev=348.18, samples=10 00:29:22.686 iops : min= 1719, max= 1868, avg=1810.30, stdev=43.61, samples=10 00:29:22.686 lat (usec) : 1000=0.03% 00:29:22.686 lat (msec) : 2=0.41%, 4=17.92%, 10=81.63% 00:29:22.686 cpu : usr=94.44%, sys=5.00%, ctx=9, majf=0, minf=0 00:29:22.686 IO depths : 1=0.2%, 2=12.6%, 4=59.0%, 8=28.2%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:22.686 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.686 complete : 0=0.0%, 4=92.9%, 8=7.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.686 issued rwts: total=9055,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.686 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:22.686 filename1: (groupid=0, jobs=1): err= 0: pid=254974: Fri Nov 29 02:34:26 2024 00:29:22.686 read: IOPS=1790, BW=14.0MiB/s (14.7MB/s)(70.0MiB/5002msec) 00:29:22.686 slat (nsec): min=4564, max=70510, avg=15427.03, stdev=8501.26 00:29:22.686 clat (usec): min=759, max=7997, avg=4413.81, stdev=613.11 00:29:22.686 lat (usec): min=773, max=8017, avg=4429.23, stdev=612.97 00:29:22.686 clat percentiles (usec): 00:29:22.686 | 1.00th=[ 2868], 5.00th=[ 3556], 10.00th=[ 3884], 20.00th=[ 4146], 00:29:22.686 | 30.00th=[ 4293], 40.00th=[ 4359], 50.00th=[ 4359], 60.00th=[ 4424], 00:29:22.686 | 70.00th=[ 4490], 80.00th=[ 4621], 90.00th=[ 4948], 95.00th=[ 5473], 00:29:22.686 | 99.00th=[ 6783], 99.50th=[ 7177], 99.90th=[ 7504], 99.95th=[ 7701], 00:29:22.686 | 99.99th=[ 8029] 00:29:22.686 bw ( KiB/s): min=13840, max=14736, per=24.80%, avg=14321.20, stdev=248.53, samples=10 00:29:22.686 iops : min= 1730, max= 1842, avg=1790.10, stdev=31.06, samples=10 00:29:22.686 lat (usec) : 1000=0.06% 00:29:22.686 lat (msec) : 2=0.49%, 4=13.32%, 10=86.13% 00:29:22.686 cpu : usr=95.28%, sys=4.22%, ctx=10, majf=0, minf=9 00:29:22.686 IO depths : 1=0.1%, 2=13.5%, 4=58.5%, 8=27.8%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:22.686 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.686 complete : 0=0.0%, 4=92.4%, 8=7.6%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.686 issued rwts: total=8955,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.686 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:22.686 00:29:22.686 Run status group 0 (all jobs): 00:29:22.686 READ: bw=56.4MiB/s (59.1MB/s), 14.0MiB/s-14.2MiB/s (14.7MB/s-14.9MB/s), io=282MiB (296MB), run=5002-5003msec 00:29:22.945 02:34:26 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:29:22.945 02:34:26 -- target/dif.sh@43 -- # local sub 00:29:22.945 02:34:26 -- target/dif.sh@45 -- # for sub in "$@" 00:29:22.945 02:34:26 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:22.945 02:34:26 -- target/dif.sh@36 -- # local sub_id=0 00:29:22.945 02:34:26 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:22.945 02:34:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.945 02:34:26 -- common/autotest_common.sh@10 -- # set +x 00:29:22.945 02:34:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.945 02:34:26 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:22.945 02:34:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.945 02:34:26 -- common/autotest_common.sh@10 -- # set +x 00:29:22.945 02:34:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.945 02:34:26 -- target/dif.sh@45 -- # for sub in "$@" 00:29:22.945 02:34:26 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:22.945 02:34:26 -- target/dif.sh@36 -- # local sub_id=1 00:29:22.945 02:34:26 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:22.945 02:34:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.945 02:34:26 -- common/autotest_common.sh@10 -- # set +x 00:29:22.945 02:34:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.945 02:34:26 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:22.945 02:34:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.945 02:34:26 -- common/autotest_common.sh@10 -- # set +x 00:29:22.945 02:34:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.945 00:29:22.945 real 0m24.192s 00:29:22.945 user 4m32.722s 00:29:22.945 sys 0m6.052s 00:29:22.945 02:34:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:22.945 02:34:26 -- common/autotest_common.sh@10 -- # set +x 00:29:22.945 ************************************ 00:29:22.945 END TEST fio_dif_rand_params 00:29:22.945 ************************************ 00:29:22.945 02:34:26 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:29:22.945 02:34:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:22.945 02:34:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:22.945 02:34:26 -- common/autotest_common.sh@10 -- # set +x 00:29:22.945 ************************************ 00:29:22.945 START TEST fio_dif_digest 00:29:22.945 ************************************ 00:29:22.945 02:34:26 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:29:22.945 02:34:26 -- target/dif.sh@123 -- # local NULL_DIF 00:29:22.945 02:34:26 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:29:22.945 02:34:26 -- target/dif.sh@125 -- # local hdgst ddgst 00:29:22.945 02:34:26 -- target/dif.sh@127 -- # NULL_DIF=3 00:29:22.946 02:34:26 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:29:22.946 02:34:26 -- target/dif.sh@127 -- # numjobs=3 00:29:22.946 02:34:26 -- target/dif.sh@127 -- # iodepth=3 00:29:22.946 02:34:26 -- target/dif.sh@127 -- # runtime=10 00:29:22.946 02:34:26 -- target/dif.sh@128 -- # hdgst=true 00:29:22.946 02:34:26 -- target/dif.sh@128 -- # ddgst=true 00:29:22.946 02:34:26 -- target/dif.sh@130 -- # create_subsystems 0 00:29:22.946 02:34:26 -- target/dif.sh@28 -- # local sub 00:29:22.946 02:34:26 -- target/dif.sh@30 -- # for sub in "$@" 00:29:22.946 02:34:26 -- target/dif.sh@31 -- # create_subsystem 0 00:29:22.946 02:34:26 -- target/dif.sh@18 -- # local sub_id=0 00:29:22.946 02:34:26 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:22.946 02:34:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.946 02:34:26 -- common/autotest_common.sh@10 -- # set +x 00:29:22.946 bdev_null0 00:29:22.946 02:34:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.946 02:34:26 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:22.946 02:34:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.946 02:34:26 -- common/autotest_common.sh@10 -- # set +x 00:29:22.946 02:34:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.946 02:34:26 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:22.946 02:34:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.946 02:34:26 -- common/autotest_common.sh@10 -- # set +x 00:29:22.946 02:34:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.946 02:34:26 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:22.946 02:34:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.946 02:34:26 -- common/autotest_common.sh@10 -- # set +x 00:29:22.946 [2024-11-29 02:34:26.488301] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:22.946 02:34:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.946 02:34:26 -- target/dif.sh@131 -- # fio /dev/fd/62 00:29:22.946 02:34:26 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:29:22.946 02:34:26 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:22.946 02:34:26 -- nvmf/common.sh@520 -- # config=() 00:29:22.946 02:34:26 -- nvmf/common.sh@520 -- # local subsystem config 00:29:22.946 02:34:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:22.946 02:34:26 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:22.946 02:34:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:22.946 { 00:29:22.946 "params": { 00:29:22.946 "name": "Nvme$subsystem", 00:29:22.946 "trtype": "$TEST_TRANSPORT", 00:29:22.946 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:22.946 "adrfam": "ipv4", 00:29:22.946 "trsvcid": "$NVMF_PORT", 00:29:22.946 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:22.946 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:22.946 "hdgst": ${hdgst:-false}, 00:29:22.946 "ddgst": ${ddgst:-false} 00:29:22.946 }, 00:29:22.946 "method": "bdev_nvme_attach_controller" 00:29:22.946 } 00:29:22.946 EOF 00:29:22.946 )") 00:29:22.946 02:34:26 -- target/dif.sh@82 -- # gen_fio_conf 00:29:22.946 02:34:26 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:22.946 02:34:26 -- target/dif.sh@54 -- # local file 00:29:22.946 02:34:26 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:22.946 02:34:26 -- target/dif.sh@56 -- # cat 00:29:22.946 02:34:26 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:22.946 02:34:26 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:22.946 02:34:26 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:22.946 02:34:26 -- common/autotest_common.sh@1330 -- # shift 00:29:22.946 02:34:26 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:22.946 02:34:26 -- nvmf/common.sh@542 -- # cat 00:29:22.946 02:34:26 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:22.946 02:34:26 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:22.946 02:34:26 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:22.946 02:34:26 -- target/dif.sh@72 -- # (( file <= files )) 00:29:22.946 02:34:26 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:22.946 02:34:26 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:22.946 02:34:26 -- nvmf/common.sh@544 -- # jq . 00:29:22.946 02:34:26 -- nvmf/common.sh@545 -- # IFS=, 00:29:22.946 02:34:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:22.946 "params": { 00:29:22.946 "name": "Nvme0", 00:29:22.946 "trtype": "tcp", 00:29:22.946 "traddr": "10.0.0.2", 00:29:22.946 "adrfam": "ipv4", 00:29:22.946 "trsvcid": "4420", 00:29:22.946 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:22.946 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:22.946 "hdgst": true, 00:29:22.946 "ddgst": true 00:29:22.946 }, 00:29:22.946 "method": "bdev_nvme_attach_controller" 00:29:22.946 }' 00:29:22.946 02:34:26 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:22.946 02:34:26 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:22.946 02:34:26 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:22.946 02:34:26 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:22.946 02:34:26 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:22.946 02:34:26 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:22.946 02:34:26 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:22.946 02:34:26 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:22.946 02:34:26 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:22.946 02:34:26 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:23.206 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:23.206 ... 00:29:23.206 fio-3.35 00:29:23.206 Starting 3 threads 00:29:23.206 EAL: No free 2048 kB hugepages reported on node 1 00:29:23.464 [2024-11-29 02:34:27.135402] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:23.464 [2024-11-29 02:34:27.135508] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:35.669 00:29:35.669 filename0: (groupid=0, jobs=1): err= 0: pid=255747: Fri Nov 29 02:34:37 2024 00:29:35.669 read: IOPS=198, BW=24.9MiB/s (26.1MB/s)(250MiB/10045msec) 00:29:35.669 slat (nsec): min=7486, max=36971, avg=13211.09, stdev=2148.66 00:29:35.669 clat (usec): min=11641, max=57204, avg=15043.46, stdev=1603.48 00:29:35.669 lat (usec): min=11654, max=57217, avg=15056.67, stdev=1603.46 00:29:35.669 clat percentiles (usec): 00:29:35.669 | 1.00th=[12518], 5.00th=[13304], 10.00th=[13698], 20.00th=[14091], 00:29:35.669 | 30.00th=[14484], 40.00th=[14746], 50.00th=[15008], 60.00th=[15270], 00:29:35.669 | 70.00th=[15533], 80.00th=[15795], 90.00th=[16319], 95.00th=[16909], 00:29:35.669 | 99.00th=[17957], 99.50th=[18220], 99.90th=[46924], 99.95th=[57410], 00:29:35.669 | 99.99th=[57410] 00:29:35.669 bw ( KiB/s): min=24625, max=26880, per=33.48%, avg=25551.25, stdev=663.89, samples=20 00:29:35.669 iops : min= 192, max= 210, avg=199.60, stdev= 5.22, samples=20 00:29:35.669 lat (msec) : 20=99.90%, 50=0.05%, 100=0.05% 00:29:35.669 cpu : usr=92.51%, sys=6.99%, ctx=28, majf=0, minf=136 00:29:35.669 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:35.669 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:35.669 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:35.669 issued rwts: total=1998,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:35.669 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:35.669 filename0: (groupid=0, jobs=1): err= 0: pid=255748: Fri Nov 29 02:34:37 2024 00:29:35.669 read: IOPS=195, BW=24.4MiB/s (25.6MB/s)(246MiB/10048msec) 00:29:35.669 slat (nsec): min=7509, max=66875, avg=12745.56, stdev=2591.23 00:29:35.669 clat (usec): min=11498, max=51032, avg=15309.04, stdev=1548.46 00:29:35.669 lat (usec): min=11511, max=51045, avg=15321.78, stdev=1548.51 00:29:35.669 clat percentiles (usec): 00:29:35.669 | 1.00th=[12780], 5.00th=[13566], 10.00th=[13960], 20.00th=[14353], 00:29:35.669 | 30.00th=[14746], 40.00th=[14877], 50.00th=[15270], 60.00th=[15533], 00:29:35.669 | 70.00th=[15795], 80.00th=[16188], 90.00th=[16712], 95.00th=[17171], 00:29:35.669 | 99.00th=[17957], 99.50th=[18482], 99.90th=[47449], 99.95th=[51119], 00:29:35.669 | 99.99th=[51119] 00:29:35.669 bw ( KiB/s): min=23808, max=26368, per=32.91%, avg=25113.60, stdev=765.30, samples=20 00:29:35.669 iops : min= 186, max= 206, avg=196.20, stdev= 5.98, samples=20 00:29:35.669 lat (msec) : 20=99.75%, 50=0.20%, 100=0.05% 00:29:35.669 cpu : usr=92.30%, sys=7.22%, ctx=35, majf=0, minf=240 00:29:35.669 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:35.669 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:35.669 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:35.669 issued rwts: total=1964,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:35.669 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:35.669 filename0: (groupid=0, jobs=1): err= 0: pid=255749: Fri Nov 29 02:34:37 2024 00:29:35.669 read: IOPS=201, BW=25.2MiB/s (26.5MB/s)(254MiB/10046msec) 00:29:35.669 slat (nsec): min=7508, max=41183, avg=12805.42, stdev=2269.62 00:29:35.669 clat (usec): min=11142, max=54148, avg=14817.06, stdev=1647.91 00:29:35.669 lat (usec): min=11157, max=54160, avg=14829.86, stdev=1647.89 00:29:35.669 clat percentiles (usec): 00:29:35.669 | 1.00th=[12387], 5.00th=[13042], 10.00th=[13435], 20.00th=[13829], 00:29:35.669 | 30.00th=[14222], 40.00th=[14484], 50.00th=[14746], 60.00th=[15008], 00:29:35.669 | 70.00th=[15270], 80.00th=[15664], 90.00th=[16057], 95.00th=[16712], 00:29:35.669 | 99.00th=[17695], 99.50th=[17957], 99.90th=[22414], 99.95th=[51643], 00:29:35.669 | 99.99th=[54264] 00:29:35.669 bw ( KiB/s): min=24576, max=27392, per=33.98%, avg=25932.80, stdev=940.05, samples=20 00:29:35.669 iops : min= 192, max= 214, avg=202.60, stdev= 7.34, samples=20 00:29:35.669 lat (msec) : 20=99.75%, 50=0.15%, 100=0.10% 00:29:35.669 cpu : usr=93.45%, sys=6.07%, ctx=27, majf=0, minf=47 00:29:35.669 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:35.669 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:35.669 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:35.669 issued rwts: total=2029,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:35.669 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:35.669 00:29:35.669 Run status group 0 (all jobs): 00:29:35.669 READ: bw=74.5MiB/s (78.1MB/s), 24.4MiB/s-25.2MiB/s (25.6MB/s-26.5MB/s), io=749MiB (785MB), run=10045-10048msec 00:29:35.669 02:34:37 -- target/dif.sh@132 -- # destroy_subsystems 0 00:29:35.669 02:34:37 -- target/dif.sh@43 -- # local sub 00:29:35.669 02:34:37 -- target/dif.sh@45 -- # for sub in "$@" 00:29:35.669 02:34:37 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:35.669 02:34:37 -- target/dif.sh@36 -- # local sub_id=0 00:29:35.669 02:34:37 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:35.669 02:34:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:35.670 02:34:37 -- common/autotest_common.sh@10 -- # set +x 00:29:35.670 02:34:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:35.670 02:34:37 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:35.670 02:34:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:35.670 02:34:37 -- common/autotest_common.sh@10 -- # set +x 00:29:35.670 02:34:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:35.670 00:29:35.670 real 0m11.066s 00:29:35.670 user 0m29.112s 00:29:35.670 sys 0m2.312s 00:29:35.670 02:34:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:35.670 02:34:37 -- common/autotest_common.sh@10 -- # set +x 00:29:35.670 ************************************ 00:29:35.670 END TEST fio_dif_digest 00:29:35.670 ************************************ 00:29:35.670 02:34:37 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:29:35.670 02:34:37 -- target/dif.sh@147 -- # nvmftestfini 00:29:35.670 02:34:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:35.670 02:34:37 -- nvmf/common.sh@116 -- # sync 00:29:35.670 02:34:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:35.670 02:34:37 -- nvmf/common.sh@119 -- # set +e 00:29:35.670 02:34:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:35.670 02:34:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:35.670 rmmod nvme_tcp 00:29:35.670 rmmod nvme_fabrics 00:29:35.670 rmmod nvme_keyring 00:29:35.670 02:34:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:35.670 02:34:37 -- nvmf/common.sh@123 -- # set -e 00:29:35.670 02:34:37 -- nvmf/common.sh@124 -- # return 0 00:29:35.670 02:34:37 -- nvmf/common.sh@477 -- # '[' -n 249513 ']' 00:29:35.670 02:34:37 -- nvmf/common.sh@478 -- # killprocess 249513 00:29:35.670 02:34:37 -- common/autotest_common.sh@936 -- # '[' -z 249513 ']' 00:29:35.670 02:34:37 -- common/autotest_common.sh@940 -- # kill -0 249513 00:29:35.670 02:34:37 -- common/autotest_common.sh@941 -- # uname 00:29:35.670 02:34:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:35.670 02:34:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 249513 00:29:35.670 02:34:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:35.670 02:34:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:35.670 02:34:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 249513' 00:29:35.670 killing process with pid 249513 00:29:35.670 02:34:37 -- common/autotest_common.sh@955 -- # kill 249513 00:29:35.670 02:34:37 -- common/autotest_common.sh@960 -- # wait 249513 00:29:35.670 02:34:37 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:35.670 02:34:37 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:35.670 Waiting for block devices as requested 00:29:35.670 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:35.670 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:35.670 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:35.929 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:35.929 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:35.929 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:35.929 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:35.929 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:36.189 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:36.189 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:36.189 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:36.189 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:36.448 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:36.448 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:36.448 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:36.448 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:36.448 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:36.706 02:34:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:36.706 02:34:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:36.706 02:34:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:36.706 02:34:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:36.706 02:34:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:36.706 02:34:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:36.706 02:34:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:38.610 02:34:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:38.610 00:29:38.610 real 1m7.367s 00:29:38.610 user 6m31.090s 00:29:38.610 sys 0m16.977s 00:29:38.610 02:34:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:38.610 02:34:42 -- common/autotest_common.sh@10 -- # set +x 00:29:38.610 ************************************ 00:29:38.610 END TEST nvmf_dif 00:29:38.610 ************************************ 00:29:38.610 02:34:42 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:38.610 02:34:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:38.610 02:34:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:38.610 02:34:42 -- common/autotest_common.sh@10 -- # set +x 00:29:38.610 ************************************ 00:29:38.610 START TEST nvmf_abort_qd_sizes 00:29:38.610 ************************************ 00:29:38.610 02:34:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:38.870 * Looking for test storage... 00:29:38.870 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:29:38.870 02:34:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:38.870 02:34:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:38.870 02:34:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:38.870 02:34:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:38.870 02:34:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:38.870 02:34:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:38.870 02:34:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:38.870 02:34:42 -- scripts/common.sh@335 -- # IFS=.-: 00:29:38.870 02:34:42 -- scripts/common.sh@335 -- # read -ra ver1 00:29:38.870 02:34:42 -- scripts/common.sh@336 -- # IFS=.-: 00:29:38.870 02:34:42 -- scripts/common.sh@336 -- # read -ra ver2 00:29:38.870 02:34:42 -- scripts/common.sh@337 -- # local 'op=<' 00:29:38.870 02:34:42 -- scripts/common.sh@339 -- # ver1_l=2 00:29:38.870 02:34:42 -- scripts/common.sh@340 -- # ver2_l=1 00:29:38.870 02:34:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:38.870 02:34:42 -- scripts/common.sh@343 -- # case "$op" in 00:29:38.870 02:34:42 -- scripts/common.sh@344 -- # : 1 00:29:38.870 02:34:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:38.870 02:34:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:38.870 02:34:42 -- scripts/common.sh@364 -- # decimal 1 00:29:38.870 02:34:42 -- scripts/common.sh@352 -- # local d=1 00:29:38.870 02:34:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:38.870 02:34:42 -- scripts/common.sh@354 -- # echo 1 00:29:38.870 02:34:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:38.870 02:34:42 -- scripts/common.sh@365 -- # decimal 2 00:29:38.870 02:34:42 -- scripts/common.sh@352 -- # local d=2 00:29:38.870 02:34:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:38.870 02:34:42 -- scripts/common.sh@354 -- # echo 2 00:29:38.870 02:34:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:38.870 02:34:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:38.870 02:34:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:38.870 02:34:42 -- scripts/common.sh@367 -- # return 0 00:29:38.870 02:34:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:38.870 02:34:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:38.870 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:38.870 --rc genhtml_branch_coverage=1 00:29:38.870 --rc genhtml_function_coverage=1 00:29:38.870 --rc genhtml_legend=1 00:29:38.870 --rc geninfo_all_blocks=1 00:29:38.870 --rc geninfo_unexecuted_blocks=1 00:29:38.870 00:29:38.870 ' 00:29:38.870 02:34:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:38.870 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:38.870 --rc genhtml_branch_coverage=1 00:29:38.870 --rc genhtml_function_coverage=1 00:29:38.870 --rc genhtml_legend=1 00:29:38.870 --rc geninfo_all_blocks=1 00:29:38.870 --rc geninfo_unexecuted_blocks=1 00:29:38.870 00:29:38.870 ' 00:29:38.870 02:34:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:38.870 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:38.870 --rc genhtml_branch_coverage=1 00:29:38.870 --rc genhtml_function_coverage=1 00:29:38.870 --rc genhtml_legend=1 00:29:38.870 --rc geninfo_all_blocks=1 00:29:38.870 --rc geninfo_unexecuted_blocks=1 00:29:38.870 00:29:38.870 ' 00:29:38.870 02:34:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:38.870 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:38.870 --rc genhtml_branch_coverage=1 00:29:38.870 --rc genhtml_function_coverage=1 00:29:38.870 --rc genhtml_legend=1 00:29:38.870 --rc geninfo_all_blocks=1 00:29:38.870 --rc geninfo_unexecuted_blocks=1 00:29:38.870 00:29:38.870 ' 00:29:38.870 02:34:42 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:38.870 02:34:42 -- nvmf/common.sh@7 -- # uname -s 00:29:38.870 02:34:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:38.870 02:34:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:38.870 02:34:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:38.870 02:34:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:38.870 02:34:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:38.870 02:34:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:38.870 02:34:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:38.870 02:34:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:38.870 02:34:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:38.870 02:34:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:38.870 02:34:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:38.870 02:34:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:38.870 02:34:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:38.870 02:34:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:38.870 02:34:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:38.870 02:34:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:38.870 02:34:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:38.870 02:34:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:38.870 02:34:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:38.870 02:34:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:38.870 02:34:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:38.870 02:34:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:38.870 02:34:42 -- paths/export.sh@5 -- # export PATH 00:29:38.870 02:34:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:38.870 02:34:42 -- nvmf/common.sh@46 -- # : 0 00:29:38.870 02:34:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:38.870 02:34:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:38.870 02:34:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:38.870 02:34:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:38.870 02:34:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:38.870 02:34:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:38.870 02:34:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:38.870 02:34:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:38.870 02:34:42 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:29:38.870 02:34:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:38.870 02:34:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:38.870 02:34:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:38.870 02:34:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:38.870 02:34:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:38.870 02:34:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:38.870 02:34:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:38.870 02:34:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:38.870 02:34:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:38.870 02:34:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:38.871 02:34:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:38.871 02:34:42 -- common/autotest_common.sh@10 -- # set +x 00:29:41.404 02:34:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:41.404 02:34:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:41.404 02:34:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:41.404 02:34:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:41.404 02:34:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:41.404 02:34:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:41.404 02:34:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:41.404 02:34:44 -- nvmf/common.sh@294 -- # net_devs=() 00:29:41.404 02:34:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:41.404 02:34:44 -- nvmf/common.sh@295 -- # e810=() 00:29:41.404 02:34:44 -- nvmf/common.sh@295 -- # local -ga e810 00:29:41.404 02:34:44 -- nvmf/common.sh@296 -- # x722=() 00:29:41.404 02:34:44 -- nvmf/common.sh@296 -- # local -ga x722 00:29:41.404 02:34:44 -- nvmf/common.sh@297 -- # mlx=() 00:29:41.404 02:34:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:41.404 02:34:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:41.404 02:34:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:41.404 02:34:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:41.404 02:34:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:41.404 02:34:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:41.404 02:34:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:41.404 02:34:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:41.404 02:34:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:41.404 02:34:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:41.404 02:34:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:41.404 02:34:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:41.404 02:34:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:41.404 02:34:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:41.404 02:34:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:41.404 02:34:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:41.404 02:34:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:41.404 02:34:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:41.404 02:34:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:41.404 02:34:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:41.404 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:41.404 02:34:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:41.404 02:34:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:41.404 02:34:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:41.404 02:34:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:41.404 02:34:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:41.404 02:34:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:41.404 02:34:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:41.404 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:41.404 02:34:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:41.404 02:34:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:41.404 02:34:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:41.404 02:34:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:41.404 02:34:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:41.404 02:34:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:41.404 02:34:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:41.404 02:34:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:41.404 02:34:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:41.404 02:34:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:41.405 02:34:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:41.405 02:34:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:41.405 02:34:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:41.405 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:41.405 02:34:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:41.405 02:34:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:41.405 02:34:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:41.405 02:34:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:41.405 02:34:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:41.405 02:34:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:41.405 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:41.405 02:34:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:41.405 02:34:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:41.405 02:34:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:41.405 02:34:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:41.405 02:34:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:41.405 02:34:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:41.405 02:34:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:41.405 02:34:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:41.405 02:34:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:41.405 02:34:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:41.405 02:34:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:41.405 02:34:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:41.405 02:34:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:41.405 02:34:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:41.405 02:34:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:41.405 02:34:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:41.405 02:34:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:41.405 02:34:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:41.405 02:34:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:41.405 02:34:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:41.405 02:34:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:41.405 02:34:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:41.405 02:34:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:41.405 02:34:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:41.405 02:34:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:41.405 02:34:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:41.405 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:41.405 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.191 ms 00:29:41.405 00:29:41.405 --- 10.0.0.2 ping statistics --- 00:29:41.405 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:41.405 rtt min/avg/max/mdev = 0.191/0.191/0.191/0.000 ms 00:29:41.405 02:34:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:41.405 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:41.405 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.045 ms 00:29:41.405 00:29:41.405 --- 10.0.0.1 ping statistics --- 00:29:41.405 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:41.405 rtt min/avg/max/mdev = 0.045/0.045/0.045/0.000 ms 00:29:41.405 02:34:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:41.405 02:34:44 -- nvmf/common.sh@410 -- # return 0 00:29:41.405 02:34:44 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:29:41.405 02:34:44 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:29:42.336 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:42.336 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:42.336 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:42.336 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:42.336 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:42.336 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:42.336 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:42.336 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:42.336 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:42.336 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:42.336 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:42.336 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:42.336 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:42.336 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:42.336 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:42.336 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:43.274 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:29:43.274 02:34:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:43.274 02:34:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:43.532 02:34:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:43.532 02:34:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:43.532 02:34:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:43.532 02:34:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:43.532 02:34:46 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:29:43.532 02:34:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:43.532 02:34:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:43.532 02:34:46 -- common/autotest_common.sh@10 -- # set +x 00:29:43.532 02:34:46 -- nvmf/common.sh@469 -- # nvmfpid=260767 00:29:43.532 02:34:46 -- nvmf/common.sh@470 -- # waitforlisten 260767 00:29:43.532 02:34:46 -- common/autotest_common.sh@829 -- # '[' -z 260767 ']' 00:29:43.532 02:34:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:43.532 02:34:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:29:43.532 02:34:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:43.532 02:34:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:43.532 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:43.532 02:34:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:43.532 02:34:46 -- common/autotest_common.sh@10 -- # set +x 00:29:43.532 [2024-11-29 02:34:47.022684] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:43.532 [2024-11-29 02:34:47.022770] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:43.532 EAL: No free 2048 kB hugepages reported on node 1 00:29:43.532 [2024-11-29 02:34:47.090629] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:43.532 [2024-11-29 02:34:47.206049] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:43.532 [2024-11-29 02:34:47.206213] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:43.533 [2024-11-29 02:34:47.206233] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:43.533 [2024-11-29 02:34:47.206247] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:43.533 [2024-11-29 02:34:47.206331] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:43.533 [2024-11-29 02:34:47.206387] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:43.533 [2024-11-29 02:34:47.206509] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:43.533 [2024-11-29 02:34:47.206513] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:44.467 02:34:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:44.467 02:34:47 -- common/autotest_common.sh@862 -- # return 0 00:29:44.467 02:34:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:44.467 02:34:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:44.467 02:34:47 -- common/autotest_common.sh@10 -- # set +x 00:29:44.467 02:34:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:44.467 02:34:47 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:29:44.467 02:34:47 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:29:44.467 02:34:47 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:29:44.467 02:34:47 -- scripts/common.sh@311 -- # local bdf bdfs 00:29:44.467 02:34:47 -- scripts/common.sh@312 -- # local nvmes 00:29:44.467 02:34:47 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:29:44.467 02:34:47 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:29:44.467 02:34:47 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:29:44.467 02:34:47 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:29:44.467 02:34:47 -- scripts/common.sh@322 -- # uname -s 00:29:44.467 02:34:47 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:29:44.467 02:34:47 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:29:44.467 02:34:47 -- scripts/common.sh@327 -- # (( 1 )) 00:29:44.467 02:34:47 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:29:44.467 02:34:47 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:29:44.467 02:34:47 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:29:44.467 02:34:47 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:29:44.467 02:34:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:44.467 02:34:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:44.467 02:34:47 -- common/autotest_common.sh@10 -- # set +x 00:29:44.467 ************************************ 00:29:44.467 START TEST spdk_target_abort 00:29:44.467 ************************************ 00:29:44.467 02:34:48 -- common/autotest_common.sh@1114 -- # spdk_target 00:29:44.467 02:34:48 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:29:44.467 02:34:48 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:44.467 02:34:48 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:29:44.467 02:34:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:44.467 02:34:48 -- common/autotest_common.sh@10 -- # set +x 00:29:47.749 spdk_targetn1 00:29:47.749 02:34:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:47.749 02:34:50 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:47.749 02:34:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:47.749 02:34:50 -- common/autotest_common.sh@10 -- # set +x 00:29:47.749 [2024-11-29 02:34:50.840602] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:47.749 02:34:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:47.749 02:34:50 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:29:47.749 02:34:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:47.749 02:34:50 -- common/autotest_common.sh@10 -- # set +x 00:29:47.749 02:34:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:47.749 02:34:50 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:29:47.749 02:34:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:47.749 02:34:50 -- common/autotest_common.sh@10 -- # set +x 00:29:47.749 02:34:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:47.749 02:34:50 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:29:47.749 02:34:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:47.749 02:34:50 -- common/autotest_common.sh@10 -- # set +x 00:29:47.749 [2024-11-29 02:34:50.872879] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:47.749 02:34:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:47.749 02:34:50 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:29:47.749 02:34:50 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:29:47.749 02:34:50 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:29:47.749 02:34:50 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:29:47.749 02:34:50 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:29:47.749 02:34:50 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:47.749 02:34:50 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:29:47.749 02:34:50 -- target/abort_qd_sizes.sh@24 -- # local target r 00:29:47.749 02:34:50 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:29:47.749 02:34:50 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:47.749 02:34:50 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:29:47.749 02:34:50 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:47.749 02:34:50 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:29:47.749 02:34:50 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:47.749 02:34:50 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:29:47.749 02:34:50 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:47.749 02:34:50 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:29:47.749 02:34:50 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:47.749 02:34:50 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:47.749 02:34:50 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:47.749 02:34:50 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:47.749 EAL: No free 2048 kB hugepages reported on node 1 00:29:51.029 Initializing NVMe Controllers 00:29:51.029 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:51.029 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:51.029 Initialization complete. Launching workers. 00:29:51.029 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 12823, failed: 0 00:29:51.029 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1126, failed to submit 11697 00:29:51.029 success 749, unsuccess 377, failed 0 00:29:51.029 02:34:54 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:51.029 02:34:54 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:51.029 EAL: No free 2048 kB hugepages reported on node 1 00:29:54.306 [2024-11-29 02:34:57.260424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb0b5e0 is same with the state(5) to be set 00:29:54.306 Initializing NVMe Controllers 00:29:54.306 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:54.306 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:54.306 Initialization complete. Launching workers. 00:29:54.306 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8539, failed: 0 00:29:54.306 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1222, failed to submit 7317 00:29:54.306 success 381, unsuccess 841, failed 0 00:29:54.306 02:34:57 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:54.306 02:34:57 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:54.306 EAL: No free 2048 kB hugepages reported on node 1 00:29:57.587 Initializing NVMe Controllers 00:29:57.587 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:57.587 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:57.587 Initialization complete. Launching workers. 00:29:57.587 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 30955, failed: 0 00:29:57.587 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2700, failed to submit 28255 00:29:57.587 success 553, unsuccess 2147, failed 0 00:29:57.587 02:35:00 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:29:57.587 02:35:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:57.587 02:35:00 -- common/autotest_common.sh@10 -- # set +x 00:29:57.587 02:35:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:57.587 02:35:00 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:29:57.587 02:35:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:57.587 02:35:00 -- common/autotest_common.sh@10 -- # set +x 00:29:58.520 02:35:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:58.520 02:35:01 -- target/abort_qd_sizes.sh@62 -- # killprocess 260767 00:29:58.520 02:35:01 -- common/autotest_common.sh@936 -- # '[' -z 260767 ']' 00:29:58.520 02:35:01 -- common/autotest_common.sh@940 -- # kill -0 260767 00:29:58.520 02:35:01 -- common/autotest_common.sh@941 -- # uname 00:29:58.520 02:35:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:58.520 02:35:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 260767 00:29:58.520 02:35:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:58.520 02:35:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:58.520 02:35:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 260767' 00:29:58.520 killing process with pid 260767 00:29:58.520 02:35:02 -- common/autotest_common.sh@955 -- # kill 260767 00:29:58.520 02:35:02 -- common/autotest_common.sh@960 -- # wait 260767 00:29:58.778 00:29:58.778 real 0m14.312s 00:29:58.778 user 0m55.844s 00:29:58.778 sys 0m2.926s 00:29:58.778 02:35:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:58.778 02:35:02 -- common/autotest_common.sh@10 -- # set +x 00:29:58.778 ************************************ 00:29:58.778 END TEST spdk_target_abort 00:29:58.778 ************************************ 00:29:58.778 02:35:02 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:29:58.778 02:35:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:58.778 02:35:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:58.778 02:35:02 -- common/autotest_common.sh@10 -- # set +x 00:29:58.778 ************************************ 00:29:58.778 START TEST kernel_target_abort 00:29:58.778 ************************************ 00:29:58.778 02:35:02 -- common/autotest_common.sh@1114 -- # kernel_target 00:29:58.778 02:35:02 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:29:58.778 02:35:02 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:29:58.778 02:35:02 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:29:58.778 02:35:02 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:29:58.778 02:35:02 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:29:58.778 02:35:02 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:29:58.778 02:35:02 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:29:58.778 02:35:02 -- nvmf/common.sh@627 -- # local block nvme 00:29:58.778 02:35:02 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:29:58.778 02:35:02 -- nvmf/common.sh@630 -- # modprobe nvmet 00:29:58.778 02:35:02 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:29:58.778 02:35:02 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:59.713 Waiting for block devices as requested 00:29:59.973 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:59.973 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:59.973 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:00.231 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:00.231 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:00.231 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:00.490 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:00.490 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:00.490 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:00.490 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:00.749 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:00.749 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:00.749 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:00.749 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:01.008 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:01.008 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:01.008 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:01.266 02:35:04 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:30:01.266 02:35:04 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:30:01.266 02:35:04 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:30:01.266 02:35:04 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:30:01.266 02:35:04 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:30:01.266 No valid GPT data, bailing 00:30:01.266 02:35:04 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:30:01.266 02:35:04 -- scripts/common.sh@393 -- # pt= 00:30:01.266 02:35:04 -- scripts/common.sh@394 -- # return 1 00:30:01.266 02:35:04 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:30:01.266 02:35:04 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:30:01.266 02:35:04 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:01.266 02:35:04 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:01.266 02:35:04 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:30:01.266 02:35:04 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:30:01.266 02:35:04 -- nvmf/common.sh@654 -- # echo 1 00:30:01.266 02:35:04 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:30:01.266 02:35:04 -- nvmf/common.sh@656 -- # echo 1 00:30:01.266 02:35:04 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:30:01.266 02:35:04 -- nvmf/common.sh@663 -- # echo tcp 00:30:01.266 02:35:04 -- nvmf/common.sh@664 -- # echo 4420 00:30:01.266 02:35:04 -- nvmf/common.sh@665 -- # echo ipv4 00:30:01.266 02:35:04 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:30:01.266 02:35:04 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:30:01.266 00:30:01.266 Discovery Log Number of Records 2, Generation counter 2 00:30:01.266 =====Discovery Log Entry 0====== 00:30:01.266 trtype: tcp 00:30:01.266 adrfam: ipv4 00:30:01.266 subtype: current discovery subsystem 00:30:01.266 treq: not specified, sq flow control disable supported 00:30:01.266 portid: 1 00:30:01.266 trsvcid: 4420 00:30:01.266 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:30:01.266 traddr: 10.0.0.1 00:30:01.266 eflags: none 00:30:01.266 sectype: none 00:30:01.266 =====Discovery Log Entry 1====== 00:30:01.266 trtype: tcp 00:30:01.266 adrfam: ipv4 00:30:01.266 subtype: nvme subsystem 00:30:01.266 treq: not specified, sq flow control disable supported 00:30:01.266 portid: 1 00:30:01.266 trsvcid: 4420 00:30:01.266 subnqn: kernel_target 00:30:01.266 traddr: 10.0.0.1 00:30:01.266 eflags: none 00:30:01.266 sectype: none 00:30:01.266 02:35:04 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:30:01.266 02:35:04 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:30:01.266 02:35:04 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:30:01.266 02:35:04 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:30:01.266 02:35:04 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:30:01.266 02:35:04 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:30:01.266 02:35:04 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:30:01.266 02:35:04 -- target/abort_qd_sizes.sh@24 -- # local target r 00:30:01.266 02:35:04 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:30:01.266 02:35:04 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:01.266 02:35:04 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:30:01.266 02:35:04 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:01.266 02:35:04 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:30:01.266 02:35:04 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:01.266 02:35:04 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:30:01.266 02:35:04 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:01.266 02:35:04 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:30:01.266 02:35:04 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:01.266 02:35:04 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:01.266 02:35:04 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:01.266 02:35:04 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:01.266 EAL: No free 2048 kB hugepages reported on node 1 00:30:04.616 Initializing NVMe Controllers 00:30:04.616 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:04.616 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:04.616 Initialization complete. Launching workers. 00:30:04.616 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 44070, failed: 0 00:30:04.616 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 44070, failed to submit 0 00:30:04.616 success 0, unsuccess 44070, failed 0 00:30:04.616 02:35:07 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:04.616 02:35:07 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:04.616 EAL: No free 2048 kB hugepages reported on node 1 00:30:07.895 Initializing NVMe Controllers 00:30:07.895 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:07.895 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:07.895 Initialization complete. Launching workers. 00:30:07.895 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 84068, failed: 0 00:30:07.895 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 21194, failed to submit 62874 00:30:07.895 success 0, unsuccess 21194, failed 0 00:30:07.895 02:35:11 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:07.895 02:35:11 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:07.895 EAL: No free 2048 kB hugepages reported on node 1 00:30:11.175 Initializing NVMe Controllers 00:30:11.175 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:11.175 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:11.175 Initialization complete. Launching workers. 00:30:11.175 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 77281, failed: 0 00:30:11.175 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 19306, failed to submit 57975 00:30:11.175 success 0, unsuccess 19306, failed 0 00:30:11.175 02:35:14 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:30:11.175 02:35:14 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:30:11.175 02:35:14 -- nvmf/common.sh@677 -- # echo 0 00:30:11.175 02:35:14 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:30:11.175 02:35:14 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:11.175 02:35:14 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:30:11.175 02:35:14 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:11.175 02:35:14 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:30:11.175 02:35:14 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:30:11.175 00:30:11.175 real 0m11.893s 00:30:11.175 user 0m5.790s 00:30:11.175 sys 0m2.335s 00:30:11.175 02:35:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:11.175 02:35:14 -- common/autotest_common.sh@10 -- # set +x 00:30:11.175 ************************************ 00:30:11.175 END TEST kernel_target_abort 00:30:11.175 ************************************ 00:30:11.175 02:35:14 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:30:11.175 02:35:14 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:30:11.175 02:35:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:11.175 02:35:14 -- nvmf/common.sh@116 -- # sync 00:30:11.175 02:35:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:11.175 02:35:14 -- nvmf/common.sh@119 -- # set +e 00:30:11.175 02:35:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:11.175 02:35:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:11.175 rmmod nvme_tcp 00:30:11.175 rmmod nvme_fabrics 00:30:11.175 rmmod nvme_keyring 00:30:11.175 02:35:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:11.175 02:35:14 -- nvmf/common.sh@123 -- # set -e 00:30:11.175 02:35:14 -- nvmf/common.sh@124 -- # return 0 00:30:11.175 02:35:14 -- nvmf/common.sh@477 -- # '[' -n 260767 ']' 00:30:11.175 02:35:14 -- nvmf/common.sh@478 -- # killprocess 260767 00:30:11.175 02:35:14 -- common/autotest_common.sh@936 -- # '[' -z 260767 ']' 00:30:11.175 02:35:14 -- common/autotest_common.sh@940 -- # kill -0 260767 00:30:11.175 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (260767) - No such process 00:30:11.175 02:35:14 -- common/autotest_common.sh@963 -- # echo 'Process with pid 260767 is not found' 00:30:11.175 Process with pid 260767 is not found 00:30:11.175 02:35:14 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:30:11.175 02:35:14 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:11.741 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:11.741 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:11.741 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:11.999 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:11.999 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:11.999 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:11.999 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:11.999 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:11.999 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:11.999 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:11.999 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:11.999 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:11.999 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:11.999 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:11.999 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:11.999 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:11.999 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:11.999 02:35:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:11.999 02:35:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:11.999 02:35:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:11.999 02:35:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:11.999 02:35:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:11.999 02:35:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:11.999 02:35:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:14.534 02:35:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:14.534 00:30:14.534 real 0m35.430s 00:30:14.534 user 1m4.044s 00:30:14.534 sys 0m8.705s 00:30:14.534 02:35:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:14.534 02:35:17 -- common/autotest_common.sh@10 -- # set +x 00:30:14.534 ************************************ 00:30:14.534 END TEST nvmf_abort_qd_sizes 00:30:14.534 ************************************ 00:30:14.534 02:35:17 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:30:14.534 02:35:17 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:30:14.534 02:35:17 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:30:14.534 02:35:17 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:30:14.534 02:35:17 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:30:14.534 02:35:17 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:30:14.534 02:35:17 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:30:14.534 02:35:17 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:30:14.534 02:35:17 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:30:14.534 02:35:17 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:30:14.534 02:35:17 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:30:14.534 02:35:17 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:30:14.534 02:35:17 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:30:14.534 02:35:17 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:30:14.534 02:35:17 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:30:14.534 02:35:17 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:30:14.534 02:35:17 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:30:14.534 02:35:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:14.534 02:35:17 -- common/autotest_common.sh@10 -- # set +x 00:30:14.534 02:35:17 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:30:14.534 02:35:17 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:30:14.534 02:35:17 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:30:14.534 02:35:17 -- common/autotest_common.sh@10 -- # set +x 00:30:15.912 INFO: APP EXITING 00:30:15.912 INFO: killing all VMs 00:30:15.912 INFO: killing vhost app 00:30:15.912 INFO: EXIT DONE 00:30:17.287 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:17.287 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:17.287 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:17.287 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:17.287 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:17.287 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:17.287 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:17.287 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:17.287 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:17.287 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:17.287 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:17.287 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:17.287 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:17.287 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:17.287 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:17.287 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:17.287 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:18.665 Cleaning 00:30:18.665 Removing: /var/run/dpdk/spdk0/config 00:30:18.665 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:30:18.665 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:30:18.665 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:30:18.665 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:30:18.665 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:30:18.665 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:30:18.665 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:30:18.665 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:30:18.665 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:30:18.665 Removing: /var/run/dpdk/spdk0/hugepage_info 00:30:18.665 Removing: /var/run/dpdk/spdk1/config 00:30:18.665 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:30:18.665 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:30:18.665 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:30:18.665 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:30:18.665 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:30:18.665 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:30:18.665 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:30:18.665 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:30:18.665 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:30:18.665 Removing: /var/run/dpdk/spdk1/hugepage_info 00:30:18.665 Removing: /var/run/dpdk/spdk1/mp_socket 00:30:18.665 Removing: /var/run/dpdk/spdk2/config 00:30:18.665 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:30:18.665 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:30:18.665 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:30:18.665 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:30:18.665 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:30:18.665 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:30:18.665 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:30:18.665 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:30:18.665 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:30:18.665 Removing: /var/run/dpdk/spdk2/hugepage_info 00:30:18.665 Removing: /var/run/dpdk/spdk3/config 00:30:18.665 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:30:18.665 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:30:18.665 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:30:18.665 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:30:18.665 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:30:18.665 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:30:18.665 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:30:18.665 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:30:18.665 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:30:18.665 Removing: /var/run/dpdk/spdk3/hugepage_info 00:30:18.665 Removing: /var/run/dpdk/spdk4/config 00:30:18.665 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:30:18.665 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:30:18.665 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:30:18.665 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:30:18.665 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:30:18.665 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:30:18.665 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:30:18.665 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:30:18.665 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:30:18.665 Removing: /var/run/dpdk/spdk4/hugepage_info 00:30:18.665 Removing: /dev/shm/bdev_svc_trace.1 00:30:18.665 Removing: /dev/shm/nvmf_trace.0 00:30:18.665 Removing: /dev/shm/spdk_tgt_trace.pid4185032 00:30:18.665 Removing: /var/run/dpdk/spdk0 00:30:18.665 Removing: /var/run/dpdk/spdk1 00:30:18.665 Removing: /var/run/dpdk/spdk2 00:30:18.665 Removing: /var/run/dpdk/spdk3 00:30:18.665 Removing: /var/run/dpdk/spdk4 00:30:18.665 Removing: /var/run/dpdk/spdk_pid10084 00:30:18.665 Removing: /var/run/dpdk/spdk_pid101544 00:30:18.665 Removing: /var/run/dpdk/spdk_pid10317 00:30:18.665 Removing: /var/run/dpdk/spdk_pid10509 00:30:18.665 Removing: /var/run/dpdk/spdk_pid10711 00:30:18.665 Removing: /var/run/dpdk/spdk_pid108099 00:30:18.665 Removing: /var/run/dpdk/spdk_pid10923 00:30:18.665 Removing: /var/run/dpdk/spdk_pid1118 00:30:18.665 Removing: /var/run/dpdk/spdk_pid113605 00:30:18.665 Removing: /var/run/dpdk/spdk_pid114976 00:30:18.665 Removing: /var/run/dpdk/spdk_pid116069 00:30:18.665 Removing: /var/run/dpdk/spdk_pid126897 00:30:18.665 Removing: /var/run/dpdk/spdk_pid1283 00:30:18.665 Removing: /var/run/dpdk/spdk_pid129195 00:30:18.665 Removing: /var/run/dpdk/spdk_pid13152 00:30:18.665 Removing: /var/run/dpdk/spdk_pid132112 00:30:18.665 Removing: /var/run/dpdk/spdk_pid133326 00:30:18.665 Removing: /var/run/dpdk/spdk_pid134704 00:30:18.666 Removing: /var/run/dpdk/spdk_pid134970 00:30:18.666 Removing: /var/run/dpdk/spdk_pid135124 00:30:18.666 Removing: /var/run/dpdk/spdk_pid135276 00:30:18.666 Removing: /var/run/dpdk/spdk_pid135889 00:30:18.666 Removing: /var/run/dpdk/spdk_pid137362 00:30:18.666 Removing: /var/run/dpdk/spdk_pid138323 00:30:18.666 Removing: /var/run/dpdk/spdk_pid138839 00:30:18.666 Removing: /var/run/dpdk/spdk_pid142352 00:30:18.666 Removing: /var/run/dpdk/spdk_pid1427 00:30:18.666 Removing: /var/run/dpdk/spdk_pid145941 00:30:18.666 Removing: /var/run/dpdk/spdk_pid150200 00:30:18.666 Removing: /var/run/dpdk/spdk_pid174157 00:30:18.666 Removing: /var/run/dpdk/spdk_pid177118 00:30:18.666 Removing: /var/run/dpdk/spdk_pid181606 00:30:18.666 Removing: /var/run/dpdk/spdk_pid1818 00:30:18.666 Removing: /var/run/dpdk/spdk_pid182708 00:30:18.666 Removing: /var/run/dpdk/spdk_pid183826 00:30:18.666 Removing: /var/run/dpdk/spdk_pid186540 00:30:18.926 Removing: /var/run/dpdk/spdk_pid189069 00:30:18.926 Removing: /var/run/dpdk/spdk_pid193613 00:30:18.926 Removing: /var/run/dpdk/spdk_pid193617 00:30:18.926 Removing: /var/run/dpdk/spdk_pid196559 00:30:18.926 Removing: /var/run/dpdk/spdk_pid196710 00:30:18.926 Removing: /var/run/dpdk/spdk_pid196847 00:30:18.926 Removing: /var/run/dpdk/spdk_pid197137 00:30:18.926 Removing: /var/run/dpdk/spdk_pid197254 00:30:18.926 Removing: /var/run/dpdk/spdk_pid198365 00:30:18.926 Removing: /var/run/dpdk/spdk_pid1985 00:30:18.926 Removing: /var/run/dpdk/spdk_pid199583 00:30:18.926 Removing: /var/run/dpdk/spdk_pid200798 00:30:18.926 Removing: /var/run/dpdk/spdk_pid202017 00:30:18.926 Removing: /var/run/dpdk/spdk_pid203235 00:30:18.926 Removing: /var/run/dpdk/spdk_pid204565 00:30:18.926 Removing: /var/run/dpdk/spdk_pid208460 00:30:18.926 Removing: /var/run/dpdk/spdk_pid208870 00:30:18.926 Removing: /var/run/dpdk/spdk_pid210518 00:30:18.926 Removing: /var/run/dpdk/spdk_pid211620 00:30:18.926 Removing: /var/run/dpdk/spdk_pid215437 00:30:18.926 Removing: /var/run/dpdk/spdk_pid217610 00:30:18.926 Removing: /var/run/dpdk/spdk_pid221227 00:30:18.926 Removing: /var/run/dpdk/spdk_pid224906 00:30:18.926 Removing: /var/run/dpdk/spdk_pid228535 00:30:18.926 Removing: /var/run/dpdk/spdk_pid228957 00:30:18.926 Removing: /var/run/dpdk/spdk_pid229500 00:30:18.926 Removing: /var/run/dpdk/spdk_pid229926 00:30:18.926 Removing: /var/run/dpdk/spdk_pid230524 00:30:18.926 Removing: /var/run/dpdk/spdk_pid231073 00:30:18.926 Removing: /var/run/dpdk/spdk_pid231625 00:30:18.926 Removing: /var/run/dpdk/spdk_pid232181 00:30:18.926 Removing: /var/run/dpdk/spdk_pid234739 00:30:18.926 Removing: /var/run/dpdk/spdk_pid234995 00:30:18.926 Removing: /var/run/dpdk/spdk_pid2375 00:30:18.926 Removing: /var/run/dpdk/spdk_pid238865 00:30:18.926 Removing: /var/run/dpdk/spdk_pid239046 00:30:18.926 Removing: /var/run/dpdk/spdk_pid240820 00:30:18.926 Removing: /var/run/dpdk/spdk_pid246616 00:30:18.926 Removing: /var/run/dpdk/spdk_pid246627 00:30:18.926 Removing: /var/run/dpdk/spdk_pid249696 00:30:18.926 Removing: /var/run/dpdk/spdk_pid251136 00:30:18.926 Removing: /var/run/dpdk/spdk_pid252577 00:30:18.926 Removing: /var/run/dpdk/spdk_pid253378 00:30:18.926 Removing: /var/run/dpdk/spdk_pid254786 00:30:18.926 Removing: /var/run/dpdk/spdk_pid255689 00:30:18.926 Removing: /var/run/dpdk/spdk_pid261207 00:30:18.926 Removing: /var/run/dpdk/spdk_pid2615 00:30:18.926 Removing: /var/run/dpdk/spdk_pid261609 00:30:18.926 Removing: /var/run/dpdk/spdk_pid262012 00:30:18.926 Removing: /var/run/dpdk/spdk_pid263491 00:30:18.926 Removing: /var/run/dpdk/spdk_pid263906 00:30:18.926 Removing: /var/run/dpdk/spdk_pid264316 00:30:18.926 Removing: /var/run/dpdk/spdk_pid2768 00:30:18.926 Removing: /var/run/dpdk/spdk_pid2828 00:30:18.926 Removing: /var/run/dpdk/spdk_pid3012 00:30:18.926 Removing: /var/run/dpdk/spdk_pid3257 00:30:18.926 Removing: /var/run/dpdk/spdk_pid3397 00:30:18.926 Removing: /var/run/dpdk/spdk_pid3569 00:30:18.926 Removing: /var/run/dpdk/spdk_pid3825 00:30:18.926 Removing: /var/run/dpdk/spdk_pid3984 00:30:18.926 Removing: /var/run/dpdk/spdk_pid4126 00:30:18.926 Removing: /var/run/dpdk/spdk_pid4183067 00:30:18.926 Removing: /var/run/dpdk/spdk_pid4183892 00:30:18.926 Removing: /var/run/dpdk/spdk_pid4185032 00:30:18.926 Removing: /var/run/dpdk/spdk_pid4185901 00:30:18.926 Removing: /var/run/dpdk/spdk_pid4187244 00:30:18.926 Removing: /var/run/dpdk/spdk_pid4188194 00:30:18.926 Removing: /var/run/dpdk/spdk_pid4188520 00:30:18.926 Removing: /var/run/dpdk/spdk_pid4188853 00:30:18.926 Removing: /var/run/dpdk/spdk_pid4189080 00:30:18.926 Removing: /var/run/dpdk/spdk_pid4189404 00:30:18.926 Removing: /var/run/dpdk/spdk_pid4189566 00:30:18.926 Removing: /var/run/dpdk/spdk_pid4189747 00:30:18.926 Removing: /var/run/dpdk/spdk_pid4190044 00:30:18.926 Removing: /var/run/dpdk/spdk_pid4190371 00:30:18.926 Removing: /var/run/dpdk/spdk_pid4192925 00:30:18.926 Removing: /var/run/dpdk/spdk_pid4193225 00:30:18.926 Removing: /var/run/dpdk/spdk_pid4193518 00:30:18.926 Removing: /var/run/dpdk/spdk_pid4193658 00:30:18.926 Removing: /var/run/dpdk/spdk_pid4193974 00:30:18.926 Removing: /var/run/dpdk/spdk_pid4194112 00:30:18.926 Removing: /var/run/dpdk/spdk_pid4413 00:30:18.926 Removing: /var/run/dpdk/spdk_pid4554 00:30:18.926 Removing: /var/run/dpdk/spdk_pid4717 00:30:18.926 Removing: /var/run/dpdk/spdk_pid4978 00:30:18.926 Removing: /var/run/dpdk/spdk_pid5145 00:30:18.926 Removing: /var/run/dpdk/spdk_pid5285 00:30:18.926 Removing: /var/run/dpdk/spdk_pid5563 00:30:18.926 Removing: /var/run/dpdk/spdk_pid5712 00:30:18.926 Removing: /var/run/dpdk/spdk_pid5872 00:30:18.926 Removing: /var/run/dpdk/spdk_pid597 00:30:18.926 Removing: /var/run/dpdk/spdk_pid6067 00:30:18.926 Removing: /var/run/dpdk/spdk_pid6293 00:30:18.926 Removing: /var/run/dpdk/spdk_pid6440 00:30:18.926 Removing: /var/run/dpdk/spdk_pid6607 00:30:18.926 Removing: /var/run/dpdk/spdk_pid6874 00:30:18.926 Removing: /var/run/dpdk/spdk_pid7032 00:30:18.926 Removing: /var/run/dpdk/spdk_pid70517 00:30:18.926 Removing: /var/run/dpdk/spdk_pid7178 00:30:18.926 Removing: /var/run/dpdk/spdk_pid73295 00:30:18.926 Removing: /var/run/dpdk/spdk_pid7452 00:30:18.926 Removing: /var/run/dpdk/spdk_pid7606 00:30:18.926 Removing: /var/run/dpdk/spdk_pid7767 00:30:18.926 Removing: /var/run/dpdk/spdk_pid793 00:30:18.926 Removing: /var/run/dpdk/spdk_pid8032 00:30:18.926 Removing: /var/run/dpdk/spdk_pid81060 00:30:18.926 Removing: /var/run/dpdk/spdk_pid8194 00:30:18.926 Removing: /var/run/dpdk/spdk_pid8341 00:30:18.926 Removing: /var/run/dpdk/spdk_pid84435 00:30:18.926 Removing: /var/run/dpdk/spdk_pid8613 00:30:18.926 Removing: /var/run/dpdk/spdk_pid86893 00:30:18.926 Removing: /var/run/dpdk/spdk_pid87333 00:30:18.926 Removing: /var/run/dpdk/spdk_pid8763 00:30:18.926 Removing: /var/run/dpdk/spdk_pid8922 00:30:18.926 Removing: /var/run/dpdk/spdk_pid9157 00:30:18.926 Removing: /var/run/dpdk/spdk_pid92432 00:30:18.926 Removing: /var/run/dpdk/spdk_pid92720 00:30:18.926 Removing: /var/run/dpdk/spdk_pid9348 00:30:18.926 Removing: /var/run/dpdk/spdk_pid9504 00:30:18.926 Removing: /var/run/dpdk/spdk_pid95410 00:30:18.926 Removing: /var/run/dpdk/spdk_pid975 00:30:18.926 Removing: /var/run/dpdk/spdk_pid9754 00:30:18.926 Removing: /var/run/dpdk/spdk_pid9926 00:30:18.926 Removing: /var/run/dpdk/spdk_pid99303 00:30:18.926 Clean 00:30:19.185 killing process with pid 4155251 00:30:27.316 killing process with pid 4155248 00:30:27.316 killing process with pid 4155250 00:30:27.316 killing process with pid 4155249 00:30:27.316 02:35:30 -- common/autotest_common.sh@1446 -- # return 0 00:30:27.316 02:35:30 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:30:27.316 02:35:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:27.316 02:35:30 -- common/autotest_common.sh@10 -- # set +x 00:30:27.316 02:35:30 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:30:27.316 02:35:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:27.316 02:35:30 -- common/autotest_common.sh@10 -- # set +x 00:30:27.316 02:35:30 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:27.316 02:35:30 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:30:27.316 02:35:30 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:30:27.316 02:35:30 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:30:27.316 02:35:30 -- spdk/autotest.sh@383 -- # hostname 00:30:27.316 02:35:30 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:30:27.316 geninfo: WARNING: invalid characters removed from testname! 00:30:53.845 02:35:56 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:57.127 02:36:00 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:59.654 02:36:03 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:02.936 02:36:05 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:05.467 02:36:08 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:07.998 02:36:11 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:10.530 02:36:13 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:31:10.530 02:36:13 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:31:10.530 02:36:13 -- common/autotest_common.sh@1690 -- $ lcov --version 00:31:10.530 02:36:13 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:31:10.530 02:36:13 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:31:10.530 02:36:13 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:31:10.530 02:36:13 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:31:10.530 02:36:13 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:31:10.530 02:36:13 -- scripts/common.sh@335 -- $ IFS=.-: 00:31:10.530 02:36:13 -- scripts/common.sh@335 -- $ read -ra ver1 00:31:10.530 02:36:13 -- scripts/common.sh@336 -- $ IFS=.-: 00:31:10.530 02:36:13 -- scripts/common.sh@336 -- $ read -ra ver2 00:31:10.530 02:36:13 -- scripts/common.sh@337 -- $ local 'op=<' 00:31:10.530 02:36:13 -- scripts/common.sh@339 -- $ ver1_l=2 00:31:10.530 02:36:13 -- scripts/common.sh@340 -- $ ver2_l=1 00:31:10.530 02:36:13 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:31:10.530 02:36:13 -- scripts/common.sh@343 -- $ case "$op" in 00:31:10.530 02:36:13 -- scripts/common.sh@344 -- $ : 1 00:31:10.530 02:36:13 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:31:10.530 02:36:13 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:10.530 02:36:13 -- scripts/common.sh@364 -- $ decimal 1 00:31:10.530 02:36:13 -- scripts/common.sh@352 -- $ local d=1 00:31:10.530 02:36:13 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:31:10.530 02:36:13 -- scripts/common.sh@354 -- $ echo 1 00:31:10.530 02:36:13 -- scripts/common.sh@364 -- $ ver1[v]=1 00:31:10.530 02:36:13 -- scripts/common.sh@365 -- $ decimal 2 00:31:10.530 02:36:13 -- scripts/common.sh@352 -- $ local d=2 00:31:10.530 02:36:13 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:31:10.530 02:36:13 -- scripts/common.sh@354 -- $ echo 2 00:31:10.530 02:36:13 -- scripts/common.sh@365 -- $ ver2[v]=2 00:31:10.530 02:36:13 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:31:10.530 02:36:13 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:31:10.530 02:36:13 -- scripts/common.sh@367 -- $ return 0 00:31:10.530 02:36:13 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:10.530 02:36:13 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:31:10.530 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:10.530 --rc genhtml_branch_coverage=1 00:31:10.530 --rc genhtml_function_coverage=1 00:31:10.530 --rc genhtml_legend=1 00:31:10.530 --rc geninfo_all_blocks=1 00:31:10.530 --rc geninfo_unexecuted_blocks=1 00:31:10.530 00:31:10.530 ' 00:31:10.530 02:36:13 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:31:10.530 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:10.530 --rc genhtml_branch_coverage=1 00:31:10.530 --rc genhtml_function_coverage=1 00:31:10.530 --rc genhtml_legend=1 00:31:10.530 --rc geninfo_all_blocks=1 00:31:10.530 --rc geninfo_unexecuted_blocks=1 00:31:10.530 00:31:10.530 ' 00:31:10.530 02:36:13 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:31:10.530 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:10.530 --rc genhtml_branch_coverage=1 00:31:10.530 --rc genhtml_function_coverage=1 00:31:10.530 --rc genhtml_legend=1 00:31:10.530 --rc geninfo_all_blocks=1 00:31:10.530 --rc geninfo_unexecuted_blocks=1 00:31:10.530 00:31:10.530 ' 00:31:10.530 02:36:13 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:31:10.530 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:10.530 --rc genhtml_branch_coverage=1 00:31:10.530 --rc genhtml_function_coverage=1 00:31:10.530 --rc genhtml_legend=1 00:31:10.530 --rc geninfo_all_blocks=1 00:31:10.530 --rc geninfo_unexecuted_blocks=1 00:31:10.530 00:31:10.530 ' 00:31:10.530 02:36:13 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:10.530 02:36:13 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:31:10.530 02:36:13 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:10.530 02:36:13 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:10.530 02:36:13 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:10.530 02:36:13 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:10.530 02:36:13 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:10.530 02:36:13 -- paths/export.sh@5 -- $ export PATH 00:31:10.530 02:36:13 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:10.530 02:36:13 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:31:10.530 02:36:13 -- common/autobuild_common.sh@440 -- $ date +%s 00:31:10.530 02:36:13 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732844173.XXXXXX 00:31:10.530 02:36:13 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732844173.wkkbI6 00:31:10.530 02:36:13 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:31:10.530 02:36:13 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:31:10.530 02:36:13 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:31:10.530 02:36:13 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:31:10.530 02:36:13 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:31:10.530 02:36:13 -- common/autobuild_common.sh@456 -- $ get_config_params 00:31:10.530 02:36:13 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:31:10.530 02:36:13 -- common/autotest_common.sh@10 -- $ set +x 00:31:10.530 02:36:14 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:31:10.530 02:36:14 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:31:10.530 02:36:14 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:10.530 02:36:14 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:31:10.530 02:36:14 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:31:10.530 02:36:14 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:31:10.530 02:36:14 -- spdk/autopackage.sh@19 -- $ timing_finish 00:31:10.530 02:36:14 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:31:10.530 02:36:14 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:31:10.530 02:36:14 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:31:10.530 02:36:14 -- spdk/autopackage.sh@20 -- $ exit 0 00:31:10.530 + [[ -n 4112935 ]] 00:31:10.530 + sudo kill 4112935 00:31:10.542 [Pipeline] } 00:31:10.558 [Pipeline] // stage 00:31:10.563 [Pipeline] } 00:31:10.586 [Pipeline] // timeout 00:31:10.591 [Pipeline] } 00:31:10.605 [Pipeline] // catchError 00:31:10.610 [Pipeline] } 00:31:10.625 [Pipeline] // wrap 00:31:10.631 [Pipeline] } 00:31:10.644 [Pipeline] // catchError 00:31:10.653 [Pipeline] stage 00:31:10.655 [Pipeline] { (Epilogue) 00:31:10.668 [Pipeline] catchError 00:31:10.670 [Pipeline] { 00:31:10.682 [Pipeline] echo 00:31:10.684 Cleanup processes 00:31:10.690 [Pipeline] sh 00:31:11.044 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:11.044 276906 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:11.102 [Pipeline] sh 00:31:11.389 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:11.389 ++ grep -v 'sudo pgrep' 00:31:11.389 ++ awk '{print $1}' 00:31:11.389 + sudo kill -9 00:31:11.389 + true 00:31:11.403 [Pipeline] sh 00:31:11.688 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:31:21.693 [Pipeline] sh 00:31:21.991 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:31:21.991 Artifacts sizes are good 00:31:22.005 [Pipeline] archiveArtifacts 00:31:22.012 Archiving artifacts 00:31:22.178 [Pipeline] sh 00:31:22.461 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:31:22.477 [Pipeline] cleanWs 00:31:22.487 [WS-CLEANUP] Deleting project workspace... 00:31:22.487 [WS-CLEANUP] Deferred wipeout is used... 00:31:22.494 [WS-CLEANUP] done 00:31:22.496 [Pipeline] } 00:31:22.514 [Pipeline] // catchError 00:31:22.526 [Pipeline] sh 00:31:22.838 + logger -p user.info -t JENKINS-CI 00:31:22.847 [Pipeline] } 00:31:22.860 [Pipeline] // stage 00:31:22.865 [Pipeline] } 00:31:22.879 [Pipeline] // node 00:31:22.885 [Pipeline] End of Pipeline 00:31:22.917 Finished: SUCCESS